Technical Program Manager, AI Evaluation Specialist

Who you are

You have a strong background in managing technical programs, particularly in the realm of AI and machine learning. Your experience includes overseeing evaluation processes and ensuring that AI systems meet high standards of accuracy and reliability. You are skilled in collaborating with cross-functional teams, including data scientists and model owners, to drive improvements in AI systems. You understand the importance of maintaining quality and trust in AI operations, and you are adept at identifying gaps and opportunities for enhancement. You are detail-oriented and possess excellent analytical skills, allowing you to conduct thorough evaluations and investigations into AI performance. You are committed to fostering a culture of continuous improvement and are passionate about leveraging AI to enhance operational efficiency.

Desirable

Experience in speech analytics or similar fields would be a plus. Familiarity with human-in-the-loop processes and metrics tracking is also desirable. You are comfortable working in a remote environment and have strong communication skills to effectively convey insights and recommendations to various stakeholders.

What you'll do

In this role, you will own the human-in-the-loop evaluation process for all AI models supporting Chime's operations. You will run recurring sampling and reviews to assess the accuracy and consistency of AI outputs, identifying any failure modes and areas for improvement. Your responsibilities will include scoring, tagging, and documenting cases where AI systems misclassify or generate incomplete outputs. You will maintain structured rubrics and guidelines to ensure reviewer alignment and scoring consistency. Additionally, you will conduct deeper investigations into error patterns and root causes, translating insights into actionable recommendations for model owners and partner teams. Tracking and reporting key evaluation metrics such as accuracy, recall, coverage, and error rates will be a critical part of your role, ensuring that AI systems operate safely and consistently in production.

What we offer

Chime offers a competitive salary starting at $103,680 and going up to $144,000, depending on your experience and qualifications. Full-time employees are also eligible for a bonus and a competitive equity package, along with comprehensive benefits. You will be part of a dynamic team that values innovation and collaboration, working in a supportive remote environment. Chime is committed to fostering a culture of trust and quality in its AI operations, and you will play a key role in shaping the future of AI at the company.