Amazon is seeking a Program Manager to manage a new team of AI evaluators. This role will bring structure, speed, and scale to our efforts to deliver a seamless and delightful AI-assisted shopping experience to customers worldwide.
We are looking for candidates who are passionate about the intersection of language and technology and are keen to support the training of Large Language Models. This role will be responsible for overseeing a program that delivers high-judgment evaluations and labeling data to Product and Science teams, in order to improve the fluency of our Shopping AI model. This Program Manager must be exceptionally detail-oriented, comfortable with tight deadlines, and have a track record of exhibiting high judgment in ambiguous environments.
This role requires strong written and oral communication skills, exceptional interpersonal skills, deep curiosity about how things work, and a passion for developing high-performing teams. You must enjoy context-switching and multi-tasking while partnering at all levels of the organization. This is an opportunity to gain valuable experience in the growing field of artificial intelligence and its application in diverse business settings.
Key job responsibilities
* Develop and oversee a team of evaluators, continually upskilling the team.
* Foster an engaging, motivating, and collaborative work environment for a distributed team.
* Initiate and facilitate major project kick-offs and support hand-off from product and science teams to editorial teams.
* Manage multiple projects and programs concurrently, identifying efficiencies, prioritizing, and pushing back when necessary.
* Establish processes, tracking, and reporting mechanisms to streamline and simplify delivery of high-priority LLM training data.
* Analyze root causes, identify error patterns, and propose solutions to enhance the quality of labeling tasks and their outputs.
* Produce clear, compelling, and well-structured written communications, such as email updates, program reviews, and other artifacts.
* Hold a high bar for editorial quality, including guidance on tone, style, and grammar across varied workflows.
A day in the life
You will oversee a team of AI tutors responsible for evaluating and annotating data for use in training Amazon’s Shopping LLM. You will partner closely with Product, Science, and Engineering teams, who are invested in creating solutions that make it easier, faster, and more intuitive for our non-coding workforce to iterate and improve Rufus for customers. You will be part of an Editorial team, which includes creative product and program managers, writers, editors, and language engineers. This is a startup culture: We move fast, have ambitious goals, adapt quickly, and learn along the way.
About the team
This is an opportunity to join the high-performing team behind Amazon’s generative AI-powered shopping assistant. Rufus makes it easy for customers to find and discover the best products to meet their unique needs by helping with product research, providing comparisons and recommendations, answering specific product questions, and more. - 5+ years of working cross functionally with tech and non-tech teams experience
- 5+ years of team management experience
- 5+ years of cross functional project delivery experience
- 5+ years of program or project management experience
- Experience defining program requirements and using data and metrics to determine improvements- Experience managing, analyzing and communicating results to senior leadership
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit
https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $114,500/year in our lowest geographic market up to $189,300/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit
https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
