AI Benchmarking Specialist, SP Support - French, International Seller Growth

Who you are

You have a strong background in AI and Large Language Models, with experience in benchmarking and auditing AI systems. Your analytical skills allow you to design and execute effective benchmarking exercises, ensuring model quality and compliance. You are detail-oriented and capable of preparing clear audit reports that include error ratings and recommendations. You possess excellent communication skills, enabling you to effectively convey findings to stakeholders. You are proactive in identifying potential regulatory risks and ensuring data handling practices meet privacy standards. You thrive in collaborative environments and are eager to contribute to the success of the Seller AI team.

What you'll do

In this role, you will assist in planning and executing benchmarking exercises for AI models, defining test plans, metrics, and acceptance criteria across various dimensions such as accuracy, robustness, bias, and reliability. You will support content accuracy and relevancy checks by reviewing datasets and model outputs, ensuring that the information collected is of high quality. Your responsibilities will include validating data based on specific annotation guidelines and preparing comprehensive audit and benchmarking reports. You will also contribute to presentations that summarize your findings and recommendations, playing a pivotal role in shaping the future of selling on Amazon for sellers worldwide.

What we offer

At Amazon, you will be part of a dynamic team focused on leveraging AI to enhance seller experiences. We offer competitive compensation and opportunities for professional growth within a leading technology company. You will have access to resources and tools that empower you to excel in your role and make a meaningful impact on the business. Join us in our mission to provide sellers with the best tools and solutions to accelerate their growth on Amazon.