AI Benchmarking Specialist, SP Support - Spanish, International Seller Growth

Who you are

You have a strong background in Artificial Intelligence and Large Language Models, with experience in AI auditing and quality assurance. You are skilled in designing and executing benchmarking exercises, defining test plans, metrics, and acceptance criteria across various dimensions such as accuracy and robustness. You understand the importance of compliance and fairness in AI systems, and you are adept at reviewing datasets and model outputs to ensure content accuracy and relevancy. Your communication skills enable you to prepare clear audit and benchmarking reports, including error ratings and root-cause analysis, which you present to stakeholders effectively.

What you'll do

In this role, you will assist in planning and executing benchmarking exercises for AI models, ensuring that they meet the defined metrics and acceptance criteria. You will support content accuracy checks by reviewing datasets and model outputs, escalating any potential regulatory risks you identify. Your responsibilities will include validating data based on specific annotation guidelines to ensure the quality of the collected information. You will prepare detailed audit and benchmarking reports that include error ratings and recommendations, contributing to presentations that communicate your findings to the team and stakeholders. You will play a pivotal role in shaping the future of selling on Amazon by ensuring that AI tools and solutions are effective and reliable for sellers worldwide.

What we offer

At Amazon, you will be part of a dynamic team that is focused on leveraging AI to enhance seller experiences. We offer a collaborative work environment where your contributions will directly impact the success of our sellers. You will have opportunities for professional growth and development, working alongside experts in the field of AI and machine learning. We value diversity and encourage you to apply even if your experience doesn't match every requirement. Join us in shaping the future of e-commerce through innovative AI solutions.