AI Benchmarking Spec. - Spanish, SFIX

Who you are

You are an entry-level professional with a foundational understanding of Artificial Intelligence (AI) and Large Language Models (LLMs). You have experience or coursework related to AI auditing and quality assurance, and you are eager to learn and grow in a fast-paced environment. You possess strong analytical skills and attention to detail, which will help you in validating data and preparing audit reports. You are comfortable working with datasets and have a keen interest in ensuring compliance and robustness in AI systems. You are a team player who communicates effectively with stakeholders and enjoys collaborating with others to achieve common goals. You are motivated by the opportunity to shape the future of selling on Amazon for sellers worldwide.

What you'll do

In this role, you will assist in planning and executing benchmarking exercises for AI models, which includes defining test plans, metrics, and acceptance criteria across various dimensions such as accuracy, robustness, bias, and reliability. You will support content accuracy and relevancy checks by reviewing datasets, model outputs, and data handling practices, ensuring that potential regulatory risks are escalated appropriately. You will validate data based on specific annotation guidelines, ensuring the accuracy and quality of the collected information. Additionally, you will prepare clear audit and benchmarking reports that include error ratings, root-cause analysis, and actionable recommendations. Your contributions will play a crucial role in enhancing the seller experience on Amazon by ensuring that AI tools are effective and reliable.

What we offer

At Amazon, you will be part of a dynamic team that is dedicated to innovation and excellence in AI. We provide a supportive work environment where you can develop your skills and advance your career. You will have access to training and development opportunities that will help you grow in your role. We value diversity and inclusion and encourage you to apply even if your experience doesn't match every requirement. Join us in shaping the future of selling on Amazon and making a positive impact on our sellers worldwide.