Sr. SWE for Code Reviewing LLM Data Training (Bash/PowerShell)

Who you are

You have 5–7+ years of experience in shell scripting, system administration, or DevOps with deep expertise in Bash and PowerShell. Your strong knowledge of Bash/PowerShell syntax, command-line utilities, debugging, edge cases, and testing makes you an ideal candidate for this role. You are comfortable using code execution environments and debugging tools, and you have experience working in both Unix/Linux and Windows environments. Your excellent written communication skills enable you to provide constructive feedback effectively.

Desirable

Experience with AI training or data annotation processes would be a plus, as well as familiarity with proof-of-work methodologies. You are detail-oriented and have a strong commitment to maintaining high annotation standards, ensuring that all evaluations meet strict quality guidelines.

What you'll do

In this role, you will review and audit annotator evaluations of AI-generated Bash/PowerShell scripts. Your primary responsibility will be to assess whether the code follows the prompt instructions, is functionally correct, and secure. You will validate code snippets using proof-of-work methodology and identify inaccuracies in annotator ratings or explanations. Providing constructive feedback will be crucial to maintaining high annotation standards and ensuring that all evaluations align with Project Atlas guidelines for evaluation integrity and consistency.

You will collaborate with a team of data annotators and AI experts, ensuring that the evaluations are accurate and meet the required quality standards. Your role will involve continuous learning and adaptation to new guidelines and methodologies as the project evolves. You will also have the opportunity to contribute to the development of best practices for code reviewing in AI training contexts.

What we offer

G2i Inc. offers flexible, remote AI training opportunities, ensuring that all contributions are paid weekly once approved. Compensation is personalized based on your experience level, educational background, location, and industry expertise. You'll see your specific rate in your contract offer before signing, and rates for technical roles can vary significantly based on these factors and can be re-evaluated for different projects based on your performance and experience. We encourage you to apply even if your experience doesn't match every requirement, as we value diverse backgrounds and perspectives.