Remote job
Senior Software Engineer, AI Training - LATAM
Job details
About this role
Role overview Assess the quality of interactions between experienced developers and AI coding agents. This contract role focuses on engineering judgment: whether an agent’s answers, explanations, and guidance would be useful and trustworthy to a skilled software engineer. The work centers on evaluation and written feedback rather than building production software.
Responsibilities - Review AI-assisted coding interactions from start to finish. - Judge whether responses are useful, broadly correct, and grounded in sound engineering practice. - Evaluate explanations and reasoning as well as code, including whether guidance helps developers make progress. - Apply consistent quality distinctions across responses and explain what separates stronger work from weaker work. - Write clear, direct feedback about what was effective, confusing, incomplete, or misleading. - Help establish quality expectations for interactions with coding agents.
Requirements - Senior-, staff-, or principal-level engineering experience, or equivalent expertise. - Strong background in TypeScript/JavaScript or Python. - Hands-on experience with at least one modern coding agent, such as Codex, Claude Code, or Cursor, and deep familiarity with AI-assisted development workflows. - Ability to assess code at a high level without executing it or reviewing every line. - Strong written and spoken English at B2 level or above, including the ability to write detailed feedback and record short video explanations. - Confidence making rigorous, subjective judgments and giving candid feedback, with a high standard for engineering quality.
Nice to have - Exposure to prompt design or model-evaluation workflows. - Experience mentoring senior engineers or defining engineering standards.
Benefits and work setup - Remote contract engagement, with eligibility depending on location. - Flexible workload of 10–20 hours per week; rate is listed as $100–$200 per hour depending on experience and location. - Ongoing engagement with individual projects typically lasting a few weeks to a few months; further projects may be offered based on performance. - Selection involves a take-home evaluation and recorded walkthrough; no interview is specified.