Senior Software Engineer, AI Training - NZ

Role overview Assess how AI coding assistants handle realistic software engineering tasks. The work focuses on whether their answers show sound judgment, communicate useful reasoning, and guide a developer effectively; it does not involve building production software. Engagements are remote contract projects, with location eligibility varying.

Responsibilities - Review AI-assisted coding interactions from start to finish and judge their overall usefulness and technical direction. - Evaluate explanations and reasoning alongside the proposed code, including whether the guidance is clear and credible to an experienced developer. - Apply consistent quality ratings and explain the difference between stronger and weaker responses. - Write direct, specific feedback about what worked, what was confusing, and what could mislead a user. - Help shape quality standards for interactions with modern coding agents. - Record short video walkthroughs to explain evaluation decisions.

Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong experience in TypeScript/JavaScript or Python. - Hands-on familiarity with at least one AI coding assistant and a solid understanding of AI-supported development workflows. - Ability to assess code and engineering decisions efficiently without running every example or inspecting every line. - Strong spoken and written English (B2 or above) for detailed written feedback and recorded explanations. - Confidence making rigorous, clearly reasoned judgments about engineering quality.

Nice to have - Experience with prompt design or model evaluation. - Experience mentoring senior engineers or setting engineering standards.

Benefits and work setup - Flexible workload of about 10–20 hours per week, with rates of $100–$200 per hour depending on experience and location. - Ongoing opportunities may follow successful projects, which typically last from around two weeks to several months. - Selection involves a take-home evaluation and recorded walkthrough; the listing describes no interview.