Remote job
JavaScript of Senior Software Engineer, AI Training
Job details
About this role
Role overview Assess how well AI coding assistants handle realistic software engineering interactions. This is an evaluation and feedback role rather than production development: the focus is on whether responses show sound engineering judgment, explain decisions clearly, and guide developers in a useful and trustworthy way.
Responsibilities - Review AI-generated coding interactions from start to finish and judge their practical usefulness and high-level correctness. - Evaluate explanations and reasoning as well as code, including whether the assistant guides the user effectively. - Apply consistent quality distinctions across responses and explain what separates stronger work from weaker work. - Write direct, detailed feedback about what succeeded, failed, or could mislead an experienced developer. - Help establish quality standards for interactions with modern AI coding tools.
Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong background in TypeScript, JavaScript, or Python. - Hands-on experience with at least one modern coding assistant, such as Codex, Claude Code, or Cursor, and familiarity with AI-assisted development workflows. - Ability to assess code without running it or reviewing every line, using sound engineering judgment. - Strong written and spoken English (B2 or above); the work includes detailed written feedback and short recorded explanations. - Comfort making and clearly supporting subjective but rigorous assessments.
Nice to have - Exposure to prompt design or evaluation work, or experience mentoring senior engineers and setting engineering standards.
Benefits and work setup - Worldwide remote contract, with flexible hours of approximately 10–20 per week. - Listed rate is $100–$200 per hour, depending on experience and location. Engagements may continue on an ongoing basis, with individual projects typically lasting a few weeks to a few months. - Selection involves a take-home evaluation and recorded walkthrough; no interview is listed.