Remote job
Senior Software Engineer, (OpenAI Codex, Claude Code or Cursor)
Job details
About this role
Role overview Assess how well AI coding assistants respond to realistic engineering scenarios, with particular attention to engineering judgment, explanation quality, and the overall developer experience. This is an evaluation role rather than a production software development position.
Responsibilities - Evaluate AI-generated coding sessions end to end for usefulness and high-level correctness. - Assess whether the assistant’s explanations and reasoning would help an experienced developer make progress. - Apply consistent distinctions between different levels of response quality. - Provide specific written feedback on sound decisions, gaps, misleading claims, and awkward interactions. - Contribute to defining what good assistance looks like across modern coding tools.
Requirements - Senior, staff, principal, or equivalent experience as a software engineer. - Strong background in TypeScript/JavaScript or Python. - Practical experience with at least one of Codex, Claude Code, or Cursor, plus familiarity with AI-assisted development workflows. - Ability to judge code and engineering choices without needing to execute every suggestion or inspect every line. - Strong English (B2 or higher) for detailed written assessments and short recorded explanations. - A high engineering bar and the ability to communicate candid, well-supported opinions.
Nice to have - Exposure to prompt design or evaluation processes. - Experience coaching senior engineers or establishing engineering standards.
Benefits and work setup - Remote contract open worldwide, with flexible availability of approximately 10–20 hours per week. - Hourly pay ranges from $100 to $200 depending on experience and location. - Work is ongoing, with individual projects lasting around two weeks to a few months and potential follow-on assignments for strong evaluators. - The stated selection process is one take-home exercise with a recorded walkthrough and no interview.