Remote job
Remote Senior Software Engineer, (OpenAI Codex, Claude Code or Cursor)
Job details
About this role
Role overview Assess the quality of AI coding assistant interactions in realistic software development situations. This senior-level contract focuses on engineering judgment, useful explanations, and how well the assistant supports a developer; it does not involve writing production code. Your evaluations and feedback will help define what high-quality AI-assisted development looks like.
Responsibilities - Evaluate AI-generated coding interactions from start to finish. - Judge whether responses are useful, broadly correct, and consistent with strong engineering practice. - Review explanations and reasoning, including whether the assistant guides the user effectively and earns trust. - Distinguish levels of response quality and explain the basis for your ratings. - Provide clear written feedback on strengths, weaknesses, and potentially misleading aspects. - Contribute to quality standards for AI coding workflows.
Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong TypeScript/JavaScript or Python background. - Practical experience with at least one AI coding assistant and familiarity with modern AI-assisted development. - Ability to assess code and engineering decisions without executing code or reviewing every line. - B2-level English or higher for detailed written feedback and brief recorded explanations. - Confidence making rigorous, candid judgments and articulating a high bar for engineering quality.
Nice to have - Experience with prompt design or evaluation workflows. - Experience mentoring senior engineers or defining engineering standards.
Benefits and work setup - Remote contract engagement, subject to location eligibility. - Flexible workload of 10–20 hours weekly. Individual projects run roughly two weeks to a few months, and additional work may be offered to strong evaluators. - Compensation is $100–$200 per hour, depending on experience and location. - The process includes a take-home evaluation and recorded walkthrough, with no interview specified; start timing depends on passing and project availability.