Senior Software Engineer, AI Training

Role overview Help assess the quality of AI coding assistant behavior in practical software engineering situations. The work centers on whether the assistant reasons and communicates in ways that experienced developers find useful and trustworthy, rather than on building or shipping production code.

Responsibilities - Review complete AI-assisted coding interactions and assess their overall effectiveness. - Evaluate whether outputs are useful, sensible, and correct at a high level. - Examine explanations and reasoning alongside code suggestions. - Calibrate quality ratings by identifying meaningful differences between response levels. - Document clear, direct feedback about helpful choices, shortcomings, and misleading or unnatural guidance. - Help establish expectations for strong AI-assisted engineering interactions.

Requirements - Senior, staff, principal, or comparable software engineering background. - Strong proficiency in Python or TypeScript/JavaScript. - Hands-on familiarity with at least one coding agent, such as Codex, Claude Code, or Cursor, and modern AI-supported development practices. - Sound judgment when reviewing code without executing it or examining every line. - English proficiency of B2 or above, with strong writing and speaking skills for feedback and brief recorded explanations. - Comfort offering decisive, evidence-based opinions and a strong sense of engineering quality.

Nice to have - Prior work involving prompts or evaluation workflows. - Mentoring experience at senior levels or involvement in setting engineering practices.

Benefits and work setup - Worldwide remote contract with flexible hours, typically 10–20 per week. - Compensation is $100–$200 per hour, based on experience and location. - Ongoing opportunities are organized into projects of about two weeks to several months, with additional work possible for successful evaluators. - Entry requires a take-home assessment and recorded walkthrough; the listing specifies no interview.