Python Senior Software Engineer, AI Training

Role overview Evaluate whether AI coding assistants handle realistic software engineering tasks with sound judgment. This contract role focuses on the usefulness and quality of their explanations and interactions; it does not involve writing production code.

Responsibilities - Review AI-generated coding interactions from start to finish, assessing whether responses are useful and broadly correct. - Judge the quality of explanations and reasoning, not just the apparent correctness of code. - Distinguish stronger responses from weaker ones using consistent quality judgments. - Write clear, direct feedback about what worked, what was misleading, or what felt unlike an experienced engineer’s approach. - Help define standards for high-quality interactions with coding assistants.

Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong experience with TypeScript/JavaScript or Python. - Hands-on use of at least one modern coding assistant, such as Codex, Claude Code, or Cursor, and familiarity with AI-assisted development workflows. - Ability to assess code at a high level without running it or reviewing every line. - Strong spoken and written English (B2 or above), including the ability to provide detailed written feedback and record short video explanations. - Confidence making and explaining rigorous, opinionated judgments about engineering quality.

Nice to have - Experience with prompt design or model evaluation. - Experience mentoring senior engineers or setting engineering standards.

Benefits and work setup - Worldwide remote contract, with flexible hours of about 10–20 per week. - Rate of $100–$200 per hour, depending on experience and location. - Ongoing work across projects that typically last from roughly two weeks to several months; further projects may be offered based on evaluation performance. - Selection involves a take-home evaluation with a recorded walkthrough; no interview is specified.