Remote Python Senior Software Engineer, AI Training

Role overview Evaluate how AI coding assistants handle realistic software engineering scenarios. The work focuses on engineering judgment, explanations, and the quality of the overall interaction rather than writing production code or checking syntax alone. You will provide rigorous assessments that help establish standards for strong AI-assisted development.

Responsibilities - Review AI-generated coding interactions from beginning to end. - Assess whether responses are useful, sound at a high level, and reflect how an experienced engineer would approach the problem. - Evaluate explanations and reasoning as well as code, including whether the assistant guides the user clearly and builds trust. - Apply consistent quality distinctions and explain what separates weaker responses from stronger ones. - Write direct, detailed feedback about what worked, what was misleading, and what felt off. - Help define quality expectations for AI coding workflows.

Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong background in TypeScript/JavaScript or Python. - Hands-on experience with at least one AI coding assistant and deep familiarity with AI-assisted development workflows. - Ability to evaluate code and engineering decisions without running the code or inspecting every line. - English proficiency at B2 level or above, for detailed written feedback and short recorded explanations. - Comfort making and clearly explaining candid, subjective judgments, with a high standard for engineering quality.

Nice to have - Exposure to prompt design or evaluation processes. - Experience mentoring senior engineers or setting engineering standards.

Benefits and work setup - Remote contract work, with location eligibility varying by project. - Flexible commitment of 10–20 hours per week; projects typically last from about two weeks to a few months, with further assignments possible based on performance. - Rate of $100–$200 per hour, depending on experience and location. - Selection involves a take-home evaluation with a recorded walkthrough; no interview is specified. Starting depends on passing the exercise and an open project seat.