Senior Software Engineer, AI Training

Role overview Assess whether AI coding assistants handle realistic software development requests with the judgment and communication style expected of an experienced engineer. This contract focuses on reviewing complete interactions and explaining what makes an answer useful, trustworthy, and well reasoned; it does not involve writing production code.

Responsibilities - Review coding assistant interactions from the initial response through the proposed solution. - Judge high-level correctness, usefulness, and alignment with sound engineering practice. - Assess explanations and reasoning as well as the code, including whether the assistant guides the user clearly. - Apply consistent quality distinctions and explain why one response is stronger than another. - Write direct feedback on what worked, what was misleading, and what should improve. - Help establish standards for high-quality AI-assisted development interactions.

Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong background in TypeScript/JavaScript or Python. - Hands-on experience with at least one modern AI coding assistant and familiarity with AI-assisted development workflows. - Ability to assess code efficiently without running it or inspecting every line. - Strong spoken and written English at B2 level or above, including for detailed written feedback and short recorded explanations. - Confidence making rigorous, clearly explained judgments and giving candid feedback.

Nice to have - Experience with prompt design or evaluation processes. - Experience mentoring senior engineers or setting engineering standards.

Benefits and work setup - Remote contract work, with location eligibility varying by region. - Flexible commitment of 10–20 hours per week; projects typically last from about two weeks to several months, with further assignments possible based on performance. - Hourly rate of $100–$200, depending on experience and location. - Selection involves a take-home evaluation with a recorded walkthrough; no interview is specified.