TypeScript Senior Software Engineer, AI Training

Role overview Review AI coding agents’ responses to realistic development tasks, focusing on engineering judgment, explanations, and the quality of guidance a developer receives. The work is evaluative rather than focused on writing or shipping production code.

Responsibilities - Assess AI-generated coding interactions from beginning to end for usefulness and high-level correctness. - Judge whether the reasoning and explanations help a developer understand and act on the result. - Distinguish levels of response quality using consistent engineering standards. - Write candid, specific feedback on strengths, shortcomings, unclear reasoning, and potentially misleading output. - Help define what effective, trustworthy AI-assisted software development looks like.

Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong background in TypeScript/JavaScript or Python. - Hands-on experience with an AI coding assistant and deep familiarity with AI-supported development workflows. - Ability to assess code and engineering decisions without executing every suggestion or reviewing every line. - Strong spoken and written English (B2 or above) for detailed reviews and short recorded explanations. - Confidence in making rigorous, opinionated assessments and maintaining a high bar for engineering quality.

Nice to have - Prior experience with prompt design or evaluation workflows. - Experience mentoring senior engineers or establishing engineering standards.

Benefits and work setup - Worldwide remote contract with flexible commitment of about 10–20 hours per week. - Compensation is listed at $100–$200 per hour, varying with experience and location. - Engagement is ongoing, with projects typically lasting from about two weeks to a few months and possible additional projects for successful evaluators. - Entry requires a take-home evaluation and recorded walkthrough; project work begins when a seat is available.