Remote job
Senior Software Engineer - JavaScript/TypeScript
Job details
About this role
Role overview A contracted evaluation role focused on judging the quality of interactions produced by modern AI coding agents rather than shipping production software. The work centers on assessing whether generated responses reflect the reasoning and instincts of a strong JavaScript or TypeScript engineer across realistic development scenarios. This is a part-time, asynchronous engagement suited to senior engineers who enjoy critiquing craft and shaping standards for AI-assisted tooling.
Responsibilities - Review full AI coding interactions end-to-end, weighing usefulness, high-level correctness, and overall alignment with senior-level engineering judgment. - Judge the quality of explanations, preambles, and reasoning rather than fixating on line-by-line syntax. - Calibrate ratings by distinguishing what separates a mediocre response from a strong one, and articulating those differences. - Deliver clear, opinionated written feedback covering what worked, what fell short, and where responses felt off or misleading. - Contribute to defining what an excellent interaction looks like inside AI-first IDEs and editor workflows.
Requirements - Senior-level engineering background with deep, current expertise in JavaScript and TypeScript. - Hands-on familiarity with contemporary AI coding tools such as OpenAI Codex, Claude Code, and Cursor-class editors. - Ability to evaluate code and conversation quality without executing or auditing every line in detail. - Comfort making rigorous, subjective judgments about engineering taste and communication style. - Track record of holding a high bar for what strong engineering output looks like in practice.
Nice to have - Prior exposure to prompt design, evaluation rubrics, or annotation workflows. - Experience mentoring senior engineers or establishing engineering standards within a team.
Benefits and work setup - Contract engagement running through early May, with possible extension. - Approximately 10 to 20 hours per week, fully remote and async-friendly. - Hourly compensation between $100 and $200, with an ASAP start date. - Hiring process consists of a take-home evaluation exercise followed by a single behavioral interview.