Remote job
Go - Senior Backend Engineer, AI Coding Agent Quality
Job details
About this role
Role overview A contracted evaluator position focused on the quality of interactions generated by modern AI coding agents, with particular emphasis on backend scenarios written in Go. The role is not a traditional engineering job; instead of writing production code, the evaluator judges whether an AI behaves the way a senior Go backend engineer would think, reason, and communicate. It suits experienced engineers who want to shape the bar for AI-assisted development through part-time, async-friendly work.
Responsibilities - Assess AI coding interactions end-to-end, weighing usefulness, high-level correctness, and alignment with senior engineering judgment in Go contexts. - Evaluate the quality of explanations, preambles, and reasoning rather than just the code surface. - Calibrate scoring by articulating the differences between mediocre and excellent responses. - Deliver direct, opinionated feedback covering what succeeded, what missed, and what felt misleading to an experienced developer. - Help codify what exemplary interaction looks like inside AI-first IDEs and coding workflows.
Requirements - Senior- or staff-level engineering background with substantial, current experience in Go backend development. - Hands-on familiarity with modern AI coding tools such as OpenAI Codex, Claude Code, and Cursor-class editors. - Confidence evaluating code and conversational quality without needing to fully execute or line-by-line review everything. - Willingness to make rigorous subjective calls about engineering taste and communication. - High personal standard for what good backend engineering looks like in practice.
Nice to have - Prior work with prompt design, evaluation pipelines, or human annotation workflows. - Experience mentoring senior engineers or defining engineering quality bars across a team.
Benefits and work setup - Contract role running through early May, with the possibility of extension. - Roughly 10 to 20 hours per week, remote and flexible. - Hourly rate between $100 and $200, starting ASAP. - Process includes a take-home evaluation exercise and one behavioral interview.