Remote job
Java of Senior Software Engineer, AI Training
Job details
About this role
Role overview Assess how AI coding agents handle realistic software engineering tasks. This contract role focuses on the quality of their decisions, explanations, and guidance from an experienced engineer’s perspective; it does not involve building production software.
Responsibilities - Review AI-generated coding interactions from start to finish, judging usefulness and overall correctness. - Assess whether explanations and reasoning are clear, relevant, and helpful to a working developer. - Compare response quality consistently, including identifying what separates adequate work from strong work. - Write direct, specific feedback about sound decisions, gaps, confusing claims, and misleading guidance. - Help describe the standards that make AI-assisted development interactions effective and trustworthy.
Requirements - Senior, staff, principal, or equivalent software engineering experience. - Strong experience in TypeScript/JavaScript or Python. - Hands-on use of at least one AI coding assistant and familiarity with current AI-supported development workflows. - Ability to assess code and engineering choices without running every example or inspecting every line. - Strong spoken and written English (B2 or above), including the ability to write detailed reviews and record short video explanations. - Comfortable making well-supported, candid judgments and applying a high engineering bar.
Nice to have - Experience with prompt design or model evaluation. - Background mentoring senior engineers or setting engineering standards.
Benefits and work setup - Remote contract work, open worldwide, with flexible hours of about 10–20 per week. - Compensation is listed at $100–$200 per hour, depending on experience and location. - Work is ongoing, with individual projects typically lasting from around two weeks to several months; further projects may be offered based on evaluation performance. - Selection involves a take-home evaluation and recorded walkthrough. Work can begin after successful evaluation when a project has an opening.