AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project

Role overview This freelance contract role focuses on auditing AI-assisted developer workflow tasks that are used to train and evaluate AI systems. The work is fully remote and centers on applying expertise with modern developer tooling to ensure tasks reflect realistic coding-assistant scenarios. Specialists are matched to a single domain based on their background.

Responsibilities - Evaluate developer workflow tasks for technical accuracy, realism, solvability, and reproducibility, including the quality of supporting tests and evaluation criteria - Audit IDE integrations, AI-assisted coding patterns, and task logic for inefficiencies, faults, or errors - Produce clear, actionable written feedback that helps task authors strengthen their work - Work with AI coding assistants and developer telemetry or trace tooling to verify task design and execution

Requirements - Demonstrable professional experience with modern developer tooling and AI-assisted coding workflows - Familiarity with telemetry or trace analysis within developer workflow ecosystems - Strong analytical and problem-solving skills for testing and troubleshooting complex technical scenarios

Benefits and work setup - Hourly pay of $60, with the final rate adjusted based on experience, expertise, and location - Fully remote work as an independent contractor; must supply a secure computer and high-speed internet - No employer-sponsored health insurance, paid time off, or other employee benefits apply