Remote job
Data Science & Analysis - AI Training - Washington DC, US
Job details
About this role
Role overview Apply data science or analytics knowledge to paid AI evaluation tasks, helping improve the accuracy and quality of model responses. Work is project-based and may involve reviewing statistical outputs, validating code, and documenting where models reason well or fall short. A brief assessment is used to determine suitability.
Responsibilities - Review generated data insights and statistical work for accuracy, clarity, and completeness. - Verify formulas, mathematical reasoning, and data-based claims against authoritative sources. - Run Python or R scripts to confirm results and check behavior on edge cases. - Evaluate model reasoning on data analysis and predictive modeling problems. - Record whether outputs follow the technical and behavioral instructions for each task.
Requirements - A bachelor's, master's, or PhD in data science, statistics, mathematics, or another relevant quantitative field. - Real-world work in data analysis, predictive modeling, or machine learning engineering. - Strong statistical problem-solving skills and ability to interpret advanced visualizations independently. - Careful analytical judgment, including the ability to spot subtle errors in statistical arguments. - Significant use of large language models in data workflows and knowledge of where they can fail. - Clear communication, Python or R proficiency, advanced SQL, and a PayPal account for payment.
Nice to have Experience with common data analysis and visualization libraries or tools, machine learning frameworks such as PyTorch or TensorFlow, and statistical modeling techniques.
Benefits and work setup Tasks can be completed remotely with flexible hours. Some assignments need one uninterrupted hour; others are shorter. Rates are task-dependent and may be as high as $80 per hour. A short skills assessment precedes access to tasks.