Quality Evaluator – Fluent English (Mexico)

Role overview Evaluate responses from multiple AI models and help improve their accuracy, clarity, and usefulness. This part-time independent contract role involves comparing outputs across varied topics, applying detailed criteria, and explaining decisions in writing. The assignment may run for up to three months.

Responsibilities - Review prompts and responses produced by different AI models and tools. - Compare two or more responses to determine which better serves the user’s needs. - Judge outputs for accuracy, helpfulness, clarity, and adherence to instructions. - Apply rating guidance consistently through multi-step workflows. - Write concise, well-supported explanations for evaluation decisions.

Requirements - Fluent English, with strong reading comprehension and writing skills. - Extensive practical experience using large language models and assessing their outputs critically. - Sound analytical judgment across several dimensions of response quality. - Careful attention to detail and ability to follow complex instructions. - Ability to communicate evaluation reasoning clearly. - Comfort moving between models, tools, and structured workflows.

Nice to have - Background in AI evaluation, data annotation, or quality assurance. - Experience with editing, research, fact-checking, or analytical writing. - Familiarity with evaluation rubrics and side-by-side response comparisons.

Benefits and work setup - Remote, part-time independent contract work. - Compensation listed as $7–$12 per hour.