Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Role overview Create and assess voice-based evaluation tasks for AI systems handling customer support conversations. Scenarios may cover travel bookings, financial services, or technical troubleshooting, with evaluations focused on completing the user’s task accurately, understanding spoken input, and responding naturally in Portuguese.

Responsibilities - Design and conduct realistic customer support role-plays for audio model evaluation. - Audit responses against qualitative and quantitative criteria, including task completion, conversational flow, and audio comprehension. - Assess basic programming-related reasoning in context, such as interpreting JSON, functions, methods, and simple logic. - Help produce varied, reliable evaluation data that reflects customer expectations for clear and efficient service. - Follow structured prompts, rubrics, and technical guidelines carefully.

Requirements - Native or bilingual Portuguese proficiency across speaking, listening, reading, and writing. - Professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation. - Strong analytical and verbal communication skills for conducting role-plays and judging model performance. - Basic programming literacy, including JSON structures, functions, methods, and simple logic. - Careful attention to detail when applying evaluation criteria and documenting results. - Access to a high-quality microphone for clean voice input.

Benefits and work setup - Remote freelance contract work. - Hourly pay is listed at $6–$65, with the final rate depending on experience, expertise, and location. - Contractors provide a secure computer and high-speed internet. Health insurance and paid time off are not provided.