Remote jobs at agency

Assess AI models’ software engineering responses in Bengali, helping identify gaps in coding logic and language quality. The work covers technical topics such as algorithms, appli…

Bring HTML and web development experience to the evaluation of AI-generated software guidance. You’ll test the model on realistic engineering questions, review its technical accur…

Help assess and improve language models’ ability to reason about web development and user interface design. The work covers modern frontend practice, from accessible responsive la…

Assess the accuracy, safety, and reliability of language models through structured testing and detailed failure analysis. This contract role spans evaluation design, adversarial t…

Use C# and software engineering expertise to test how well an AI model handles practical development questions. The work combines solving technical scenarios, reviewing the model’…

Evaluate the accuracy, safety, and reliability of language models through structured testing and detailed failure analysis. The work focuses on LLM evaluation, including test desi…

Guide restaurants and other merchants through setting up direct online ordering, from initial configuration to a working launch. The work combines remote onboarding, technical tro…

Evaluate how AI models reason about Java-based infrastructure and large-scale software systems. You’ll work through realistic architecture and operations scenarios, check proposed…

Evaluate and improve AI models’ ability to solve software engineering problems in TypeScript. You’ll examine a broad range of coding and systems scenarios, check the accuracy and…

Evaluate advanced AI models’ ability to solve challenging problems in Java. The work focuses on judging whether generated solutions are correct, clearly reasoned, robust to edge c…

Create and review Kotlin solutions for real-world Android development tasks, such as bug fixes and feature requests in code repositories. The focus is on producing technically cor…

Use video editing and post-production expertise to test and improve an AI model’s understanding of visual storytelling. You’ll work through editing scenarios and technical questio…

Create and carry out evaluation tasks that measure how well AI audio systems handle realistic customer support conversations. The project spans scenarios such as travel bookings,…

Create expert evaluation material for AI systems working on information management and retrieval. You’ll independently develop realistic tasks, prompts, and scoring guidance, then…

Use professional audio editing knowledge to assess and improve an AI model’s understanding of sound and production workflows. You’ll explore practical editing scenarios and audio…

Evaluate and improve language models’ understanding of visual and digital arts through expert-led creative and technical challenges. The work spans areas such as illustration, gra…