Quality Assurance Specialist

Role overview Help ensure AI-powered applications behave reliably and safely in everyday use. You’ll test prompts, model responses, and multi-turn conversations, then work with engineering and prompt design colleagues to address issues before and after release.

Responsibilities - Run structured tests across prompts, response flows, and unusual or high-risk scenarios. - Assess responses for accuracy, consistency, relevance, bias, hallucinations, and safety concerns. - Check application behavior before and after deployment, including errors, logs, response stability, latency, and token use. - Record findings with the relevant prompts, outputs, and clear steps for reproducing each issue. - Review the quality and consistency of AI-generated training data and annotations. - Collaborate with developers and prompt engineers to validate fixes and improvements.

Requirements - Hands-on experience testing generative AI, language models, or conversational applications. - Familiarity with prompt and output evaluation, including multi-turn interactions. - Ability to spot inaccurate, inconsistent, biased, or unsafe AI responses. - Experience working with AI service APIs or model integrations and reviewing logs or performance indicators. - Basic understanding of natural language processing and language model behavior. - Careful, systematic approach to testing, edge cases, and issue documentation.

Benefits and work setup - Remote independent-contractor role for candidates based in Singapore or the Philippines.