Information Specialist - Freelance AI Trainer Project

Role overview Create expert evaluation material for AI systems working on information management and retrieval. You’ll independently develop realistic tasks, prompts, and scoring guidance, then check that the resulting data reflects professional information practices.

Responsibilities - Design complex, realistic prompts involving information science, data management, knowledge organization, or information retrieval. - Build evaluation rubrics with specific, objective criteria that can be scored consistently. - Produce structured benchmark and training examples for assessing AI-generated information architecture and retrieval work. - Fact-check tasks and scoring criteria against data governance standards, research methods, and information management practices. - Review metadata, search approaches, data architectures, and knowledge-base details for accuracy.

Requirements - Professional expertise in information science, library science, data governance, or knowledge management. - Familiarity with relevant industry standards, metadata schemas, and search methodologies. - Strong writing skills and the ability to create realistic, challenging evaluation scenarios. - Experience developing clear rubrics that limit ambiguity and subjective scoring. - Careful fact-checking and attention to detail.

Benefits and work setup - Freelance, independent-contractor engagement; work is remote. - Stated pay range is $10–$30 per hour, with the rate based on experience, expertise, and location; the final offer may differ from the range. - Contractors provide a secure computer and high-speed internet. Health insurance and paid time off are not provided.