Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)

Role overview Author realistic professional services tasks, rubrics, and reference materials drawn from real client work, then evaluate AI-generated deliverables against those rubrics. The current focus is on accounting and audit work, though adjacent professional services backgrounds are welcome. The work directly shapes how AI models are trained and benchmarked for client-facing deliverables.

Responsibilities - Design realistic task scenarios rooted in actual engagement work, such as reviewing financial statements and audit workpapers, building a consulting deliverable, or drafting client-facing proposals and analyses. - Supply the reference materials a practitioner would normally use, including financial statements, engagement letters, project reports, and supporting schedules. - Write detailed rubrics specifying exactly what a correct deliverable requires, from accurate figures and formulas to structure and professional formatting. - Grade AI-generated deliverables, typically Excel workbooks, Word documents, or PDF reports, against the rubric. - Join calibration sessions with other experts to keep scoring consistent across the benchmark.

Requirements - Hands-on experience in accounting or audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing or business services, or another engagement-based professional services role. - Comfort reviewing detailed client-facing work product line by line. - Prior experience with AI model training, evaluation, or benchmark development is a plus.

Benefits and work setup A supportive, flexible working environment with opportunities for professional development in AI and the chance to work on projects that shape how AI handles real professional services work.