Remote job
Manufacturing AI Training Specialist — Task Creation & Model Evaluation (Contract)
Job details
About this role
Role overview This contract position focuses on building benchmark training data for artificial intelligence systems applied to the manufacturing sector. The work is centered on authoring realistic production scenarios and rigorous evaluation rubrics, then scoring AI-generated outputs against those standards, rather than traditional data labeling.
Responsibilities - Design authentic task scenarios drawn from real manufacturing work, such as interpreting production data, constructing cost or capacity models, reviewing supplier quotes, and assessing technical specifications. - Assemble reference materials that mirror those used on the job, including spreadsheets, CAD or engineering files, and procurement documents. - Develop detailed rubrics that define required calculations, formatting, structure, and overall quality a client would expect from a polished deliverable. - Score AI-generated outputs, frequently Excel-based models or technical documents, against the rubric and personal professional standards. - Join calibration sessions with other domain experts to align grading standards and ensure consistency across the benchmark.
Requirements - Bachelor's or Master's degree in Industrial Engineering, Mechanical Engineering, Operations, or a closely related field. - Hands-on experience in manufacturing operations, production management, or supply chain and procurement work. - Strong fluency with Excel-driven workflows such as cost models, bills of materials, and capacity planning. - Solid written communication skills for translating domain knowledge into precise task instructions and scoring criteria.
Nice to have - Prior experience with AI model training, evaluation, or benchmark design.
Benefits and work setup - Flexible, remote-friendly working arrangement suited to independent contributors. - Opportunities for development in the AI training field and involvement in projects shaping how AI handles manufacturing and industrial work.