Remote job
Healthcare/Nursing AI Training Specialist — Task Creation & Model Evaluation
Job details
About this role
Role overview Use clinical experience to create realistic work scenarios and evaluation criteria for AI systems in nursing and healthcare. The work goes beyond labeling: you’ll define what a sound clinical deliverable should contain, assess model-generated work against that standard, and help ensure experts score consistently.
Responsibilities - Develop realistic clinical tasks grounded in professional experience, such as assessment documentation, care planning, vital-sign tracking, lab trend review, or medication management. - Provide suitable reference materials, such as redacted charts, care plans, or clinical notes. - Write detailed rubrics that define clinically sound reasoning, accurate assessments, and appropriate terminology. - Review AI-generated clinical documents or assessment workbooks against the rubric. - Participate in calibration sessions to support consistent evaluation across experts.
Requirements - Registered Nurse, Nurse Practitioner, or comparable clinical credential. - Hands-on experience in patient care, clinical documentation, or care coordination. - Careful, line-by-line review skills for detailed clinical work. - Ability to draw on clinical practice to create realistic scenarios and judge the quality of deliverables.
Nice to have - Experience with AI model training, evaluation, or benchmark development.
Benefits and work setup - Flexible working environment and opportunities for professional development in AI. - Work on projects intended to influence AI systems used in healthcare and clinical work.