Remote job
Senior AI Engineer (CCC Casualty / Claims Intelligence)
Job details
About this role
Role overview Build and operate language model agents that support experts handling auto injury claims. You will own the path from prototype to measured production performance, including agent orchestration, retrieval, evaluation, and safeguards for workflows that use complex documents and sensitive claims information. The products include medical bill workflows, claims decision support, and shared rules and agent tooling.
Responsibilities - Design and build language model agents and workflows, including tool use, retrieval, structured data extraction, and human review. - Write production code to deploy agent capabilities that support claims experts in their daily work. - Develop evaluation datasets with labelers and subject matter experts, and run evaluations for each meaningful change. - Add safeguards and monitoring so agent behavior can be assessed and managed in production. - Track and improve system cost, response time, and output quality while handling sensitive health information carefully. - Use evaluation results to measure changes and guide ongoing product improvements.
Requirements - Typically five or more years of software or machine learning engineering experience, including substantial recent work with language models. - Strong production Python skills, including API services, and comfort working with TypeScript. - At least one year shipping language model products to real users, including retrieval-augmented generation, embeddings, vector search, and prompt design. - Experience evaluating non-deterministic systems and measuring performance before and after changes. - Quantitative approach to metrics, sampling, and error analysis, with the judgment to distinguish meaningful results from noise. - Experience using AI-assisted or agentic engineering tools to ship work faster, with examples to discuss.
Nice to have - Document understanding, OCR, or extraction from complex documents. - Experience fine-tuning language models or working with multimodal data.
Benefits and work setup - Listed base salary range is $180,000–$225,000, with bonus eligibility. - Benefits include health coverage, paid time off, retirement matching, tuition reimbursement, wellness programs, and stock purchase options.