Data Engineer, AI Backend

Role overview Build and operate the data services behind an AI assistant for legal and financial disclosure workflows. The role spans API design, document processing and search, source citations, and production operations, with close collaboration across engineering and data science teams.

Responsibilities - Define and maintain the AI backend API contract, including a working stub, versioning, and clear communication with dependent teams. - Build a service that supplies relevant document context while respecting user access permissions. - Create pipelines to ingest, process, and index regulatory filings for peer-company research. - Develop citation data that links AI responses to the precise sentences in source documents. - Route requests among AI models and provide logging, monitoring, reliability controls, and usage and cost visibility. - Produce evaluation data and establish data quality and operational practices for backend services.

Requirements - At least five years of professional Python data or backend engineering experience. - Experience operating production data pipelines at scale with Databricks, Spark, or a comparable platform. - Experience building production Python services and stable APIs used by other engineering teams. - Familiarity with document or text data, search, indexing, or information retrieval. - Strong data modeling, testing, observability, and pipeline reliability practices. - Ability to deliver against milestones that involve multiple teams.

Nice to have - Production experience with retrieval-augmented generation, vector search, or hybrid search. - Work on citations, provenance, or source traceability for search or AI responses. - Familiarity with regulatory or financial documents, filing systems, or structured financial reporting. - Experience with cloud AI services, model routing, usage monitoring, or cost controls. - Experience building evaluation datasets or pipelines for generative AI.

Benefits and work setup The listed compensation range is $130,000–$165,000 annually, with actual pay varying by factors such as experience and location. Benefits include medical, dental, vision, and life coverage; retirement contributions; paid leave; parental leave; volunteer time; and wellness and employee assistance resources.