Senior Data Platform Engineer

Role overview

Build the data platform’s durable record of resolved entities, preserving what each source said, the evidence behind it, confidence levels, and how conclusions changed over time. The storage design must support probabilistic matching and source disagreement without silently overwriting information, while allowing past results and their rationale to be reconstructed on demand.

Responsibilities

- Design storage that retains conflicting source claims and their history instead of resolving disagreements during writes. - Build a results and evidence store that links saved outcomes to originating records and keeps prior results, human feedback, and configuration versions distinct. - Implement provenance and lineage across records and relationships, following the platform’s evidence contract. - Store versioned rules and configurations, and record the precise rule versions and ordered context used by model-assisted steps. - Make writes traceable and decisions reproducible, including point-in-time answers about what was believed and the evidence available then. - Carry match confidence and other uncertainty through the platform, and coordinate data needs with entity resolution and machine learning colleagues.

Requirements

- At least six years in data or data platform engineering, including production experience with versioned, temporal, or historized data models. - Experience designing storage where provenance, history, and source disagreement are preserved as core data. - Comfort working with probabilistic upstream results rather than relying on a clean shared key. - Strong Python and SQL, with production experience using PostgreSQL or a comparable database. - U.S. citizenship and an active Secret clearance.

Nice to have

- Storage experience downstream of entity resolution or record linkage. - Production use of bitemporal, event-sourced, graph, or other temporal data models. - Government or regulated-industry experience requiring historical decisions to be reproducible. - An active Top Secret clearance.

Benefits and work setup

The position is fully remote with occasional travel to offices, customer locations, or partner facilities. The listed compensation range is $165,000–$200,000, with potential bonus and equity. Benefits include employer-paid medical, dental, and vision coverage for employees and their families, manager-approved unlimited paid time off, flexible scheduling, and 14 weeks of paid parental leave.