Senior Data Engineer

Role overview Lead and deliver large scale data engineering work that turns information from many sources into dependable, usable datasets. The role covers ingestion, transformation, entity matching, and production quality controls, as well as solving open ended data challenges. It requires substantial industry experience and pairs high individual ownership with collaboration across a remote team.

Responsibilities - Build and improve scalable systems for ingesting, cleaning, transforming, and loading high volumes of data. - Develop entity resolution approaches to reconcile records into consistent datasets. - Create CI/CD workflows and anomaly detection that raise the reliability of production data. - Set sound processing and storage patterns for incremental updates, partitioning, rebuilds, and backfills. - Write data design documentation and coordinate scope, delivery progress, and blockers with stakeholders.

Requirements - Around 5–7 or more years of industry experience, with evidence of strategic technical problem solving and implementation. - Strong software development fundamentals and hands on experience with Python, SQL, and Apache Spark. - Experience building scalable data processing systems and using orchestration tools such as Airflow, dbt, or Dagster. - Familiarity with Databricks, lakehouse practices, cloud services such as AWS, GCP, or Azure, and data warehousing. - Knowledge of modern storage formats such as Parquet, ORC, Avro, or Delta Lake. - Able to work remotely with autonomy, communicate clearly in writing, collaborate, and proactively manage work and blockers.

Nice to have - A quantitative degree or experience in entity resolution, record linkage, data acquisition, or data integration. - Python data stack experience, streaming technology such as Kafka, or methods for evaluating data quality.

Benefits and work setup - Remote work with flexibility in location and work style. - Equity, health, dental, and vision coverage, paid time off, and health, fitness, and office stipends. - Listed compensation: $200,000–$220,000.