Lead Data Engineer

Role overview

Provide technical leadership for enterprise data platforms, with a focus on scalable pipelines, change data capture, and real-time event streaming. This hands-on role also guides architecture and engineering practices, mentors colleagues, and coordinates complex initiatives across teams. Applicants must already be authorized to work for any U.S. employer; visa sponsorship is unavailable.

Responsibilities

- Design and deliver data pipelines and streaming ingestion systems for high availability and low latency. - Build and operate Kafka producers and consumers, and move changes from relational and NoSQL databases into event streams. - Develop stream-processing solutions to enrich, filter, and aggregate data; manage schemas, evolution, and delivery guarantees. - Monitor pipelines and address operational concerns such as consumer offsets, partition rebalancing, and dead-letter queues. - Set technical direction for complex initiatives, translating business needs into scalable designs and improving platform reliability and performance. - Establish data quality, security, governance, and contract practices; mentor engineers and lead code reviews.

Requirements

- Bachelor’s degree in computer science or a related field, or equivalent training and experience. - 6–8 or more years of data engineering experience with enterprise-scale platforms. - 6–8 or more years working with Kafka, Confluent Cloud, AWS Kinesis, or Apache Pulsar. - Advanced Python, PySpark, and SQL skills, plus production experience with a language such as Java, Scala, or Go. - Experience with streaming frameworks, cloud data platforms, and change data capture tools such as Debezium or Kafka Connect. - Practical knowledge of AWS, infrastructure automation, and container or CI/CD tools.

Nice to have

- Experience with schema registries and formats such as Avro or Protobuf, lakehouse formats such as Iceberg or Delta Lake, and warehouses such as Snowflake or BigQuery. - Familiarity with orchestration tools for automated validation or event routing.

Benefits and work setup

- The listed base salary range is $131,700–$190,950; eligible non-sales employees may also participate in a bonus program. - Benefits include health and life insurance, a 401(k) with company matching, tuition reimbursement, paid time off and holidays, paid volunteer time, and leave programs. - Remote and hybrid workers need reliable wired high-speed internet and a suitable home workspace; equipment is provided.