Remote job
Senior / Staff Data Platform Engineer (US)
Job details
About this role
Role overview Build and operate the data platform that supports research and monitoring products, including its lakehouse, ingestion pipelines, API serving layer, and deployments in secure federal environments. The role carries architectural ownership across commercial and government cloud boundaries and contributes to engineering practices that use AI coding agents for implementation and review.
Responsibilities - Develop batch and streaming pipelines, transforming incoming data into reliable, curated production datasets. - Own data modeling and performance for the API serving layer, including PostgreSQL workloads and large table reloads. - Design change data capture and data movement across commercial cloud and government environments. - Help define data architecture around federal authorization boundaries and permissible data flows. - Improve observability, data quality, alerting, cost visibility, and incident response. - Contribute shared libraries and internal agent skills, workflows, and safeguards, while partnering with teams building language-model-powered research tools.
Requirements - At least 5 years in data engineering, including ownership of a production data platform. - Strong Python and SQL, with sound software engineering practices such as testing, code review, CI/CD, and maintainable design. - Hands-on lakehouse experience with Spark or PySpark, Delta Lake or Iceberg, and catalog or governance tools. - Production AWS experience and infrastructure-as-code experience with Terraform. - Experience modeling and tuning PostgreSQL for API-serving workloads. - Practical use of AI coding agents, with the ability to explain how you scope work and validate and review their output. - Clear written communication and comfort working across U.S. and European time zones; U.S. citizenship is required. Clearance eligibility is an advantage.
Nice to have - AWS GovCloud, FedRAMP, or Department of Defense Impact Level experience; CDC tools such as AWS DMS, Kinesis, or Debezium; Kafka; Airflow; Elasticsearch or graph databases; or pipelines supporting language model workflows.
Benefits and work setup - U.S. role with remote and hybrid work options. Listed starting salary is $170,000 USD per year, adjustable based on experience and location; equity, unlimited vacation, health, dental, and vision coverage, and a 401(k) plan are offered.