Remote job
Data Engineer
Job details
About this role
Role overview Develop production data capabilities that bring together complex health, financial, operational, and mission datasets from federal and defense systems. The work includes building scalable pipelines, integrations, APIs, and reusable data products that support reporting, operational decisions, and a broader data platform used by multiple teams.
Responsibilities - Build and maintain production data pipelines with Python, SQL, Spark, and a Databricks environment. - Integrate and transform data from varied sources into reliable, reusable datasets and products. - Create data models and analytics datasets for reporting and operational decision-making. - Develop API-based integrations for data ingestion and exchange between systems. - Monitor scheduled workflows, resolve production issues, and improve pipeline performance and reliability. - Apply data validation, quality, lineage, and governance practices; contribute to reviews, automated testing, documentation, and reusable engineering patterns.
Requirements - At least three years of experience in data engineering, software engineering, or a related technical field. - Strong Python and SQL skills, with experience in Spark or a similar distributed processing framework. - Experience with Databricks or a comparable data platform, production pipelines, and ETL/ELT processes. - Working knowledge of data modeling and preparing raw data for analytics or reusable data products. - Experience with REST APIs, pipeline troubleshooting, Git workflows, command-line tools, and modern engineering practices. - Familiarity with data quality, security, privacy, governance, and compliance, plus the ability to communicate with stakeholders and drive work through ambiguity. - U.S. citizenship and an active Department of War Secret or higher clearance are required. A relevant bachelor’s degree is preferred.
Nice to have AWS, very large datasets, Palantir Foundry, Advana or similar defense data environments, GitLab, CI/CD, or experience with sensitive federal health or financial data.
Benefits and work setup Remote within the continental United States; periodic travel may be required. Benefits include flexible paid time off and federal holidays, health, dental, and vision coverage, a flexible spending account, 401(k) matching, insurance, and professional development support.