Remote job
Senior Data Engineering Developer
Job details
About this role
Role overview Build and maintain cloud data systems and pipelines that make large clinical and genomic datasets usable for research and analytics. The role combines data engineering, modeling, platform support, and modernization of legacy ETL workflows, while contributing technical guidance across the development lifecycle.
Responsibilities - Develop and operate PySpark and SQL pipelines that transform clinical data for research use. - Create and maintain data models and warehouse schemas in Databricks to support scalable storage and analysis. - Modernize on-premises SQL Server ETL workflows by implementing equivalent cloud-based pipelines. - Add data validation and quality checks, monitor pipeline health, and troubleshoot reliability or performance issues. - Support Databricks users with compute selection and optimization of Spark and SQL workloads. - Participate in architecture discussions, reviews, testing, documentation, releases, and post-launch support; share knowledge and mentor colleagues.
Requirements - At least 10 years of related work experience. - Demonstrated experience with Databricks and cloud data engineering platforms. - Strong SQL and Python/PySpark skills, with experience using Spark or another distributed processing technology. - Background designing data models and warehouse schemas for large datasets, and developing or modernizing ETL pipelines. - Experience with relational databases and SQL Server; familiarity with AWS and cloud data architectures. - Knowledge of data quality, monitoring, troubleshooting, and performance optimization, plus clear communication and cross-disciplinary collaboration skills.
Nice to have - A technology-related bachelor’s degree and experience migrating on-premises ETL processes to the cloud.
Benefits and work setup - Work from home within Pennsylvania; the listing specifies a regular, 40-hour workweek on day shifts. Healthcare benefits, including vision and dental, are described as available from the first day for eligible full-time and part-time positions.