Remote job
Middle Data Engineer
Job details
About this role
Role overview
A data engineering role focused on building and operating the data backbone for a risk accumulation management platform used by a major European insurance company. The work centers on Databricks-based transformations, Delta Lake modeling, and reliable ETL/ELT pipelines that feed downstream analytics, reporting, and risk workflows.
Responsibilities
- Build and maintain scalable ETL/ELT pipelines on Databricks using PySpark - Design and evolve Delta Lake data models that support risk accumulation and reporting use cases - Develop transformation jobs integrating source data into curated, analytics-ready layers - Monitor pipeline health, troubleshoot failures, and uphold data quality across the platform - Collaborate with analytics, risk, and business stakeholders to translate requirements into well-modeled data products
Requirements
- 4+ years of professional data engineering experience - Strong proficiency in Python and PySpark - Hands-on production experience with Databricks and Delta Lake - Solid understanding of ETL/ELT patterns, data modeling, and pipeline orchestration - Comfort working in a regulated or data-sensitive environment such as insurance or financial services