Remote job
Senior Data Engineer (Earnix)
Job details
About this role
Role overview
Lead the engineering of production data pipelines and governed data products for insurance pricing and rating use cases. The work spans solution design, data modeling, platform quality and performance, and technical guidance for a cross-functional team.
Responsibilities - Build and optimize pipelines and data products using Azure Databricks, dbt, Python or PySpark, SQL, and Delta Lake. - Develop consistent Silver and Gold models for pricing factors, model inputs, quote versions, and policy premiums. - Establish data quality checks, observability, monitoring, governance, and performance practices across the lakehouse. - Partner with pricing, actuarial, underwriting, data science, BI, architecture, and quality engineering teams. - Provide technical leadership through design and code reviews, and mentor other engineers. - Own production pipelines from design and deployment through monitoring and incident resolution.
Requirements - At least 7 years of data engineering experience, including recent work on enterprise Databricks platforms. - Production experience with Azure Databricks, Spark, Delta Lake, Databricks Workflows or Jobs, and Databricks SQL. - Advanced dbt skills, including models, macros, tests, documentation, incremental processing, and CI/CD integration. - Strong Python, PySpark, and SQL skills for transformations, reusable frameworks, validation, testing, reconciliation, and analytical modeling. - Experience with batch and incremental ELT/ETL, data quality, production support, and platform optimization. - Familiarity with data governance, lineage, access controls, Git-based delivery, Azure storage, identity, security, and integration patterns.
Nice to have
Insurance pricing, policy, quote, premium, underwriting, or actuarial data experience is useful, as is integration with a pricing or rating engine. Familiarity with Dataiku, MLflow, streaming systems, REST APIs, low-latency services, Power BI, or Terraform is also relevant.
Benefits and work setup
Remote role open to candidates in Costa Rica, Peru, Colombia, or Bolivia.