Senior Data Engineer

Role overview A senior data engineering role focused on designing, delivering, and maintaining production data pipelines built on Microsoft Fabric, Python, and PySpark. You'll work with significant autonomy on complex and ambiguous problems, mentor less experienced engineers, and partner with architects, product teams, and client stakeholders to translate requirements into robust solutions. The team treats batch and ELT pipeline engineering as a separate discipline from real-time streaming.

Responsibilities - Own the design, build, and maintenance of scalable, production-ready data pipelines on Microsoft Fabric, Python, and PySpark - Make architectural decisions on pipeline design, data modelling, and tooling, weighing performance, cost, and maintainability - Mentor and review work from junior and mid-level data engineers, raising the bar on delivery - Continuously improve CI/CD pipelines for data engineering workflows - Act as an escalation point for complex issues in live data pipelines - Translate ambiguous data requirements into robust, maintainable technical solutions alongside stakeholders

Requirements - Significant hands-on experience with a modern cloud data platform such as Microsoft Fabric, Databricks, Snowflake, or Synapse, including designing and operating production pipelines - Deep SQL expertise with hands-on experience in data modelling patterns such as Kimball, medallion or lakehouse, or domain-driven modelling - Strong proficiency in Python and PySpark for batch data processing, with a track record of production-grade, well-tested code - Experience owning data engineering delivery with limited oversight, including CI/CD management and support - Comfort mentoring and supporting the development of less experienced engineers - Ability to engage directly with stakeholders to shape solutions from ambiguous requirements

Benefits and work setup - Flexible working with hybrid and remote options - Office hubs in Edinburgh, Leeds, Manchester, London, and Bulgaria - Occasional travel to client sites or team offices when needed - Supportive culture focused on impact and outcomes over activity