Principal Data Engineering Consultant

Role overview

Guide data engineering delivery across multiple client projects, connecting technical design with practical delivery needs. The role calls for broad understanding of the data platform lifecycle and the ability to consult with clients, manage project scope and budgets, and help teams deliver robust solutions. The position is remote for people based in the UK, with occasional customer and team visits.

Responsibilities - Shape end-to-end data platform solutions across concurrent engagements. - Consult with clients, gather requirements, and translate them into delivery plans. - Guide agile project work, including budget and scope management. - Build or oversee data pipelines and platform components using cloud, Spark, Python, and SQL technologies. - Promote quality, resilience, observability, governance, and sound CI/CD practices. - Share expertise and support learning across the team and data community.

Requirements - Strong experience with Azure and cloud computing concepts. - Proficiency with Apache Spark, Python, and complex, performance-minded SQL. - Familiarity with orchestration, data lake storage, and Delta Lake patterns. - Knowledge of data governance tools and infrastructure as code, such as Unity Catalog or Purview, Terraform, or Azure DevOps. - Client consulting and requirements gathering skills, plus agile delivery experience that includes scope and budget management. - Understanding of object-oriented development, ETL quality and resilience, observability, CI/CD, and the software development lifecycle.

Nice to have - Experience with streaming systems, distributed compute, or cloud functions.

Benefits and work setup - Remote work from within the UK, with occasional travel to customers or team locations.