Data Engineering Consultant

Role overview

Build data platforms and analytical solutions for client projects, combining hands-on engineering with consulting and agile delivery. The work spans the data pipeline lifecycle, from understanding requirements through building reliable, governed solutions. This is a remote role for candidates based in the UK, with occasional visits to customers or team locations.

Responsibilities - Gather client requirements and contribute to practical data engineering designs. - Develop data pipelines and platform components using cloud services, Spark, Python, and SQL. - Orchestrate data workflows and work with lake storage and table formats. - Apply practices that improve data quality, resilience, observability, and governance. - Participate in agile project delivery and follow sound development and deployment processes. - Share knowledge with colleagues and contribute to a collaborative technical community.

Requirements - Working knowledge of Microsoft Azure and cloud computing concepts. - Experience with Apache Spark, such as Databricks, Microsoft Fabric, or a similar engine. - Good Python and SQL skills, including writing complex, efficient queries. - Familiarity with orchestration tools, Azure Data Lake, and Delta Lake. - Exposure to data governance tooling and infrastructure as code, such as Unity Catalog or Purview, Terraform, or Azure DevOps. - Client consulting, requirements gathering, agile delivery, object-oriented development, and CI/CD or software lifecycle practices.

Nice to have - Experience with streaming data, distributed systems, or Azure Functions.

Benefits and work setup - Remote work from within the UK, with occasional travel to customers or team locations.