Senior Data Engineer

Role overview

This remote senior engineering role owns the design, implementation, optimization, and operation of enterprise data pipelines and platform capabilities in Microsoft Fabric. The engineer provides technical leadership across ingestion, transformation, platform administration, security, automation, deployment, reliability, and data quality while mentoring other engineers.

Responsibilities

- Lead scalable ETL and ELT architecture for structured and semi-structured data, including Bronze, Silver, and Gold medallion layers. - Configure and administer Fabric tenants, workspaces, capacities, security settings, and environment governance. - Build transformation workloads with Spark, PySpark, SQL, and related processing tools, incorporating schema validation, cleansing, normalization, enrichment, and reconciliation. - Establish data-quality monitoring, automated tests, validation controls, alerting, and troubleshooting practices for pipeline and platform failures. - Create separated development, test, staging, and production environments with CI/CD and infrastructure-as-code deployment processes. - Implement security and resilience controls such as encryption, role-based access, identity integration, privileged access management, hybrid connectivity, disaster recovery, rollback, and restoration procedures.

Requirements

- Significant experience building enterprise data pipelines, ETL/ELT frameworks, and cloud data platforms. - Hands-on Microsoft Fabric experience and experience administering or configuring enterprise cloud data environments. - Strong SQL skills plus experience with Azure Data Factory or comparable integration technologies and Spark/PySpark processing. - Experience with medallion architectures, data-quality controls, source control, CI/CD, automated deployment, and environment promotion. - Understanding of cloud security, identity, encryption, least-privilege access, production reliability, performance, and availability requirements. - Strong technical documentation and communication skills, experience mentoring engineers, and an active Secret clearance.

Nice to have

- Certification in Fabric data engineering or analytics; advanced lakehouse, tenant, capacity, workspace, and deployment-pipeline experience. - Experience with Azure DevOps, GitHub Actions, GitLab CI/CD, Terraform, Bicep, ARM templates, automated quality monitoring, hybrid environments, disaster recovery, metadata, lineage, or enterprise governance. - Experience in federal or defense data environments.

Benefits and work setup

The position is remote and includes supported certifications, advancement opportunities, retirement contributions with a stated match, medical and other insurance coverage, paid time off and holidays, home-office support, wellness reimbursement, weekly pay, and team activities.