Remote job
Data Engineer
Job details
About this role
Role overview
This remote data engineering role develops and maintains ingestion, transformation, integration, and quality processes for modern cloud data platforms. The engineer will work primarily in Microsoft Fabric, support layered lakehouse architecture, and integrate data from education, personnel, financial, logistics, service-management, and operational systems.
Responsibilities
- Build and maintain ETL and ELT pipelines that load enterprise source data into a Fabric lakehouse using Bronze, Silver, and Gold layers. - Create integrations for student information, HR, financial, logistics, IT service-management, and other operational systems, including REST API connections and automated synchronization. - Support education data exchange using a standardized education data model, including source mapping, descriptor customization, transformation logic, validation, and migration planning. - Profile, map, cleanse, transform, and reconcile source and target data to verify completeness, accuracy, consistency, and usability. - Develop SQL queries, Python or PySpark processing logic, and reusable transformation components; troubleshoot pipeline, integration, and data-quality issues. - Document data flows, interfaces, mappings, configurations, transformation rules, and operational procedures while supporting migration, knowledge transfer, and transition to operations.
Requirements
- Experience developing data pipelines, ETL/ELT processes, and system integrations. - Experience with Microsoft Fabric, Azure Data Factory, or a comparable cloud data platform. - Strong SQL skills for querying, transformation, validation, and troubleshooting, plus Python and/or PySpark experience. - Experience with structured and semi-structured data, lake, lakehouse, or warehouse architectures, profiling, mapping, reconciliation, and data-quality processes. - Experience integrating systems through REST APIs or similar interfaces. - Strong troubleshooting, analytical, communication, and technical documentation skills, plus an active Secret clearance.
Nice to have
- Experience with Fabric lakehouse architecture and Bronze, Silver, and Gold designs. - Experience with the Ed-Fi data standard, its ODS/API or REST APIs, source-to-Ed-Fi mapping, or student information system integration. - Familiarity with personnel, finance, logistics, IT service-management data, large-scale cloud migration, data governance, metadata, lineage, or enterprise quality practices.
Benefits and work setup
The position is remote and includes supported certifications, advancement opportunities, retirement contributions with a stated match, medical and other insurance coverage, paid time off and holidays, home-office support, wellness reimbursement, weekly pay, and team activities.