Remote job
Lead Data Engineer
Job details
About this role
Role overview
Lead Data Engineer responsible for shaping a modern, enterprise-grade data platform that underpins analytics, reporting, and AI initiatives. The role blends hands-on engineering with leadership, owning the lakehouse architecture, ingestion frameworks, and governance program while partnering with AI/ML, platform, and security teams.
Responsibilities
- Design and operate scalable lakehouse architectures and enterprise data platforms that serve analytics, reporting, and downstream AI use cases. - Build secure ingestion frameworks covering CDC, batch, API, and file-based integrations from operational and transactional source systems. - Develop and maintain data models, semantic layers, and governed metrics so consumers receive consistent, business-ready data. - Implement data quality, reconciliation, observability, and monitoring practices that keep pipelines reliable and recoverable. - Partner with AI/ML, platform engineering, and security functions to deliver governed data products and meet regulatory compliance requirements. - Establish data governance standards, lineage documentation, data contracts, quality thresholds, and operational procedures for new sources and environments.
Requirements
- 8+ years in data engineering with end-to-end ownership of ingestion, transformation, storage, and analytics delivery, including large-scale initiatives. - Strong Python and SQL skills, advanced data modeling, transformation frameworks, data quality, and performance optimization. - Hands-on experience with modern lakehouse technologies such as Apache Iceberg, Delta Lake, Hudi, object storage, and cloud-native data services. - Proven work on scalable pipelines and CDC solutions using tools such as Kafka, Debezium, Airflow, Dagster, and dbt. - Solid grasp of governance, lineage, security, and compliance, including data contracts, access controls, observability, and regulated industry environments. - Track record collaborating with AI/ML, analytics, platform, and business teams; financial services or banking background is a strong plus.
Nice to have
- Background in regulated industries such as financial services or banking. - Experience working across global teams and distributed delivery models.