Remote job
Senior Databricks Engineer/Architect
Job details
About this role
Role overview Lead the design and delivery of data engineering solutions centered on Databricks. The work covers scalable pipelines, PySpark transformations, and platform migration, while keeping data quality and performance in view and aligning technical plans with business needs.
Responsibilities - Design, develop, and maintain scalable, high-performance data pipelines. - Plan and lead data migrations to Databricks as part of platform modernization. - Build and optimize complex data transformations with PySpark. - Develop and improve ETL/ELT workflows for enterprise data initiatives. - Protect data quality and integrity while improving platform scalability and performance. - Present architecture, migration plans, and progress to stakeholders; connect technical teams with business decision-makers.
Requirements - Senior-level data engineering or architecture experience with Databricks and PySpark. - Demonstrated ability to build and optimize scalable data pipelines and robust ETL/ELT workflows. - Experience architecting and executing data migrations to Databricks or modernizing data platforms. - Ability to translate complex technical needs into effective, reliable data solutions. - Strong collaboration and presentation skills for communicating architecture and project outcomes to business stakeholders and leadership.
Benefits and work setup - Long-term, ongoing 1099 contract. - Remote within the United States.