Remote job
Principal Data Platform Developer
Job details
About this role
Role overview Build and operate a production data platform using Databricks, supporting the flow from source ingestion through governed data layers, analytics products, and AI-assisted processing. The role combines hands-on pipeline development with platform governance, deployment automation, troubleshooting, and collaboration with business stakeholders.
Responsibilities - Build and maintain Databricks Asset Bundles for ingestion, transformation, product, and orchestration jobs, using the team's deployment standards and Git-based CI/CD. - Operate Salesforce ingestion across client organizations and address authentication or field-level access issues while protecting sensitive data in curated tables. - Manage Unity Catalog permissions, PII tags, attribute-based masking, and access to sensitive intermediate data. - Develop document processing and retrieval workflows using foundation model endpoints for classification, detection, and inference. - Create reporting marts and data products that support business metrics and stakeholder reporting. - Troubleshoot pipeline failures, evaluate model-serving endpoints, and document known defects and operational runbooks.
Requirements - At least three years of data engineering experience, including production work on Databricks. - Strong Python, SQL, and PySpark skills, with experience in Delta Lake and Delta Live Tables or Lakeflow. - Practical knowledge of Unity Catalog governance, including grants, tagging, masking, and row filters. - Experience deploying data infrastructure as code, such as Databricks Asset Bundles or Terraform, through Git-based CI/CD. - Familiarity with Salesforce data models and CRM ingestion patterns. - Bachelor's degree in computer science, engineering, or a related field, or equivalent experience; clear communication and documentation skills.
Nice to have - Experience building or integrating LLM workflows, including retrieval-augmented generation or model evaluation. - Working knowledge of Azure identity, service principals, and storage.
Benefits and work setup Benefits listed include medical, dental, and vision coverage; a 401(k) match; paid vacation, sick, personal, parental, and volunteer leave; an employee assistance program; recognition rewards; and on-demand training. Applicants must be authorized to work in the position's country without employer sponsorship. Successful hires must pass pre-employment checks.