Senior Data Platform Engineer

Role overview A senior engineering role on a Data Platform team that owns a Databricks-based Lakehouse used by Machine Learning, Analytics, and Software Engineering teams to build training data and business metrics. The position focuses on Lakehouse infrastructure, security, and compliance in support of lending, fraud, and pricing workloads, including a newly launched regulated environment. It blends platform engineering, cost optimization, and cross-functional collaboration with Data Engineering, Security, Compliance, and ML stakeholders.

Responsibilities - Own Databricks platform infrastructure across multiple environments, expanding infrastructure as code, enforcing no-click-ops practices, and establishing disaster recovery. - Implement least-privilege and attribute-based access controls, ensure environment isolation, and resolve known security risks on the Lakehouse. - Close control gaps and automate evidence gathering for OCC, SOX, and SOC audits across access management, change management, and data quality. - Reduce Databricks and AWS spend through accurate cost attribution, waste detection, compute rightsizing, improved pruning, Graviton and spot migrations, and Delta Lake archival. - Evaluate and adopt new technologies, including open-source lakehouse alternatives, to expand platform capabilities. - Mentor engineers, promote good coding and engineering practices, and break complex projects into quarterly commitments and sprints.

Requirements - Bachelor's degree in Computer Science or a related field, or equivalent practical experience. - 5+ years of experience in infrastructure or platform engineering roles. - Experience implementing security and compliance controls in audited environments such as SOX, SOC 2, GDPR, GLBA, or OCC, including access management, encryption, and change management. - Experience reducing cloud or data platform costs through usage analysis, cost attribution, and infrastructure optimization techniques. - Proficiency in DevOps engineering using CI/CD tools such as Kubernetes, Jenkins, CDK, APM, and Terraform, with strengths in automation, monitoring, security, and declarative infrastructure. - Solid understanding of cloud networking fundamentals and familiarity with distributed systems, data architecture design, and big data technologies such as Spark, Kafka, Lakehouse, and Databricks.

Nice to have - Experience using AI coding assistants or agents to accelerate infrastructure development and operations. - Ability to reason from first principles and communicate complex concepts simply in fast-paced, ambiguous settings.

Benefits and work setup - Anticipated base salary range of $166,900 to $230,900 USD, plus bonus, equity grants vesting quarterly, and an Employee Stock Purchase Plan (US only). - 401(k) or Group Retirement Savings Plan with a $2-for-$1 company match up to $15,000 annually, plus life insurance and disability coverage. - Comprehensive medical, dental, and vision coverage for employees and family, with HSA contributions on eligible plans (US only). - Paid time off, sick leave, company holidays, paid family and parental leave, fertility and family-building benefits, and an Employee Assistance Program. - Financial wellness resources including planning tools and a concierge service (US only), an annual wellness allowance, and an annual productivity allowance. - Digital-first work model with optional in-person collaboration from offices in Columbus, Austin, the Bay Area, or New York City, plus team events and employee resource groups. - Catered lunches and stocked micro-kitchens are available when working onsite.