Principal Engineer, Big Data Platform

Role overview A principal-level engineering role is responsible for shaping the next generation of large-scale data infrastructure that powers big data and AI workloads across the organization. The position sets technical direction for petabyte-scale processing systems and partners with internal teams whose most critical business use cases depend on reliable, high-throughput data platforms.

Responsibilities - Define the long-term strategy and technical roadmap for distributed data infrastructure supporting analytics and machine learning applications - Design and scale compute engines, job orchestration, resource management, scheduling, and remote shuffling frameworks that handle petabyte-class datasets - Collaborate closely with internal stakeholders to translate business-critical data needs into platform capabilities - Provide company-wide technical leadership on best practices for reliable, fast, and cost-efficient data processing at scale - Contribute to architectural reviews, mentor senior engineers, and help evolve the platform's technical vision

Requirements - 12+ years of industry software engineering experience with a demonstrated record of technical excellence - 8+ years building and operating large-scale Kubernetes-based platforms or big data systems in production - Deep familiarity with distributed data and ML technologies such as Flink, Spark, Presto, Kubernetes, Ray, or PyTorch/TensorFlow - Strong proficiency in one or more of Java, Go, Scala, or Python - Hands-on experience with Kubernetes and AWS cloud infrastructure - Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience - Proven ability to align cross-functional partners around priorities in ambiguous situations

Nice to have - Prior experience contributing to open source big data or orchestration projects - Background guiding other senior engineers through technical mentorship or technical leadership roles

Benefits and work setup - Remote-eligible position based anywhere in the country, with in-person collaboration expected one to two times per quarter - Base salary range of $242,634–$499,541 USD, plus equity, with final compensation determined by location, experience, and skills - Relocation assistance is not offered for this role