Software Engineer

Role overview

Build core capabilities for an open-source data and AI infrastructure platform and its commercial offerings. The role focuses on designing scalable systems across metadata, storage, distributed compute, and cloud environments, while also contributing to open-source development and engaging with technical users. It offers a mix of implementation, systems optimization, customer interaction, and community participation.

Responsibilities

- Design and implement components for an open-source infrastructure platform and related commercial products. - Develop high-performance, reliable systems for metadata management, storage, distributed compute engines, and cloud environments. - Investigate difficult systems problems and improve scalability, efficiency, and operational robustness. - Contribute code, reviews, documentation, and technical direction to relevant open-source projects. - Work with customers and engineers to understand real-world requirements and technical challenges. - Participate in the broader data and AI community, including technical presentations when appropriate.

Requirements

- At least 3 years of experience building large-scale distributed systems. - Strong foundations in computer science, systems programming, and software design. - Experience with data or AI infrastructure, particularly open-source technologies used in production environments. - Proficiency in at least one systems language such as Java, Go, C++, or Rust. - Solid Linux and operating-system fundamentals. - Evidence of meaningful open-source contributions or substantial work in public technical ecosystems.

Nice to have

- Experience with database or data-engine internals, including query processing, transactions, or storage systems. - Familiarity with lakehouse technologies and metadata or governance platforms. - Exposure to large language models, AI infrastructure, or AI agent systems. - Background at a data infrastructure, AI infrastructure, developer-tools, or major technology company. - Experience with technical writing, developer advocacy, or community engagement.

Benefits and work setup

- Based in the San Francisco Bay Area, with remote work available. - Requires up to approximately 30% travel, primarily to the Bay Area. - Published compensation is $150,000–$200,000 in base salary, plus equity and benefits.