Remote job
Software Engineer - Data Engineering
Job details
About this role
Role overview Build the interoperability layer that connects a Rust-based sensor data platform with modern data engineering tools and open table formats. You’ll develop ways to import data from external systems and export it for downstream pipelines, working across storage formats, query infrastructure, and data movement.
Responsibilities - Design and implement read and write conversions for formats such as Delta Lake and Apache Iceberg. - Extend existing integrations with Apache Arrow, DataFusion, and Parquet. - Support data exchange with external systems and downstream processing pipelines. - Assess format internals and make implementation tradeoffs for the integration layer. - Own technical decisions and contribute to the open-source codebase.
Requirements - Strong Rust skills, or experience in C++ or another systems language with the ability to ramp up quickly. - Hands-on experience with an open table format such as Delta Lake, Apache Iceberg, or Apache Hudi. - Understanding of ETL pipelines and how data moves between systems. - Comfort working across systems engineering and data engineering. - Ability to work autonomously and communicate fluently in English.
Nice to have - Contributions to Arrow, DataFusion, or related open-source projects. - Experience with query engine internals, storage formats, or cloud object storage. - Familiarity with robotics or sensor data.
Benefits and work setup - Full-time, remote role, with optional office access in Reggio Emilia; applicants must be legally entitled to work in Italy. - Flexible hours, welfare package, and stock options. - Salary range of €60,000–€100,000, adjusted for location, experience, and level. - Technical ownership in an open-source project released under Apache 2.0.