Remote job
Principal Engineer
Job details
About this role
Role overview Serve as a senior hands-on technical leader for distributed data systems and enterprise deployments. The work combines deep engineering in Spark and JVM-based systems with customer architecture, performance tuning and practical integration into complex data estates. You will also raise engineering standards and help the team build expertise in distributed systems.
Responsibilities - Lead architecture and hands-on engineering for customer implementations, including integration, performance tuning and deployment within network, identity and security constraints. - Advise customer architecture teams and systems-integration partners through technical design, workshops and escalations. - Use deployment experience to identify recurring product obstacles and drive platform improvements. - Set expectations for design and code review, performance, reliability, incident response and root-cause analysis. - Mentor engineers and strengthen the team’s capability in Spark internals and distributed systems.
Requirements - At least 10 years of software development experience, with a record of remaining hands-on. - Deep Apache Spark expertise, including internals, execution, query planning and tuning at scale. - Strong JVM engineering skills, ideally in Scala; experienced Java or Kotlin engineers willing to work in Scala are also considered. - Data-platform experience in product engineering or substantial customer-side implementations; experience with Databricks is especially valued. - Experience with Kubernetes, Linux, containerized distribution, upgrades and releases, and enterprise identity integrations such as Entra ID, Active Directory, LDAP or Kerberos. - Strong SQL and query-performance skills, customer-facing technical judgment, Australian work rights and comfort working in a distributed team.
Nice to have - Experience with on-premises, air-gapped or otherwise restricted deployments; regulated industries; query federation or data virtualization; heterogeneous data connectors; partner-led delivery; governance and fine-grained access controls; or applying LLMs and machine learning to data-platform problems. - Open-source contributions to Spark or related projects.
Benefits and work setup - Remote-first work from anywhere in Australia, with travel to customer or partner sites when useful. - Professional development funding, conference attendance and support for open-source contributions. - Competitive salary and equity are offered; the position is full time.