Architect

Role overview

Set the technical direction for a large scale data platform undergoing changes in storage formats, analytics, privacy expectations, and AI workloads. You’ll shape a multi-year architecture spanning lake and lakehouse systems, analytical and search engines, governance, and shared operating practices. The role works across teams to establish standards, guide migrations, and improve reliability, cost, and performance at petabyte scale.

Responsibilities

- Define a coherent platform architecture across data lakes and lakehouses, ClickHouse, Elasticsearch, and governance, including when each engine fits and how systems should evolve. - Document major decisions on storage formats, catalogs, compute, tenancy, data placement, and build-versus-adopt choices, accounting for cost and performance. - Set reference designs for deployment, scaling, tuning, capacity, tenant isolation, and upgrades of shared storage and query systems. - Establish reliability practices for availability, failure domains, disaster recovery, observability, and incident response. - Design privacy and compliance capabilities across storage, backups, and derived data, including deletion, retention, residency, and personal data classification. - Guide catalog, metadata, lineage, access control, data contracts, and quality standards; review technical direction and resolve difficult distributed systems or performance issues. - Mentor senior engineers and partner with product, security, infrastructure, and consuming teams on platform roadmaps and adoption decisions. - Evaluate emerging approaches through prototypes or benchmarks before recommending changes.

Requirements

- Bachelor’s or master’s degree in computer science, engineering, or a related field, or equivalent practical experience. - 15 or more years in software development or a related field, including at least eight years in architecture or senior technical leadership. - Track record setting strategy and delivering large scale data platforms on cloud infrastructure, using Kubernetes, Terraform, and Helm. - Deep knowledge of analytical storage and compute, including columnar and open table formats, lakehouse architecture, partitioning, indexing, and query planning at petabyte scale. - Hands-on depth in at least two areas: analytical engines such as ClickHouse, search systems such as Elasticsearch or OpenSearch, or lake and distributed processing engines such as Spark, Trino, or Flink. - Experience with data governance and privacy, including catalogs and metadata, lineage, access control, retention, deletion, and compliance requirements. - Ability to set direction across organizational boundaries, communicate tradeoffs, and mentor experienced engineers.

Nice to have

- Experience with catalog systems such as Glue, Unity Catalog, Polaris, or DataHub, and open table format catalog strategies. - Platform migrations across domains or ownership models, measurable cost optimization, or network security expertise.

Benefits and work setup

- Remote role based in the United States, with occasional travel for project or team meetings. - Pay, equity or bonus eligibility, healthcare, retirement savings, and paid leave vary by location.