Remote job
Senior Data Engineer, Event Data
Job details
About this role
Role overview Build and operate the data systems that collect, process, and serve high volumes of event data for products and internal teams. This role offers the chance to shape streaming architecture, improve availability and speed, and help migrate older pipelines while keeping downstream users supported.
Responsibilities - Create and maintain streaming pipelines that bring in events from client systems, internal services, and external sources. - Develop analytical data models and databases for high-volume queries and low-latency access. - Build production services in Elixir and Python to process, transform, and route events. - Plan and carry out migrations from legacy pipelines to newer streaming systems while limiting disruption to consumers. - Define event schemas, data contracts, and quality practices with teams that produce and use the data. - Track pipeline health, freshness, and service commitments using monitoring, alerts, dashboards, and runbooks. - Work with platform, product engineering, and analytics colleagues on data needs, system design, and shared engineering practices.
Requirements - Six or more years in data engineering or backend/systems engineering, including substantial work with streaming or event-driven systems. - Strong Elixir and/or Python skills for building services, connectors, and pipeline components. - Advanced SQL and production experience with columnar or OLAP databases. - Experience with stream processing and brokers such as Flink, Kafka, Pulsar, or Kinesis. - Ability to integrate systems and migrate data pipelines, with a track record of production monitoring, alerting, service dashboards, and runbooks. - Experience operating data systems in AWS; familiarity with infrastructure-as-code tools such as Terraform or CloudFormation. - Clear communication skills for technical specifications, design discussions, and work across teams.
Nice to have - Apache Flink, Databricks, GCP, or retail event data experience, such as clickstream, purchases, or product interactions.
Benefits and work setup - The listed base salary range is CAD $145,000–$185,000, with a possible bonus and a range of medical, financial, and other benefits. The offer may vary with relevant skills and experience.