Remote job
Data Engineer, Event Data
Job details
About this role
Role overview Develop the systems that ingest, process, and serve high volumes of client and internal event data. You’ll help shape the architecture for this data domain, building streaming services and analytical models that improve data speed, reliability, and availability for teams and downstream users.
Responsibilities - Build and maintain streaming pipelines that ingest events from client systems, internal services, and third-party sources. - Develop analytical databases and data models for high-volume queries and low-latency access. - Write production services in Elixir and Python to process, transform, and route events. - Plan migrations from legacy pipelines to modern streaming infrastructure while limiting disruption to downstream users. - Create monitoring and alerting for pipeline health, data freshness, and service-level targets. - Define event schemas, data contracts, and quality standards with teams that produce and consume the data. - Collaborate on data product needs, system design reviews, and team engineering practices.
Requirements - Strong proficiency in Elixir and/or Python for connectors, data services, or pipeline components. - Advanced SQL skills for modeling, query tuning, and analytics workloads. - Experience with production-scale columnar or OLAP databases and stream processing systems or brokers. - Ability to integrate and migrate systems across legacy and modern architectures. - Experience operating data pipelines, including monitoring, alerting, service-level dashboards, and runbooks. - Experience designing and running data systems on AWS, using infrastructure-as-code tools, and working across teams through design discussions and technical specifications.
Nice to have - Familiarity with Flink, Kafka, Pulsar, Kinesis, Databricks, GCP, or retail event data such as clickstream, purchases, or product interactions.
Benefits and work setup - Listed base pay is $130,000–$165,000 CAD; the offer may vary with relevant skills and experience, and may include a bonus. - Medical, financial, and other benefits are available.