Remote job
Senior Data Engineer - MongoDB and PostgreSQL
Job details
About this role
Role overview The Senior Data Engineer builds and operates a near real-time transactional cache that gives APIs, applications, and digital experiences scalable access to operational data outside a legacy source platform. The role covers data replication, transformation, database modeling, performance, and production reliability across PostgreSQL, MongoDB Atlas, and cloud services.
Responsibilities - Design and support the transactional cache platform and change data capture pipelines that replicate source data into PostgreSQL. - Transform relational operational data into MongoDB document models suited to API and application use. - Develop indexing, partitioning, and query strategies for high-throughput, low-latency workloads. - Work with API and application teams to define cache-ready data models that meet performance and scaling needs. - Monitor data freshness, latency, availability, and reliability; troubleshoot incidents and take part in root cause analysis. - Maintain runbooks, dashboards, alerts, and support procedures; contribute to code reviews, documentation, engineering practices, and mentoring.
Requirements - At least five years of data engineering, software engineering, or data platform development experience, including three or more years with enterprise-scale platforms or distributed systems. - Strong MongoDB Atlas and PostgreSQL skills, including data modeling, aggregation, index design, and performance optimization. - Experience with change data capture, replication, near real-time data movement, and operational data stores or API-serving platforms. - Strong Python and SQL skills, plus production ETL/ELT pipeline experience. - Experience with GCP services such as Cloud SQL, Dataproc Serverless, Cloud Composer, Monitoring, IAM, and cloud networking fundamentals. - Linux/Unix experience and the ability to diagnose distributed processing and data synchronization issues.
Nice to have Kafka, Pub/Sub, or other event-driven systems; API and microservice data platforms; Terraform or other infrastructure as code; GKE or Kubernetes; highly available, low-latency platform design; large-enterprise Agile or SAFe experience; healthcare or AWS experience; and AWS or GCP certifications. A bachelor’s degree or equivalent experience is required. Eastern Time working hours are preferred.