Remote job
Senior Data Platform Engineer
Job details
About this role
Role overview Build and operate production-grade data platforms spanning ingestion, transformation, orchestration, storage-facing services, and APIs. The role combines hands-on data engineering with infrastructure automation, observability, security, and reliability practices. You will help make pipelines resilient, testable, and useful to product, engineering, and analytics teams.
Responsibilities - Design and operate batch and change-driven pipelines, including scheduling, orchestration, schema evolution, retries, and failure recovery. - Build tested transformation and merge processes, create consumable data models, and improve SQL performance. - Develop or support APIs with well-defined contracts, authentication, validation, idempotency, and auditability. - Provision and manage cloud resources with Terraform, automate delivery through CI/CD, and write shell scripts for operational tasks. - Instrument services and pipelines with logs, metrics, and traces; define alerts, runbooks, and service-level objectives. - Apply least-privilege access, secrets management, encryption, automated tests, and data-quality checks across the platform.
Requirements - At least seven years of experience in data engineering, backend engineering, or DevOps. - Strong SQL skills, including tuning, indexing, query plans, and relational database fundamentals. - Proficiency with Python for data or service development and with Bash or PowerShell scripting. - Experience with Terraform, infrastructure as code, CI/CD, and production operations. - Strong Azure experience preferred; substantial AWS experience is also acceptable. - Clear written and verbal communication, including the ability to document data contracts, mappings, runbooks, and technical decisions.
Nice to have - Awareness of data protection or public-sector compliance requirements. - Experience with dimensional modeling, BI consumption patterns, streaming or message queues, Parquet, monitoring platforms, or data governance. - Exposure to simple operational interfaces or broader data-platform architecture. - Effective, judicious use of AI coding tools alongside independent coding and testing.
Benefits and work setup - Remote contract engagement, with preference for candidates in India or Latin America. - Expected duration of at least 12 months, with possible extension or transition to full-time work. - Flexible schedule with agreed overlap and on-call windows across time zones. - Opportunity for production ownership and hands-on work with cloud, Terraform, orchestration, and modern data-platform tooling.