Remote job
Senior Data Engineer
Job details
About this role
Role overview Build and operate large-scale data pipelines that bring information from multiple sources into cloud analytics platforms. The work spans data integration, batch processing, orchestration, modeling, and performance improvement, with close collaboration across teams to deliver dependable data products.
Responsibilities - Develop and maintain ETL/ELT pipelines integrating cloud platforms, a data warehouse, SaaS services, and APIs. - Build and tune hourly and daily incremental batch loads across datasets ranging from tens of millions of rows to hundreds of gigabytes or more. - Orchestrate workflows using Airflow or a comparable tool, and design scalable analytical data models. - Add automated data quality checks, tests, monitoring, and alerts; improve pipeline reliability and query performance. - Apply version control, automation, and CI/CD practices, and use AI-assisted development tools for coding, debugging, and documentation. - Coordinate with partner teams to deliver and maintain scalable data solutions.
Requirements - A bachelor’s degree and at least five years of related experience, or a master’s degree and at least three years. - Strong SQL and experience with relational and NoSQL databases; proficiency in Python, Java, or Scala. - Hands-on Snowflake experience and familiarity with AWS cloud data platforms and modern warehouses or lakehouses. - Experience with Airflow or similar orchestration tools, data modeling, ETL/ELT, and large-scale distributed or batch processing. - Ability to integrate data from multiple sources and improve pipeline quality, reliability, monitoring, and performance. - Experience using AI-assisted development tools.
Nice to have - Salesforce-to-warehouse integrations, including API limits, incremental extraction, and deleted-record handling. - Streaming tools such as Kafka; dbt, data catalogs, observability tools, ML pipelines, or feature stores. - Terraform or Kubernetes experience, or work in marketplaces, search, advertising, or recommendation systems.
Benefits and work setup - Remote role open to candidates in Costa Rica, Peru, Colombia, or Bolivia.