Remote job
Senior Data Engineer
Job details
About this role
Role overview
Build and improve a cloud data platform, with responsibility for reliable pipelines, warehouse models, and the engineering practices that support them. The role combines hands-on Python development with technical input on architecture, data quality, governance, and operational performance.
Responsibilities
- Design and maintain scalable workflows using Airflow on AWS MWAA, including custom orchestration and integrations with external APIs and SDKs. - Develop production Python code for data processing, with attention to error handling, testing, and maintainability. - Evolve Snowflake warehouse models and implement data transformations with dbt. - Manage infrastructure through Terraform and maintain CI/CD for pipelines and models. - Establish monitoring and automated checks for data quality and reliability, using tools such as Grafana and CloudWatch. - Apply governance practices for data cataloging, lineage, and access; improve cost and performance across the platform.
Requirements
- Production experience as a data engineer, including advanced Python development and T-SQL query tuning. - Experience with Snowflake, dbt, and data modeling. - Proficiency with AWS services, particularly S3, Lambda, EMR, and ECS. - Experience with Terraform or a comparable infrastructure-as-code tool, plus familiarity with Docker and continuous delivery. - Knowledge of data governance, observability, and monitoring practices. - Ability to contribute to architecture and engineering standards while building and operating production systems.
Nice to have
- Apache Spark or PySpark experience; familiarity with LLMs, agentic AI, or AWS Bedrock. - Exposure to additional AWS services, InfluxDB, OpenSearch, data catalog or quality tools, or Azure DevOps. - Knowledge of cloud cost optimization and FinOps practices.
Benefits and work setup
- Remote role based in Brazil.