Remote job
Data Engineer
Job details
About this role
Role overview Build and maintain data pipelines and infrastructure that deliver dependable data for analysis and other business needs. The role covers end-to-end data solutions, from integrating diverse inputs and creating storage systems to validating data quality and supporting delivery in an Agile team.
Responsibilities - Design, develop, and maintain scalable ETL pipelines for data from multiple sources. - Build and optimize data lakes and warehouses for efficient storage, retrieval, and processing. - Combine structured and unstructured data from internal and external systems into usable datasets. - Validate, cleanse, and transform data to improve accuracy, consistency, and completeness. - Document data processes, tools, and systems, and contribute to effective working practices. - Gather requirements with product managers and other stakeholders, then translate them into technical solutions. - Test and debug software, write unit and integration tests, and address defects and performance bottlenecks.
Requirements - Ability to design and maintain data pipelines and work with data from varied sources. - Understanding of data lakes, warehouses, and efficient data processing and retrieval. - Attention to data validation, cleansing, quality, and documentation. - Ability to gather business needs and turn them into technical recommendations or implementations. - Experience working with Agile teams and adapting to changing priorities. - Ability to write and run unit and integration tests and troubleshoot reliability, security, and performance issues.
Benefits and work setup - The role is listed as remote in India.