Cloud Data Engineer

1 day ago Be among the first 25 applicants

Responsibilities

• Design, develop, and maintain ETL processes using AWS analytics services for extracting, transforming, and loading data from various sources into our data lake and data warehouse.
• Collaborate with cross‑functional teams to understand data requirements, identify data sources, and implement solutions for data ingestion and integration.
• Support data & ETL migrations from On‑prem to Cloud platforms.
• Develop custom transformations and data pipelines using PySpark and Python as needed.
• Ensure data quality and integrity throughout the ETL process, implementing appropriate error handling and monitoring mechanisms.
• Implement and enforce data governance policies and procedures within the data warehouse, ensuring compliance with regulatory requirements and industry best practices.
• Work closely with data scientists, analysts, and business stakeholders to gather data requirements to design and implement data models, schemas, and structures, with a focus on data governance principles such as data lineage, data quality monitoring, and metadata management.
• Expand the business intelligence and data analytics product capabilities using GenAI technology.
• Monitor and troubleshoot data pipelines to ensure data quality, consistency, and performance.
• Ensure data consistency, availability, and recoverability through backup and disaster recovery procedures.
• Collaborate with stakeholders to define and document data governance standards, processes, and guidelines, and facilitate training and awareness programs as needed.
• Continuously evaluate and implement best practices, tools, and technologies to improve data governance practices and ensure data security, privacy, and confidentiality.

What We’re Looking For

Education and Certifications

#J-18808-Ljbffr