Talent.com
No longer accepting applications
Cloud Data Engineer

Cloud Data Engineer

TennecoRybnik, Górnośląsko-Zagłębiowska Metropolia, Polska
1 day ago
Job description

Job Responsibilities

  • Design, develop, and maintain ETL processes using AWS analytics services for extracting, transforming, and loading data from various sources into our data lake and data warehouse.
  • Collaborate with cross-functional teams to understand data requirements, identify data sources, and implement solutions for data ingestion and integration.
  • Support data & ETL migrations from On-prem to Cloud platforms.
  • Develop custom transformations and data pipelines using PySpark and Python as needed.
  • Ensure data quality and integrity throughout the ETL process, implementing appropriate error handling and monitoring mechanisms.
  • Implement and enforce data governance policies and procedures within the data warehouse, ensuring compliance with regulatory requirements and industry best practices.
  • Work closely with data scientists, analysts, and business stakeholders to gather data requirements to design and implement data models, schemas, and structures, with a focus on data governance principles such as data lineage, data quality monitoring, and metadata management.
  • Expand the business intelligence and data analytics product capabilities using GenAI technology.
  • Monitor and troubleshoot data pipelines to ensure data quality, consistency, and performance.
  • Ensure data consistency, availability, and recoverability through backup and disaster recovery procedures.
  • Collaborate with stakeholders to define and document data governance standards, processes, and guidelines, and facilitate training and awareness programs as needed.
  • Continuously evaluate and implement best practices, tools, and technologies to improve data governance practices and ensure data security, privacy, and confidentiality.

What We're Looking For :

  • 8+ years’ Experience with Datawarehouse, Datalake ETL platforms.
  • 8+ years’ Experience with Data Modelling framework such as Data Vault 2.0 / Star Model / Snowflake Model.
  • 8+ years’ Experience SQL scripting including SCD1, SCD2 & SCD3 logic.
  • Expert in distributed data processing frameworks such as Spark (Core, Streaming, SQL), Storm, Flink etc.
  • 3+ years’ Experience with IAC (Infrastructure as Code) using Terraform, CloudFormation.
  • 5+ years’ Experience with AWS Cloud service e.g., AWS Glue, Athena, EMR, Firehose, Kinesis, Redshift, RDS, DMS, S3, App Flow, SQS Lambda, Airflow, Eventbridge etc.
  • 8+ years’ Experience working on some of the relational databases (Oracle / SQL Server / DB2 / PostgreSQL / MySQL, SAP Hana) on AWS and / or on-prem infrastructure.
  • 5+ years’ Experience with NoSQL solutions such as DynamoDB, Big Table, MongoDB, Cassandra.
  • 5+ years’ Experience with Python / Java / Scala programming languages.
  • 5+ years’ Experience with Business Intelligence technologies such as PowerBI, Tableau, Quick Sight.
  • 5+ years’ Experience with CI / CD pipelines on platforms such as GitHub, Azure DevOps.
  • Experienced in Hadoop eco-system with AWS cloud distribution.
  • Experienced in Big Data ingestion tools such as Sqoop, Flume, NiFI & distributed messaging and ingestion frameworks like Theobald, Kafka, Pulsar, Pub / Sub, etc.
  • Agile methodology and skill, including experience with Scrum Ceremonies and work management tools (e.g., (JIRA, Confluence, ADO).
  • Work as a cross-functional team member to support multiple work streams and products.
  • Experienced in AWS Foundation and Organizations.
  • Education and Certification :

  • Bachelor's degree in computer science, Software Engineering, Data Science and or equivalent work experience.
  • AWS Certification -Database, Data Engineer, AI / ML, AWS Certified Solutions Architect.
  • Seniority level

    Mid-Senior level

    Employment type

    Full-time

    Job function

    Information Technology and Engineering

    Industries

    Motor Vehicle Parts Manufacturing

    Location : Ostrava, Moravia-Silesia, Czechia

    #J-18808-Ljbffr

    Create a job alert for this search

    Cloud Engineer • Rybnik, Górnośląsko-Zagłębiowska Metropolia, Polska

    Related jobs
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Sii Sp. z o.o.Katowice, śląskie, Polska
    Chcesz rozwijać swoje kompetencje w technologiach chmurowych? Dołącz do naszej wyspecjalizowanej jednostki skupiającej ekspertów z dziedziny procesowania i analizy danych w ramach Centrum Kompetenc...Show moreLast updated: 30+ days ago
    • Promoted
    System Engineer (Cloud / Microsoft Stack) @ Winged IT

    System Engineer (Cloud / Microsoft Stack) @ Winged IT

    Winged ITBielsko-Biała, Polish
    Employer : International sensor company.Location : Bielsko-Biała (hybrid work : 2-4 days per month in the office).Rate : 13 000 - 17 000 PLN on UoP. Cooperation model : Employment contract.Recruitment pr...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HAVI Global Business Servicesśląskie, Katowice, Polska
    Data Engineer, Integrated Planning Analytics and Insights.Architect, design, implement, enhance, and maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cuttin...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Reply Polska Sp. z o. o.Katowice, Katowice, Polska
    Implement data-facing backend features : analyze, design, and code services that read / write Delta tables, respecting schema evolution and time travel. document APIs and data contracts.Validate feasi...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Sopra Steria Polska Sp. z o.o.Katowice, Silesian, Poland
    We are looking for a Cloud Engineer to join Sopra Steria Polska and support our client — one of the largest broadcasting and media companies in France. You will be part of a team responsible for bui...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Travcorp Poland Sp z o.o.śląskie, Katowice, Polska
    We are seeking a highly skilled and motivated Data Engineer to join our team.The ideal candidate will be strong in SQL and Python. Understand financial and operational business metrics and have exce...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SD Worx Poland Sp z o.o.śląskie, Katowice, Polska
    Drive the development of robust data pipelines and storage solutions using cutting-edge technologies, ensuring optimal performance, scalability, and security. Mentor and guide a team of Data Enginee...Show moreLast updated: 13 days ago
    • Promoted
    Cloudera Engineer

    Cloudera Engineer

    Sopra Steria Polska Sp. z o.o.Katowice, Silesian, Poland
    We are looking for Cloudera Engineer to join Sopra Steria Polska for a team that works for a client that involves providing technological and operational support for the French postal service.You w...Show moreLast updated: 4 days ago
    • Promoted
    Infrastructure Support / Data Cloud Engineer (GCP) @ IT LeasingTeam

    Infrastructure Support / Data Cloud Engineer (GCP) @ IT LeasingTeam

    IT LeasingTeamKatowice, Poland
    W ITLT pomagamy naszym zaprzyjaźnionym firmom przekształcać ambitne pomysły w cyfrową rzeczywistość.Z nastawieniem na wyzwania, ciekawość technologii i zwinność - współtworzymy wyjątkowe rozwiązani...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer with AWS and Snowflake

    Senior Data Engineer with AWS and Snowflake

    Sii Sp. z o.o.Katowice, śląskie, Polska
    Senior Data Engineer with AWS and Snowflake.We are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to des...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    Sii Sp. z o.o.śląskie, Katowice, Polska
    We are looking for an experienced Cloud Engineer to join our team.In this role, you will be responsible for implementing and maintaining our client’s cloud environment based on the Low-Level Design...Show moreLast updated: 19 hours ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Reply Polska Sp. z o. o.Katowice, Katowice, Polska
    Learn what are the key-points of a Cloud Infrastructure and the tasks behind its creation.Work with our Cloud Architects and learn how to design, implement, and provision all type of infrastructure...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Azure Cloud

    Data Engineer Azure Cloud

    in4ge sp. z o.o.Katowice, Katowice, Polska
    In4ge jest firmą rekrutacyjną, w której wierzymy, że wszystko jest możliwe dzięki odpowiednim ludziom.Naszym celem jest połączenie najbardziej utalentowanych pracowników z odpowiednimi firmami, two...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Data Engineer – Migration & Innovation (Level 4)

    Data Engineer – Migration & Innovation (Level 4)

    Cycladśląskie, Katowice, Polska
    Data Engineer – Migration & Innovation (Level 4).Lead the migration of traditional ETL workflows from on-premise systems (e. Informatica) to Azure-based data solutions.Plan, analyze and execute migr...Show moreLast updated: 19 hours ago
    • Promoted
    Mid Senior Cloud Platform Engineer Azure

    Mid Senior Cloud Platform Engineer Azure

    Reply Polska Sp. z o. o.Katowice, Katowice, Polska
    Working on migration of on-premise environment to Azure cloud.Design and implementation of CI / CD pipelines using GitLab and Azure DevOps. Ensure best practices in code structure, reusability, and se...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer with GCP

    Data Engineer with GCP

    co.brickGliwice, Gliwice, Polska
    Senior Data Engineer (GCP / BigQuery Specialist).We are looking for an experienced.Google Cloud Platform (GCP), BigQuery, Python, and SQL. You will be joining our client—an innovative.This role offers...Show moreLast updated: 14 days ago
    • Promoted
    Cloud DevOps Engineer

    Cloud DevOps Engineer

    Reply Polska Sp. z o. o.Katowice, Katowice, Polska
    Design and implement a scalable and secure API management platform using cloud-based technologies such as Azure or AWS.Implement API gateways using Terraform and Helm to manage and deploy APIs to K...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    CLOUDFIDEKatowice, Katowice, Polska
    Passionate about Cloud and data analytics.Curious and eager to learn new technologies.One that would like to work with a team of like-minded people. You will work on a project involving modern cloud...Show moreLast updated: 30+ days ago