Talent.com
This job offer is not available in your country.
Data Engineer with banking

Data Engineer with banking

EYWrocław, DS, PL
30+ days ago
Job description

The opportunity

As a Data Engineer, You will be responsible for the creation, schedule and optimization of the data processing pipelines using Apache Spark and Apache Airflow deployed on our data analytics platform.

The Data Engineer will support our software developers, architects, and DevOps team on data initiatives. Ability to work in an Agile / Scrum model.

Your key responsibilities

  • Create, build and deploy data pipelines that clean and process data for analysis
  • Build reusable component pipelines that can be assembled for more complex pipelines
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
  • Work with structured and unstructured data sets
  • Work with QA to develop an automation test strategy for data pipelines that aligns with the platform’s architecture

Skills and attributes for success

  • Minimum 7 years hands-on experience building complex data pipelines
  • Strong experience in data processing and optimization using Apache Spark
  • Good knowledge of data manipulation and transformation
  • Experience with Apache Airflow, Python, SQL
  • Deployment and provisioning automation tools (, Docker, Kubernetes, CI / CD)
  • Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (S3 / Spark and / or Kafka / Flink)
  • Hands-on experience in training and evaluating ML models
  • Experience with Golang
  • Experience with monitoring and observability (ELK stack)
  • Bash scripting and Linux systems
  • Experience with buildpacks
  • Security, authentication, and authorisation (LDAP / Kerberos / PAM)
  • Experience working in cloud environment (, GCP)
  • Ideally, you’ll also have

  • Experience with data warehousing solutions
  • Knowledge of big data tools and technologies
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration skills
  • Ability to work independently and as part of a team
  • What we offer

    EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across ten locations – Argentina, China, Hungary, India, the Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom – and with teams from all EY service lines, geographies and sectors, playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants, we offer a wide variety of fulfilling career opportunities that span all business disciplines. In GDS, you will collaborate with EY teams on exciting projects and work with well-known brands from across the globe. We’ll introduce you to an ever-expanding ecosystem of people, learning, skills and insights that will stay with you throughout your career.

  • Continuous learning :   You’ll develop the mindset and skills to navigate whatever comes next.
  • Success as defined by you :   We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
  • Transformative leadership :   We’ll give you the insights, coaching and confidence to be the leader the world needs.
  • Diverse and inclusive culture :   You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
  • About EY

    EY | Building a better working world

    Create a job alert for this search

    Data Engineer • Wrocław, DS, PL

    Related jobs
    • Promoted
    • New!
    Senior GCP Data Engineer with Airflow

    Senior GCP Data Engineer with Airflow

    Xebia sp. z o.o.Wrocław, Lower Silesia, Poland
    As a Senior Data Engineer at Xebia, you will work closely with engineering, product, and data teams to deliver our clients scalable and robust data solutions. Your key responsibilities will include ...Show moreLast updated: 16 hours ago
    Data Engineer

    Data Engineer

    Next Technology ProfessionalsCentrum, Wrocław
    Dla naszego klienta poszukujemy kandydatów na stanowisko : .Projekt : dla firmy z branży FinTech.Stack technologiczny : Python, AWS, Terraform, K8S. Zespół : nbsp;5 osób (międzynarodowy zespół).Model wspó...Show moreLast updated: 26 days ago
    Data Architect with AWS

    Data Architect with AWS

    UPVANTA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄWrocław, dolnośląskie, Polska
    Dołącz do zespołu realizującego ambitne projekty w środowisku enterprise dla międzynarodowego klienta z sektora doradczego. Poszukujemy doświadczonego Data Architecta ze znajomością chmury AWS, któr...Show moreLast updated: 10 days ago
    Senior Data Engineer

    Senior Data Engineer

    SigmoidalWrocław, Polska
    Chcesz pracować nad projektami, które mają realny wpływ na biznes i wprowadzać rozwiązania kształtujące rynek? W.AI i Data Science, które pomagają firmom w takich branżach jak farmacja, fintech czy...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    UBSWrocław, Poland
    Do you have passion for reliability, scalability and performance in software?.Do you want to design and build the next generation business applications using evolutionary architectures?.Are you con...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    NATEK POLANDWrocław, Lower Silesia, Poland
    Opportunity to work on a modern project focused on customer data processing and.Machine Learning, with access to the latest cloud and analytical. Possibility to grow towards ML Engineering and MLOps...Show moreLast updated: 14 days ago
    Senior Data Engineer with AWS and Snowflake @ Sii Polska

    Senior Data Engineer with AWS and Snowflake @ Sii Polska

    Sii PolskaWrocław, Poland
    We are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines an...Show moreLast updated: 30+ days ago
    Data Engineer SQL

    Data Engineer SQL

    AIDA RecruitmentWrocław, Poland
    We are AIDA Recruitment, a technology and artificial intelligence-based employee search.We are seeking a highly skilled.The ideal candidate will be responsible for developing data pipelines, prepa...Show moreLast updated: 14 days ago
    Data Analytics Engineer / Data Analyst

    Data Analytics Engineer / Data Analyst

    Piwik PROWrocław, Polska
    Data Analytics Engineer / Data Analyst.Location : [Wrocław / Remote / Hybrid].We are looking for a seasoned Data Analytics Engineer with a strong analytical mindset and proven experience in transfor...Show moreLast updated: 5 days ago
    Data Engineer with Snowflake and DBT

    Data Engineer with Snowflake and DBT

    Holisticon InsightWrocław, Polska
    Swedish-based leading provider of transport solutions.In the role of Data Engineer, you will.BI and analytics tool in the Finance Department. You might be the perfect match if you possess the follow...Show moreLast updated: 30+ days ago
    Senior Data Engineer with Snowflake @ N-iX

    Senior Data Engineer with Snowflake @ N-iX

    N-iXWrocław, Poland
    Join an exciting journey to create a greenfield, cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from...Show moreLast updated: 8 days ago
    Data Scientist with French

    Data Scientist with French

    EY (dawniej Ernst & Young)Wrocław, Polska
    We are looking for a top-notch technology savvy specialists willing to move our projects on the new track! You will use the most advanced technology stack and have an opportunity to implement new s...Show moreLast updated: 30+ days ago
    Data Scientist with NLP

    Data Scientist with NLP

    LiveChatWrocław, Lower Silesia Poland
    Well email you when this position is available again.Join us and get a chance to work with data from over 38, businesses using the LiveChat app to communicate with customers.You will be working in ...Show moreLast updated: 30+ days ago
    GCP Data Engineer

    GCP Data Engineer

    Groupe SIIWroclaw, poland
    Join one of the largest financial organizations in the world as a Data Engineer.As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to de...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    ITL PolandWroclaw, Poland
    Job description Role : Data EngineerLocation : PolandType of work : remoteResponsibilities : Design, develop, and maintain scalable data pipelines using Python, ADF, and Databricks Implement ETL proces...Show moreLast updated: 17 days ago
    Data Engineer

    Data Engineer

    EpamWroclaw, Poland
    EPAM Data Competency Center and grow professionally by participating in a project for a technological giant.Our work involves close collaboration with clients, understanding business needs, providi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer with Python

    Data Engineer with Python

    Sii Sp. z o.o.Wrocław, Lower Silesia, Poland
    We are looking for a Senior Data Engineer who is not merely familiar with Google Cloud Platform and data engineering concepts through adjacent development or integration tasks, but someone who trul...Show moreLast updated: 30+ days ago
    Junior Banking Services Specialist with German

    Junior Banking Services Specialist with German

    DXC TechnologyWROCLAW,DS,POL
    DXC Technology (NYSE : DXC) - where brilliant people embrace change and seize opportunities to advance their careers and amplify customer success. We live in more than 70 countries, speak multiple lan...Show moreLast updated: 30+ days ago