Data Engineer with Pyspark

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Capgemini

Data Engineer with Pyspark

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Overview

Capgemini is hiring a Data Engineer with PySpark. This role focuses on building scalable data pipelines, transforming large datasets, and ensuring data quality across distributed environments.

Responsibilities

• Design and implement robust data pipelines using PySpark.
• Process and transform large datasets efficiently in distributed environments.
• Collaborate with data architects and analysts to deliver high-quality data solutions.
• Ensure data quality, consistency, and performance across systems.
• Participate in code reviews and contribute to technical improvements.

Qualifications

• Hands-on experience in data engineering and can independently handle moderately complex tasks.
• Proficiency in PySpark and understanding of distributed data processing.
• Comfort with Python for data transformation and automation.
• Experience with relational and/or NoSQL databases.
• Clear and effective English communication.

Nice to Have

• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Solid SQL skills and understanding of data modeling.
• Experience with orchestration tools (e.g., Airflow, Prefect).
• Exposure to CI/CD pipelines and DevOps practices.
• Knowledge of streaming technologies (e.g., Kafka, Spark Streaming).
• Experience working with Databricks in production or development environments.
• Relevant certifications in data engineering or big data technologies.

What you’ll love about working here

• Access to over 70 training tracks with certification opportunities on our NEXT platform, plus access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
• Cutting-Edge Technology: Work with the latest technologies and platforms as Capgemini partners with top global enterprises.
• Community Hub with over 20 professional communities (e.g., Salesforce, Java, Cloud, IoT, Agile, AI).
• Well-being culture: medical care with Medicover, private life insurance, Multisport card, and Capgemini Helpline for therapeutic support; educational podcast "Let’s talk about wellbeing" on Spotify.

Get to know us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.

Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on TikTok — @capgeminipl.

About Capgemini

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided every day by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members globally in more than 50 countries. With its 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving cloud, data, AI, connectivity, software, digital engineering and platforms.

Referrals increase your chances of interviewing at Capgemini by 2x

Get notified about new Data Engineer jobs in Gdansk Metropolitan Area .

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr