Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

MDPIBasel (Europe) • Kraków
20 days ago
Job description

Become a key player in our data engineering team and help us build the foundation of our data-driven success!

As a Senior Data Engineer, you will play a critical role in designing, developing, and optimizing our data infrastructure. You will work closely with a team of data engineers, under the leadership of our Data Architect, to ensure data quality, scalability, and efficiency across the organization. Your technical expertise and problem-solving skills will be vital in shaping our data landscape.

This is a fully in-office role based in Kraków

Key responsibilities :

  • Data Infrastructure Development : Contribute to the design and implementation of data lakes, data warehouses, and ETL / ELT pipelines.
  • Data Modeling : Develop and maintain data models to support the efficient storage and retrieval of data.
  • Data Orchestration and DataOps : Implement and optimize data pipelines, ensuring seamless data flow and processing.
  • Data Acquisition : Integrate and process data from multiple sources, ensuring consistency and accuracy.
  • Monitoring and Maintenance : Develop and implement monitoring systems to ensure data quality and availability.
  • Collaboration : Work closely with the Data Architect and other team members to ensure alignment on technical strategies and project goals. Work effectively within a diverse, international team spread across Switzerland, Serbia, and China.
  • Optimization : Continuously seek to improve the performance, scalability, and reliability of the data infrastructure.

Required Hard Skills :

  • University degree, ideally a Masters in Computer Science or related science, technology or engineering field.
  • 5+ years of relevant work experience in data engineering roles.
  • Proven experience in data acquisition, laking, warehousing, modeling, and orchestration.
  • Strong knowledge of common columnar file formats used in data applications.
  • Expertise in data partitioning and incremental scalability.
  • Expertise in data quality and data governance.
  • Advanced skills in SQL (including window functions and CTE).
  • Proficiency in RDBMS MySQL, PostgreSQL).
  • Strong programming skills in Python (with libraries like Polars, optionally Arrow / PyArrow APIf).
  • Experience with OLAP query engines Clickhouse, DuckDB, Apache Spark).
  • Experience with Apache Airflow (or similar tools like Dagster or Prefect).

    • Good to Have :

  • Experience in entity disambiguation.
  • Familiarity with orchestration and containerization technologies Docker, Kubernetes).
  • Knowledge of Linux (Ubuntu / Debian).
  • Experience with Git and Atlassian tools (Jira, Confluence).
  • Knowledge of dbt.
  • Understanding of graph databases neo4j).

    • Required Soft Skills :

  • Strong teamwork and communication skills.
  • Ability to work independently and manage your time effectively.
  • Comfortable working in a diverse, international environment.

    • Why Join Us?

  • Be part of a dynamic and innovative team at the forefront of data technology.
  • Opportunity to shape a new team, driving impactful projects.
  • Work in a collaborative environment that values creativity and diversity.
  • Competitive salary.
  • Private medical care (fully covered).
  • MultiSport card (partially covered).
  • Team building activities.

    • Li-Onsite

    Create a job alert for this search

    Senior Data Engineer • Basel (Europe) · Kraków