Senior Data Engineer @ 1dea

Senior Data Engineer @ 1dea, Polska

Senior Data Engineer – AWS / Databricks / Python

Responsibilities

Design, develop and maintain data pipelines to extract data from a variety of sources and populate data lake and data warehouse; develop data transformation rules and data modelling capabilities; collaborate with Product Analysts, Data Scientists, and Machine Learning Engineers to identify and transform data to make it understandable; implement data quality checks; maintain data catalogues; use orchestration, logging, and monitoring tools; perform data analysis; implement information architecture concepts and implementation; use Git for version control and understand various branching strategies; apply test‑driven development methodology when building ELT / ETL pipelines.

Qualifications

• Minimum 5 years of relevant experience.
• Solid experience with AWS services (S3, IAM, Redshift, SageMaker, Glue, Lambda, Step Functions, CloudWatch).
• Experience with platforms such as Databricks and Dataiku.
• Proficient in Python / Java and SQL – Redshift preferred.
• Experience with Jenkins, CloudFormation, Terraform, Git, Docker, and 2‑3 years of Spark – PySpark.
• Good communication and SDLC documentation skills.
• Familiarity with establishing data quality checks and maintaining data catalogues.

Requirements : AWS, Databricks, Python, SQL. Additionally : International projects.

#J-18808-Ljbffr