Ta oferta pracy nie jest dostępna w Twoim kraju.

Data Engineer @ AVENGA (Agencja Pracy, nr KRAZ : 8448)

AVENGA (Agencja Pracy, nr KRAZ : 8448)Remote, Poland

8 dni temu

Opis pracy

2+ years of experience as a Data Engineer, focusing on data pipelines and transformations.

1+ year of hands-on Python experience, especially using Pandas .

2+ years working with SQL and relational databases.

Experience with dbt for transformations and Git / GitLab CI / CD for versioning and automation.

Understanding of data modeling , ETL concepts, and data warehouse design.

Familiarity with cloud platforms (GCP, AWS, Azure – GCP preferred but optional).

Experience with different types of storage systems : filesystem, relational, MPP, NoSQL.

Good knowledge of DevOps tools (e.g., Docker, Jenkins, Terraform) and Unix / Linux systems .

Nice to Have

Experience with real-time streaming, data quality frameworks, and distributed systems.
Exposure to open-source or proprietary tools like Airflow , Glue , or Dataflow .
Very good understanding of Gitflow development process.

Design, build, and maintain robust data pipelines and ETL / ELT processes., Work with Python (especially Pandas) and SQL to transform and process structured and unstructured data., Use dbt and GitLab for data transformations and version control / CI / CD workflows., Collaborate with analysts, data scientists, and engineers to deliver clean, high-quality data., Ensure best practices in data architecture, documentation, and metadata management., Work with Snowflake for scalable data warehousing (warehouses, schemas, access control)., Maintain workflows using tools like Airflow, Glue, or Dataflow (optional but a plus).] Requirements : Python, SQL, dbt, Cloud Additionally : Sport subscription, Training budget, Private healthcare, International projects.

Utwórz powiadomienie o ofertach pracy dla tego wyszukiwania

Data Engineer • Remote, Poland