Talent.com
GenAI Azure Data Engineer

GenAI Azure Data Engineer

PragmileWarszawa, Masovian, Poland
10 days ago
Job description

technologies-expected :

  • Python
  • SQL
  • Terraform
  • PySpark
  • CI / CD
  • Azure Services

about-project :

  • We are looking for an experienced Data Engineer / Data Architect to lead the design, development, and optimization of enterprise-scale data solutions on Microsoft Azure, with additional expertise in Google Cloud Platform (GCP). This is a hands-on individual contributor role focused on building scalable and efficient data platforms, developing complex ETL / ELT pipelines, and enabling seamless multi-cloud integration. The ideal candidate combines strong technical depth with practical experience in data architecture, governance, and automation (CI / CD) within large-scale enterprise environments.

    • responsibilities :

  • Azure-Centric Data Engineering
  • Design and deploy Azure data platforms :
  • Data Lakes : Azure Data Lake Storage (ADLS Gen2) with Delta Lake optimizations.
  • ETL / ELT : Azure Data Factory, Synapse Analytics, and Databricks workflows.
  • Data Warehousing : Synapse Dedicated Pools, Azure SQL DB.
  • Optimize Spark workloads (e.g. Azure Databricks) for performance tuning (partitioning, caching).
  • Implement real-time pipelines : Azure Event Hubs, Stream Analytics, and IoT Hub integrations.
  • Ensure data governance :
  • Enforce data quality with Azure Purview (lineage tracking, sensitivity labeling).
  • Implement RBAC and Azure Active Directory (AAD) integration for secure access.
  • Build real-time analytics pipelines :
  • Process streaming data via Azure Event Hubs / Stream Analytics with windowing and watermarking strategies.
  • Operational Excellence
  • Automate CI / CD pipelines.
  • Lead disaster recovery (DR)
  • Manage data lifecycle

    • requirements-expected :

  • Core Azure Expertise
  • Advanced SQL, PySpark, and Python.
  • Infrastructure-as-Code (Terraform, ARM / Bicep).
  • Performance tuning (partitioning, indexing, query optimization).
  • Azure Services :
  • Data Factory (ADF), Synapse, Databricks, Cosmos DB.
  • DevOps (Azure Pipelines, Repos), Monitor, and Security Center.
  • GCP Proficiency (nice to have) :
  • BigQuery (partitioned tables, materialized views).
  • Cloud Storage, Dataflow, Pub / Sub.
  • IAM and VPC networking.
  • Looker, Dataproc, Composer (Airflow).

    • offered :

  • Opportunity to lead end-to-end design of advanced, enterprise-scale data platforms in Azure and multi-cloud environments.
  • Work with modern technologies (Azure, Databricks, Terraform, GCP) in a highly technical, hands-on role.
  • Supportive, growth-oriented environment with opportunities for certification and continuous learning.
  • A training budget to support your technical and professional development
  • Private medical care and co-financing of a sports card
  • Flexible working hours and the option to work fully remotely

    • benefits :

  • sharing the costs of sports activities
  • private medical care
  • sharing the costs of foreign language classes
  • sharing the costs of professional training & courses
  • remote work opportunities
  • flexible working time
  • integration events
    • Create a job alert for this search

    Data Engineer Azure • Warszawa, Masovian, Poland