Senior Data Engineer
Miejsce pracy : Gdańsk
Technologies we use
Expected
- Python
- Docker
- Kubernetes
- Apache Spark
- Apache Airflow
- PostgreSQL
- MongoDB
- BigQuery
- Cassandra
About the project
You will design and maintain robust data solutions to process and analyze vast amounts of data.
Collaborate with cross-functional teams to optimize cloud-native data architectures and pipelines.
Your responsibilities
Design, build, and maintain robust data ingestion and processing pipelines for large-scale dataCollaborate with product teams to deliver comprehensive data solutions that meet business requirementsDevelop and manage data warehouses, marts, and aggregations that offer deep insights into customer and product behaviorImplement real-time monitoring and alerting for pipeline performance and reliabilityDocument key data assets, KPIs, and metrics to promote knowledge sharing and transparencyContinuously improve the cloud-native data architecture for greater scalability and efficiencyOur requirements
5+ years in a similar roleProficiency in building scalable systems using Python, Docker, KubernetesExperience with big data pipelines using tools like Apache Spark, Dataflow, and orchestration with Apache AirflowSkilled in designing DataMarts and managing complex data pipelines to meet business needsStrong in data modeling, SQL, and distributed NoSQL databases such as Postgres, MongoDB, BigQuery, CassandraExperience with BI tools and reporting frameworksAgile development experience in cross-functional, distributed teamsEnglish fluency at B2–C1 levelThis is how we organize our work
This is how we work
at the client's sitescrumWhat we offer
50% KUP (CoE)Annual bonus (CoE)Benefits
private medical careI consent to the processing of my personal data for the purposes of current and future recruitment processes carried out by Develocraft sp. z o.o. in accordance with the provisions of : Regulation (EU) 2016 / 679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95 / 46 / EC (General Data Protection Regulation „GDPR”) and art. 22 1 of the Labor Code.