Czym będziesz się zajmować?
- Design, implement, and maintain large-scale distributed data processing systems using Hadoop, Spark, and related technologies
- Develop scalable and efficient data pipelines using Scala, Spark, Hive, and SQL
- Work with Google Cloud Platform (GCP) services for data ingestion, transformation, storage, and orchestration
- Migrate and process data using GCP tools such as BigQuery, Dataflow, Dataproc, Cloud Storage, Pub / Sub, and Composer (Airflow).
- Collaborate with architects and development teams to define technically sound and scalable solution designs.
- Debug and troubleshoot data processing and code-related issues; communicate findings with the development team
- Create automated data workflows using tools like Airflow and Jenkins as part of CI / CD pipelines.
- Ensure proper version control, testing (unit / integration), and deployment practices in accordance with DevOps methodologies.
- Communicate effectively with business stakeholders and contribute to a collaborative team environment
- Work in Agile methodologies (Scrum / Kanban) and participate in planning, stand-ups, and retrospectives
Kogo poszukujemy?
Strong experience with the Hadoop ecosystem : Hadoop, HDFS, HiveProficiency in Apache Spark and ScalaAdvanced SQL skillsExperience with Google Cloud Platform (GCP), especially : BigQueryCloud DataflowCloud DataprocCloud StoragePub / SubCloud Composer amp; AirflowFamiliarity with CI / CD tools such as Jenkins and Git / GitHubExperience with Airflow or similar orchestration toolsUnderstanding of big data architecture and data modeling techniques (both relational and non-relational)Experience in designing and deploying scalable data solutionsStrong debugging and code review skillsExposure to Enterprise Data Warehousing conceptsExperience with DevOps practices and tools (Ansible, JIRA)Knowledge of Agile frameworks (Scrum, Kanban)Czego wymagamy?
Znajomości :
HadoopSparkJęzyki :
PolskiAngielskiJakie warunki i benefity otrzymasz?
26300-28400 PLN miesięcznieB2B - Elastyczne godziny pracy (100%)Praca zdalna : Możliwa częściowoPakiet medyczny, Pakiet sportowyKawa / Herbata, Zimne napojeParking, Pokój relaksuKim jesteśmy?
Verita HR is an international company providing recruitment support within #Fintech, #Finance and #Banking market in EMEA. We connect the most innovative organizations with the best people in the market. We conduct systematic market research, which allows our Digital Teams to be a step ahead of the competition.