Senior big data engineer

Technologies-expected :

Apache Spark

Apache Hadoop

map-reduce

Delta Lake

Apache Kafka

Java

Scala technologies-optional :

Hbase

Cassandra about-project : Join our Competency Center Digital and a new team that focuses on real-time data capture and decisioning. You will work on high-traffic, high-visibility applications, handling immense amounts of data and solving challenging scaling problems in a project for an American technology company specializing in software and digital services. You will contribute to delivering a streamlined set of core services built on top of the data layer, focusing on foundational elements such as identity, profile, segmentation, and edge components. responsibilities :

Integrate and improve Big Data tools and frameworks to provide requested capabilities

Develop and deploy critical parts of the services and deliver them to production

Articulate the choice of accurate tools and technologies

Translate high-level requirements into meaningful tasks and actions

Optimize distributed microservices and Spark applications to reduce cost and enhance availability

Participate in sophisticated, large-scale projects in an Agile environment using Java, Jenkins, and Spark

Collaborate with multi-functional specialists (Product Management, Design, Engineering, etc.) to launch customer-focused solutions requirements-expected :

Min. 9 years of software development experience

Hands-on experience with open-source technologies such as Spark, Hadoop Stack, and Kafka

Proven record of delivering highly optimized code in Java

Experience working with No SQL databases, preferably HBase and Cassandra

Proficiency in data structures and algorithms

Proven expertise in Java, OOP principles, clean design, and design patterns

Deep understanding of modern cloud technologies and design patterns for building “always-up” services

Unending curiosity, thoroughness, tenacity, and focus on quickly designing and building sophisticated software systems with great quality to solve customer problems

Experience with Containers and CI / CD systems like Argo CD and Git Ops

Fluent English required

Residing in Poland required offered :

Great Place to Work since 2015 - it’s thanks to feedback from our workers that we get this special title and constantly implement new ideas

Employment stability - revenue of PLN 2.1 BN, no debts, since 2006 on the market

We share the profit with Workers - over PLN 76 M has already been allocated for this aim since 2022

Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more

Comfortable workplace – class A offices or remote work

Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application

PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers

Investment in your growth – meetups, webinars, training platform and technology blog – you choose

Fantastic atmosphere created by all Sii Power People