DevOps Engineer – Kafka Specialist

At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, and Cybersecurity – supporting industries like Telecom, Banking, and Hi-Tech.

We are looking for a Kafka Infrastructure Engineer to join a high-performing team focused on building and maintaining robust streaming infrastructure. You’ll be working on complex enterprise environments, ensuring the reliability and performance of Kafka-based platforms that support key business applications and services.

Responsibilities :

Manage and maintain high-availability Kafka clusters in production

Monitor Kafka using tools like Burrow , identify lags and performance bottlenecks

Handle topic configurations , partitioning , replication , and Zookeeper coordination

Deploy and configure Kafka environments using Ansible

Work with developers to support application releases and environment expansions

Liaise with Cloudera support on Kafka-specific issues

Maintain and support MirrorMaker / SRM for cross-cluster replication

Support DR processes and participate in on-call rotations

Log parsing and integration (e.g. Logstash )

Collaborate with cross-functional teams to optimise performance and stability

Requirements :

Strong experience operating Kafka clusters in a production environment

Knowledge of Kafka internals : topics, partitions, replication, Zookeeper

Hands-on experience with Ansible for configuration management

Exposure to Cloudera Kafka distribution (nice to have)

Knowledge of SQL

Experience with MirrorMaker / SRM

Familiarity with log processing tools and Kafka monitoring

Readiness to work on-call and support critical environments

Good communication skills and ability to collaborate across teams

Benefits :

Hybrid work model – 1 day per week in the client's office in Warsaw

Solid, competitive salary.

Work in multilingual, multinational and multicultural environment on international projects

Comprehensive medical care