You will be a senior engineer on the team that owns the real-time data platform. The platform turns operational events (orders, driver locations, geofence transitions, shifts, MQTT session events) into live analytics, routing inputs, and warehoused data across Postgres/TimescaleDB, ClickHouse, and BigQuery. You will own the platform end-to-end: design, implementation, deployment, and production operation of the streaming jobs, CDC pipelines, Kafka Connect bridges, and downstream sinks that move this data.
- Designing, implementing, and operating stateful Apache Flink streaming pipelines: keyed state, windowing, watermarks, timers, side outputs, custom sources/sinks.
- Designing, developing, deploying, and maintaining Change Data Capture (CDC) pipelines using Flink CDC or Debezium, moving operational database changes into the streaming platform with correct snapshot/incremental handling, schema evolution, and downstream idempotency.
- Building and operating Kafka and Kafka Connect pipelines: topic and partition design, source/sink connectors in distributed mode, schema and converter management, and deadletter routing.
- Owning the path from Kafka → Flink → Postgres / TimescaleDB / ClickHouse / BigQuery, including schema design, idempotency strategy, batch tuning, and observability.
- Diagnosing and fixing production issues: checkpoint failures, backpressure, state growth, sink slowness, autoscaler oscillation, restart loops.
- Hardening the platform: delivery guarantees, watermarks, DLQ handling, schema migrations, alerting coverage. * Code reviews and mentoring mid-level engineers.
- Contributing to the deployment side: Helm charts, ArgoCD applications, GKE configuration, Grafana dashboards, Prometheus alert rules.
- Influencing direction: state backend choices, schema migrations, when a pipeline needs to be split or rebuilt.
- 5+ years of professional software/data engineering experience, with strong Java expertise.
- Production experience with Apache Flink and stateful real-time streaming pipelines.
- Strong Apache Kafka experience, including Kafka Connect, consumer groups, partitions, delivery guarantees, and schema management.
- Hands-on CDC experience using Debezium or Flink CDC.
- Experience designing and operating Kafka → Flink → database/data warehouse pipelines in production.
- Strong understanding of PostgreSQL and experience with at least one analytical database such as ClickHouse or BigQuery.
- Experience with Kubernetes and deploying/operating production data workloads.
- Proven ability to troubleshoot and optimize production streaming systems—backpressure, checkpoint failures, state growth, latency, lag, and sink performance.
- Strong understanding of data consistency, idempotency, schema evolution, and observability.
- Ability to work independently and own a data platform component end-to-end, from design through production operation.
- Experience with TimescaleDB, hypertables, and time-series data.
- Experience with PostGIS and geospatial/spatial query optimization.
- Deep ClickHouse performance tuning, including MergeTree and partitioning strategies.
- Strong BigQuery optimization and data modeling experience.
- Experience with Flink Kubernetes Operator and Flink autoscaler tuning.
- Experience with ArgoCD, Helm, GKE, Prometheus, and Grafana.
- Experience designing high-throughput, low-latency real-time systems at scale.
- Experience with MQTT or IoT/event-driven systems.
- Knowledge of Kafka Schema Registry, Avro/Protobuf, and advanced schema evolution.
- Experience mentoring engineers and leading technical decisions around streaming architecture.
- Experience with routing, logistics, delivery, mobility, or location-based platforms would be particularly relevant.
- 20 days of paid vacation, 5 sick days, and public holidays.
- Flexible schedule with a high level of autonomy.
- Opportunity to influence product and technical decisions.
- Professional growth and learning opportunities.
- Comfortable working environment with a supportive team.
- Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues)
Senior Data Engineer - Real Time Streams • PL
Reboot Monkey is a global datacenter services provider headquartered in Haarlem, Netherlands, operating.We deliver colocation, IP transit, smart hands, remote hands, and managed datacenter services... Pokaż więcej
As a Data Engineer, you’ll work closely with international clients, providing both consultancy and technical architecture to shape reliable, high-performance data solutions.You’ll handle everything... Pokaż więcej
Role: Data Engineer (Transport Focus).Seniority: Regular, Regular+, or Senior.A technology company building and optimising a highly scalable Data Mesh that powers cross-product use cases across the... Pokaż więcej
Budowa i utrzymanie rozwiązań na platformie.Azure Data (Data Lake, Data Factory, Synapse).Współpraca z biznesem — zbieranie wymagań i przekładanie ich na rozwiązania techniczne.Dbanie o jakość dany... Pokaż więcej
Bronze/Silver/Gold or equivalent medallion patterns).Proven track record delivering.Neo4j, Amazon Neptune, TigerGraph) for relationship modeling.Kafka, Flink, Spark Streaming, Kinesis).Deep experti... Pokaż więcej
Discover The System MyLeadBiz That’s Helping Newbies Earn Daily.Turn free traffic into $100+ per day with this beginner-friendly biz opp strategy.No product or tech skills n... Pokaż więcej
The role requires deep expertise in Java for backend/data processing, Mandatory hands-on experience in Unit, Integration, and E2E testing, Practical experience with Terraform (ideally AWS), and Dir... Pokaż więcej
Copilot Agent & SDLC Context Platform Engineer.SDLC, compliance, security, and quality standards.This role focuses on constructing the.You will further integrate these systems into the SDLC through... Pokaż więcej
