What You’ll Do
Design, build, and enhance data pipelines for streaming and batch processing Extend and support our AWS cloud data platform Develop features using Databricks pipelines, Unity Catalog, and Spark Streaming Lead and mentor the team, promoting best practices and process improvements Gather requirements from stakeholders and deliver high-quality solutions Partner with customers to ensure project success
What You’ll Bring
3+ years of strong Python development experience and solid engineering practices Expertise in microservices frameworks and event-driven architectures Advanced Spark skills (PySpark, Scala) with experience in scalable, maintainable pipelines Experience with Spark Streaming and Delta Lake Familiarity with Kubernetes and MongoDB Proven AWS cloud experience Strong communication and a commitment to high ethical standards
What You’ll Do
Design, build, and enhance data pipelines for streaming and batch processing Extend and support our AWS cloud data platform Develop features using Databricks pipelines, Unity Catalog, and Spark Streaming Lead and mentor the team, promoting best practices and process improvements Gather requirements from stakeholders and deliver high-quality solutions Partner with customers to ensure project success
What You’ll Bring
3+ years of strong Python development experience and solid engineering practices Expertise in microservices frameworks and event-driven architectures Advanced Spark skills (PySpark, Scala) with experience in scalable, maintainable pipelines Experience with Spark Streaming and Delta Lake Familiarity with Kubernetes and MongoDB Proven AWS cloud experience Strong communication and a commitment to high ethical standards
What You’ll Do, Design, build, and enhance data pipelines for streaming and batch processing Extend and support our AWS cloud data platform Develop features using Databricks pipelines, Unity Catalog, and Spark Streaming Lead and mentor the team, promoting best practices and process improvements Gather requirements from stakeholders and deliver high-quality solutions Partner with customers to ensure project success ] Requirements : Data pipelines, AWS, Cloud, Databricks, UNITY, Spark Streaming, Python, Microservices, Spark, PySpark, Scala, Kubernetes, MongoDB Additionally : Sport subscription, Training budget, Private healthcare, Flat structure, International projects, Small teams, Free coffee, Canteen, Bike parking, Playroom, Free snacks, Free beverages, In-house trainings, Modern office, Startup atmosphere.
Senior Data Engineer • Warszawa, Poland