Senior Data Engineer / ML
B2B.NET S.A.Warszawa, Masovian, Poland7 days ago
Job descriptionTensorFlow PyTorch We are looking for an MLOps / ML Engineer responsible for the end-to-end lifecycle of machine learning models - from development and deployment to automation and performance monitoring, leveraging AWS, Spark, and Python. The role includes building scalable, distributed data processing pipelines in a big data environment, collaborating with data scientists and analysts, and enhancing MLOps best practices across the organization. Experience in designing and deploying predictive and analytical models is a strong plus. Managed the lifecycle of machine learning models from development to deployment and monitoring, ensuring optimal performance and reliability. Implemented MLOps principles, including continuous integration, continuous delivery, testing, and monitoring, to streamline machine learning operations. Working with Spark & Python to define and maintain data ingestions and transformation, handling both real-time and batch data processing. Building distributed and highly parallelized big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time. Leverage Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics. Collaborated with cross-functional teams, including data scientists, DevOps engineers, and IT, to deliver high-quality machine learning solutions. Working closely with analysts and business stakeholders to develop analytics models. Help in optimizing our current MLOps practices and libraries, make applicable for wider range of use cases outside propensity models. Cloud solution exploration for AI / ML areas. Proficiency in programming languages like Python & Spark - minimum 5 years. Hands-on experience with AWS services for machine learning and data processing - particulary S3, Glue, SageMaker, Lambda and StepFunctions / Airflow / MWAA - covering data ingestion, model training, batch inference and automation pipelines. Practical understanding of AWS Infrastracture setup and automation using AWS CLI, boto3 and IAM roles, ensuring reproducible and secure ML workflows. Understanding of algorithms and data structures, knowledge of statistics and linear algebra. Experience with machine learning frameworks (TensorFlow or PyTorch), including training new ML models, refining existing ones, and deploying these models into user-friendly applications. Solid understanding of distributed systems with experience in Hadoop / Hive ecosystem and / or other Big Data Technologies. Proficient in SQL (Spark / Hive SQL), previous experience in creating data flows. Experience with BitBucket and GIT, code versioning and branching strategy. Familiar with Agile / Safe framework.
technologies-expected :
- Python
- Spark
- S3
- Glue
- SageMaker
- Lambda
- AWS
- SQL
- Bitbucket
- Git
technologies-optional :
about-project :
responsibilities :
requirements-expected :
Create a job alert for this search
Senior Data Engineer • Warszawa, Masovian, Poland
Related jobs
- Promoted
Senior Data Scientist / ML Engineer @ Addepto
AddeptoWarsaw, Poland Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for some of the world’s largest enterprises and pioneering startups, including Rolls R...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer @ RemoDevs
RemoDevsWarsaw, Poland We are seeking a highly motivated and self-driven data engineer for our growing data team who is able to work and deliver independently and as a team.
In this role, you will play a crucial part in d...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Procter & GambleWarszawa, PL The Senior Data Engineer is responsible for designing, developing, and implementing data and analytics.Microsoft Azure Databricks Platform.
Assemble large complex data sets which meet functional and...Show moreLast updated: 11 days ago
- Promoted
Senior Data Engineer with Databricks
KMD Poland Sp. z o.o.Warszawa, Masovian, Poland Python #ApacheSpark #Databricks #MSSQL #Git #CI / CD #Docker #Azure #Kubernetes.Are you ready to join our international team as a Senior Data Engineer with Databricks? We shall tell you why you shoul...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
WINGED IT SP Z O OWarszawa, Masovian, Poland Do you want to play a key role in revolutionizing the future of finance? Join Klarna - a global leader in deferred payments, with over 85 million active users and 2.
As a pioneer in modern payment s...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer (Databricks) @ Addepto
AddeptoWarsaw, Poland Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for some of the world’s largest enterprises and pioneering startups, including Rolls R...Show moreLast updated: 30+ days ago
- Promoted
Senior ML Data Engineer
Intuition MachinesWarszawa, Województwo mazowieckie, Polska Intuition Machines uses AI / ML to build enterprise security products.We apply our research to systems that serve hundreds of millions of people, with a team distributed around the world.You are prob...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer / ML
INNOBO sp. z o.o.Warszawa, Masovian, Poland Hourly Rate : up to 160 PLN + VAT.Location : Gdansk or Gdynia or Warsaw or Lodz, Poland.Work arrangement : hybrid, 2 days at the office, full-time.
For our Client from banking industry we are looking f...Show moreLast updated: 23 days ago
- Promoted
Senior Data Engineer with AWS and Snowflake
Sii Sp. z o.o.Warszawa, Masovian, Poland We are looking for a Data Engineer with expertise in Snowflake, AWS, and ETL processes, who will work closely with AI scientists and data analysts to design, develop, and maintain data pipelines an...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer @ Bayer
BayerWarsaw, Poland At Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where ,Health for all, Hunger for none’ is no longer a dream, but a real possibility.We’re doing...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer (Databricks)
AddeptoWarszawa, Masovian, Poland As a Senior Data Engineer, you will have the exciting opportunity to work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies.H...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
The Stepstone Group Polska sp. z o.o.Warszawa, Masovian, Poland Join our team where you can participate delivering data driven solutions based on Medallion data design pattern.Introducing Medallion Architecture, with its Raw, Silver, and Gold layers, we expect ...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer Market Data Asset
Digital Hub Warsaw at BayerWarszawa, Masovian, Poland The Data Assets, Analytics & AI organization at Bayer Consumer Health focuses on driving digital transformation and innovation by creating best-in-class analytical solutions that enable data-driven...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
CLOUDFIDE SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄWarszawa, Masovian, Poland Passionate about cloud and data analytics, inspiring person that enjoy your day-to-day job.Curious and eager to learn new technologies.
One that would like to work with a team of like-minded people....Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer Market Data Asset @ Bayer
BayerWarszawa, Poland Senior Data Engineer – Market Data Asset.The Data Assets, Analytics & AI organization at Bayer Consumer Health focuses on driving digital transformation and innovation by creating best-in-class...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
PromiseGroupWarszawa, PL Microsoft partner in CEE region, offering a wide range of products and services for clients from various economic sectors, including finance, telecommunications, media, energy, manufacturing, trade...Show moreLast updated: 20 days ago
- Promoted
AI / ML Data Engineer
YOUR ITEAMS sp. z o.o.Warszawa, Masovian, Poland We are looking for an experienced Data & AI - AI / ML Engineer with expertise in end-to-end ML pipeline design, model training, optimization.
Machine Learning & Model Development.Build, train, and o...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer @ N-iX
N-iXWarsaw, Poland As a Senior / Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment.
The project involves integrating various data...Show moreLast updated: 14 days ago