Manage the end to end data pipelines that pull data from operational system and from different end points, transform and load the data to the company data lake
Current environment is set up on hadoop, but the team will be responsible to complete migration to a new Spark based environment on AWS
Qualifications :
4+ years of hands-on experience as a Data Engineer
BA / BSc in a related field such as CS, engineering, information systems, or equivalent.
High proficiency in SQL & Python
Experience working with cloud-hosted data warehouses (Hive, Snowflake)
Hands-on experience with developing end-to-end ETL / ELT processes (Spark and SQL)
Experience with the Hadoop framework and parallel computing (EMR, HIVE, Presto / Trino / Athena, Glue)
Proven experience with data warehousing, modeling paradigms, and architectures, proficient in DWH methodologies and best practices
Will be a plus :
Familiar with Kafka, Confluent, Fluentd, Spark, and Airflow
Experience with data visualization tools such as Tableau
Experience with the media or TV industry - an advantage
Soft skills :
Strong analytical skills and attention to detail
Team player
Ability to handle several tasks simultaneously
Comfortable working independently and leading projects from end to end
Create a job alert for this search
Data Engineer • PL
Related jobs
Data Engineer
Nacre CapitalPL
Remote
Quick Apply
Aquaticode builds artificial intelligence solutions for aquaculture.Our core competency lies at the intersection of biology and artificial intelligence, utilizing specialized imaging technology to ...Show moreLast updated: 30+ days ago
Data Engineer
TechBiz GlobalPoland
About TechBiz Global TechBiz Global is a leading recruitment and software development company.Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software deve...Show moreLast updated: 30+ days ago
Data Engineer
SnaphuntPoland
Join a well known brand within FinTech.Work within a company with a solid track record of success.Excellent career development opportunities.
Design, build, and own near-time and batch data processi...Show moreLast updated: 30+ days ago
Lead Data Engineer (Airflow)
EpamPoland
We are looking for an experienced.This robust data platform is designed to centralize network data-related analytics activities to support efficient assurance operations and stable, high-quality se...Show moreLast updated: 30+ days ago
Lead Data Engineer @ Link Group
Link GroupRemote, Poland
You will lead technical direction, mentor team members, and collaborate closely with cross-functional teams to ensure scalable, reliable, and high-performance data platforms.Experience with orchest...Show moreLast updated: 11 days ago
Data Engineer
Infosys Consulting - EuropePL
Remote
Quick Apply
Do you want to boost your career and collaborate with expert, talented colleagues to solve and deliver against our clients' most important challenges? We are growing and are looking for people to j...Show moreLast updated: 18 days ago
Data Engineer
Scanmed Groupcała Polska
Miejsce pracy cała Polska Region Polska Opis oferty.Grupa Scanmed jest częścią Grupy American Heart of Poland.Rafała w Krakowie, Rudolfa Weigla w Blachowni, Ars Medical w Pile, Vital Medic w Kluczb...Show moreLast updated: 4 days ago
Data Engineer
InfosysPoland
Do you want to boost your career and collaborate with expert, talented colleagues to solve and deliver against our clients' most important challenges? We are growing and are looking for people to j...Show moreLast updated: 16 days ago
Senior / Lead Data Engineer (#2328)
N-iXPoland
Data Engineering team to stand up modern data platform for one of its portfolio companies in the financial services sector.
The role requires expertise in Python, SQL (PostgreSQL, MySQL), Airflow, S...Show moreLast updated: 9 days ago
Data Modeler / Data Engineer
DevirePolska
IT, oparta na zasadach własnej działalności gospodarczej -.Klientów prowadzących innowacyjne i nowoczesne projekty.Dla Klienta z branży finansowej, poszukujemy doświadczonego.Doświadczenie w Data M...Show moreLast updated: 10 days ago
Lead Data Engineer @ ITFS Sp. z o.o.
ITFS Sp. z o.o.Remote, Poland
Miejsce pracy : praca w 100% zdalna.Stawka : 170-190 zł / h netto + VAT.Proces rekrutacyjny : krótka rozmowa z ITFS (ok.Przejrzyste warunki współpracy w firmie o pewnej i stabilnej pozycji rynkowej.Możl...Show moreLast updated: 9 days ago
Lead Data Scientist / ML Engineer @ Addepto
AddeptoRemote, Poland
Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects.
We partner with top-tier global enterprises and pioneering s...Show moreLast updated: 30+ days ago
Global Master Data Lead
NovocurePL
Novocure is a global publicly-traded commercial-stage oncology company developing a profoundly different cancer treatment therapy called tumor treating fields (TTFields) for patients with solid tum...Show moreLast updated: 16 days ago
Lead AI Data Engineer
DotlinkersPoland
Our client is a rapidly growing, innovation-driven real estate company with a strong focus on customer experience and sustainable asset design.
Operating across the UK, Spain, Portugal, and expandin...Show moreLast updated: 10 days ago
Lead Data Engineer @ Elitmind
ElitmindRemote, Poland
Lead Data Engineer will responsible for developing and maintaining data and reporting platforms and lead our team of Data Engineers through challenges.
This key role embraces overseeing the entire e...Show moreLast updated: 13 days ago
Lead Big Data Engineer (AWS)
SoftServePoland
SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993.Our team is passionate innovators working on over 2,000 cutting-edge projects worldwide from the ...Show moreLast updated: 4 days ago
Data Engineer
Neogames Systems Ltd (ISR)Remote, Poland
Design and build scalable, maintainable data pipelines using.Create data models and workflows that power dashboards, reports, and analytical products.
Collaborate with analysts, product teams, and g...Show moreLast updated: 16 days ago
Lead Data Scientist (Ranking)
OLXPoland, Poland
Remote Poland, PolandOLX – Data Science and Analytics / Full-time / Remote.At OLX, we work together to build a more sustainable world through trade.
We make it safe, smart, and convenient to buy and s...Show moreLast updated: 16 days ago