Description
We are looking for an experienced Lead Data Engineer to join our team and support our clients on-premises data platform within the telecommunication domain.
This robust data platform is designed to centralize network data-related analytics activities to support efficient assurance operations and stable, high-quality service delivery to internal client departments.
The ideal candidate will play a key role in developing and delivering robust, reusable, and scalable ETL / ELT data pipelines and productionalized ML solutions. This includes the automated logging / monitoring of data pipelines, ensuring data quality and stable performance of ML models.
EasyApply
Responsibilities
- Introduce and implement the best Data Engineering tools and practices tailored to the customers on-premise infrastructure
- Ensure the stable delivery of robust, reusable, and maintainable ETL / ELT data pipelines
- Enhance the operational usability of existing data pipelines
- Lead and organize regular code reviews and participate in ongoing code reviews
- Regularly participate in knowledge transfer and onboarding sessions
- Maintain partial onsite presence as required
Requirements
At least 5 years of relevant experience in data software engineering, with demonstrated experience in leading and managing teams of engineersProficiency in Python programming and extensive knowledge of ETL / ELT development, orchestration, and maintenance approachesProficiency with Apache Airflow, PostgreSQL and S3 object storage standardExperience in unit testing of Airflow DAGs and data processing applicationsExpertise with state-of-the-art Big Data processing technologies (mostly batch, some streaming)Proven experience in the productionalization of Machine Learning solutionsStrong understanding of data solutions architecture and the ability to select the correct tools and solutions for specific use casesFamiliarity with core principles of data visualizationNice to have
Understanding of typical performance metrics used in ML modelsFamiliarity with Kafka, Spark, MongoDB or other NoSQL databases, ELK stack, Loki, Apache Superset and GrafanaExperience in the Telco domain is a plusWe offer
We gather like-minded people : Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Relocation within our 50+ officesWe provide growth opportunities : Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, OReilly, Cloud Guru Language classes in English and Polish for foreignersWe cover it all : Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being eventsPlease, note : The set of bonuses might vary based on the role you apply for specifics will be discussed with our recruiter during the general interview We will reach out to selected candidates exclusivelyEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
