Senior Data Engineer – B2B – Krakow or Gdansk
Description
Our client envisions the RIPL platform as a groundbreaking, AI-driven investment ecosystem that revolutionizes the entire investment process by formulating an intuitive and human-centric design approach. The advanced AI-native platform will be meticulously designed to meet Client's strategic needs, offering transformative capabilities for the investment landscape.
We are looking for a dynamic, hands-on Senior Data Engineer for a full-stack AI native Data Eng team for building a cutting edge quantitative investment platform.
- 12 months initial contract
- Market rate
- 5 days per week on site
Responsibilities
Data Pipeline Development :Implement data pipelines for structured, unstructured, and operational data sources.Ensure efficient data ingestion, transformation, and storage processes.Data Quality and Management :Establish data quality rules and monitor data integrity.Support the creation and maintenance of a comprehensive data catalog.Support for AI Integration :Collaborate with architects to integrate AI-driven analytics into data workflows.Assist in implementing GraphRAG for transforming unstructured documents into queryable entities.Security and Compliance :Implement role-based access control and ensure data security measures are in place.Support compliance with data lineage and sensitivity requirements.Data Warehousing and Management :Utilize Snowflake for data warehousing, ensuring scalable and efficient data storage solutions.Establish and monitor data quality rules, ensuring data integrity and compliance.Requirements
Technical Skills :Proficiency in Snowflake and Airflow.Experience with data pipeline engineering and data architecture.AI and Graph Experience :Familiarity with Graph RAG and Graph Data Structures.Experience in integrating AI-driven solutions into data processes.Additional Skills :AWS skills.
Ability to collaborate and share knowledge on data engineering practices.
