Detailed description of work task to be carried out
Nordea is embarking on an ambitious program of work to deliver a number of generative and predictive AI models to optimize the work for hundreds of people in Group Financial Crime Prevention. While we are an established and mature IT organization, working in our AI program is going to feel more like a startup! We are experimenting with methods and tooling and are seeking a number of experienced Devops engineers to help facilitate the build and deployment of our Generative AI applications.
Must-have knowledge and experience
1. Orchestration services : Step function, Event-Bridge, Airflow (MWAA), Lamda.
2. Processing : Glue, EMR, EKS
3. Storage Service : S3
4. Querying and Analysis services : Athena
5. Bigdata ETL development and frameworks using : PySpark with Python or / and Spark with Scala (nice to have).
6. Experience with working with Python / Pandas transformation
7. Experience with Hadoop Ecosystem (Hive, Impala, Sqoop, HDFS, Oozie),
8. Knowledge of CI / CD Pipeline (Jenkins) and Infrastructure as a code (Terraform).
Nice-to-have knowledge and experience
ML Flow
AWS BedRock
AWS SageMaker
AWS EC2, Fargate
AWS Lambda
HashiCorp Tools
AWS development
Hadoop knowledge
Bonus if :
Kubernetes
ChromaDB or other vector database
Engineer Aws • Gdańsk, Polska