Lead AI / ML Engineer

Introduction

IBM Automation and AI group is seeking an experienced AI / ML Engineer specializing in Large Language Models (LLMs) to join our AI / ML Center of Excellence team. In this role, you will collaborate with cross-functional product teams to implement cutting-edge AI capabilities across IBM's Automation product portfolio. You will lead efforts in data collection for LLM training and evaluation, integrate LLM technologies into existing and new products, and establish best practices for AI / ML feature implementation by product teams.

Your Role And Responsibilities

Data Collection and Management for LLM Evaluation and Training

• Lead Design and implement robust data collection pipelines for diverse LLM training datasets leveraging the IBM AI Model & Data Catalog.
• Develop data quality assessment frameworks to ensure training data meets IBM's high standards
• Create annotation guidelines and workflows for specialized domain-specific datasets
• Implement data governance protocols that ensure compliance with privacy regulations and ethical AI principles following the IBM Data & Model Governance process and tooling.
• Establish evaluation datasets and benchmarks to measure LLM performance across various use cases leveraging FM-Eval and Unitxt.

LLM Integration and Implementation

AI / ML Best Practices and Innovation

Preferred Education

Doctorate Degree

Required Technical And Professional Expertise

Preferred Technical And Professional Experience