Talent.com
Mercor
AI Safety Practitioner - Expert EvaluatorMercor • Warsaw, Masovian Voivodeship, Poland
AI Safety Practitioner - Expert Evaluator

AI Safety Practitioner - Expert Evaluator

Mercor • Warsaw, Masovian Voivodeship, Poland
12 godz. temu
Typ pracy
  • Zdalna
  • Quick Apply
Opis pracy

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Practitioner
Type: Contract
Compensation: $60–$70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
  • Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
  • Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
  • Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
  • Provide structured feedback to improve model alignment and safety performance.
  • Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

Must-Have

  • Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
  • 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
  • Excellent written English, critical thinking, and analytical reasoning skills.
  • Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred

  • Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
  • Familiarity with safety policies, content moderation, or evaluation rubric development.
  • Experience reviewing complex, high-risk, or ambiguous content.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Utwórz powiadomienie o ofertach pracy dla tego wyszukiwania

AI Safety Practitioner - Expert Evaluator • Warsaw, Masovian Voivodeship, Poland

Podobne stanowiska

AI Research Engineer (MultiModal & Vision) 100% Remote Worldwide

Tether Operations LimitedWarsaw, 14, PL

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Pokaż więcej

Senior AI Platform Engineer

Warsaw Hub @ Helvetia Baloise GroupWarszawa, PL

Role Purpose: As part of the AI Platform and Services team, you will contribute to building and operating AI platforms across multi-cloud environments (AWS, Azure) and supporting their full lifecyc... Pokaż więcej

 • Promowane

Lead AI Engineer

EPAM SystemsWarszawa, PL

We are seeking a Lead AI Engineer to design and develop comprehensive AI applications, including chatbots and agent workflows.You will work closely with clients to deliver tailored LLM-driven solut... Pokaż więcej

 • Promowane

AI Research Engineer (Agentic Posttraining) 100% Remote Worldwide

Tether Operations LimitedWarsaw, 14, PL

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Pokaż więcej

AI Research Engineer (MultiModal Reinforcement Learning) 100% Remote Worldwide

Tether Operations LimitedWarsaw, 14, PL

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Pokaż więcej

Engagement Manager, AI Implementations

Tether Operations LimitedWarsaw, 14, PL

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Pokaż więcej

DevOps Engineer - AI Model Evaluator

MercorWarsaw, Masovian Voivodeship, Poland
Zdalna
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Pokaż więcej

Gen AI Developer

Capgemini PolskaWarszawa, PL

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to... Pokaż więcej

 • Promowane

AI Engineer

KyribaWarszawa, PL

About Us Kyriba is a global fintech leader empowering CFOs and finance teams with cloud-based treasury, payments, risk management and working capital solutions.We serve 3,000+ customers worldwide, ... Pokaż więcej

 • Promowane

AI Research Engineer (Kernel & Inference Optimization) 100% Remote Worldwide

Tether Operations LimitedWarsaw, 14, PL

Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution.Our cutting-edge solutions empower businesses—from ex... Pokaż więcej

 • Nowe!

AI Engineer (f/m/x)

SiiWarszawa, PL

We are looking for an AI Engineer to join our team and help shape the future of software engineering through the practical use of Artificial Intelligence and Generative AI.In this role, you will wo... Pokaż więcej

 • Promowane

AI/ML Engineer

Infotree Global SolutionsWarsaw, Masovian Voivodeship, Poland

Applied Artificial Intelligence (AI) Research team.As an integral part of the team, you will play a pivotal role in driving the adoption of cutting-edge AI and Machine Learning (ML) technologies at... Pokaż więcej