AI Safety Expert – English, Bengali

Mercor

. Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation .

Posted 9/19/2026contractRemote • United StatesMid-LevelSenior💰 $16 - $22 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and biases. Proficient in generating human data through annotation and classification, while ensuring adherence to quality standards and guidelines.

Highest-signal resume keywords

Fluent In English And BengaliAdversarial ML ExperienceCybersecurity ExperienceStrong Judgment About Language And ContentAbility To Assess AI Responses

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Red-TeamingPrompt InjectionBias ExploitationVulnerability ClassificationReproducible ReportingAnnotation Of FailuresMulti-Turn ManipulationAdversarial Machine LearningPenetration TestingConversational AI Testing

Soft Skills

Strong JudgmentAttention To DetailClear CommunicationAdaptabilityIndependent Work

Industry Keywords

Conversational AISystemic RisksQuality StandardsCybersecuritySocio-Technical Risk

Tech Stack

Tools & technologies

Cyber Security

About the role

Key responsibilities & impact

Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
Apply taxonomies, benchmarks, and playbooks to keep testing consistent
Produce reproducible reports, datasets, and attack cases for customers
Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
Uncover vulnerabilities that automated tests miss
Expand evaluation coverage and reduce production surprises
Strengthen customer AI systems through reproducible artifacts
Collaborate with leading researchers on projects training and enhancing frontier AI systems

Requirements

What you’ll need

Fluent/native fluency in English and Bengali is required
Strong judgment about language and content
Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
Ability to notice subtle errors, inconsistencies, and gaps
Ability to follow guidelines and quality standards consistently
Ability to explain reasoning clearly to technical and non-technical audiences
Adaptability across projects, task types, and customers
Independent contractor status
Must not be an H1-B or STEM OPT candidate
Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking

Benefits

Comp & perks

Fully remote role
Flexible schedule / work on your own schedule
Weekly payments via Stripe or Wise
Wellness resources and clear guidelines for higher-sensitivity projects
Opportunity to build experience in human data-driven AI red teaming
Opportunity to help make AI systems more robust, safe, and trustworthy
Competitive pay
Collaboration with leading researchers
Referral payments of up to $90 per successful referral