FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and biases. Proficient in generating human data through annotation and classification while maintaining rigorous quality standards.
Highest-signal resume keywords
Red-Team Conversational AI ModelsBias ExploitationHuman Data AnnotationFluent in English and BengaliAttention to Detail
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Prompt InjectionMisuse Case AnalysisVulnerability ClassificationSystemic Risk FlaggingReproducible Reporting
Soft Skills
Strong JudgmentClear CommunicationAdaptability
Industry Keywords
AI Model EvaluationQuality StandardsTesting TaxonomiesBenchmarkingMulti-Turn Manipulation
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Probe AI outputs involving bias, misinformation, and harmful behaviors
- Identify vulnerabilities missed by automated tests
- Expand evaluation coverage and reduce production surprises
- Help Mercor’s AI lab and enterprise customers train and enhance frontier AI models
Requirements
What you’ll need- Fluent/native fluency in English and Bengali required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- H1-B and STEM OPT candidates are not supported
Benefits
Comp & perks- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity projects are optional
- Clear guidelines and wellness resources for sensitive-content work
- Competitive pay
- Referral payments of up to $90 per successful referral
