FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in evaluating and red-teaming conversational AI models, focusing on identifying vulnerabilities and ensuring the safety and trustworthiness of AI systems. Proficient in generating human data through annotation and classification while adhering to established guidelines and quality standards.
Highest-signal resume keywords
Native Fluency In EnglishNative Fluency In OdiaJudgment About Language And ContentAttention To DetailAbility To Explain Reasoning
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Red-TeamingPrompt Injection AnalysisBias ExploitationVulnerability ClassificationData AnnotationReport ProductionSystemic Risk FlaggingEvaluation Coverage ExpansionAutomated Test AnalysisMulti-Turn Manipulation
Soft Skills
AdaptabilityClear CommunicationAttention To Subtle Errors
Industry Keywords
Conversational AIAI SafetyQuality StandardsTesting ConsistencyMisinformation ReviewHarmful Behavior AnalysisGuideline AdherenceIndependent Contractor Engagement
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Follow taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Identify vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Support Mercor customers in making AI systems safer and more trustworthy
Requirements
What you’ll need- Native fluency in English and Odia is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Attention to subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- This is an independent contractor engagement
- H1-B and STEM OPT candidates are not supported
Benefits
Comp & perks- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Reasonable accommodations upon request
- Wellness resources and clear guidelines for higher-sensitivity projects
- Opportunity to build experience in human data-driven AI red teaming
- Collaborate with leading researchers
- Referral payments of up to $90 per successful referral
