FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and biases. Proficient in generating human data through annotation and classification, while ensuring adherence to guidelines and quality standards.
Highest-signal resume keywords
Red-Team Conversational AI ModelsBias ExploitationHuman Data AnnotationClear CommunicationNative Fluency in English and Kannada
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Prompt InjectionMisuse Case AnalysisVulnerability ClassificationSystemic Risk FlaggingTaxonomy ApplicationBenchmarkingReport ProductionDataset CreationAdversarial MLCybersecurity
Soft Skills
Strong JudgmentAttention to DetailAdaptability
Industry Keywords
Conversational AIMulti-Turn ManipulationQuality StandardsSocio-Technical RiskCreative Probing
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Probe AI outputs involving bias, misinformation, and harmful behaviors
- Help Mercor’s AI-lab and enterprise customers train and enhance frontier AI models
- Expand evaluation coverage and identify vulnerabilities missed by automated tests
Requirements
What you’ll need- Native fluency in English and Kannada required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Clear communication with technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits
Comp & perks- Fully remote role
- Work on your own schedule
- Weekly payments via Stripe or Wise
- Higher-sensitivity project participation is optional
- Clear content guidelines and wellness resources
- Competitive payment
- Referral opportunity earning up to $90 per successful referral
