FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and biases. Proficient in generating human data through annotation and classification, while adhering to established taxonomies and quality standards.
Highest-signal resume keywords
Red-Team Conversational AI ModelsAdversarial Machine LearningBias ExploitationHuman Data AnnotationNative Fluency in English and Kannada
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Prompt InjectionMisuse Case AnalysisVulnerability ClassificationSystemic Risk FlaggingReport ProductionDataset CreationAutomated TestingEvaluation Coverage ExpansionQuality Standards AdherenceConversational AI Testing
Soft Skills
Strong Judgment About LanguageClear CommunicationRigorous Attention to DetailAdaptability Across Projects
Industry Keywords
CybersecuritySocio-Technical RiskConversational AITaxonomiesBenchmarksPlaybooks
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Probe AI systems to uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Help train and enhance frontier AI models for Mercor’s AI lab and enterprise customers
Requirements
What you’ll need- Native fluency in English and Kannada
- Strong judgment about language and content, including assessing whether AI responses are accurate, complete, and appropriate
- Ability to explain reasoning clearly to technical and non-technical audiences
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to follow taxonomies, benchmarks, playbooks, guidelines, and quality standards consistently
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must be unable to require H1-B or STEM OPT sponsorship; H1-B and STEM OPT candidates are not supported
- Nice-to-have experience in adversarial ML, cybersecurity, socio-technical risk, conversational AI testing, psychology, acting, or unconventional adversarial writing
Benefits
Comp & perks- Fully remote role that can be completed on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Competitive pay
- Opportunity to build experience in human data-driven AI red teaming
- Collaborate with leading researchers
- Reasonable accommodations upon request
- Referral payments of up to $90 per successful referral
