FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, focusing on identifying vulnerabilities and ensuring the safety and robustness of AI systems. Proficient in generating human data through annotation and classification while maintaining high-quality standards and clear communication.
Highest-signal resume keywords
Red-Team Conversational AI ModelsAdversarial ML ExperienceNative Fluency in English and KannadaCybersecurity ExperienceAbility to Identify Subtle Errors
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
JailbreaksPrompt InjectionsBias ExploitationMulti-Turn ManipulationVulnerability ClassificationSystemic Risk FlaggingReproducible ReportingDataset ProductionAdversarial Machine LearningPenetration Testing
Soft Skills
Strong JudgmentClear Explanation SkillsAdaptabilityAttention to DetailIndependent Work
Industry Keywords
Conversational AI TestingCybersecuritySocio-Technical RiskHarassment ProbingDisinformation Analysis
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Help Mercor customers strengthen the safety, robustness, and trustworthiness of their AI systems
Requirements
What you’ll need- Native fluency in English and Kannada
- Strong judgment about language and content, including assessing whether AI responses are accurate, complete, and appropriate
- Ability to identify subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: creative probing experience in psychology, acting, or writing
Benefits
Comp & perks- Fully remote role that can be completed on your own schedule
- Payments weekly via Stripe or Wise based on services rendered
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Competitive pay
- Direct experience in human data-driven AI red teaming
- Opportunity to collaborate with leading researchers
- Referral payments of up to $90 for each successful referral, subject to limits
