FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Help Mercor customers improve the safety, robustness, and trustworthiness of their AI systems
Requirements
What you’ll need- Native fluency in English and Marathi is required
- Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate
- Ability to identify subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not require H1-B or STEM OPT support
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits
Comp & perks- Fully remote role that can be completed on your own schedule
- Weekly payments via Stripe or Wise
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content work
- Competitive pay
- Opportunity to collaborate with leading researchers
- Referral payments of up to $90 per successful referral (limits apply)
