FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Probe AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Expand evaluation coverage and identify vulnerabilities automated tests miss
- Create artifacts that strengthen customer AI systems
- Work on projects training and enhancing AI systems for Mercor's AI lab and enterprise partners
Requirements
What you’ll need- Native fluency in English and Punjabi is required
- Strong judgment about language and content, including assessing whether AI responses are accurate, complete, and appropriate
- Ability to explain reasoning clearly to technical and non-technical audiences
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- H1-B and STEM OPT candidates are not supported
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, and model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, and reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, and conversational AI testing
- Nice-to-have: creative probing experience in psychology, acting, or writing
Benefits
Comp & perks- Fully remote role
- Work on your own schedule
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Weekly payments via Stripe or Wise based on services rendered
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Reasonable accommodations upon request
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Collaboration with leading researchers
- Referral payments of up to $90 for each successful referral, subject to referral limits