FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in adversarial testing of conversational AI models, with a focus on identifying vulnerabilities and biases. Proficient in generating and annotating human data while maintaining high standards of quality and consistency across diverse projects.
Highest-signal resume keywords
Adversarial ML ExperienceCybersecurity ExperienceNative Fluency in English and MarathiAttention to DetailAbility to Explain Reasoning
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Adversarial TestingPrompt InjectionJailbreak DatasetsBias ExploitationVulnerability ClassificationSystemic Risk FlaggingMulti-Turn ManipulationPenetration TestingExploit DevelopmentConversational AI Testing
Soft Skills
Strong JudgmentAdaptabilityClear Communication
Industry Keywords
Conversational AIHuman Data AnnotationQuality StandardsSocio-Technical RiskMisinformation Analysis
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements
What you’ll need- Native fluency in English and Marathi is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- H1-B and STEM OPT candidates are not supported
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits
Comp & perks- Fully remote role
- Flexible schedule; work can be completed on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content work
- Reasonable accommodations upon request
- Competitive pay
- Opportunity to collaborate with leading researchers
- Referral payments of up to $90 for each successful referral, subject to limits
