FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, focusing on identifying vulnerabilities and improving safety and robustness. Proficient in generating human data through annotation and classification while adhering to established guidelines and benchmarks.
Highest-signal resume keywords
Red-Team Conversational AI ModelsAdversarial ML ExperienceFluent in English and PunjabiAbility to Assess AI ResponsesExploit Development
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
JailbreaksPrompt InjectionsBias ExploitationMulti-Turn ManipulationVulnerability ClassificationSystemic Risk FlaggingReproducible ReportingAutomated TestingConversational AI TestingReverse Engineering
Soft Skills
Strong JudgmentClear CommunicationAdaptabilityAttention to Detail
Industry Keywords
TaxonomiesBenchmarksPlaybooksQuality StandardsHarmful BehaviorsDisinformation ProbingHarassment Analysis
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Expand evaluation coverage and uncover vulnerabilities automated tests miss
- Strengthen customer AI systems and improve their safety, robustness, and trustworthiness
Requirements
What you’ll need- Fluent/native fluency in English and Punjabi
- Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate
- Ability to identify subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines, taxonomies, benchmarks, playbooks, and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- H1-B and STEM OPT candidates are not supported
- Nice-to-have experience in adversarial ML, jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction, penetration testing, exploit development, reverse engineering, harassment/disinformation probing, abuse analysis, conversational AI testing, psychology, acting, or unconventional adversarial writing
Benefits
Comp & perks- Fully remote role with flexible, self-directed scheduling
- Weekly payments via Stripe or Wise
- Competitive pay
- Wellness resources and clear guidelines for higher-sensitivity projects
- Reasonable accommodations upon request
- Referral payments of up to $90 per successful referral
- Opportunity to collaborate with leading researchers
- Experience in human data-driven AI red teaming at the frontier of safety
