FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and systemic risks. Proficient in generating human data through annotation and classification, while maintaining high standards of quality and adaptability across diverse projects.
Highest-signal resume keywords
Adversarial TestingVulnerability ClassificationBias ExploitationNative Fluency in English and PunjabiStrong Judgment About Language and Content
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Red-Team TestingPrompt InjectionMulti-Turn ManipulationSystemic Risk AnalysisData AnnotationReport ProductionBenchmark ApplicationTaxonomy ApplicationFailure ClassificationEvaluation Coverage Expansion
Soft Skills
Clear CommunicationAttention to DetailAdaptabilityIndependent WorkJudgment
Industry Keywords
Conversational AICybersecurityAdversarial Machine LearningSocio-Technical RiskQuality Standards
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements
What you’ll need- Native fluency in English and Punjabi is required
- Strong judgment about language and content, including evaluating whether AI responses are accurate, complete, and appropriate
- Ability to explain reasoning clearly to technical and non-technical audiences
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to work consistently to guidelines and quality standards
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have experience in adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits
Comp & perks- Fully remote role
- Flexible work schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Wellness resources and clear guidelines for higher-sensitivity projects
- Competitive pay
- Opportunity to collaborate with leading researchers
- Referral payments of up to $90 per successful referral
