FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and assessing AI outputs for accuracy and appropriateness. Proficient in generating human data through annotation and classification while adhering to quality standards and guidelines.
Highest-signal resume keywords
Adversarial MLCybersecurityVulnerability AssessmentData AnnotationFluency in English and Gujarati
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Red-TeamingPrompt InjectionBias ExploitationMulti-Turn ManipulationSystemic Risk IdentificationReproducible ReportingDataset ProductionQuality Standards AdherenceFailure AnnotationEvaluation Coverage Expansion
Soft Skills
Strong JudgmentAttention to DetailClear CommunicationAdaptabilityIndependent Work
Industry Keywords
Conversational AIAdversarial TestingMisuse CasesTaxonomiesBenchmarksPlaybooksSensitive Topics ReviewAI System StrengtheningCreative ProbingSocio-Technical Risk
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Identify vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements
What you’ll need- Native fluency in English and Gujarati required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits
Comp & perks- Fully remote role
- Flexible own schedule
- Weekly payments via Stripe or Wise
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Competitive pay
- Collaboration with leading researchers
- Reasonable accommodations upon request
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content work