FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and biases. Proficient in generating human data through annotation and classification while maintaining rigorous quality standards.
Highest-signal resume keywords
Red-Team Conversational AI ModelsAdversarial MLBias ExploitationNative Fluency in English and UrduAttention to Detail
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Prompt InjectionMisuse Case AnalysisVulnerability ClassificationSystemic Risk FlaggingReport ProductionDataset GenerationAutomated Test EvaluationEvaluation Coverage Expansion
Soft Skills
Strong JudgmentClear CommunicationAdaptability
Tools & Technologies
TaxonomiesBenchmarksPlaybooks
Industry Keywords
CybersecuritySocio-Technical RiskCreative Probing
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Collaborate on projects focused on training and enhancing AI systems
Requirements
What you’ll need- Native fluency in English and Urdu is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to work consistently to guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not require H1-B or STEM OPT support
- Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits
Comp & perks- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Wellness resources and clear guidelines for higher-sensitivity projects
- Reasonable accommodations upon request
- Competitive payment
- Referral opportunity offering up to $90 per successful referral
