FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in red-teaming conversational AI models and agents, with a focus on identifying vulnerabilities and assessing AI outputs for accuracy and appropriateness. Proficient in generating human data through annotation and classification while adhering to quality standards and guidelines.
Highest-signal resume keywords
Fluent In English And PunjabiAdversarial ML ExperienceCybersecurity ExperienceAbility To Assess AI ResponsesIndependent Contractor Engagement
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Red-TeamingPrompt InjectionBias ExploitationVulnerability ClassificationAnnotationReproducible ReportingMulti-Turn ManipulationSystemic Risk FlaggingAdversarial Machine LearningPenetration Testing
Soft Skills
Strong Judgment About LanguageAttention To DetailClear CommunicationAdaptabilityAbility To Explain Reasoning
Industry Keywords
Conversational AICybersecuritySocio-Technical RiskCreative ProbingQuality Standards
Tech Stack
Tools & technologiesCyber Security
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Identify vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Collaborate with leading AI researchers on projects that train and enhance frontier AI systems
Requirements
What you’ll need- Fluent/native fluency in English and Punjabi required
- Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must be able to work without access to confidential or proprietary information from another employer, client, or institution
- H1-B and STEM OPT candidates are not supported
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: creative probing experience in psychology, acting, or writing
Benefits
Comp & perks- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity project participation is optional
- Clear content guidelines and wellness resources
- Reasonable accommodations upon request
- Competitive pay
- Referral earnings of up to $90 per successful referral (referral limits apply)
