FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in evaluating and enhancing conversational AI models through rigorous testing and analysis, with a focus on identifying vulnerabilities and ensuring quality standards. Proficient in generating detailed reports and datasets while effectively communicating findings to diverse audiences.
Highest-signal resume keywords
Native Fluency In EnglishNative Fluency In MarathiJudgment About Language And ContentAssessment Of AI ResponsesIdentification Of Errors And Inconsistencies
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Red-Teaming AI ModelsAnnotating FailuresClassifying VulnerabilitiesFlagging Systemic RisksApplying TaxonomiesProducing Reproducible ReportsGenerating DatasetsEvaluating AI OutputsTesting ConsistencyEnhancing AI Models
Soft Skills
Clear Explanation Of ReasoningAdaptability Across ProjectsStrong JudgmentAttention To DetailIndependent Work
Industry Keywords
Conversational AIBias ExploitationPrompt InjectionsMulti-Turn ManipulationQuality StandardsSystemic RisksEvaluation CoverageCustomer AI Systems
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Help expand evaluation coverage and strengthen customer AI systems
- Work on projects training and enhancing frontier AI models
Requirements
What you’ll need- Native fluency in English and Marathi is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to identify subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- H1-B and STEM OPT candidates are not supported
Benefits
Comp & perks- Fully remote role
- Flexible schedule; work can be completed on your own schedule
- Weekly payments via Stripe or Wise
- Competitive pay
- Collaboration with leading researchers
- Wellness resources and clear guidelines for higher-sensitivity projects
- Reasonable accommodations upon request
- Referral bonus of up to $90 per successful referral
