FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in evaluating and enhancing conversational AI models, focusing on identifying vulnerabilities and biases while producing detailed reports and datasets. Proficient in communicating findings clearly to diverse audiences and adhering to quality standards across various projects.
Highest-signal resume keywords
Native Fluency In EnglishNative Fluency In OdiaAssessment Of AI ResponsesAttention To DetailAdaptability Across Projects
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Soft Skills
Strong Judgment About Language And ContentClear Communication To Technical And Non-Technical Audiences
Industry Keywords
Red-Team AI ModelsPrompt InjectionsBias ExploitationSystemic RisksEvaluation CoverageAutomated TestsAI Lab Projects
About the role
Key responsibilities & impact- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Annotate failures, classify vulnerabilities, and flag systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Probe AI outputs involving bias, misinformation, and harmful behaviors
- Expand evaluation coverage and identify vulnerabilities automated tests miss
- Work on projects training and enhancing AI systems for Mercor’s AI lab and enterprise customers
Requirements
What you’ll need- Native fluency in English and Odia is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to work consistently to guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Unable to support H1-B or STEM OPT candidates at this time
Benefits
Comp & perks- Fully remote role that can be completed on your own schedule
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive content
- Weekly payments via Stripe or Wise based on services rendered
- Competitive pay
- Collaboration with leading researchers
- Reasonable accommodations upon request
- Referral opportunity earning up to $90 per successful referral (referral limits apply)
