FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates strong analytical skills and attention to detail in evaluating AI model interactions, with a focus on clear communication and objective analysis of conversational quality.
Highest-signal resume keywords
Bachelors DegreeAttention To DetailStrong Written Communication SkillsCritical-Thinking SkillsFamiliarity With AI Assistants
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Soft Skills
Excellent Listening SkillsComprehension SkillsReliabilityConsistency
Industry Keywords
Voice-Based AIConversational SystemsEvaluation GuidelinesError ClustersModel Performance Comparison
About the role
Key responsibilities & impact- Review an assigned scenario and roleplay a natural conversation with two different AI models.
- Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible.
- Maintain approximately the same number of conversational turns with each model to support a fair comparison.
- Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses.
- Evaluate each model across five defined evaluation dimensions.
- Identify and categorize relevant error clusters that may occur in the audio or conversation.
- Compare the performance of Model A and Model B based on the evaluation criteria and your observations.
- Select the model that demonstrated the stronger overall performance according to the defined evaluation framework.
- Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations.
- Apply evaluation guidelines consistently across different scenarios and model interactions
Requirements
What you’ll need- Bachelors Degree
- Strong attention to detail and ability to notice subtle differences in conversational quality.
- Excellent listening and comprehension skills.
- Strong written communication skills, particularly the ability to explain observations clearly and objectively.
- Ability to follow detailed evaluation guidelines consistently.
- Comfort speaking naturally and roleplaying different conversational scenarios.
- Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
- Strong critical-thinking and analytical skills.
- Reliability and consistency when completing structured evaluation tasks.
- Familiarity with AI assistants, voice-based AI, or conversational systems