FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
LLM AI Quality Analyst, Chinese
Donato Technologies, Inc.. Evaluate personalized AI responses and determine their quality .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates strong analytical and critical-thinking skills to evaluate AI responses effectively, with a focus on accuracy and personalization. Proficient in Chinese reading and writing, enabling clear communication and detailed feedback in evaluations.
Highest-signal resume keywords
Chinese Language ProficiencyAI Evaluation ExperienceAnalytical SkillsWritten CommunicationData Annotation Experience
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI EvaluationData AnnotationContent ModerationLinguisticsResearch
Soft Skills
Analytical ThinkingCritical ThinkingWritten Communication
Tools & Technologies
Google AccountLaptopDesktopReliable Internet
Industry Keywords
PersonalizationFeedbackEvaluationRemote WorkUSA Location Requirement
About the role
Key responsibilities & impact- Evaluate personalized AI responses and determine their quality
- Create multi-turn prompts based on personal experiences and context
- Review AI responses for accuracy, helpfulness, and appropriate personalization
- Identify incorrect personalization, unsupported assumptions, and hallucinations
- Compare AI responses side-by-side and provide detailed feedback
- Write clear rationales explaining evaluations
- Complete the online assessment within 24 hours
- Participate in a pre-onboarding discussion
Requirements
What you’ll need- Strong Chinese reading and writing skills
- Excellent analytical and critical-thinking skills
- Strong written communication
- Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
- Bachelor's degree or equivalent experience
- Comfortable working independently in a remote environment
- Laptop/desktop with reliable internet
- Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation
- Availability for 30 or 40 hours per week
- Minimum 4 hours per day
- Ability to provide 4 hours of overlap with PST
- Must be located in the USA; sourcing is excluded from Texas and Illinois
- Strong Chinese language proficiency
Benefits
Comp & perks- Flexible remote work environment
- Student-friendly opportunity
- Paperless pay statement
- Medical benefits
- Vision benefits
- Flexible spending account for medical and dependent care
- Dental benefits