FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in AI evaluation and data annotation, with strong analytical skills and attention to detail. Capable of providing constructive feedback on AI responses while working independently in a remote setting.
Highest-signal resume keywords
AI EvaluationData AnnotationContent ModerationAnalytical SkillsAttention to Detail
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI EvaluationData AnnotationContent ModerationPrompt TestingResponse Assessment
Soft Skills
Strong English Reading SkillsStrong English Writing SkillsIndependent Work
Tools & Technologies
Google AccountLaptopDesktopReliable Internet
Industry Keywords
PersonalizationGroundingIntegrationHelpfulnessRemote Work
About the role
Key responsibilities & impact- Evaluate personalized AI/Gemini responses
- Create and test multi-turn prompts
- Assess AI responses for Grounding, Integration, and Helpfulness
- Compare model responses side-by-side
- Identify incorrect personalization, poor inferences, and hallucinations
- Provide detailed feedback and rationales
Requirements
What you’ll need- Bachelor’s or Master’s degree in IT or any IT-related field
- Strong English reading and writing skills
- Strong analytical and attention-to-detail skills
- AI evaluation, data annotation, content moderation, or related experience preferred
- Ability to work independently in a remote environment
- Laptop/Desktop with reliable internet
- Willingness to use a primary personal Google account and enable personal data sources for the assessment
- Availability of 30–40 hours per week
- Availability during PST hours with 4 hours of overlap required
- Must be located in one of the approved states: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, or Wyoming
- Strong English language skills
Benefits
Comp & perks- Flexible remote work arrangement
- Monthly pay for contract employees
- Medical benefits
- Vision benefits
- Flexible spending account for medical and dependent care
- Dental benefits
- Paperless pay statements
- Text message updates about the application