FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and managing AI data projects, including building automation with LLM agents and configuring workflows. Proficient in data analytics and project management, ensuring quality assurance and effective collaboration with external vendors.
Highest-signal resume keywords
Intermediate JavaScriptIntermediate PythonAgent Building in ClaudeLLM Evaluation ExperienceData Analytics Background
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI Data Project DesignAutomation BuildingWorkflow ConfigurationQuality Assurance DesignData Collection and AnnotationError MeasurementTask Specification CreationProduction Automation MaintenanceAPI ConnectionProject Management
Soft Skills
Decision MakingCollaborationStakeholder Management
Tools & Technologies
ClaudeEnterprise Agentic EnvironmentAutomation Tools
Industry Keywords
Data Collection IndustryAnnotation IndustryQuality Data Analysis
Tech Stack
Tools & technologiesJavaScriptPython
About the role
Key responsibilities & impact- Design and run AI data projects
- Build hybrid automation combining deterministic tooling with LLM agents
- Decide which workflow steps should use rules versus models and design hand-offs
- Set up and run agents in Claude and the native enterprise agentic environment
- Configure task specifications, data and tool connections, schedules, monitoring, and failure handling
- Design quality assurance workflows, guidelines, rubrics, and scorecards
- Calibrate automated checks against human reviewers and measure error categories
- Run data collection and annotation projects end to end, including scoping, vendors, workflows, tracking, and delivery
- Build tooling for project coordinators
- Collect, clean, and analyze production and quality data
- Create reporting on throughput, rework, error rates, and contributor performance
- Test automation before release and build continuous auditing workflows
- Create specifications, tickets, and runbooks for coordinators and engineers
Requirements
What you’ll need- Intermediate JavaScript and Python, sufficient to build and maintain production automation
- Hands-on agent building in Claude, including projects, skills, connectors, and scheduled tasks
- Ability to build agents in the native enterprise agentic environment and connect APIs with native infrastructure
- LLM evaluation experience, including prompt and rubric design and calibration against human judgment
- Data analytics background with experience in the data collection or annotation industry
- Experience managing projects with external vendors or contributors and multiple stakeholders
- Ability to make and own decisions with incomplete information
Benefits
Comp & perks- Remote work arrangement
- Full-time, fixed-term employment (1 year with possibility to extend)
