FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in AI product evaluation, development, and integration, with a strong focus on quality standards and user research principles. Proven ability to collaborate across teams and maintain compliance with AI governance and regulatory requirements.
Highest-signal resume keywords
AI Product EvaluationExperience with LLM-Based AssistantsAI Governance KnowledgeCollaboration with Engineering TeamsUser Research Principles
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI Performance EvaluationRegression TestingData AnalysisProduct Roadmap DevelopmentDataset ManagementAI Capability DevelopmentQuality Standards DefinitionAutomated EvaluationsB2B SaaS ExperienceAI Feature Evaluation
Soft Skills
Fantastic Communication SkillsInterpersonal SkillsCuriosityPragmatismEmpathy
Industry Keywords
EU AI ActSustainabilityESG ImpactProduct InnovationCustomer-Facing AI Policies
About the role
Key responsibilities & impact- Define how AI performance is evaluated across key product flows, with quality standards, representative datasets and automated evaluations
- Create scalable processes for product teams to propose, test and release AI capabilities
- Improve AI access to and maintenance of accurate product knowledge
- Improve AI performance, reliability and cost efficiency as usage scales
- Integrate the AI assistant more deeply into the product experience
- Define how emerging AI standards and interfaces can extend customer and external-tool interactions
- Review customer AI interactions to identify issues, recurring needs and product opportunities
- Define standards for AI test and evaluation datasets across product teams
- Guide product teams in building AI capabilities and maintaining consistent quality
- Shape AI product direction, priorities and roadmap
- Lead discovery, specifications and testing for AI initiatives
- Maintain customer-facing AI policies and documentation and collaborate with Legal on regulatory requirements
- Support customer-facing teams with questions about AI capabilities, operation and usage measurement
- Collaborate with engineering, design, customer-facing teams, the Ginkgo team, squad PMs and Legal
Requirements
What you’ll need- 5+ years of experience in software-as-a-service environments in the B2B space
- Hands-on experience with AI-powered products, ideally LLM-based assistants or agents
- Familiarity with evaluating AI features: datasets, thresholds and regression testing
- Solid understanding of user research principles, problem framing and requirements elicitation
- Experience collaborating closely with engineering teams on complex or data-driven features
- Experience serving several product squads from a platform or shared team
- Working knowledge of AI governance and data-use questions, ideally the EU AI Act
- Proficient in English
- French is a bonus
- Fantastic communication and interpersonal skills
- Curiosity and pragmatism when approaching AI
- Comfort operating in ambiguity, with a strong sense of ownership and quality
- Enthusiastic, self-motivated, and able to work with a high degree of autonomy
- Patient and clear when helping squad PMs build on Sweepy
- Empathetic and people-oriented mindset
- Passion for sustainability and commitment to driving positive ESG impact through product innovation
Benefits
Comp & perks- Hybrid work model
- Flexibility to balance personal and professional life while staying connected with the team
- Opportunity to contribute to Sweep’s next chapter and sustainability mission
- Inclusive company culture
- B Corporation and entreprise à mission environment