FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in validating AI models and systems, with a strong foundation in software testing principles and methodologies. Proficient in Python programming for test development and automation, with experience in Agile environments and collaboration with multidisciplinary teams.
Highest-signal resume keywords
AI Model TestingPython ProgrammingPairwise TestingLarge Language Models (LLMs)Agile Methodologies
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI/ML ConceptsModel Validation TechniquesData AnalysisTest Scenario DesignBias TestingDrift TestingAutomation FrameworksQuality Engineering PracticesData Quality AssessmentExploratory Data Analysis
Soft Skills
Analytical SkillsProblem-SolvingCommunicationStakeholder ManagementCollaboration
Tools & Technologies
SeleniumPlaywrightPyTestMicrosoft AzureAWSGoogle Cloud PlatformGitHub Copilot
Industry Keywords
Generative AIAgentic AITesting MethodologiesQuality StandardsData Augmentation
Tech Stack
Tools & technologiesAWSAzureCloudGoogle Cloud PlatformPythonSelenium
About the role
Key responsibilities & impact- Validate AI models and systems across Narrow AI, Generative AI, and Agentic AI implementations
- Perform data collection, data generation, data augmentation, exploratory data analysis, and assessment of data quality, bias, and privacy considerations
- Evaluate AI model outputs against functional, business, and performance metrics
- Identify defects, inconsistencies, and improvement opportunities
- Design and execute test scenarios for AI-based applications
- Apply pairwise, metamorphic, back-to-back, bias, and drift testing
- Use Python-based frameworks and automation tools to improve testing efficiency and coverage
- Collaborate with developers, data scientists, product owners, and stakeholders to resolve quality issues
- Support validation of Large Language Models and Agentic AI systems
- Recommend enhancements to testing processes, methodologies, and quality standards
- Work within Agile teams to deliver high-quality AI solutions
Requirements
What you’ll need- Proven experience in testing AI models and systems
- Strong understanding of software testing principles, methodologies, and quality engineering practices
- Foundational knowledge of AI/ML concepts, algorithms, and model validation techniques
- Understanding of Large Language Models (LLMs), Generative AI, and Agentic AI systems
- Experience with pairwise testing, metamorphic testing, bias testing, drift testing, and back-to-back testing
- Proficiency in Python programming for test development, validation, and automation
- Experience with Selenium, Playwright, PyTest, or similar test automation frameworks
- Knowledge of Microsoft Azure, AWS, or Google Cloud Platform
- Exposure to GitHub Copilot and AI-assisted development tools
- Strong analytical, troubleshooting, and problem-solving capabilities
- Excellent communication and stakeholder management skills
- Ability to collaborate effectively in Agile delivery environments and multidisciplinary teams
Benefits
Comp & perks- Flexible environment
- Health and wellness packages
- Rewards
- Learning opportunities
- Professional development opportunities
- Mentorship and opportunities to build new skills and take on leadership roles
- Diversity, equity, and inclusiveness culture
- Disability-related adjustments or accommodations during recruitment