FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in quality assurance for software features, including risk-based testing, automated test suite development, and LLM evaluation. Proficient in collaborating with engineering teams to shape acceptance criteria and ensure comprehensive test coverage.
Highest-signal resume keywords
Automated Test Suite DevelopmentExploratory TestingAI/LLM EvaluationCI IntegrationSQL and PostgreSQL
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Test AutomationTest DesignPythonDjangoReactPlaywrightCypressPytestSQLLLM Testing
Soft Skills
Clear Written Communication
Tools & Technologies
CI PipelinesAgentic Coding ToolsAWSKubernetes
Industry Keywords
HIPAADocument ProcessingUnstructured DataContract TestsSensitive Data
Tech Stack
Tools & technologiesAWSCypressDjangoKubernetesPostgresPythonReactSQL
About the role
Key responsibilities & impact- Own quality for a feature or product area, including risk-based test strategy, regression scope, and release sign-off
- Build and maintain automated test suites integrated with CI
- Troubleshoot flaky tests and fix underlying causes
- Run exploratory testing against lien workflows and understand application risk areas and failure modes
- Test LLM-based features by building evaluation suites, setting acceptance thresholds, checking LLM-judge agreement with human labels, and adding adversarial and prompt-injection cases
- Use agentic coding tools to build and maintain automation and review AI-generated tests
- Shape Acceptance Criteria with the Product Owner and identify testability gaps before development
- Recommend coverage and risk priorities
- Shepherd defects from triage through resolution and write reproducible reports
- Work directly with embedded engineering teams day to day
Requirements
What you’ll need- 3+ years on a QA or software development team, including experience owning test coverage for a feature or product area
- Strong skills in at least one of exploratory testing and test design, test automation and infrastructure, or AI/LLM evaluation, with working proficiency in a second
- Hands-on experience building and maintaining automated test suites in a modern framework (Playwright, Cypress, pytest, or similar), including diagnosing flaky tests and fixing their root causes
- Comfortable reading and writing code; ability to understand Python/Django and React changes and their risks
- Experience integrating tests into CI pipelines and deciding which checks should gate a merge or a deploy
- Strong SQL and experience with PostgreSQL
- Hands-on experience testing LLM or ML features, including building golden datasets, measuring output quality, and understanding failure modes
- Experience using or experimenting with agentic coding tools and judging when their output needs closer review
- Clear written communication for defect reports, test plans, and release sign-offs
- Applicants must be authorized to work in the United States without employer-sponsored visa support now or in the future
- Nice to have: experience testing document processing or extraction from unstructured data
- Nice to have: experience testing third-party integrations using contract tests, sandboxes, or recorded fixtures
- Nice to have: familiarity with AWS and Kubernetes
- Nice to have: experience handling sensitive data such as PHI or working under HIPAA-style requirements
Benefits
Comp & perks- Private Health Care Plan (Medical, Dental & Vision)
- Company HSA contributions for HDHP participants
- Flexible Spending Accounts (Health & Dependent Care)
- Company-Paid Short-Term Disability Coverage
- Voluntary Long-Term Disability, Life, AD&D, and Supplemental Coverage Options
- 401(k) Plan with Company Match
- Paid Time Off (Vacation, Sick Time & 10 paid Holidays)
- Parental Leave
- Discretionary quarterly bonus
