ML Engineer, Retrieval – Grounded Generation

Red Cell Partners

. Own the system test plan for functional, integration, performance, and load testing .

Posted 11/9/2026full-timeRemote • United StatesMid-LevelSenior💰 $135,000 - $170,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive experience in software quality engineering and test automation, with a strong focus on building and maintaining automated test suites integrated into CI/CD processes. Proficient in performance and load testing, as well as producing clear, audit-ready documentation and test reports.

Highest-signal resume keywords

Test Automation Using Python With PytestJavaScript/TypeScript With PlaywrightExperience With Performance And Load TestingCI/CD Integration For Automated Test SuitesActive US Secret Clearance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software Quality EngineeringTest AutomationPerformance TestingLoad TestingAutomated Test SuitesStatistical LiteracyTest Plan OwnershipApplication Code ReasoningAI-Assisted DevelopmentClear Documentation

Soft Skills

Judgment About Testing PracticesWillingness To Report Unfavorable ResultsCollaboration With Engineering TeamsAccountability For Acceptance CriteriaCommunication Of Test Results

Tools & Technologies

PytestPlaywrightCypressSeleniumJMeterK6LocustAI-Assisted TestingTest Data ManagementTest Infrastructure

Certifications & Qualifications

Active US Secret ClearanceActive Top Secret Clearance (Preferred)

Industry Keywords

DevSecOpsRMFATO ExperienceContract/API TestingModel CardsNIST AI RMFSection 508 VerificationWCAG Verification

Tech Stack

Tools & technologies

CypressJavaScriptJMeterPythonSeleniumTypeScript

About the role

Key responsibilities & impact

Own the system test plan for functional, integration, performance, and load testing
Translate product acceptance criteria into executable tests
Review acceptance criteria before development and identify ambiguity or unverifiable requirements
Hold engineering, platform, and partner teams accountable to acceptance criteria and release evidence
Collaborate daily with engineering while independently reporting test results
Plan and coordinate customer user acceptance testing and track findings to resolution
Build and maintain automated test suites integrated into CI/CD as release gates
Establish automated coverage standards and report against them
Build performance and load testing for expected user loads
Maintain regression coverage across releases
Build labeled evaluation sets with subject-matter experts
Design and run sampled audits of automated decisions
Measure system misses, correct outcomes, and user overrides
Document measures, data, and release evidence
Produce evidence independently of model builders
Maintain version inventories across builds, models, configurations, and thresholds
Produce test reports, evaluation records, and rollback criteria for each release
Verify test environments meaningfully match production
Hold the release gate so no release ships without required evidence

Requirements

What you’ll need

5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership
Clear point of view on how testing should be done and judgment about worthwhile practices
Strong coding ability in a test-automation language and framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium
Ability to read and reason about application code under test
Routine use of AI-assisted development, with judgment about verification of AI output
Experience building automated test suites and integrating them into CI/CD as release gates
Experience owning a test plan through review and acceptance
Experience testing against requirements rather than implementation, working with product owners or end users
Experience with performance and load testing
Working statistical literacy, including sampling design and measurement confidence
Experience measuring what a system misses, not only what it gets right
Willingness to report unfavorable results independently
Ability to gate work owned by people outside your reporting line
Clear, audit-ready written documentation
Willingness to hold and explain a release gate
US Citizenship required
Active US Secret clearance required from the start, with favorable investigation and CAC eligibility
Willingness to travel up to 25% to customer sites, DEFCON AI HQ, and vendor facilities
Preferred: active Top Secret clearance; government DevSecOps, RMF, or ATO experience; formal accreditation/audit evidence; contract/API testing; test data management; test infrastructure; AI-assisted testing; JMeter, k6, Locust, or comparable tools; ML/model-output evaluation including groundedness and citation checking; model cards or NIST AI RMF; Section 508 and WCAG verification

Benefits

Comp & perks

Competitive salary, bonus, and equity package
100% employer-paid comprehensive health insurance including medical, dental, and vision for you and your family
Unlimited PTO, with manager/management approval
Flexible work environment where you manage your work day
14 weeks of fully paid parental leave
Career track opportunity with potential for rapid advancement with strong performance
Opportunities for professional development and continued learning
Optional 401K, FSA, and equity incentives
Mental health benefits through Tara Mind
Cost-effective GLP-1 solutions through Crux