AI Solutions QA Analyst

McDermott Will & Emery

. Own the full QA lifecycle for AI-powered solutions, from unit and integration testing through system, performance, and scalability testing .

Posted 10/9/2026full-timeUnited StatesMid-LevelSenior💰 $93,000 - $142,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in the full QA lifecycle for AI-powered solutions, including unit, integration, system, and regression testing. Proficient in integrating automated test suites into Azure DevOps CI/CD pipelines and evaluating AI solution reliability.

Highest-signal resume keywords

QA Lifecycle ManagementAutomated Test IntegrationAzure DevOpsAI Tools UtilizationPerformance Testing

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Unit TestingIntegration TestingSystem TestingRegression TestingTest Script WritingBoundary TestingEdge Case TestingDefect TrackingQuality Metrics ReportingScalability Testing

Soft Skills

Analytical ThinkingLeadership

Tools & Technologies

Azure DevOpsAI-Assisted ToolsCI/CD Pipelines

Certifications & Qualifications

BS in Computer ScienceBS in Information SystemsBS in Engineering

Industry Keywords

AI-Powered ApplicationsSecurity Testing PrinciplesRegulated Industry Experience

Tech Stack

Tools & technologies

Azure

About the role

Key responsibilities & impact

Own the full QA lifecycle for AI-powered solutions, from unit and integration testing through system, performance, and scalability testing
Partner with Analysts to generate and evaluate test cases using AI-assisted tools
Focus on boundary conditions, edge cases, and AI output validation
Work with engineering to define and integrate automated test suites into the Azure DevOps CI/CD pipeline
Define system-level test strategies with the Director of QA, covering functional, regression, and non-functional testing
Coordinate with the security team to translate security testing guidance into solution-specific security test cases
Evaluate AI solution reliability across varied inputs
Maintain test documentation, defect tracking, and quality metrics
Provide leadership visibility into solution readiness
Champion a quality culture across the delivery team

Requirements

What you’ll need

4+ years of formal QA experience
Experience writing and executing test scripts across the full testing lifecycle
Strong experience with unit, integration, system, and regression testing, both manual and automated
Hands-on experience integrating test suites into CI/CD pipelines
Azure DevOps experience strongly preferred
Ability to design boundary and edge case tests for complex, data-driven applications
Active use of AI tools and ability to direct leading AI platforms to generate, evaluate, and refine test cases
Understanding of performance and scalability testing concepts
Solid grasp of defect tracking, test documentation, and quality metrics reporting
Strong analytical thinking
BS in Computer Science, Information Systems, Engineering, or equivalent experience
Preferred: experience testing AI-powered applications, including prompt-driven systems, agentic workflows, or LLM-integrated tools
Preferred: familiarity with AI-assisted test generation workflows and code-generating platforms
Preferred: exposure to security testing principles
Preferred: experience in legal, financial services, or other regulated industry environments
Preferred: knowledge of Azure DevOps, including pipeline configuration and automated test integration

Benefits

Comp & perks

Comprehensive benefits package
Discretionary performance-based bonus
Support for physical, emotional, mental, and financial health
Work-life balance support
Career opportunities and career development support
Remote-first work environment