Functional Leader – Quality Assurance

EXL

. Develop and execute test cases, scripts, and procedures for Conversational AI and Agentic AI applications .

Posted 10/16/2026full-timeIndiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in testing Conversational AI and Agentic AI applications, including functional, regression, and performance testing. Proficient in defect management, validation techniques, and compliance with Responsible AI principles.

Highest-signal resume keywords

Conversational AI TestingDefect ManagementLarge Language Models (LLMs)JIRA for Defect TrackingAI Evaluation Metrics

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software TestingQuality AssuranceValidation TechniquesFunctional TestingIntegration TestingPerformance TestingSecurity TestingUser Acceptance TestingData AnalysisTest Strategy Design

Soft Skills

Analytical SkillsProblem-Solving SkillsCollaborationAdaptabilityTroubleshooting Skills

Tools & Technologies

JIRAExcelPostmanSwaggerAI Testing FrameworksAgentic AI FrameworksCloud AI PlatformsAutomated Testing ToolsVersion Control SystemsNLP/NLU

Certifications & Qualifications

BS/BE Degree

Industry Keywords

Conversational AIGenerative AIAgentic AIAI Agent ArchitecturesPrompt EngineeringAI ComplianceQuality MetricsContinuous ImprovementMulti-Agent CollaborationResponsible AI

Tech Stack

Tools & technologies

CloudSDLC

About the role

Key responsibilities & impact

Develop and execute test cases, scripts, and procedures for Conversational AI and Agentic AI applications
Collaborate with product managers, developers, data scientists, prompt engineers, and other stakeholders throughout the development lifecycle
Perform functional, regression, integration, performance, and end-to-end testing across conversational AI platforms and agent-based AI systems
Validate AI agent decision-making, task execution, multi-step workflows, reasoning paths, and interactions with external tools, APIs, and knowledge sources
Test LLM-powered applications for accuracy, relevance, consistency, hallucinations, guardrail compliance, and response quality
Evaluate agent orchestration, including multi-agent collaboration, task decomposition, context management, memory retention, and tool utilization
Identify, document, and track defects using JIRA and provide detailed testing reports
Analyze requirements and design comprehensive test strategies covering conversational flows, autonomous agent behaviors, integrations, and edge cases
Conduct prompt, response, and workflow validation
Perform security, privacy, bias, and responsible AI testing for organizational and regulatory compliance
Generate test reports, dashboards, and quality metrics for stakeholders
Contribute to continuous improvement of AI testing processes, frameworks, methodologies, and automation capabilities

Requirements

What you’ll need

3-7 years of experience in software testing and quality assurance, with exposure to Conversational AI, Generative AI, Agentic AI, or similar AI technologies
Strong knowledge of QA methodologies, SDLC, STLC, defect management, and validation techniques
Experience testing conversational AI platforms, chatbots, voicebots, virtual assistants, or AI-driven applications
Understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), prompt engineering concepts, and AI agent architectures
Experience with JIRA for defect tracking and project management
Strong proficiency in Excel for data analysis, reporting, and test metrics
Familiarity with API testing tools such as Postman, Swagger, or equivalent
Experience in functional, integration, performance, security, and user acceptance testing
Understanding of AI evaluation metrics, model behavior analysis, and conversational testing frameworks
Ability to work effectively in cross-functional teams and adapt to fast-paced environments
Strong analytical, troubleshooting, and problem-solving skills
BS/BE degree
Desired: experience with Agentic AI frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, LangChain, or similar platforms; automated testing tools and scripting languages; NLP/NLU; cloud AI platforms; version control systems; AI test automation frameworks; Responsible AI principles