Lead QA Engineer – AI Voice

Lingaro

. Design the voice AI test strategy and process from speech input through speech recognition (ASR), the LLM, tools and integrations, to speech output .

Posted 11/5/2026full-timeRemote • PolandSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Voice AI Testing, including Speech Recognition and Output, with a strong focus on Automation and Multilingual Coverage. Proven ability to lead UAT processes, manage defects, and communicate effectively with stakeholders.

Highest-signal resume keywords

Voice AI TestingTest Automation in Python or JavaScript/TypeScriptEnd-to-End Testing and UAT LeadershipExperience with Cloud Speech ServicesISTQB Certification

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software QASpeech RecognitionSpeech OutputTest AutomationVoice Quality MetricsLLM EvaluationAPI TestingTroubleshootingDefect ManagementResponsible-AI Testing

Soft Skills

Structured CommunicationMentoringStakeholder Management

Tools & Technologies

JiraAzure DevOpsPostmanHammingCekuraCovalBotiumPromptfooDeepEvalLangSmith

Certifications & Qualifications

ISTQB Certification

Industry Keywords

Conversational AIMultilingual CoverageCustomer Journey ValidationTelephony BasicsSIPTwilioAzure Communication Services

Tech Stack

Tools & technologies

AWSAzureCloudJavaScriptPythonTypeScript

About the role

Key responsibilities & impact

Design the voice AI test strategy and process from speech input through speech recognition (ASR), the LLM, tools and integrations, to speech output
Define the automation approach and how it scales, including multilingual coverage of around 100 languages
Test predictable behaviour such as intents, routing, and integrations, as well as non-deterministic AI behaviour
Evaluate prompts and LLM responses using test datasets and scoring criteria
Lead UAT planning, scenarios, test data, business tester coordination, and sign-off recommendation
Gather business acceptance criteria and turn them into measurable targets
Own defect and risk management and provide release go/no-go recommendations
Replan and communicate options when development is delayed
Challenge stakeholders on readiness and quality
Mentor the Regular engineer

Requirements

What you’ll need

At least 6 years of experience in software QA
At least 2 years of experience testing voice agents or conversational AI in live delivery
Experience leading E2E and UAT, and working as the lone or lead QA with limited guidance
Experience in international or distributed teams
Voice AI testing, including speech recognition, speech output, latency, interruptions, accents, and noise
Knowledge of voice quality metrics such as word error rate, intent accuracy, and task completion
Practical understanding of how LLMs work and fail
Test automation in Python or JavaScript/TypeScript, with CI/CD and API testing such as Postman
Experience using cloud speech services such as Azure, Google, AWS, or similar to generate test calls
Practical experience with Jira or Azure DevOps and a test management tool
Practical experience troubleshooting from logs, transcripts, and call recordings
Structured, recommendation-first communication with technical and business stakeholders
English at least B2
Voice testing platforms such as Hamming, Cekura, Coval, or Botium are a plus
Experience with LLM evaluation tools such as Promptfoo, DeepEval, or LangSmith is a plus
Experience with telephony basics such as SIP, Twilio, or Azure Communication Services is a plus
ISTQB certification is a plus
Experience in Responsible-AI testing, including PII, bias, and safety, is a plus
Experience validating customer journeys across multiple markets is a plus

Benefits

Comp & perks

Stable employment
“Office as an option” model: choose to work remotely or in the office
Workation in line with the workation policy
Great Place to Work® certified employer
Flexibility regarding working hours and preferred form of contract
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs
Upskilling support, capability development programs, Competency Centers, knowledge sharing sessions, community webinars, and 110+ training opportunities yearly
Internal promotion and career growth opportunities
Diverse, inclusive, and values-driven community
Autonomy to choose the way you work
Referral bonuses
Activities supporting well-being and health
Opportunities to donate to charities and support the environment
Modern office equipment purchased for you or available to borrow, depending on location