Mid-Level Systems Quality Analyst

Grupo IOB

. Plan and execute testing strategies for AI agents, MCP servers, and APIs .

Posted 9/19/2026full-timeRemote • BrazilMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in planning and executing testing strategies for AI agents and APIs, with a strong focus on both manual and automated testing methodologies. Proficient in investigating bugs, validating AI responses, and collaborating effectively with cross-functional teams throughout the development lifecycle.

Highest-signal resume keywords

Automated TestingFunctional TestingLoad TestingGit Version ControlCI/CD

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Regression TestingPerformance TestingTest Case DocumentationBug InvestigationCode Adjustment

Soft Skills

Analytical ThinkingTechnical Curiosity

Tools & Technologies

GitHub ActionsGitLab CIMCPAI AgentsLLM-Based Systems

Industry Keywords

APIsIntegration TestingEnd-to-End TestingAI SystemsChatbots

About the role

Key responsibilities & impact

Plan and execute testing strategies for AI agents, MCP servers, and APIs
Perform functional, integration, regression, and performance testing
Build and maintain automated unit, integration, and end-to-end tests
Validate AI agent responses and behavior, including prompt scenarios, hallucinations, and edge cases
Investigate bugs through to their root cause
Propose or implement minor fixes directly in the code in collaboration with the development team
Document test cases, evidence, and quality reports
Collaborate with developers, AI engineers, and product managers throughout the development lifecycle

Requirements

What you’ll need

Previous experience as a QA professional or Test Analyst, working with both manual and automated testing
Ability to read and understand code, with the autonomy to propose or make minor adjustments and fixes
Knowledge of Git version control
Strong analytical thinking and technical curiosity to investigate the non-deterministic behavior commonly found in AI systems
Experience testing LLM-based systems, AI agents, or chatbots
Familiarity with the MCP (Model Context Protocol) or AI-powered tool integrations
Experience with load and performance testing for APIs
Knowledge of CI/CD, including GitHub Actions and GitLab CI

Benefits

Comp & perks

100% remote work
Health insurance
Dental insurance
IOB Benefits Card
Childcare assistance
Life insurance
Internet allowance
Profit-sharing plan (PLR)
Partnerships with educational institutions
Access to an Assessment and Development Platform
Training and professional development programs
Continuous feedback culture