SDET

• Build evaluation suites for LLM and ML features, including curated test sets, reference-answer scoring, justified LLM-as-judge evaluation, and human review where appropriate.
• Define measurable quality standards with the delivery team before launch and hold releases to them.
• Test retrieval pipelines end to end, including chunking, indexing, retrieval quality, answer grounding, and missing-document behavior.
• Write regression tests for non-deterministic output using semantic similarity, structured-output validation, tolerance bands, and repeated sampling.
• Test client-relevant failure modes including hallucination, prompt injection, cross-tenant or cross-session data leakage, refusal and over-refusal, and Thai-language degradation.
• Track cost and latency alongside accuracy before release.
• Detect post-release drift by comparing production samples with the baseline and raise issues early.
• Design and maintain automated test suites for APIs, services, data pipelines, and web applications built for client projects.
• Run tests in CI and maintain fast, stable suites, treating flakiness as a defect.
• Set the test strategy at engagement start, including automation scope, manual testing, exit criteria, and client evidence.

SDET jobs in Thailand

Senior QA Automation Engineer