AI Engineer – Trust & Explainability, AI Platform

MeridianLink

. Build tracing across the platform's gateway, orchestration, memory, and tool layers .

Posted 9/28/2026full-timeRemote • United StatesMid-LevelSenior💰 $104,148 - $177,600 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and maintaining observability and tracing frameworks, with a strong focus on integrating large language models and automated testing practices. Proficient in collaborating with cross-functional teams to deliver robust software solutions in production environments.

Highest-signal resume keywords

Software Engineering ExperiencePython ProficiencyLLM Observability and TracingAutomated TestingDistributed Tracing Tools

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AlgorithmsData StructuresSoftware Design FundamentalsGitDockerAI-Assisted Development ToolsLarge Language Model APIsAgent FrameworksRAG PipelinesApplication Security Testing

Soft Skills

CollaborationDocumentationProblem-Solving

Tools & Technologies

AzureAWSOpenTelemetryGenAI Semantic ConventionsOpenLLMetryLLM Evaluation ToolsDeveloper-Facing Debugging Tools

Certifications & Qualifications

Bachelor's Degree in Computer ScienceSoftware Engineering

Industry Keywords

Multi-Agent WorkflowsSaaSRegulated IndustriesTenant IsolationSecurity Operations

Tech Stack

Tools & technologies

AWSAzureDockerPythonTypeScript

About the role

Key responsibilities & impact

Build tracing across the platform's gateway, orchestration, memory, and tool layers
Correlate actions across agents in multi-agent workflows, including handoffs, parallel branches, and retries
Build developer-facing trace views and human-readable explanation layers
Build customer-facing explanation records, confidence and provenance metadata, and summaries of what agents relied on
Partner with product engineers on the Document Request Agent and MLM agents
Evaluate, integrate, and extend open-source observability, tracing, and evaluation frameworks
Build and maintain evaluation tooling including golden dataset management, test runners, scoring pipelines, and regression reporting
Run model and prompt comparisons and report changes
Build red-team and adversarial test suites for prompt injection, jailbreaks, tool misuse, and data exfiltration
Build automated tests proving tenant isolation across memory, retrieval, tool calls, and model context
Share red-team findings with Security Operations and incorporate threat models into platform tests
Participate in design discussions and code reviews
Support onboarding of L1 AI Engineer teammates and contribute to documentation
Complete assigned features and bug fixes independently, write tests, monitor issues, and document implementation decisions

Requirements

What you’ll need

3+ years of professional software engineering experience, delivering features independently in a production environment
Solid understanding of algorithms, data structures, and software design fundamentals
Proficiency with Git, Docker, automated testing, and modern scripting languages
Active daily use of AI-assisted development tools
Bachelor's degree in Computer Science, Software Engineering, or equivalent experience
Hands-on experience building software that integrates large language models (LLM APIs, agent frameworks, RAG pipelines, or similar)
Proficiency in Python with production experience; TypeScript a plus
Hands-on experience in LLM observability and tracing, LLM evaluation and testing, agent frameworks and multi-agent orchestration, or application security testing
Experience with distributed tracing or observability tooling in a production system
Strong automated testing instincts, including testing non-deterministic systems
Experience running workloads on Azure or AWS, including identity and access management, networking, and secrets management
Preferred: experience with OpenTelemetry, GenAI semantic conventions, OpenLLMetry, LLM observability/evaluation tools, open-source AI projects, AWS Bedrock or Azure OpenAI, multi-tenant SaaS, regulated industries, and developer-facing debugging or visualization tools
Must complete MeridianLink's background check, credit check, and drug test as part of the offer process
Must be legally authorized to work in the United States or address sponsorship requirements

Benefits

Comp & perks

Insurance coverage (medical, dental, vision, life, and disability)
Flexible paid time off
Paid holidays
401(k) plan with company match
Remote work