Senior AI Platform Engineer

Truvio

. Design and run core AI platform services, including an LLM gateway, model routing, prompt and tool registries, retrieval over the context graph, and agent orchestration .

Posted 11/3/2026full-timeRemote • United Kingdom, Netherlands, Germany, Denmark, Sweden, AustriaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and running AI platform services, with a strong focus on LLMs and production systems. Proficient in backend development, cloud technologies, and ensuring compliance with data handling regulations.

Highest-signal resume keywords

Software Engineering ExperienceBackend Development in Python and/or C#/.NETCloud Experience with AzureAPI and Distributed Systems DesignInfrastructure as Code with Bicep or Terraform

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringBackend DevelopmentAPI DesignDistributed SystemsCloud ComputingMachine Learning ModelsEvaluation MetricsInfrastructure as CodeCI/CDData Handling

Soft Skills

Clear Written EnglishRemote Team Collaboration

Tools & Technologies

Azure OpenAIAI FoundryAKSContainer AppsFunctionsKey VaultGitHub ActionsAzure DevOps

Industry Keywords

LLM GatewayModel RoutingTenant IsolationGDPREU AI ActSOC 2 ControlsMicrosoft Dynamics 365Knowledge GraphsGraph DatabasesAgent Frameworks

Tech Stack

Tools & technologies

AzureCloudDistributed SystemsERPPythonTerraformVault.NET

About the role

Key responsibilities & impact

Design and run core AI platform services, including an LLM gateway, model routing, prompt and tool registries, retrieval over the context graph, and agent orchestration
Build evaluation and testing infrastructure with offline evaluations, regression suites, and production quality signals
Ensure AI is safe to run in customer ERP tenants through tenant isolation, data residency, PII handling, cost controls, audit trails, and human-in-the-loop hooks
Own observability for AI workloads, including tracing, latency, token cost, and quality dashboards per customer and feature
Ship SDKs, templates, and documentation enabling product teams to build agents quickly
Partner with the Principal AI Engineer and product teams to turn repeated needs into platform capabilities
Evaluate new models and frameworks with a focus on proven production solutions
Support Truvio product teams in delivering reliable AI features for Microsoft Dynamics 365

Requirements

What you’ll need

6+ years of software engineering experience, including at least 2 years building production systems on top of LLMs or ML models
Strong backend skills in Python and/or C#/.NET
Solid API and distributed systems design skills
Hands-on cloud experience, ideally Azure, including Azure OpenAI or AI Foundry, AKS or Container Apps, Functions, and Key Vault
Practical experience with retrieval, embeddings, vector or graph stores, and agent or tool-calling patterns
Experience measuring evals, SLOs, and cost per request
Infrastructure as code and CI/CD experience using Bicep or Terraform and GitHub Actions or Azure DevOps
Clear written English
Comfort working across time zones in a remote team
Experience with Microsoft Dynamics 365, Dataverse, or other ERP data models is a plus
Knowledge graphs or graph databases is a plus
Familiarity with MCP, Semantic Kernel, LangGraph, or similar agent frameworks is a plus
Working knowledge of GDPR, the EU AI Act, or SOC 2 controls as they apply to AI systems is a plus
Experience building internal developer platforms at a multi-product company is a plus

Benefits

Comp & perks

Remote work in Europe
Nordic hubs or Vienna welcome
Fun activities and social time together
Latest technology and workplace resources
Opportunity for professional growth and ownership
Global SaaS environment and collaboration across teams and time zones