LLM Engineer

• Own the LLM gateway, including routing, provider failover, rate limits, retries and cost attribution across multiple model providers
• Deploy, version and deprecate models across clouds, regions and environments, including quota and capacity planning managed as infrastructure as code
• Build the shared evaluation platform with versioned datasets, experiment tracking, run and result schemas, reporting and trace linkage back to the run
• Own infrastructure for asynchronous and long-running AI workloads
• Own observability for AI traffic, including latency, retries and fallbacks, token usage, cost and errors by team and use case
• Participate in the on-call rotation, run incidents and close follow-ups
• Implement platform security and compliance controls, including retention, access control, RBAC and SSO
• Define and maintain integration contracts between the platform and consuming teams
• Partner with product and ML engineers to turn requirements into self-service platform capabilities

LLM Engineer jobs in Netherlands

Senior Software Engineer – LLM Ops, Evals