FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Software Engineer – LLM Ops, Evals
DataSnipper. Own the LLM gateway, including routing, provider failover, rate limits, retries and cost attribution across multiple model providers .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in backend engineering and platform management, with a strong focus on LLM infrastructure, observability, and compliance. Proficient in deploying and maintaining scalable services across cloud environments while ensuring security and performance.
Highest-signal resume keywords
Production PythonLLM Inference InfrastructureInfrastructure As CodeObservability ToolsPlatform Security
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Backend EngineeringLLM InferenceRate LimitingCost AttributionCapacity PlanningLoad TestingDocument AISynthetic Data PipelinesAnonymisationRBAC
Soft Skills
Incident ManagementCollaboration
Tools & Technologies
AzureGCPTerraformOpenTelemetryGrafanaTemporal
Industry Keywords
AuditAccountingFintechCompliancePII Handling
Tech Stack
Tools & technologiesAzureCloudGoogle Cloud PlatformGrafanaPythonTerraform
About the role
Key responsibilities & impact- Own the LLM gateway, including routing, provider failover, rate limits, retries and cost attribution across multiple model providers
- Deploy, version and deprecate models across clouds, regions and environments, including quota and capacity planning managed as infrastructure as code
- Build the shared evaluation platform with versioned datasets, experiment tracking, run and result schemas, reporting and trace linkage back to the run
- Own infrastructure for asynchronous and long-running AI workloads
- Own observability for AI traffic, including latency, retries and fallbacks, token usage, cost and errors by team and use case
- Participate in the on-call rotation, run incidents and close follow-ups
- Implement platform security and compliance controls, including retention, access control, RBAC and SSO
- Define and maintain integration contracts between the platform and consuming teams
- Partner with product and ML engineers to turn requirements into self-service platform capabilities
Requirements
What you’ll need- 5+ years in backend or platform engineering, with strong production Python
- Experience building or running LLM inference infrastructure, including a gateway or routing layer with multiple providers, failover, rate limiting and cost attribution
- Experience with cloud at the infrastructure level and infrastructure as code; Azure, GCP and Terraform
- Experience running a shared service in production, including on-call, incidents, postmortems and SLOs
- Hands-on experience with observability tools such as OpenTelemetry and Grafana, including instrumenting services and designing dashboards and alerts
- Comfort with privacy and compliance work, including PII handling, anonymisation, retention and access control
- Experience building platform or shared-service capabilities consumed by multiple internal teams
- Experience with LLM or agent evaluation
- Experience with Temporal or another durable workflow engine
- Experience with self-hosted inference, capacity planning and load testing
- Experience with synthetic data or document anonymisation pipelines
- Experience with document AI, including VLMs, OCR, structured extraction and related metrics
- Domain experience in audit, accounting or fintech
Benefits
Comp & perks- 🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account DataSnipper Website LinkedIn All Job Openings 201 - 500 employees Founded 2017 ☁️ SaaS 🤝 B2B 💸 Finance 💰 $100M Series B - DataSnipper on 2024-02 SaaS
- B2B
- Finance DataSnipper is a Netherlands-based scale-up that provides software to empower audit and finance teams worldwide. With a team of over 200 professionals from 40+ nationalities, the company focuses on improving productivity and accuracy for audit and finance professionals through product engineering, customer success, and partnerships. DataSnipper emphasizes fast growth, customer-centric values (EMPWR), sustainability (1% for the planet), and offers typical scale-up perks and global teams across sales, marketing, and operations. Senior Software Engineer – LLM Ops, Evals 🔥 1 hour ago 🏢🏡 Amsterdam – Hybrid ⏰ Full Time 🟠 Senior 🗣️ LLM Engineer 👻 Ghost score 12% Azure Cloud Google Cloud Platform Grafana Python Terraform Apply Now Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
- Own the LLM gateway, including routing, provider failover, rate limits, retries and cost attribution across multiple model providers
- Deploy, version and deprecate models across clouds, regions and environments, including quota and capacity planning managed as infrastructure as code
- Build the shared evaluation platform with versioned datasets, experiment tracking, run and result schemas, reporting and trace linkage back to the run
- Own infrastructure for asynchronous and long-running AI workloads
- Own observability for AI traffic, including latency, retries and fallbacks, token usage, cost and errors by team and use case
- Participate in the on-call rotation, run incidents and close follow-ups
- Implement platform security and compliance controls, including retention, access control, RBAC and SSO
- Define and maintain integration contracts between the platform and consuming teams
- Partner with product and ML engineers to turn requirements into self-service platform capabilities 🎯 Requirements
- 5+ years in backend or platform engineering, with strong production Python
- Experience building or running LLM inference infrastructure, including a gateway or routing layer with multiple providers, failover, rate limiting and cost attribution
- Experience with cloud at the infrastructure level and infrastructure as code; Azure, GCP and Terraform
- Experience running a shared service in production, including on-call, incidents, postmortems and SLOs
- Hands-on experience with observability tools such as OpenTelemetry and Grafana, including instrumenting services and designing dashboards and alerts
- Comfort with privacy and compliance work, including PII handling, anonymisation, retention and access control
- Experience building platform or shared-service capabilities consumed by multiple internal teams
- Experience with LLM or agent evaluation
- Experience with Temporal or another durable workflow engine
- Experience with self-hosted inference, capacity planning and load testing
- Experience with synthetic data or document anonymisation pipelines
- Experience with document AI, including VLMs, OCR, structured extraction and related metrics
- Domain experience in audit, accounting or fintech Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Generative AI Engineer – Python, Azure, RAG, FastAPI 🕒 October 30, 2025 Wypoon Technologies 51 - 200 💼 Consulting 📦 Logistics 📣 Marketing Website LinkedIn All Job Openings Generative AI Engineer focused on building and deploying GenAI solutions at Wypoon Technologies. Work closely with clients and teams using Azure-based platforms in a hybrid working environment. 🏢🏡 Amsterdam – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🗣️ LLM Engineer Azure Cyber Security Docker Kubernetes Postgres Python Vault View More LLM Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Remote jobs Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources About us Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Is Remote Rocketship legit? Privacy policy Terms of service Job board SEO course Remote Job Search MasterClass Resume Review AI Apply Copilot OpenClaw job finder API docs Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs