FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates extensive backend engineering expertise with a strong proficiency in Go, focusing on building low-latency, high-reliability APIs and enterprise-grade infrastructure. Capable of integrating with LLM provider APIs and implementing robust systems for online AI evaluation.
Highest-signal resume keywords
Backend Engineering ExperienceProficiency In GoExperience With LLM Provider APIsCloud Infrastructure ExperienceAPI Gateway Development
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Backend EngineeringAPI DevelopmentDistributed SystemsStreaming ManagementRate LimitingToken ManagementFailure RecoveryResponse NormalizationInfrastructure InstrumentationEnterprise-Grade Features
Soft Skills
Product-Oriented MindsetComfort With AmbiguityCollaboration
Tools & Technologies
AWSGCPAzureKubernetesTerraformPostgresRedisStripeMetronomeOrb
Industry Keywords
SOC 2 ComplianceAI/ML InfrastructureModel ServingInference FrameworksAudit Logging
Tech Stack
Tools & technologiesAWSAzureCloudDistributed SystemsGoogle Cloud PlatformKubernetesPostgresRedisTerraformGo
About the role
Key responsibilities & impact- Design and implement low-latency, high-reliability APIs for leaderboards, models, and arenas
- Handle SSE and streaming responses across heterogeneous model providers
- Implement partial failure recovery, mid-stream fallback, and consistent response normalization
- Build enterprise-grade infrastructure including rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC 2 compliance capabilities
- Instrument infrastructure with distributed tracing, latency breakdowns, token-level usage tracking, and real-time dashboards
- Integrate with the core evaluation platform, Arena data, and customer-specific benchmarks
- Collaborate with the research team to turn novel ideas into full-featured products
- Contribute to the backend of the Leaderboards and Evals platforms
- Help unify public and private data architectures
- Work closely with researchers, engineers, and product leadership as an early infrastructure-team member
- Operate as a hands-on individual contributor building foundational infrastructure for online AI evaluation systems
Requirements
What you’ll need- ~5+ years of backend engineering experience, with meaningful time spent on distributed systems, infrastructure, or developer-facing platforms
- Proven delivery on meaningful backend work for Senior level
- Extensive, deep experience owning backend systems end to end for Staff level
- Strong proficiency in Go; Go is the primary backend language and a must-have
- Experience with LLM provider APIs such as OpenAI, Anthropic, and Google
- Working understanding of streaming, token management, rate limits, and model-specific quirks
- Product-oriented mindset focused on developer experience
- Comfort with ambiguity and wearing many hats in a startup environment
- Legally authorized to work in the US
- Nice to have: cloud infrastructure experience with AWS, GCP, or Azure
- Nice to have: Kubernetes, Terraform, Postgres, and Redis
- Nice to have: experience building API gateways, proxies, or developer tools
- Nice to have: background in AI/ML infrastructure, model serving, inference, or evaluation frameworks
- Nice to have: enterprise-ready features such as SSO, RBAC, audit logs, and multi-tenancy
- Nice to have: billing infrastructure experience with Stripe, Metronome, or Orb
- Nice to have: familiarity with vLLM, LiteLLM, or LangChain
Benefits
Comp & perks- Equity aligned to the market where the team member is based
- Comprehensive health and wellness benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Additional support programs
- Opportunity to work on cutting-edge AI with a small, mission-driven team
- Culture that values transparency, trust, and community impact
