FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and managing secure, large-scale LLM serving platforms on GPU infrastructure, ensuring data privacy and regulatory compliance. Proficient in Kubernetes, LLM inference engines, and infrastructure as code methodologies.
Highest-signal resume keywords
Kubernetes Infrastructure ManagementLLM Inference Engine ExperienceInfrastructure As Code (Terraform)CI/CD and Observability ToolingRegulatory Compliance (DORA)
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Large-Scale Infrastructure DesignGPU Workload ManagementAccess Control ImplementationCapacity PlanningArchitecture Guidelines Writing
Tools & Technologies
VLLMSGLangTensorRT-LLMNVIDIA GPUsAMD InstinctCUDAROCm
Industry Keywords
Data PrivacyEnterprise ArchitectureSecurity DesignBanking ComplianceDORA Compliance
Tech Stack
Tools & technologiesKubernetesTerraform
About the role
Key responsibilities & impact- Design and lead a secure, internal LLM serving platform on fully controlled GPU hardware
- Ensure complete data privacy and independence from external model providers
- Manage the full serving stack, including GPU clusters, inference engines, access control and capacity planning
- Deliver a reliable AI service for the entire organization
- Set platform standards and ensure strict regulatory compliance, such as DORA
- Partner with security, operations and LLM scientists to deploy optimized models
Requirements
What you’ll need- Experience designing and running large-scale infrastructure on Kubernetes, including GPU workloads
- Hands-on experience with LLM inference engines (vLLM, SGLang, TensorRT-LLM or similar)
- Infrastructure as code experience (Terraform or similar)
- Experience with CI/CD and observability tooling
- Understanding of security, identity and network design in enterprise environments
- Experience writing architecture guidelines and working with enterprise architecture teams
- Experience configuring and managing enterprise-grade GPUs (NVIDIA or AMD Instinct) and their respective acceleration stacks (CUDA or ROCm) is a plus but not a requirement
- Background in banking or other highly regulated industries, with familiarity with DORA or equivalent compliance frameworks, is a plus but not a requirement