Head of Engineering

LlamaIndex

. Lead and develop the engineering team, setting priorities, ownership, and accountability .

Posted 10/9/2026full-timeSan Francisco • California • United StatesLead💰 $200,000 - $300,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading engineering teams within B2B SaaS environments, focusing on delivering customer-facing products while ensuring technical excellence in model training, deployment, and backend systems. Proven ability to balance product judgment with operational efficiency and security in a fast-paced startup setting.

Highest-signal resume keywords

Engineering Team LeadershipModel Training and DeploymentBackend Systems and APIsCloud Infrastructure ManagementTechnical Communication

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Production Code DevelopmentArchitecture ReviewModel ServingModel Fine-TuningDistributed SystemsGPU UtilizationIncident ResponseTesting PracticesSecurity ReviewsAPI Development

Soft Skills

Clear CommunicationCoaching and MentoringCustomer FocusAccountabilityProduct Judgment

Tools & Technologies

ML InfrastructureDocument ProcessingOCREnterprise-Data SystemsModel Serving FrameworksDeveloper Tools

Industry Keywords

B2B SaaSMulti-TenancyAccess ControlsAuditabilitySecurity Reviews

Tech Stack

Tools & technologies

CloudDistributed Systems

About the role

Key responsibilities & impact

Lead and develop the engineering team, setting priorities, ownership, and accountability
Partner with company leadership to translate customer needs into a focused roadmap and deliver software predictably
Participate directly in architecture, code reviews, production debugging, and implementation of critical changes
Set technical direction across application services, APIs, data pipelines, and ML infrastructure
Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment
Guide model serving decisions involving latency, throughput, GPU utilization, capacity, reliability, and inference cost
Improve practices for testing, observability, security, incident response, and releases
Hire engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and accountability

Requirements

What you’ll need

Experience leading engineering teams in B2B SaaS, with responsibility for delivering and operating customer-facing products
Experience leading multiple engineering teams or technical domains with complexity comparable to a 20–30-person organization
Strong, current hands-on engineering skills, including reading and writing production code, reviewing architecture, and diagnosing complex technical problems
Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations
Understanding of tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost
Strong background in backend systems, APIs, distributed systems, and cloud infrastructure
Track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback
Good product judgment, including balancing speed with correctness, reliability, and security
Clear written and verbal communication with technical teams, customers, and company leadership
Experience scaling engineering at a Series A–C startup
Experience with document processing, OCR, extraction, retrieval, indexing, or other enterprise-data systems
Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring
Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks
Experience building developer tools or API-first products
Experience with enterprise requirements such as multi-tenancy, access controls, auditability, and security reviews
Experience developing engineering managers while staying closely involved in technical execution
Ability to work from the San Francisco office at least 3 days a week
Ability to work in the United States without requiring sponsorship, if applicable

Benefits

Comp & perks

Equity 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score