Senior Software Engineer Lead

Akamai Technologies

. Lead the design and implementation of critical platform components for Akamai Inference Cloud .

Posted 10/27/2026full-timeRemote • Massachusetts • United StatesSenior💰 $146,400 - $263,600 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing scalable AI inference workloads, leveraging distributed systems and cloud services. Proficient in mentoring engineers and driving technical solutions while ensuring operational excellence in platform engineering.

Highest-signal resume keywords

AI Inference WorkloadsDistributed SystemsKubernetesTensorRTCloud Services

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Platform EngineeringModel ServingLLM DeploymentContainerizationInfrastructure-as-CodeCI/CD PipelinesGPU InfrastructureObservabilityMonitoringDebugging

Soft Skills

MentoringTechnical Problem-SolvingCollaborationCode Quality AdvocacyDesign Discussions

Tools & Technologies

DockerVLLMTorchServeTritonREST/gRPC API

Industry Keywords

Operational ExcellenceHigh-Performance SystemsCloud-Native ArchitecturesGlobally Distributed SystemsTechnical Leadership

Tech Stack

Tools & technologies

CloudDistributed SystemsDockerGRPCKubernetes

About the role

Key responsibilities & impact

Lead the design and implementation of critical platform components for Akamai Inference Cloud
Drive technical decisions for AI inference workloads, including selecting tools, frameworks, and approaches
Mentor and guide engineers through code reviews, design discussions, and technical problem-solving
Implement and optimize containerized AI workloads with hardware-specific optimizations
Integrate inference frameworks at scale
Collaborate across teams to define technical requirements and contribute to platform standards
Ensure operational excellence and delivery of high-quality, scalable solutions
Build and optimize globally distributed systems delivering OpenAI-compatible endpoints and orchestrating inference workloads across regions

Requirements

What you’ll need

8 years of relevant experience
Bachelor's degree or its equivalent
Proficiency in distributed systems, cloud services, and platform engineering
Hands-on experience with AI inference, model serving, or LLM deployment
Working knowledge of TensorRT, vLLM, TorchServe, and Triton
Experience with Kubernetes, Docker, and cloud-native architectures
Experience building scalable, high-performance systems
Experience with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
Technical leadership through mentoring, code quality advocacy, and driving technical solutions for complex problems
Familiarity with REST/gRPC API design and development
Knowledge of GPU infrastructure and hardware acceleration
Knowledge of observability, monitoring, and debugging distributed systems

Benefits

Comp & perks

Annual bonus or incentives
Equity awards
Employee Stock Purchase Plan (ESPP)
Healthcare
401K savings plan
Company holidays
Vacation (in the form of PTO)
Sick time
Parental leave
Employee assistance program
Mental and financial wellness support
Flexible work arrangements: at home, in an office, or a combination of both