Software Engineer III – AI Systems

Walmart

. Build agentic AI services involving planning, tool use, retrieval, and feedback loops .

Posted 11/7/2026full-timeUnited StatesJuniorMid-Level💰 $90,000 - $180,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and optimizing AI services, including orchestration, memory management, and performance tuning. Proficient in developing scalable backend services with a strong focus on GPU-accelerated pipelines and distributed computing frameworks.

Highest-signal resume keywords

Python ProficiencyExperience With RayGPU-Aware ProgrammingCI/CD ImplementationProduction Backend Services

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringData StructuresAlgorithmsConcurrencyNetworkingSystems DesignMicroservicesPerformance OptimizationAgent FrameworksFeature Stores

Soft Skills

Excellent CommunicationMentoring Abilities

Tools & Technologies

RAPIDSFastAPIFlaskKubernetesDockerPyTorch ProfilerNsightLine-ProfilerRay DashboardTriton Inference Server

Industry Keywords

AI ServicesML ContextsVector DatabasesEmbedding ServicesCompliance Controls

Tech Stack

Tools & technologies

DockerFlaskJavaKubernetesMicroservicesPythonPyTorchRaySparkC++Go

About the role

Key responsibilities & impact

Build agentic AI services involving planning, tool use, retrieval, and feedback loops
Implement orchestration, memory, tooling, evaluation, and guardrails for agentic workflows
Collaborate with data science and machine learning engineering partners to productionize LLMs, GNNs, and embedding services behind stable APIs and SDKs
Develop GPU-accelerated pipelines using RAPIDS and optimize end-to-end performance
Use Ray or similar frameworks for distributed compute, batch/stream processing, and workflow orchestration
Profile and optimize CPU/GPU, memory, and I/O bottlenecks using caching, vectorization, and asynchronous patterns
Design and maintain microservices for training/inference, vector indexing, and real-time decisioning
Implement observability, fault tolerance, autoscaling, and cost-aware execution
Create internal SDKs and CLIs for developer workflows, testing, and reproducibility
Establish CI/CD for AI services, including unit, integration, and end-to-end tests, canaries, blue/green deployments, and rollback
Integrate feature stores, vector databases, artifact registries, and model catalogs
Enforce security, privacy, and compliance controls
Partner with product, platform, and DS/MLE teams to align requirements, SLAs, and success metrics
Document systems, contribute to design reviews and engineering best practices, and mentor peers

Requirements

What you’ll need

Bachelor’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 2 years’ experience in software engineering or related area; or 4 years’ experience in software engineering or related area
4+ years building production backend or platform services, preferably in AI/ML contexts
Python proficiency plus one of Go, Java, or C++
Experience with Ray, Spark, or Dask
Experience with RAPIDS (cuDF/cuML/cuGraph) and GPU-aware programming concepts
Experience with FastAPI/Flask, Kubernetes, and Docker
Strong foundations in data structures/algorithms, concurrency, networking, and systems design
Production experience with agent frameworks preferred
Experience with vector databases and feature stores preferred
Familiarity with LLM and embedding services, prompt/tooling patterns, and evaluation harnesses preferred
Hands-on Kubernetes, autoscaling, and GPU scheduling/operators preferred
Experience with PyTorch profiler, Nsight, line-profiler, or Ray dashboard preferred
Experience with vLLM, Triton Inference Server, ONNX Runtime, or TensorRT preferred
Excellent communication and mentoring abilities
Master’s degree and accessibility/WCAG 2.2 AA knowledge preferred

Benefits

Comp & perks

Incentive awards for performance
401(k) match
Stock purchase plan
Paid maternity and parental leave
PTO, including sick leave
Multiple health plans, including medical, vision, and dental coverage
Company-paid life insurance
Family care leave
Bereavement leave
Jury duty leave
Voting leave
Short-term and long-term disability
Company discounts
Military Leave Pay
Adoption and surrogacy expense reimbursement
Live Better U Walmart-paid education benefit, including tuition, books, and fees
Performance-based bonus awards
Stock compensation may be available for certain positions