Senior System Software Engineer, Agentic Retrieval

NVIDIA

. Develop and optimize Rust-based data processing frameworks for large datasets on GPU-accelerated environments supporting LLM training .

Posted 10/2/2026full-timeRemote • United StatesSenior💰 $184,000 - $356,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing and optimizing Rust-based data processing frameworks and GPU-accelerated environments for LLM training. Proficient in MLOps technologies and capable of leading cross-functional teams to enhance productivity through generative AI solutions.

Highest-signal resume keywords

Rust-Based DevelopmentGPU AccelerationMLOps TechnologiesNLP and LLM ExpertiseCloud Infrastructure Management

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Rust ProgrammingPython ProgrammingData Processing FrameworksAlgorithm OptimizationContinuous Delivery PipelinesBenchmarking and ProfilingGenerative AI DevelopmentAgentic Retrieval WorkflowsMultimodal Model PreparationCloud Software Delivery

Soft Skills

Outstanding CommunicationCollaborationContinuous LearningTeam CoordinationProblem-Solving

Tools & Technologies

Docker-ComposeContainersKubernetesCloud InfrastructureData Center Deployments

Industry Keywords

LLM TrainingData ProcessingPerformance OptimizationEmployee ProductivityUnified Experiences

Tech Stack

Tools & technologies

CloudDockerKubernetesPythonRust

About the role

Key responsibilities & impact

Develop and optimize Rust-based data processing frameworks for large datasets on GPU-accelerated environments supporting LLM training
Lead development and iterative optimization of Agentic Retrieval pipeline components, including GPU acceleration and model performance optimization
Collaborate with LLM and ML researchers on full-stack, GPU-accelerated data preparation pipelines for multimodal models
Benchmark, profile, and optimize algorithms in Python across system architectures for LLM applications
Understand requirements, build and evaluate proofs of concept, and develop roadmaps for production tools and library features
Build products improving employee productivity through generative AI and copilot experiences
Develop integrated systems enabling unified experiences across applications and end-to-end user insights
Help build and maintain Continuous Delivery pipelines to move changes to production faster and safer
Provide peer reviews covering performance, scalability, and correctness; contribute to frameworks, standards, and technology adoption

Requirements

What you’ll need

Bachelor’s or Master’s Degree program in Computer Science, Computer Engineering, or a related field (or equivalent experience)
6+ years of experience in a similar or related role
Experience delivering software in a cloud context and familiarity with managing cloud infrastructure
Knowledge of MLOps technologies such as Docker-Compose, Containers, Kubernetes, and data center deployments
In-depth hands-on understanding of NLP, LLM, VLM, Generative AI, and Agentic Retrieval workflows
Passion for growth, continuous learning, and sharing findings across the team
Outstanding communication skills for distilling sophisticated topics into understandable, impactful conclusions
Ability to work successfully with multifunctional teams, principals, and architects; coordinate across organizational boundaries and geographies

Benefits

Comp & perks

Equity
Benefits 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score