AI-LLM Systems Engineer

Jack Westin

. Design, build, and maintain end-to-end AI-powered product experiences .

Posted 9/24/2026full-timeRemote • United StatesMid-LevelSenior💰 $2,000 - $3,000 per monthWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building AI-powered product experiences, with a strong focus on backend services, APIs, and integration of LLMs and retrieval systems. Capable of evaluating architectural approaches and implementing observability for AI workflows while collaborating effectively across teams.

Highest-signal resume keywords

Full-Stack Software EngineeringAPI DevelopmentLLM API IntegrationAI Workflow ObservabilityModel Evaluation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Backend Software EngineeringAPI DesignDistributed ServicesRAGEmbeddingsSemantic SearchTool CallingAI Evaluation PipelinesLatency OptimizationInference-Cost Trade-Offs

Soft Skills

Product MindsetProblem SolvingCollaborationAdaptabilityCritical Thinking

Industry Keywords

EdTechAdaptive LearningPersonalizationRecommendation SystemsMultimodal AIContent-Management Systems

About the role

Key responsibilities & impact

Design, build, and maintain end-to-end AI-powered product experiences
Develop backend services, APIs, and platform integrations supporting Jack
Integrate LLMs, retrieval systems, embeddings, vector databases, tool calling, and agentic workflows where appropriate
Evaluate architectural approaches for RAG, contextual grounding, personalization, model routing, caching, and tool use
Build reliable mechanisms for passing learner, question, content, and platform context to AI systems
Collaborate with Product to assess feasibility, technical risk, cost, latency, and expected product value before development
Implement observability and monitoring for AI workflows, including failures, latency, token usage, and cost
Support experimentation across models, prompts, retrieval strategies, and orchestration approaches
Contribute to AI evaluation and regression-testing infrastructure
Design systems that are scalable, secure, maintainable, and privacy-conscious
Work closely with frontend, platform, data, QA, and instructional teams

Requirements

What you’ll need

Strong professional experience in full-stack or backend software engineering
Strong experience designing and working with APIs and distributed services
Production experience building applications using LLM APIs
Understanding of prompting, RAG, embeddings, semantic search, retrieval, tool calling, and agent workflows
Familiarity with model evaluation, observability, latency optimization, and inference-cost trade-offs
Ability to reason about AI system failure modes and non-deterministic behavior
Strong product mindset and ability to work effectively with incomplete requirements and ambiguity
Ability to challenge assumptions, propose alternatives, and participate in product and technical discovery
Experience with EdTech or adaptive learning products (nice to have)
Experience with personalization or recommendation systems (nice to have)
Experience with multimodal AI (nice to have)
Experience building AI evaluation pipelines (nice to have)
Familiarity with learner data, content-management systems, or educational platforms (nice to have)

Benefits

Comp & perks

100% remote
Full-time position
Real ownership and impact