Senior Software Engineer, AI Engineer

Midi Health

. Design, build, and ship LLM-powered features end-to-end, including prompt design, retrieval, tool use, agents, evaluation, and production operations .

Posted 9/25/2026full-timeSan Francisco • California • United StatesSenior💰 $170,000 - $210,000 per yearWebsite

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Design, build, and ship LLM-powered features end-to-end, including prompt design, retrieval, tool use, agents, evaluation, and production operations
Build evaluation harnesses and feedback loops for responsible AI feature delivery
Integrate AI capabilities into patient, clinician, and operational workflows
Partner with clinical, product, and safety stakeholders to define quality standards
Contribute to internal AI-for-engineering practices and tooling
Stay current with AI research and the ecosystem and bring relevant advances to the team

Requirements

What you’ll need

6+ years of software engineering experience, with meaningful recent time building production LLM / ML features
Strong hands-on coding skills in Python; comfortable across the full stack when the feature demands it
Seasoned at system design for AI systems: retrieval, orchestration, caching, evaluation, cost and latency tradeoffs
Deep, hands-on command of modern AI coding tools, including Claude Code, Cursor, Copilot, and similar
Good mentorship instincts
Rigorous approach to evaluation and safety
Strong communication skills and ability to explain model behavior to non-technical stakeholders
Experience with healthcare, clinical NLP, or regulated AI deployments (nice to have)
Experience building agentic systems or production RAG at scale (nice to have)
Must be authorized to work in the United States without current or future sponsorship needs

Benefits

Comp & perks

Wide range of benefits
Equity in the company