Staff Technical Product Manager, Evals
Hercules
Posted: 10/21/2026ReactTypeScript
Technical Product Manager
G&W Electric Co.
Posted: 10/20/2026
EHS Staff Technical Product Manager
GE Vernova
Posted: 10/20/2026
Staff Product Manager, Technical
Robots & Pencils
Posted: 10/20/2026
Senior Technical Product Owner
Honeywell
Posted: 10/20/2026
Senior Technical Product Manager, Internal Tools
Cloaked
Posted: 10/20/2026SQL
Senior Technical Product Manager, AI Programs – Operating Cadence
T-Mobile
Posted: 10/20/2026
Technical Product Manager
U.S. Bank
Posted: 10/20/2026AWSCloudMicroservicesSDLCServiceNow
Senior Product Manager, Technical – Enterprise AI Training, Adoption Programs
T-Mobile
Posted: 10/20/2026Senior Product Manager – Technical, Enterprise GenAI Tools & Platforms
T-Mobile
Posted: 10/20/2026
Principal Technical Product Manager
Summit
Posted: 10/20/2026Cloud
Manager, Technical Product Management – Autonomy Integration
Zoox
Posted: 10/20/2026
Technical Product Manager – AI Delivery Research
Cisco
Posted: 10/19/2026
Technical Product Owner, AI-Directed Development
CBT Nuggets
Posted: 10/19/2026PostgresSQL
Technical Product Manager – Configuration, Pedigree
BLUE ORIGIN
Posted: 10/19/2026
Senior Technical Product Manager, Fleet Ops
AeroVect
Posted: 10/19/2026Cloud
Technical Product Owner, Data Management – Operations
Cengage Group
Posted: 10/16/2026CloudETLPythonSQL
Senior Technical Product Manager – Agentic Identity
American Express
Posted: 10/16/2026
Senior Technical Product Manager
Keyfactor
Posted: 10/16/2026
Senior Technical Product Manager
Gravitate
Posted: 10/16/2026Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates strong product management experience with a focus on AI coding solutions, including technical evaluation methodologies, system design, and user experience optimization. Proficient in leveraging data for product improvement and implementing engineering best practices in AI contexts.
Highest-signal resume keywords
Senior Product Management ExperienceTechnical Coding AbilityUnderstanding of System DesignExperience with AI Coding ChallengesFamiliarity with TypeScript and React
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Own the goal of making Hercules’ AI coding agent cheaper, faster, and more accurate
- Own Hercules Bench, the offline evaluation set
- Own Hercules online evaluations
- Leverage 500k+ users, 1M+ code repositories, and millions of chat threads to guide evaluation creation
- Anonymize data to protect customer privacy
- Work with an engineering counterpart on complex implementation
Requirements
What you’ll need- Senior or staff level product management experience
- Technical ability to code
- Understanding of system design, architecture, data modeling, and API design
- Experience creating and/or managing technical evals
- Understanding of varied evaluation methodologies and optimal reward modeling
- Strong product sense
- Track record of building simple, delightful UX/UI
- Strong experience with context and harness engineering best practices, including summarization/compression, prompting, prompt caching, subagents, memory, context management, tools, async tools, deferred tools, and skills
- Experience wrestling with AI coding challenges at scale and strong opinions on effective practices
- Familiarity with TypeScript, React, an agent framework such as AI SDK, and an eval platform such as LangSmith
- Frontier-level AI coding ability
- Willingness to work in US time zones if remote
- Willingness to travel to the office regularly if remote
Benefits
Comp & perks- Unlimited AI token budget
- Take what you need vacation policy
- Healthcare, vision, and dental
- Daily lunches, dinners and snacks in the office
- Equity
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
System DesignArchitectureData ModelingAPI DesignEvaluation MethodologiesReward ModelingUX/UI DesignContext ManagementAI Coding AbilityEngineering Best Practices
Soft Skills
Strong Product Sense
Tools & Technologies
TypeScriptReactAI SDKLangSmith
Industry Keywords
AI CodingTechnical EvaluationsUser ExperienceData AnonymizationRemote Work