Engineering Product Manager

Cisco

. Lead the strategy, architecture, and organizational adoption of Cisco's end-to-end AI evaluation platform .

Posted 10/6/2026full-timeUnited StatesMid-LevelSenior💰 $194,600 - $285,700 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading AI evaluation platform strategies, architecture, and organizational adoption, with a strong focus on product vision, quality standards, and risk-based release criteria. Proficient in driving multi-team collaboration and operationalizing evaluation frameworks for AI/ML systems.

Highest-signal resume keywords

AI/ML Product ManagementModel Evaluation FrameworksRisk-Based Launch CriteriaAutomated Evaluation SystemsGenerative AI Evaluation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Product ManagementAI Model EvaluationBenchmarking Systems DesignRegression Mitigation WorkflowsStatistical Evaluation Methodologies

Soft Skills

CollaborationLeadershipStrategic Vision

Tools & Technologies

DeepEvalRagasLangSmithTruLensAmplitude Product Analytics

Industry Keywords

Enterprise SaaSCloud InfrastructureHyperscaler EnvironmentsHuman-in-the-Loop WorkflowsReal-Time Quality Monitoring

Tech Stack

Tools & technologies

Cloud

About the role

Key responsibilities & impact

Lead the strategy, architecture, and organizational adoption of Cisco's end-to-end AI evaluation platform
Define the product vision, staged roadmap, and platform architecture for offline benchmarking suites, automated LLM judges, and continuous production evaluation systems
Convert quality standards such as factual accuracy, hallucination mitigation, safety policies, and agentic tool-use fidelity into objective test suites and human-in-the-loop review pipelines
Establish pre-deployment quality bars, risk-based release criteria, and automated regression-detection loops for AI model and application rollouts
Connect offline model evaluations with live telemetry, Amplitude product analytics, and real-time user feedback loops
Detect and remediate performance regressions
Partner with research scientists, engineering leaders, and product managers across business units to drive standardized evaluation framework adoption

Requirements

What you’ll need

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field with 12+ years of product management experience, OR Master's degree with 8+ years, OR PhD with 5+ years of experience
Prior product management experience for AI/ML platforms, model evaluation frameworks, LLM infrastructure, or data-intensive software products
Applied experience designing and operationalizing offline benchmarking systems, automated evaluation judges, or real-time production quality monitoring pipelines
Experience defining risk-based launch criteria, release-gating frameworks, and regression mitigation workflows for software or AI systems
Experience driving multi-team platform adoption across matrixed engineering and product organizations
Direct experience evaluating Generative AI, RAG pipelines, and autonomous multi-agent systems preferred
Familiarity with DeepEval, Ragas, LangSmith, TruLens, and enterprise telemetry architectures preferred
Experience in enterprise SaaS, cloud infrastructure, or hyperscaler environments preferred
Background in statistical evaluation methodologies, automated LLM-as-a-judge calibration, and human-in-the-loop annotation workflows preferred
Practical experience with online evaluations for agent systems, including observing production traces and trajectories, diagnosing failure patterns, and selecting improvement techniques preferred

Benefits

Comp & perks

Medical, dental and vision insurance
401(k) plan with a Cisco matching contribution
Paid parental leave
Short- and long-term disability coverage
Basic life insurance
Potential Cisco restricted stock unit grants
10 paid holidays per full calendar year
1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday
Paid year-end holiday shutdown
4 paid days off for personal wellness
16 days of paid vacation per full calendar year for non-exempt employees
Flexible vacation time off with no defined limit for eligible exempt employees
80 hours of sick time off provided on hire and each January 1st, plus up to 80 unused hours carried forward
Additional paid time away for critical or emergency family issues
Optional 10 paid volunteer days per full calendar year
Annual bonuses for non-sales roles, subject to Cisco’s policies
Performance-based incentive pay for sales-plan employees
Cisco benefits and perks subject to plan eligibility rules