Senior AI Product Analyst – Automation Team

MEDvidi

. Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment .

Posted 10/28/2026full-timeRemote • GeorgiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Product Analytics and Operational Analytics, with a strong focus on AI and automation workflows. Proficient in SQL and Python for data analysis, with the ability to communicate findings effectively to non-analysts.

Highest-signal resume keywords

Product AnalyticsOperational AnalyticsSQL ProficiencyPython ProgrammingAI and ML Understanding

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Product AnalyticsOperational AnalyticsData AnalyticsSQLPythonAI EvaluationLLM SystemsExperiment DesignFunnel AnalysisImpact Assessment

Soft Skills

Effective CommunicationStructured WritingDecision-MakingAdaptabilityCollaboration

Tools & Technologies

DashboardsMonitoring ToolsEvaluation FrameworksHuman Review Pipelines

Industry Keywords

AI WorkflowsAutomation InitiativesOperational MetricsClinical AnalyticsData Science

Tech Stack

Tools & technologies

PythonSQL

About the role

Key responsibilities & impact

Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment
Analyze production behavior of AI and automation workflows across clinical and operational journeys
Investigate hallucinations, silent failures, and quality degradation in AI-generated output
Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss
Design automated and human-review evaluations for AI quality
Feed evaluation results into prompt and product changes
Build monitoring and dashboards for AI and automation health and related operational metrics
Measure business and operational impact of automation initiatives
Surface risks introduced by automation initiatives
Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity

Requirements

What you’ll need

5+ years of experience in Product Analytics, Operational Analytics, Data Analytics, or analytics roles within complex production systems
Understanding of AI, ML, and LLM systems
Hands-on experience evaluating LLM or AI output is a strong plus, including prompt iteration, eval frameworks, and human review pipelines
Effective, structured written and verbal communication
Ability to turn analysis into crisp, decision-ready writeups that non-analysts can act on
Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed
Strong product / operational analytics background
Comfortable owning metrics end-to-end
Ability to write SQL and Python code against messy production data
Fluent Russian
English level B2 or higher
Ability to work CET-overlapping hours in a B2B format
Experience evaluating LLM outputs or AI systems is nice to have
Previous experience in Data Science or Machine Learning is nice to have

Benefits

Comp & perks

Competitive compensation and clear growth opportunities
Health insurance after the probation period
Sports & wellness compensation
Personalized English lessons via Preply
19 working days of vacation per year
4 additional wellness days
Paid sick leave for the first 5 working days
Thoughtful gifts for important life events
Fully remote, long-term B2B collaboration