AI Product Analyst – Automation Team

MEDvidi

. Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment .

Posted 10/22/2026full-timeRemote • PolandMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in Product Analytics and Operational Analytics, with a strong focus on AI and ML systems. Proficient in SQL and Python for data analysis, capable of translating complex findings into actionable insights for diverse stakeholders.

Highest-signal resume keywords

Product AnalyticsOperational AnalyticsSQL ProficiencyPython ProgrammingAI and ML Understanding

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Product AnalyticsOperational AnalyticsData AnalyticsSQLPythonAI EvaluationLLM SystemsExperiment DesignFunnel AnalysisImpact Assessment

Soft Skills

Effective CommunicationStructured WritingDecision-MakingAdaptabilityCollaboration

Tools & Technologies

DashboardsMonitoring ToolsEvaluation FrameworksHuman Review Pipelines

Industry Keywords

AI SystemsMachine LearningClinical WorkflowsOperational MetricsData Science

Tech Stack

Tools & technologies

PythonSQL

About the role

Key responsibilities & impact

Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment
Analyze production behavior of AI and automation workflows across clinical and operational journeys
Investigate hallucinations, silent failures, and quality degradation in AI-generated output
Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss
Design automated and human-review evaluations for AI quality
Close evaluation feedback loops into prompt and product changes
Build monitoring and dashboards for AI and automation health and related operational metrics
Measure business and operational impact of automation initiatives and surface associated risks
Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity

Requirements

What you’ll need

3+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems
Understanding of AI, ML, and LLM systems
Hands-on experience evaluating LLM or AI output; prompt iteration, eval frameworks and human review pipelines are a strong plus
Effective, structured written and verbal communication
Ability to turn analysis into crisp, decision-ready writeups that non-analysts can act on
Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed
Strong product / operational analytics background
Experience owning metrics end-to-end
Ability to write SQL and Python code against messy production data
Fluent Russian
English level B2 or higher
Ability to work CET-overlapping hours in a B2B format
Experience evaluating LLM outputs or AI systems is nice to have
Previous experience in Data Science or Machine Learning is nice to have

Benefits

Comp & perks

Competitive compensation and growth opportunities
Health insurance after probation period
Sports & wellness compensation
Fully remote, long-term B2B collaboration
19 working days of vacation per year
3 additional wellness days per year
Paid sick leave for the first 5 working days
Gifts to employees for important events
Personalized English lessons via Preply