FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
AI Product Analyst – Automation Team
MEDvidi. Own the full product analytics stack for features shipped by the Automation team, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Product Analytics and Operational Analytics, with a strong focus on AI and ML systems. Capable of conducting thorough analysis, designing evaluations, and communicating insights effectively to drive decision-making in fast-paced environments.
Highest-signal resume keywords
Product AnalyticsOperational AnalyticsSQL CodingPython CodingAI Systems Evaluation
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Product AnalyticsOperational AnalyticsData AnalyticsSQL CodingPython CodingAI EvaluationLLM Systems UnderstandingExperiment DesignFunnel AnalysisImpact Assessment
Soft Skills
Effective CommunicationStructured WritingDecision-MakingAdaptabilityCollaboration
Tools & Technologies
DashboardsMonitoring ToolsEvaluation FrameworksHuman Review Pipelines
Industry Keywords
AIMLLLMClinical WorkflowsOperational MetricsData Science
Tech Stack
Tools & technologiesPythonSQL
About the role
Key responsibilities & impact- Own the full product analytics stack for features shipped by the Automation team, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment
- Analyze production behavior of AI and automation workflows across clinical and operational journeys
- Investigate hallucinations, silent failures, and quality degradation in AI-generated output
- Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss
- Design automated and human-review evaluations for AI quality and feed findings into prompt and product changes
- Build monitoring and dashboards for AI and automation health and related operational metrics
- Measure business and operational impact of automation initiatives and surface associated risks
- Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity
Requirements
What you’ll need- 3+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems
- Understanding of AI, ML, and LLM systems
- Hands-on experience evaluating LLM or AI output is a strong plus
- Experience with prompt iteration, eval frameworks, and human review pipelines is a strong plus
- Effective, structured written and verbal communication
- Ability to turn analysis into crisp, decision-ready writeups that non-analysts can act on
- Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed
- Strong product / operational analytics background
- Ability to own metrics end-to-end
- Ability to write SQL and Python code against messy production data
- Fluent Russian
- English level B2 or higher
- Ability to work CET-overlapping hours in a B2B format
- Experience evaluating LLM outputs or AI systems is nice to have
- Previous experience in Data Science or Machine Learning is nice to have
Benefits
Comp & perks- Competitive compensation and growth opportunities
- Health insurance after probation period
- Sports & wellness compensation
- Fully remote, long-term B2B collaboration
- 19 working days of vacation per year
- 3 additional wellness days per year
- Paid sick leave for the first 5 working days
- Gifts to employees for important events
- Personalized English lessons via Preply