FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
AI Product Analyst – Automation Team
MEDvidi. Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Product Analytics and Operational Analytics, with a strong focus on AI and ML systems. Proficient in SQL and Python for data analysis, with the ability to communicate effectively in both English and Russian.
Highest-signal resume keywords
Product AnalyticsOperational AnalyticsSQL ProficiencyPython ProgrammingAI and ML Understanding
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Product AnalyticsOperational AnalyticsData AnalyticsSQLPythonAI EvaluationLLM SystemsMetrics OwnershipExperiment DesignFunnel Analysis
Soft Skills
Effective CommunicationStructured ThinkingAdaptability
Tools & Technologies
DashboardsMonitoring ToolsData Analysis Tools
Industry Keywords
AI WorkflowsAutomation InitiativesClinical DataOperational MetricsHuman Review Pipelines
Tech Stack
Tools & technologiesPythonSQL
About the role
Key responsibilities & impact- Own the full product analytics stack for features the team ships, including discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment
- Analyze production behavior of AI and automation workflows across clinical and operational journeys
- Investigate hallucinations, silent failures, and quality degradation in AI-generated output
- Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss
- Design automated and human-review evaluations for AI quality and feed findings into prompt and product changes
- Build monitoring and dashboards for AI and automation health and related operational metrics
- Measure business and operational impact of automation initiatives and surface associated risks
- Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity
Requirements
What you’ll need- 3+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems
- Understanding of AI, ML, and LLM systems
- Hands-on experience evaluating LLM or AI output — prompt iteration, eval frameworks and human review pipelines is a strong plus
- Effective, structured written and verbal communication
- Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed
- Strong product / operational analytics background
- Experience owning metrics end-to-end
- Ability to write SQL and Python code against messy production data
- Fluent Russian
- English level B2 or higher
- Ability to work CET-overlapping hours in a B2B format
- Experience evaluating LLM outputs or AI systems is nice to have
- Previous experience in Data Science or Machine Learning is nice to have
Benefits
Comp & perks- Health insurance after probation period
- Sports & wellness compensation
- Fully remote, long-term B2B collaboration
- 19 working days of vacation per year
- 3 additional wellness days per year
- Paid sick leave for the first 5 working days
- Gifts to employees for important events
- Personalized English lessons via Preply
- Competitive compensation and growth opportunities