FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in Product Analytics and Operational Analytics, with a strong focus on AI and ML systems. Proficient in SQL and Python for data analysis, with the ability to communicate complex findings effectively to non-analysts.
Highest-signal resume keywords
Product AnalyticsOperational AnalyticsSQL CodingPython CodingAI Systems Evaluation
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Product AnalyticsOperational AnalyticsData AnalyticsSQLPythonAI Evaluation FrameworksExperiment DesignFunnel AnalysisPost-Release Impact AssessmentMetrics Ownership
Soft Skills
Effective CommunicationStructured WritingAdaptability
Tools & Technologies
DashboardsMonitoring ToolsHuman-Review Pipelines
Industry Keywords
AIMLLLMClinical AnalyticsOperational MetricsData Science
Tech Stack
Tools & technologiesPythonSQL
About the role
Key responsibilities & impact- Own the full product analytics stack for shipped AI-powered and conventional product features
- Conduct discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment
- Analyze production behavior of AI and automation workflows across clinical and operational journeys
- Investigate hallucinations, silent failures, and quality degradation in AI-generated output
- Analyze logs, transcripts, generated artifacts, and operational data to identify patterns dashboards miss
- Design automated and human-review evaluations for AI quality
- Feed evaluation results into prompt and product changes
- Build monitoring and dashboards for AI and automation health and related operational metrics
- Measure business and operational impact of automation initiatives and surface associated risks
- Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity
Requirements
What you’ll need- 5+ years of experience in Product Analytics, Operational Analytics, Data Analytics, or analytics roles within complex production systems
- Understanding of AI, ML, and LLM systems
- Hands-on experience evaluating LLM or AI output is a strong plus, including prompt iteration, evaluation frameworks, and human review pipelines
- Effective, structured written and verbal communication
- Ability to turn analysis into crisp, decision-ready writeups for non-analysts
- Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed
- Strong product / operational analytics background
- Experience owning metrics end-to-end
- Ability to write SQL and Python code against messy production data
- Fluent Russian
- English level B2 or higher
- Ability to work CET-overlapping hours in a B2B format
- Experience evaluating LLM outputs or AI systems is nice to have
- Previous experience in Data Science or Machine Learning is nice to have
Benefits
Comp & perks- Competitive compensation and clear growth opportunities
- Fully remote, long-term B2B collaboration
- Health insurance after the probation period
- Sports & wellness compensation
- Career growth opportunities
- Personalized English lessons via Preply
- 19 working days of vacation per year
- 4 additional wellness days
- Paid sick leave for the first 5 working days
- Thoughtful gifts for important life events