Data Scientist

24-MAG

. Evaluate AI-generated responses to data science, statistics, machine learning, and quantitative problems .

Posted 9/15/2026contractRemote • New York • United StatesJunior💰 $245 - $280 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates strong proficiency in Python and statistical analysis, with practical experience in machine learning and data modeling. Capable of evaluating AI-generated responses and identifying methodological errors while providing clear, structured feedback.

Highest-signal resume keywords

Python ProficiencyStatistical AnalysisMachine Learning ExperienceData ModelingWritten Communication

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data ScienceQuantitative AnalysisExperiment DesignHypothesis TestingData PreprocessingFeature ConstructionStatistical ReasoningAnalytical MethodsEvaluation of AI ResponsesReproducible Research

Soft Skills

Clear CommunicationCritical ThinkingAttention to Detail

Tools & Technologies

PandasData Analysis Workflows

Industry Keywords

Quantitative ProblemsFlawed MethodologyOverfittingBiasWeak ValidationCausal Interpretation

Tech Stack

Tools & technologies

PandasPython

About the role

Key responsibilities & impact

Evaluate AI-generated responses to data science, statistics, machine learning, and quantitative problems
Assess analytical methods, assumptions, conclusions, numerical accuracy, logical consistency, and use of evidence
Identify flawed methodology, incorrect statistical reasoning, unsupported interpretations, overfitting, leakage, bias, weak validation, and inappropriate metrics
Compare alternative analytical approaches and explain relevant trade-offs
Create expert-level prompts, datasets, scenarios, and reference solutions for advanced quantitative and analytical evaluation
Define assumptions, calculations, and methodology clearly
Ensure reference materials are reproducible, technically defensible, and appropriately challenging
Evaluate experiment design, hypothesis testing, and interpretation of results
Review Python, pandas, data preprocessing, feature construction, and data-modelling workflows
Identify weaknesses in experimental setup, measurement, or causal interpretation
Provide structured written feedback on errors, weaknesses, and opportunities for improvement
Identify recurring patterns of flawed reasoning and contribute evaluation material to improve AI model capability
Maintain consistent standards across diverse data-science and quantitative tasks

Requirements

What you’ll need

At least 1 year of professional experience in data science, quantitative analysis, machine learning, or a closely related role
Experience at a top-tier or highly regarded organisation
At least part of relevant professional experience gained within approximately the past 7 years
Strong proficiency in Python
Strong knowledge of statistics, experimentation, and quantitative analysis
Practical experience with machine learning and data modelling
Familiarity with pandas and modern data-analysis workflows
Ability to identify methodological errors and weak statistical reasoning
Excellent written communication and ability to explain technical concepts clearly
Undergraduate degree from a highly ranked university is preferred
Candidates based in English-speaking countries are preferred
Ability to work without using confidential or proprietary information belonging to any employer, client, company, research organisation, institution, or other third party

Benefits

Comp & perks

Fully remote work
Independent contractor engagement
Remote consulting opportunities
Flexible/project-based assignments
Opportunity to contribute to advanced AI training and quantitative reasoning projects