Member of Technical Staff, AI Researcher

Red Cell Partners

. Design and build evaluation frameworks, benchmarks, and methodologies for frontier large language models, AI agents, multimodal models, and reinforcement learning environments .

Posted 10/22/2026full-timeRemote • United StatesLead💰 $250,000 - $400,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing evaluation frameworks and methodologies for AI models, with strong proficiency in Python and experience in building scalable software systems. Capable of translating research into actionable experiments and producing high-quality human data for model evaluation.

Highest-signal resume keywords

Machine Learning ExpertisePython ProgrammingReinforcement Learning ExperienceModel Evaluation TechniquesData Science Proficiency

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Machine LearningArtificial IntelligenceSoftware EngineeringData SciencePythonReinforcement LearningModel EvaluationReward ModelsExperiment DesignData Quality Signals

Soft Skills

Analytical SkillsProblem-SolvingWritten CommunicationTechnical Documentation

Industry Keywords

AI AgentsBenchmarksEvaluation TechniquesPost-Training ApproachesTraining-Data DesignHuman Data ProductionControlled ExperimentsTechnical RoadmapOpen-Source ToolsResearch Contributions

Tech Stack

Tools & technologies

Python

About the role

Key responsibilities & impact

Design and build evaluation frameworks, benchmarks, and methodologies for frontier large language models, AI agents, multimodal models, and reinforcement learning environments
Develop reward models, programmatic verifiers, graders, and other feedback systems that make model behavior measurable and improvable
Design and run controlled supervised fine-tuning and reinforcement learning experiments to measure the effects of datasets on model capability, generalization, and alignment
Research and define what makes evaluations representative of real-world work and operational environments
Build systems for producing high-quality human data, including expert task design, annotation methodologies, data-quality signals, and data-attribution techniques
Translate research questions into lightweight, rigorous experiments that generate actionable findings
Prototype quickly, evaluate results, diagnose failure modes, and convert findings into improved benchmarks, datasets, or technical systems
Move promising methods from experimentation into scalable, production-quality implementations
Work across research, engineering, product, and operations to advance a shared technical roadmap
Contribute to the broader technical community through benchmarks, open-source tools, research, and technical writing

Requirements

What you’ll need

5+ years of relevant experience in machine learning, artificial intelligence, computer science, data science, software engineering, or a related technical field
Demonstrated ability to operate at the intersection of AI research and software engineering
Strong Python skills and experience building reliable, scalable software
Hands-on experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems
Strong understanding of frontier AI methods, including benchmarks, evaluation techniques, agent harnesses, post-training approaches, and training-data design
Experience building or working with reward models, automated verifiers, graders, or other model-feedback systems
Experience designing evaluations or experiments that measure model capability, generalization, alignment, or agent performance
Ability to build research prototypes and develop them into maintainable, production-quality systems
Strong analytical, problem-solving, written communication, and technical documentation skills
U.S. citizenship is required
An advanced degree in machine learning, artificial intelligence, computer science, data science, or a related field is preferred but not required
Candidates with equivalent research and engineering experience, including strong technical, open-source, or published output, are encouraged to apply

Benefits

Comp & perks

Career track opportunity with potential for rapid advancement with strong performance as the firm grows
100% employer paid, comprehensive health care including medical, dental, and vision for you and your family
Paid maternity and paternity for 14 weeks at employees' normal pay
Unlimited PTO, with management approval
Opportunities for professional development and continued learning
Optional 401K, FSA, and equity incentives available
Mental health benefits are available through Tara Mind
Cost effective GLP-1 solutions available through Crux