FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and developing experimental methodologies and evaluation frameworks for AI systems, with a strong focus on statistical analysis and programming in Python or Go. Proven ability to publish research findings and collaborate with engineering teams to translate research into production-ready systems.
Highest-signal resume keywords
PhD In Computer ScienceExperimental DesignStatistical AnalysisProgramming In PythonAPI-Based Foundation Models
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Machine LearningStatistical AnalysisEmpirical EvaluationBenchmark DesignDataset DevelopmentEvaluation FrameworksResearch InfrastructureLarge-Scale Data AnalysisDistributed ExperimentationProgramming In Go
Soft Skills
Independent ResearchCommunication Skills
Tools & Technologies
LLMsRetrieval SystemsAI AgentsDeveloper ToolsCoding Assistants
Industry Keywords
Technical ReportsOpen-Source ProjectsAI Evaluation MethodologiesExperimental CampaignsProduction APIs
Tech Stack
Tools & technologiesPythonGo
About the role
Key responsibilities & impact- Design and develop SLMs for endpoint devices such as laptops
- Design and develop a model router using endpoint state
- Design rigorous evaluation methodologies for API-based coding agents, with and without access to external tools
- Build statistically sound benchmarks measuring cost, latency, accuracy, reliability, and developer productivity
- Develop techniques for optimizing agent context, retrieval, memory, and tool interactions while preserving correctness
- Design and analyze large-scale experimental campaigns using production APIs across multiple foundation models
- Build reusable research infrastructure, datasets, simulators, and evaluation frameworks for agentic systems
- Publish technical reports and contribute research findings influencing product direction and the broader AI community
- Collaborate with engineering teams to translate research into production-ready optimization systems
- Stay current with advances in LLMs, agent architectures, retrieval systems, and AI evaluation methodologies
Requirements
What you’ll need- PhD or equivalent research experience in Computer Science, Machine Learning, Mathematics, Statistics, or a related quantitative field
- Strong background in experimental design, statistical analysis, and empirical evaluation
- Excellent programming skills in Python and/or Go, with experience building research infrastructure
- Demonstrated ability to conduct independent research and communicate findings through publications, technical reports, or open-source projects
- Deep understanding of modern LLMs, retrieval systems, or AI agents
- Experience working with API-based foundation models such as Claude, GPT, Gemini, or similar systems
- Publications in machine learning, systems, information retrieval, software engineering, or AI evaluation
- Experience designing benchmarks, datasets, or evaluation frameworks
- Familiarity with developer tools, coding assistants, or software engineering workflows
- Experience with distributed experimentation and large-scale data analysis
Benefits
Comp & perks- Research with real-world impact on production-scale workloads and shipping products
- Opportunity to define a new research field
- Backed by top-tier investors
- Equal opportunity and inclusive work environment
