Technical Staff Member, Coding Agents

Handshake

. Create and publish coding benchmarks that challenge state-of-the-art frontier agents .

Posted 10/9/2026full-timeUnited StatesLead💰 $270,000 - $350,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in developing coding benchmarks and contributing to open-source software, with a strong focus on AI coding applications and agent evaluation methodologies. Possesses a deep understanding of software engineering principles and a passion for advancing coding agents through research and collaboration.

Highest-signal resume keywords

Coding Benchmark DevelopmentAI Research PublicationOpen-Source Software ContributionsAgent Evaluation MethodologiesSoftware Engineering Experience

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Coding BenchmarkAI for SoftwareCode GenerationSoftware EngineeringAgent Harnesses

Soft Skills

CollaborationOwnershipAdaptability

Industry Keywords

NeurIPSICLRICMLCOLMAI Coding Applications

About the role

Key responsibilities & impact

Create and publish coding benchmarks that challenge state-of-the-art frontier agents
Understand and shape the frontier of coding agents and publish studies of interesting or impactful findings
Help leading AI labs improve their coding models
Publicly contribute through benchmarks, open-source tools, research, and technical writing
Collaborate with AI researchers, software engineers, operators, and builders
Help define reward and verifier systems, agent-evaluation methodologies, and data-quality techniques for AI coding applications
Influence technical direction, operating culture, and open-source software, benchmarks, and research products

Requirements

What you’ll need

Extremely passionate about building software with agents and regularly tinkering with the latest coding agents
Comfort operating in an ambiguous, fast-moving environment with substantial ownership
At least one of the following: previous experience working on a Coding benchmark; published research on AI for Software / Code-Generation at NeurIPS, ICLR, ICML, COLM, etc.; extensive software engineering experience or a strong GitHub profile of OSS contributions, along with deep knowledge of agent harnesses
Willingness/ability to work in the United States and answer work authorization and visa sponsorship questions

Benefits

Comp & perks

Equity in a fast-growing company
401(k) match
Competitive compensation
Financial coaching
Paid parental leave
Fertility benefits
Parental coaching
Medical, dental, and vision insurance
Mental health support
$500 wellness stipend
$2,000 learning stipend
Ongoing development
Commuting support
Free lunch
Gym in the San Francisco office
Flexible PTO
15 holidays + 2 flex days
Team outings
Referral bonuses