Staff Software Engineer, AI Evals
G2i Inc.
Posted: 10/20/2026JavaScriptPythonRustTypeScriptGo
Software Engineer 5 – Model Development and Management, AI Platform
Netflix
Posted: 10/20/2026AirflowAWSJavaPythonScalaC++
Staff Applied AI Engineer
Collectors
Posted: 10/20/2026
Senior Applied AI Engineer
Drata
Posted: 10/20/2026Python
Transformation Lead, AI & Automation
HP France
Posted: 10/20/2026ETLPythonSQLTableau
Applied AI Engineer
Unify
Posted: 10/20/2026PythonTypeScript
Business Development Lead, AI
Monad Foundation
Posted: 10/20/2026
Agentic AI Engineer
Booz Allen Hamilton
Posted: 10/20/2026AWSAzureCloudDockerGrafanaKubernetesNeo4jReact
Principal AI Engineer
Hewlett Packard Enterprise
Posted: 10/20/2026CloudJavaPythonPyTorchTensorflowC++
Transformation Lead, AI & Automation
HP
Posted: 10/20/2026ETLPythonSQLTableau
Senior/Staff Full-Stack AI Engineer
Suno
Posted: 10/20/2026PythonReactTypeScript
Product Lead, AI
Mysten Labs
Posted: 10/20/2026
Senior AI Developer – Agent Builder, AI Focus
Simple Software Solutions Group, Inc
Posted: 10/20/2026
Principal Embedded Firmware Engineer – AI/HPC Networking Silicon
Cornelis Networks
Posted: 10/20/2026FlashPythonC++
Senior AI Engineer
Johnson Controls
Posted: 10/20/2026AssemblyCloudCyber SecurityERPPythonScikit-LearnSQL
Principal AI Engineer
Hewlett Packard Enterprise
Posted: 10/20/2026CloudJavaPythonPyTorchScikit-LearnTensorflowC++
Principal AI Engineer
Hewlett Packard Enterprise
Posted: 10/20/2026CloudJavaPythonPyTorchScikit-LearnTensorflowC++
AI Engineer 5, MLX, Agentic AI, Gen AI platform Services
Capital One
Posted: 10/20/2026AWSCloudJavaOpen SourcePythonPyTorchScalaC++Go
AI Engineer 4 – MLX, Agentic AI, Gen AI platform Services
Capital One
Posted: 10/20/2026AWSCloudDistributed SystemsJavaOpen SourcePythonPyTorchScalaC+++1 more
AI Engineer
DirectSupply
Posted: 10/20/2026AWSCloudDockerPostgresPythonTerraformTypeScript
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in evaluating AI-generated coding interactions and providing clear, opinionated feedback. Proficient in modern AI-assisted development workflows and capable of mentoring senior engineers while defining engineering standards.
Highest-signal resume keywords
Strong Background In GoStrong Background In PythonStrong Background In RustStrong Background In TypeScriptHands-On Experience Using OpenAI Codex
Tech Stack
Tools & technologiesAbout the role
Key responsibilities & impact- Evaluate AI-generated coding interactions end-to-end
- Assess whether responses make sense and whether preambles and reasoning are useful
- Judge whether outputs reflect strong engineering judgment and align with how an experienced engineer would think
- Evaluate the quality of explanations and reasoning, not just code
- Distinguish between different levels of response quality
- Provide clear, opinionated feedback on what worked, what did not, and what felt misleading
- Help define what great interactions look like for tools such as Cursor
- Evaluate interactions with modern coding agents including OpenAI Codex and Claude Code
Requirements
What you’ll need- Staff / Principal-level engineer (or equivalent experience)
- Strong background in Go, Python, Rust, or TypeScript / JavaScript
- Hands-on experience using OpenAI Codex, Claude Code, and Cursor
- Deep familiarity with modern AI-assisted development workflows
- Ability to evaluate code without needing to fully execute or deeply review every line
- Comfortable giving direct, opinionated feedback
- High bar for what “good engineering” looks like
- Able to make subjective but rigorous judgments
- Experience with Cursor or similar AI-first IDEs (nice to have)
- Prior exposure to prompt design or evaluation workflows (nice to have)
- Experience mentoring senior engineers or defining engineering standards (nice to have)
- Native English speaker or fluent English at C2+ level
- Agreement to complete a simple background check
- Must complete a take-home evaluation exercise
Benefits
Comp & perks- $100–$200/hour compensation
- Flexible workload of approximately 20–40 hours per week
- Contract duration through October with possible extensions
- Start ASAP
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
AI-Assisted Development WorkflowsCode EvaluationEngineering JudgmentPrompt DesignFeedback Provision
Soft Skills
Opinionated FeedbackJudgment SkillsMentoring
Tools & Technologies
OpenAI CodexClaude CodeCursor
Industry Keywords
AI-First IDEsEngineering StandardsResponse Quality Evaluation