Board-Certified Physician, Clinical AI Expert

Weekday (YC W21)

. Review and evaluate clinical knowledge tasks and AI-generated medical responses .

Posted 11/12/2026full-timeCalifornia City • California • United StatesMid-LevelSenior💰 $70 - $110 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates extensive clinical expertise with an MD or DO degree, active medical license, and board certification in a specialty. Capable of evaluating AI-generated medical responses and providing structured feedback while collaborating effectively with research teams.

Highest-signal resume keywords

MD Or DO DegreeActive Medical LicenseBoard CertificationClinical Decision-MakingExperience With Large Language Models

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Clinical EvaluationTask Specification DevelopmentClinical Reasoning AssessmentPatient ManagementMedical Guideline ComplianceSpecialty-Specific Clinical TasksEvaluation Dataset DevelopmentFeedback ProvisionClinical Problem DesignIndependent Medical Judgment

Soft Skills

Excellent Written CommunicationCollaborationAttention To Detail

Tools & Technologies

Internal ToolsEvaluation FrameworksWorkflows

Certifications & Qualifications

Board CertificationMedical License

Industry Keywords

Clinical PracticeMedical GuidelinesAI-Generated ResponsesClinical SpecialtyResidency TrainingPatient CareMedical Decision-Making

About the role

Key responsibilities & impact

Review and evaluate clinical knowledge tasks and AI-generated medical responses
Identify gaps in clinical reasoning, missing considerations, unsafe recommendations, and deviations from medical guidelines
Develop task specifications and accurate reference answers
Design clinical problems reflecting real-world medical practice and decision-making
Develop specialty-specific clinical tasks and evaluation datasets
Assess AI responses across diagnosis, treatment planning, patient management, clinical guidelines, and specialty-specific scenarios
Provide structured, actionable written feedback to research teams
Collaborate with AI researchers, engineers, and adjacent-domain specialists
Establish consistent evaluation standards and translate clinical expertise into measurable assessment criteria
Help develop medicine-specific evaluation frameworks, tools, and workflows
Work directly with client research and program management teams using internal tools and workflows

Requirements

What you’ll need

MD or DO degree from an accredited medical school
Completed residency training in a recognized medical specialty
Minimum of 4 years of independent clinical practice following residency; residency and fellowship training do not count
Active, unrestricted medical license in at least one US state
Current board certification in the candidate's specialty
Demonstrated expertise in a defined clinical specialty
Clear professional progression into senior clinical responsibilities, such as Attending Physician, Medical Director, Division Chief, Associate Professor, Professor, or Chief Medical Officer
Proven ownership of clinical decisions and experience applying independent medical judgment in patient care
Practical experience using large language models (LLMs) in a professional setting
Ability to distinguish clinically sound reasoning from medically incorrect responses
Excellent written communication skills and ability to explain complex clinical concepts through precise, well-structured feedback
Ability to commit reliably to 40 hours per week for the initial six-month engagement
Candidates must currently reside in the San Francisco Bay Area or be willing to relocate before the engagement begins
Candidates must be available for regular on-site collaboration multiple days each week

Benefits

Comp & perks

Client-issued accounts and equipment provided
Full-time W-2 employment
Structured role-based employment opportunity