AI Conversation Research, Evaluation Specialist

Gramian Consulting

. Review AI conversations involving real-world interpersonal situations and everyday decision-making .

Posted 10/22/2026full-timeRemote • Netherlands, Germany, Sweden, Switzerland, New Zealand, SpainMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in qualitative research, client assessment, and interpersonal communication, with a strong focus on analyzing AI-generated conversations and providing informed recommendations. Holds relevant licenses and advanced degrees in social work, counseling, or psychology, ensuring a comprehensive understanding of individual and organizational needs.

Highest-signal resume keywords

Licensed Social Work CredentialQualitative Research ExperienceClient Assessment SkillsCounseling or Therapy LicenseInterpersonal Communication Expertise

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Qualitative ResearchConversation AnalysisThematic AnalysisClient AssessmentInterviewingCounselingPsychological AssessmentCase ReviewUser ResearchQualitative Coding

Soft Skills

Analytical ThinkingAttention to DetailCollaborationCommunicationProblem-Solving

Certifications & Qualifications

LCSWLICSWLMSWLMFTLPCLCPCPhDPsyD

Industry Keywords

Social WorkCounselingTherapyHuman-Computer InteractionAdvisory FieldsMediationCoachingStudent ServicesOrganizational ConsultingCommunication

About the role

Key responsibilities & impact

Review AI conversations involving real-world interpersonal situations and everyday decision-making
Identify missing context and recommend relevant follow-up questions to improve AI responses
Evaluate whether additional information would materially change an AI-generated recommendation
Distinguish decision-relevant information from non-essential or descriptive details
Conduct qualitative reviews and document findings using structured evaluation guidelines
Assess personal, psychological, social, financial, practical, and organizational factors in conversations
Identify missed opportunities for clarification, deeper understanding, and information gathering
Review conversations involving relationships, work, education, family, wellbeing, planning, and resource constraints
Collaborate with research teams on consistent, evidence-based assessments
Maintain accuracy, clarity, and consistency while meeting project deadlines

Requirements

What you’ll need

At least 3–5 years of relevant direct professional experience in one or more listed domains
Licensed Social Work pathway: Master's degree in Social Work (MSW) or equivalent graduate-level qualification
Licensed Social Work pathway: LCSW, LICSW, LMSW, or equivalent applicable social work license or credential
Licensed Social Work pathway: Experience in client assessment, case review, interviewing, counseling, or related social-work practice
Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy license or credential; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
Counseling, Therapy, or Psychology pathway: Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work
Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in a related discipline
Qualitative Research, HCI, or Communication pathway: Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding
Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities for clarification
Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: Relevant professional qualification, credential, or demonstrated subject-matter expertise
At least 5 years of direct advisory or client-facing experience for candidates qualifying through the advisory pathway
Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work
Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations