AI Conversation Evaluation, Context Research Specialist

Gramian Consulting

. Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, everyday planning, wellbeing, and other real-world decisions .

Posted 10/22/2026full-timeRemote • Brazil, Mexico, Argentina, Colombia, Poland, RomaniaMid-LevelSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in qualitative research and client assessment, with a strong ability to analyze conversations and identify contextual gaps. Holds relevant advanced degrees and licenses in social work, counseling, or related fields, ensuring informed recommendations and high-quality evaluations.

Highest-signal resume keywords

Licensed Social Worker (LCSW, LICSW, LMSW)Master's Degree in Social Work (MSW)Qualitative Research ExperienceClient Assessment and CounselingHuman-Computer Interaction (HCI)

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Qualitative CodingConversation AnalysisThematic AnalysisInterviewing TechniquesClient AssessmentCounseling SkillsMediation SkillsOrganizational ConsultingPsychological AssessmentUser Research

Soft Skills

Analytical ThinkingCollaborationCommunicationContextual UnderstandingProblem-Solving

Certifications & Qualifications

LMFTLPCLCPCPhD in PsychologyPsyD in Psychology

Industry Keywords

Social WorkCounselingTherapyHuman-Computer InteractionQualitative ResearchInterpersonal RelationshipsWorkplace SituationsClient-Facing ExperienceAdvisory FieldsOrganizational Needs

About the role

Key responsibilities & impact

Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, everyday planning, wellbeing, and other real-world decisions
Evaluate whether the AI gathered sufficient context before providing advice, recommendations, or proposed solutions
Identify missing information and suggest relevant follow-up questions that could improve the quality of the AI's response
Assess whether additional context would materially change the recommendation or decision
Distinguish between load-bearing information that could change the outcome and non-essential or merely descriptive details
Conduct qualitative reviews using structured evaluation guidelines and document findings consistently
Identify missed opportunities for clarification, contextual understanding, and information gathering
Consider relevant personal, psychological, social, financial, practical, and organizational factors when evaluating conversations
Collaborate with research teams to maintain consistent evaluation standards and high-quality assessments
Complete assigned tasks accurately within the required project timelines

Requirements

What you’ll need

At least 3–5 years of direct professional experience in one or more listed domains
Licensed Social Work pathway: Master's degree in Social Work (MSW) or an equivalent graduate-level qualification
LCSW, LICSW, LMSW, or an equivalent applicable social work credential or license
Experience in client assessment, case review, interviewing, counseling, or related social-work practice
Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy credential; or PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work
Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline
Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities
Ability to analyze conversations systematically and identify missing context or patterns in human communication
Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: relevant professional qualification, credential, or demonstrated subject-matter expertise
At least 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway
Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work
Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations