About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are seeking experienced Subject Matter Experts (SMEs) from psychology, social work, counseling, qualitative research, human-computer interaction (HCI), communication, conflict resolution, coaching, and related advisory fields to support AI conversation evaluation research. You will review conversations between people and AI models, assess whether the AI gathered sufficient context before making recommendations, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality. The ideal candidate has at least 3–5 years of relevant professional experience, strong analytical and interviewing skills, and the ability to distinguish essential, decision-changing information from details that are less relevant to a recommendation.
Key Responsibilities
Requirements
Candidates must have at least 3–5 years of direct professional experience in one or more of the following domains.
Master's degree in Social Work (MSW) or an equivalent graduate-level qualification.
LCSW, LICSW, LMSW, or an equivalent applicable social work credential or license.
Experience in client assessment, case review, interviewing, counseling, or related social-work practice.
Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy credential; or
PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work.
MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.
Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
Ability to analyze conversations systematically and identify missing context or patterns in human communication.
Relevant professional qualification, credential, or demonstrated subject-matter expertise.
At least 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway.
Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work.
Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations.
Evaluate conversations between people and AI models, identify missing context and useful follow-up questions, and provide structured, evidence-based feedback to improve recommendation quality.
Evaluate conversations between people and AI models, identify missing context and useful follow-up questions, and provide structured, evidence-based feedback to improve recommendation quality.
Evaluate AI conversations for whether they gather enough context before offering recommendations, identify missing information and useful follow-up questions, and provide structured feedback to improve conversational quality.
Design and deliver mixed-method customer and market research, turning survey, interview, competitor and market evidence into clear, commercially relevant insights that inform products, campaigns and business decisions.
Conduct project-based market research on consumer markets, gathering information through store visits and secondary sources, and reporting findings to project managers for business intelligence projects.
