First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Text Situated Alignment Specialist (Contract)
C

Text Situated Alignment Specialist (Contract)

Careerflow.ai

Remote · US, Canada, UK, Netherlands, Spain, Portugal, Australia, Sweden, Denmark, Norway, Finland, Switzerland, Austria, Belgium, New ZealandData and AIPosted October 5, 2026
Open to people in the United States and CanadaApply for this job Write my CV for this job Early access
Pay
Not stated
Required
LCSW, LICSW, LMSW, or equivalent applicable social work license/credential
Nice to have
Qualitative coding, structured case review
Experience
3–5 years; 3+ years
Starts
1st October (estimated), As soon as you successfully pass the…
Hiring
Assessment
Posted
October 5, 2026
Company
Careerflow.ai

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US

    The post says: “Location -United States and Saudi Arabia.”

  • Open to people in Canada · Not in Quebec

    The post says: “Canada (NOT Quebec), United Kingdom, Ireland, Belgium, Netherlands, Luxembourg, Switzerland, Austria, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Australia, New Zealand.”

  • Probably open to people in the UK, Ireland, the Netherlands, Belgium, Austria, Switzerland, Sweden, Denmark, Norway, Finland, Spain, Portugal, Australia and New Zealand · Time zones

    The post says: “Canada (NOT Quebec), United Kingdom, Ireland, Belgium, Netherlands, Luxembourg, Switzerland, Austria, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Australia, New Zealand.”

  • Not open to people in the other 5 countries we cover, as far as the post says.

The job post

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

About the role

We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.

SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.

Job Responsibilities:

  • Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.

  • Identify missing context and recommend relevant follow-up questions.

  • Evaluate whether additional information would have changed the AI's recommendations.

  • Distinguish between critical ("load-bearing") and non-essential information.

  • Conduct qualitative reviews and document findings using structured evaluation guidelines.

  • Collaborate with research teams to ensure consistent, high-quality assessments..

Required Qualification:

  • Candidates should have at least 3–5 years of direct practice relevant qualifications and professional experience in at least one of the following areas:

Licensed Social Work

  • MSW or equivalent graduate-level qualification in Social Work.

  • LCSW, LICSW, LMSW, or equivalent applicable social work license/credential.

  • Experience with client assessment, case review, interviewing, counseling, or related social-work practice.

Counseling, Therapy, or Psychology

  • MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or

  • PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.

  • Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.

Qualitative Research, HCI, or Communication

  • MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.

  • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.

  • Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines.

Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields

  • Relevant professional qualification, credential, or demonstrated subject-matter expertise.

  • Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work.

  • Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance.

    Must be based in the USA, Canada or Western Europe

Preferred experience:

  • Experience eliciting relevant context when clients initially provide incomplete information

  • Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors

  • Qualitative coding or structured case review

  • Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative

  • Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information
    gathering

    Project Details :

  • Project duration - 3 weeks (short term project)

  • Project type - Pay-per-task (PPT)

  • AHT - 75 minutes (approx.)

  • Engagement - Full time

  • Estimated project start date - 1st October (estimated)

Obs:

Sample

  • 70 total professionals

  • 35 participants from High-Cost Geographies

  • 35 participants from Mid-Cost Geographies

Experience Requirement

  • Candidates must have at least 3–5 years of direct practice experience in their relevant professional field.

Eligible Qualifications

Candidates should have at least one of the following:

  • Social Work: MSW with LCSW or equivalent social-work license

  • Counseling/Therapy: MA/MS with LMFT, LPC, LCPC, or equivalent counseling license

  • Psychology: PhD/PsyD in clinical, counseling, social, or industrial-organizational psychology

  • Research and Related Fields: MA/PhD in conflict resolution, communication, HCI, anthropology, sociology, or qualitative research

  • Advisory/Client-Facing Work: Relevant professional credential plus at least five years of direct advisory or client-facing experience

3+ years of professional experience

Total number of positions: 320

Engagement Length: Full-time or Part time. 40h or 20h per week with 4 hours PST overlap.

Location -United States and Saudi Arabia

Canada (NOT Quebec), United Kingdom, Ireland, Belgium, Netherlands, Luxembourg, Switzerland, Austria, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Australia, New Zealand

6-week project, with a preferred commitment of up to 40 hours per week.

Fully remote, with payment in USD.

Start as soon as you successfully pass the assessment.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Careerflow.ai. Details may have changed since; confirm with the employer before you apply.

Open to people in the United States and CanadaApply for this job Write my CV for this job Early access
Pay
Not stated
Required
LCSW, LICSW, LMSW, or equivalent applicable social work license/credential
Nice to have
Qualitative coding, structured case review
Experience
3–5 years; 3+ years
Starts
1st October (estimated), As soon as you successfully pass the…
Hiring
Assessment
Posted
October 5, 2026
Company
Careerflow.ai

Similar jobs open to people in the United States

STEM Expert (MSc./PhD)Xperteez Technology · Remote · WorldwideAI Architect/AI Subject Matter ExpertTechtorch · United StatesAI Researcher – Multilingual DataFeatherless AI · Remote · Worldwide🌍 Subject Matter Expert – Data & Statistical Chart Analysis, Remote – ContractXperteez Technology · Remote · Worldwide
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job