First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Korean – Business Analyst P0 Evals-Personal Account
C

Korean – Business Analyst P0 Evals-Personal Account

Careerflow.ai

Remote · Canada, UK, Ireland, Germany, Netherlands, Spain, Portugal, Australia, Mexico, Brazil, India, Poland, Sweden, Denmark, Norway, Finland, Switzerland, Austria, Belgium, New ZealandData and AIPosted July 16, 2026AI training work
Probably open to people in 20 countriesApply for this job Write my CV for this job Early access
Pay
$16 an hour
Required
German (native speaker), English (comfortable reading, understanding, and evaluating)
Posted
July 16, 2026
Company
Careerflow.ai

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in Canada, Mexico and Brazil · Check the post

    The listing’s location: “Remote (International)”.

  • Probably open to people in the UK, Ireland, Germany, the Netherlands, Belgium, Austria, Switzerland, Sweden, Denmark, Norway, Finland, Poland, Spain, Portugal, Australia, New Zealand and India · Time zones

    The listing’s location: “Remote (International)”.

  • Not open to people in the United States, as far as the post says.

The job post

Role Overview:

As a Personal Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses using your primary personal Gmail account (@gmail.com). You will evaluate how effectively the system leverages your email history to deliver relevant and personalized responses across English and your native language. This role requires strong analytical skills, attention to detail, and the ability to evaluate prompts and responses in English.

Key Qualifications

  • Language Proficiency: Native speaker of one of the following languages:German (DE), Korean (KO)

  • Location: Must currently reside outside the United States.

  • Personal Account: Must have an active personal Gmail account (@gmail.com) that you use as your primary email account.

  • Mixed-Language Inbox: Your inbox must contain a meaningful mix of English and your target language, with each language representing at least 30% of your total inbox content. (Mandatory requirement)

  • Gmail Language: Gmail display language may be set to either English or your target language.

  • English Proficiency: Must be comfortable reading, understanding, and evaluating prompts and AI-generated responses in English.

  • Email History: Must have a well-established inbox with approximately 1,000+ emails and regular account activity.

  • Consent: Willing to use your primary personal Gmail account for the evaluation and complete the required consent process.

  • Exceptional Analytical Thinking: Ability to assess AI responses for relevance, personalization quality, and overall helpfulness.

  • Attention to Detail: Strong ability to identify subtle issues and inconsistencies in AI-generated responses.

  • Communication: Excellent written communication skills for providing clear and structured evaluation feedback.

  • Independence: Self-motivated and able to work independently in a remote environment.

  • Technical Setup: Desktop or laptop with a reliable internet connection.

Description:

In this role, you will be responsible for evaluating the quality of personalized AI interactions using your personal Gmail account. Your day-to-day responsibilities will include:

  • Evaluating AI-generated responses based on your personal email history and account activity.

  • Assessing whether responses are relevant, accurate, helpful, and appropriately personalized.

  • Reviewing prompts and AI responses in English while considering personalization across English and your native language.

  • Identifying incorrect personalization, unsupported assumptions, or irrelevant recommendations.

  • Comparing multiple AI responses to determine which provides the better overall user experience.

  • Providing clear, detailed, and objective evaluation feedback in accordance with project guidelines.

  • Maintaining data privacy and following all project confidentiality requirements throughout the evaluation process.

Education & Experience

  • Bachelor's degree or equivalent practical experience in any field.

  • Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.

Consent:

Must be willing to use their primary personal account and sign the Required Consent form. https://docs.google.com/document/d/1DJqKicTlfjhLFFKXEW_rEuflBZlXZPG2pdutU6AQdsI/edit?tab=t.0

Availability:

Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST.

Location:

Greenlit (except USA)

Contract duration:

16 weeks

First Monday isn’t the employer or a recruiter and isn’t affiliated with Careerflow.ai. Details may have changed since; confirm with the employer before you apply.

Probably open to people in 20 countriesApply for this job Write my CV for this job Early access
Pay
$16 an hour
Required
German (native speaker), English (comfortable reading, understanding, and evaluating)
Posted
July 16, 2026
Company
Careerflow.ai

Similar jobs open to people in Canada

Senior Data EngineerGrowth Minded · Anywhere in the WorldAI Researcher – Multilingual DataFeatherless AI · Remote · WorldwideSenior Analyst Data SolutionsKepler Group · CanadaMiddle/Senior Business Intelligence AnalystMGID · Remote · Worldwide
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job