First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Gmail & Google Calendar AI Assistant Evaluator, Remote- Contract

Gmail & Google Calendar AI Assistant Evaluator, Remote- Contract

Xperteez Technology

Remote · USData and AIPosted September 26, 2026AI training work
Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Gmail, Google Calendar, Google Meetings
Posted
September 26, 2026
Company
Xperteez Technology

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US

    The employer lists this job as remote there: “Remote (United States)”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

Role Title: Gmail & Google Calendar AI Assistant Evaluator

Role Type: Contract, Remote

Location: United States

Required Skills:

  • Gmail

  • Google Calendar

  • AI Usage

  • Scheduling

  • Emails

  • Google Meetings

In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.

Key Responsibilities:

  • Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.

  • Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.

  • Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.

  • Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.

  • Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.

  • Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.

  • Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.

Required Skills and Qualifications:

  • Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.

  • Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.

  • Regular experience coordinating with others over email or text — setting up meetups, following up on threads, or confirming shared plans and payments.

  • Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.

  • Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.

  • Exceptional attention to detail and accuracy when reviewing AI-generated output.

  • Strong written communication skills for clear reporting and timely updates on progress and challenges.

  • Demonstrated time management and self-organization for independent, remote project participation.

Preferred Qualifications:

  • Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.

  • Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.

  • Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Xperteez Technology. Details may have changed since; confirm with the employer before you apply.

Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Gmail, Google Calendar, Google Meetings
Posted
September 26, 2026
Company
Xperteez Technology

Similar jobs open to people in the United States

AI & ML EngineerAsteri AI · Remote · USAI Content RevieweriMerit · Australia, Austria, Belgium, Canada…
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job