First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Research Scientist, Benchmarks & Evals

Research Scientist, Benchmarks & Evals

Kled AI

United StatesData and AIPosted October 11, 2026
Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$250,000–$350,000 a year
Required
PyTorch
Experience
5–7 years
Equity
Equity
Posted
October 11, 2026
Company
Kled AI

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US

    The employer lists this job as remote there: “United States”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

ABOUT KLED

Kled is building the largest opt-in human data network in the world.

We are not a labeling firm. We are not a task marketplace.

We are a consumer application where people upload their real photos, videos, and documents and get paid continuously.

We then filter, standardize, and license that data to frontier AI labs and enterprises that need fresh, rights-aware training data.

Since launching our mobile app in 2026, we have:

• Reached #1 on the App Store (Finance) with 0 paid marketing
• Scaled to 600,000+ active data contributors
• Processed 5M uploads per day
• Raised $15M+ from investors behind SpaceX, Airbnb, Coinbase, xAI, OpenAI, Anthropic, Spotify, Lyft, Uber, and more

Our mission is to let anyone download the app and earn a real living wage from uploading their data.

ABOUT THE ROLE

Research Scientist - Benchmarks & Evals

AI labs buy data when a benchmark shows it works.

You’ll build the benchmarks that show what one of the largest human data networks in the world can do for frontier AI models.

You will:

- Design and ship public benchmarks for image, video and document models

- Build private test sets from real, opt-in data that no model has trained on

- Run data-value experiments: train models with and without Kled data, measure what changes

- Design human evaluation studies and the automatic metrics that track them

- Publish leaderboards and reports that researchers at frontier labs trust

- Find where models fall short and tell our team what data to collect next

- Work directly with the founders and lab buyers to turn results into data deals

WE’RE LOOKING FOR

- 5-7+ years ML research or research engineering experience

- A benchmark or evaluation you built that other people actually used

- Strong hands-on experience training and fine-tuning image or video models (PyTorch)

- Deep understanding of experimental design and statistics (controls, ablations, human studies)

- Experience running experiments end to end, from GPUs to final report

- Clear writing for both researchers and buyers

Bonus:

- Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially)

- Experience on an evaluation or data team at an AI lab

- Experience selling or licensing data to AI labs

- Experience with data valuation or data attribution research

CURRENT STACK

Research

- Python / PyTorch

- Open-weight image and video models

- Cloud GPUs

Data

- Hundreds of millions of opt-in photos, videos and documents

- PostgreSQL (Supabase)

- S3 storage

COMPENSATION

- Base salary: $250,000 - $350,000

- $750,000 – $1,500,000 equity

We move fast and work hard.

If you're excited to build the benchmarks that decide what data trains frontier AI, let’s talk!

GROWTH OPPORTUNITY

You’ll join a team operating at the frontier of applied AI data infrastructure.

In this role, you’ll have the opportunity to:

• Own core systems that power one of the largest human data networks in the world
• Design infrastructure that directly influences what data trains next-generation AI models
• Build at real scale - millions of uploads per day, adversarial environments, global contributors
• Ship alongside a team that has built marketplaces, AI systems, and products used by millions

If you’re excited to move fast, build systems that matter, and help define how human data powers frontier AI, let’s talk.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Kled AI. Details may have changed since; confirm with the employer before you apply.

Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$250,000–$350,000 a year
Required
PyTorch
Experience
5–7 years
Equity
Equity
Posted
October 11, 2026
Company
Kled AI

Similar jobs open to people in the United States

Machine Learning Engineer, AppliedTrace · Remote · USPrincipal Data Scientist, Marketing MeasurementUpstart · Remote · US, CanadaData ScientistScanna · Remote · WorldwideLApplied AI Engineer – Agent Intelligence & RetrievalLittlebird · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job