First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Operations/Strategic Project Lead

Strategic Project Lead

Contra

San FranciscoOperationsPosted July 1, 2026
Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$150,000–$200,000 a year
Nice to have
RLHF, LLM evaluation, benchmark design
Experience
3+ years
Equity
Equity
Benefits
Health insurance, Dental and vision, Retirement plan, Equipment
Hiring
Interviews, Technical interview, Presentation
Tests
Case study (paid)
Posted
July 1, 2026
Company
Contra

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in the US · Only some regions

    The post says: “Based in San Francisco, California.”

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

Who we are

Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect the originality that gets flattened as everything starts to look the same.

We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what "good" looks like across design, video, imagery, and beyond. Our work powers benchmarking, evaluation, and post-training for leading models and applications. Built on Contra, the professional network for independent creatives, we turn human judgment into the training and evaluation layer that helps these tools serve the people who use them.

Why this role exists

We are scaling across client engagements: post-training dataset creation, benchmarking programs, and ongoing evaluation partnerships. Each project spans a different mix of AI labs, creative-tool companies, and research teams, with different requirements, timelines, and quality bars. We need someone to own this work from end to end.

Think of yourself as the operator for a project or vertical. You sit between three groups that do not naturally talk to each other: the client who needs the data, the creative experts producing it, and the internal engineering team building the tooling. Your job is to make all three feel like they are working on the same thing, and to ship results that are both rigorous and genuinely useful.

What you'll own

  • The methodology. Annotation protocols, rubrics, and evaluation designs for creative and multimodal outputs.

  • Delivery. Scope, evaluator staffing, quality routing, timelines, and the client relationship, from kickoff to final readout.

  • Quality. Data quality, inter-rater reliability, and real-time course correction when something feels off. You hold the bar, and you hold the levers to fix it.

  • Analysis and storytelling. Qualitative and quantitative analysis turned into clear findings, recommendations, reports, and workshops that clients act on.

  • The systems behind it. You turn repeated work into clean, measurable process, and you partner with engineering on the tooling that makes that process faster and more reliable.

  • The narrative. Case studies and benchmark publications that sharpen how Contra Labs is understood in the market.

About you

  • You design studies for a living. You can scope a question, run the study, analyze the data, and translate it into a direction people can act on.

  • You understand good creative, and you can explain it. You recognize creative quality and can say why, and you can tell the difference between personal preference and something closer to ground truth. You build frameworks that capture that signal faithfully.

  • You care more about people than about technology for its own sake. You understand how humans judge creative work and design systems around that.

  • You turn messy work into machines. You make process clear, predictable, and measurable, and you run a tight ship across several projects at once.

  • High ownership, low ego, bias to action. You ship a v1, learn, and do what it takes to deliver.

Experience

  • 3+ years designing studies, running evaluations, analyzing data, and presenting findings.

  • Experience with data labeling, annotation, human-in-the-loop systems, or AI and ML evaluation workflows.

  • A track record managing several concurrent projects, including annotation, evaluation, or QA work.

  • A real point of view on creative quality and what "good" looks like.

Bonus

  • A strong research background, qualitative and quantitative. A Master's or PhD in HCI, cognitive science, psychology, design research, or a related field is a plus, and so is equivalent depth from industry.

  • Statistical methods for evaluation work: inter-rater reliability, sampling, regression, significance testing.

  • RLHF, LLM evaluation, or benchmark design.

  • Ethnography, UX research, or design-study methods.

  • Startup or 0-to-1 experience.

Requirements

  • Based in San Francisco, California

Total comp

  • Salary: $150,000 to $200,000 USD plus equity

  • Medical, dental, vision

  • 401k matching

  • Company laptop on your start date

Interview process

  1. Recruiting team (20 minutes)

  2. CEO and co-founder (30 minutes)

  3. Technical interview, research and methods focus (45 minutes)

  4. VP of Product (45 minutes)

  5. Paid case study and presentation (60 minutes)

Note: Contra communicates with applicants through contra.com domains only. We never ask candidates for money. For current postings, visit Contra Careers.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Contra. Details may have changed since; confirm with the employer before you apply.

Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$150,000–$200,000 a year
Nice to have
RLHF, LLM evaluation, benchmark design
Experience
3+ years
Equity
Equity
Benefits
Health insurance, Dental and vision, Retirement plan, Equipment
Hiring
Interviews, Technical interview, Presentation
Tests
Case study (paid)
Posted
July 1, 2026
Company
Contra

Similar jobs open to people in the United States

CStrategic Project Lead – Software EngineeringCareerflow.ai · Remote · US, Brazil, IndiaDirector, AI TransformationHuman Agency · US or CanadaOperations, Strategy & Special ProjectsAquaria · United StatesAI Strategist – SupernalInfinity · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job