First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Head of Evaluations (Legal AI Benchmarking)

Head of Evaluations (Legal AI Benchmarking)

Newcode.ai

United States · United Kingdom · Norway…Data and AIPosted July 15, 2026
Open to people in 4 countriesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Python, panda, NumPy, jupiter notebooks
Visa
No visa sponsorship
Posted
July 15, 2026
Company
Newcode.ai

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US, the UK, Sweden and Norway

    The employer lists this job as remote there: “United States · United Kingdom · Norway · Sweden”.

  • Not open to people in the other 17 countries we cover, as far as the post says.

The job post

Who are we?

At Newcode.ai, we're transforming how law firms and legal professionals harness AI for real-world impact. As part of our collaborative, high-growth team, you'll have the rare opportunity to work side-by-side with visionary founders at the bleeding edge of AI and legal innovation — shaping not just our product, but the future of legal work itself.

Note: We believe in being transparent about what it's like to work at Newcode. As a fast-growing startup, we're building and evolving every day. That means not every process, playbook, or framework is already in place, and priorities can shift quickly.

The people who thrive here are comfortable with ambiguity, take ownership, and don't wait for perfect direction. They are resourceful, proactive, and able to "figure it out"—solving problems, creating structure where needed, and helping build the company as they go. If you are good with this then, great! Keep reading to learn more.

Position Overview

We are seeking a highly analytical professional with a strong statistical background to join our Head of Evaluations. In this role, you will design, implement, and scale the testing frameworks used to evaluate our platform. You will ensure our AI products meet the highest standards of legal reasoning, factual accuracy, and regulatory compliance while maintaining a near-zero hallucination rate.

Key Responsibilities

  • Design Legal Benchmarks for: Contract Drafting, Information Extraction, Legal Research, and Contract Review
  • Build, source and maintain relevant datasets
  • Audit AI Output: Review and score complex AI-generated legal text, contract analyses, and statutory interpretations for accuracy and precision and lay out a strategy.
  • Define Evaluation Metrics: Establish clear criteria for grading model performance, specifically focusing on logical reasoning, citation accuracy, and the model's ability to safely abstain from answering.
  • Collaborate with Engineering: Partner directly with Engineering to translate legal errors into actionable technical feedback for model fine-tuning.

Requirements

  • PhD or Masters in statistics, mathematics, machine learning or equivalent
  • Analytical Skills: Proven ability to break down complex statutory frameworks and case law into structured, logical data points.
  • Tech-Savviness: python, panda, numpy, jupiter notebooks and similar statistical models

Visa Sponsorship:

At this time, Newcode is unable to provide visa sponsorship. Candidates must be authorized to work in the applicable country without employer sponsorship.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Newcode.ai. Details may have changed since; confirm with the employer before you apply.

Open to people in 4 countriesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Python, panda, NumPy, jupiter notebooks
Visa
No visa sponsorship
Posted
July 15, 2026
Company
Newcode.ai

Similar jobs open to people in the United States

AI Evaluation EngineerSedgwick · Telecommuter FLResearch Engineer / Scientist, Reinforcement LearningHarvey · Remote · USStaff AI Operations LeadHoneycomb.io · Remote · CanadaDirector, Corporate Legal & Compliance Enablement – AI and Data ScienceCredit Acceptance · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job