First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/QA Analyst – LOIS for Word

QA Analyst – LOIS for Word

Filevine

San FranciscoEngineeringPosted June 1, 2026
Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$105,000–$150,000 a year
Required
bug tracking tools, test management workflows
Nice to have
CI/CD, AI or LLM-based products, Legal technology
Experience
2+ years
Benefits
Health insurance, Dental and vision, Parental leave, Life and disability insurance
Posted
June 1, 2026
Company
Filevine

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in the US · Location only

    The listing’s location: “San Francisco”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency. Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.
Role Summary:

This role owns quality for LOIS for Word, Filevine's AI-powered legal drafting product. You'll help build and own the QA function: the test strategy, the process, and the automation. You'll work at the intersection of legal AI and product quality, evaluating everything from AI output accuracy to UI behavior across the product. A big part of this role is moving quality upstream, so it's built into how features are planned and shipped from the start.

The ideal candidate has 2+ years of QA experience, brings a sharp eye for both functional bugs and AI quality issues, is comfortable building from scratch in ambiguity, and gets genuinely uncomfortable shipping something they haven't tried to break.

What You'll Do:

  • Define and own the test strategy, process, and QA playbook for the product

  • Move QA upstream by partnering with product and engineering early, so test plans are ready before features ship

  • Evaluate AI output quality across dimensions like accuracy, citation reliability, and appropriately scoped reasoning

  • Design and maintain evaluation sets that account for non-deterministic output and catch regressions over time

  • Test how AI-generated edits apply to documents, including accuracy and formatting fidelity across document structures

  • Build automated guardrails integrated into CI/CD that cover critical flows

  • Write structured, reproducible bug reports

  • Partner with legal domain experts to understand how different customer types use the product, and translate that into test coverage

  • Approach QA with a product and design mindset. If something works but could be better, we want to hear it

  • Compare behavior across product surfaces and document discrepancies

What You'll Need:

  • 2+ years of QA experience, including ownership of test strategy for a product or major feature area

  • Track record of building QA process and automation from scratch in a fast-moving environment

  • Comfort operating in high ambiguity, where features ship quickly and you figure out how to test them fast

  • Strong analytical and problem-solving skills, with attention to both functional correctness and AI output quality

  • Ability to reason about non-deterministic systems and define what "correct" means when there's no single right answer

  • Excellent written communication, with the ability to write clear, concise, actionable bug reports backed by evidence

  • Experience with bug tracking tools and test management workflows

Nice To Have:

  • Experience testing AI or LLM-based products, especially for output accuracy and eval design

  • CI/CD experience setting up pipelines and release gates for automated tests

  • A design or UX sensibility, with an eye for where product workflows could be smoother

  • Prior experience in legal technology or comfort reading legal contracts

  • Programming experience beyond test automation

Compensation Information: $105,000 - $150,000

The salary range represents the low and high end of the salary range for this position. The total compensation package for this position will be determined by each individual’s location, qualifications, education, work experience, skills and performance.

An individual’s final offer will be weighted by their primary work location and expertise.

Cool Company Benefits: - A dynamic, rapidly growing company, focused on helping organizations thrive - Medical, Dental, & Vision Insurance (for full-time employees) - Competitive & Fair Pay - Maternity & paternity leave (for full-time employees) - Short & long-term disability - Opportunity to learn from a dedicated leadership team - Top-of-the-line company swag Privacy Policy Notice Filevine will handle your personal information according to what’s outlined in our Privacy Policy. Communication about this opportunity, or any open role at Filevine, will only come from representatives with email addresses using "filevine.com". Other addresses reaching out are not affiliated with Filevine and should not be responded to.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Filevine. Details may have changed since; confirm with the employer before you apply.

Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$105,000–$150,000 a year
Required
bug tracking tools, test management workflows
Nice to have
CI/CD, AI or LLM-based products, Legal technology
Experience
2+ years
Benefits
Health insurance, Dental and vision, Parental leave, Life and disability insurance
Posted
June 1, 2026
Company
Filevine

Similar jobs open to people in the United States

QA Engineer: AI-Assisted TestingECFX · United StatesManager, AI-Native Quality EngineeringLibra Solutions · United StatesStaff Data EngineerEve · Remote · USCQA Automation EngineerCome and See · USA Only
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job