First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Product and design/Senior Product Quality Analyst – AI Voice

Senior Product Quality Analyst – AI Voice

Spotify

LondonProduct and designPosted August 17, 2026
Probably open to people in the United KingdomApply for this job Write my CV for this job Early access
Pay
Not stated
Required
MOS-style evaluations
In person
Office
Posted
August 17, 2026
Company
Spotify

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in the UK · Only some regions

    The post says: “This role is based in London.”

    The post also says: in the office at times.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we’re behind some of Spotify’s most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you’ll keep millions of users listening by making great recommendations to each and every one of them.

We are the Voice Production Team, the creative team behind Spotify’s AI voice experiences. We think about AI voices from a casting perspective — including voice type, age and gender — and from a performance perspective, recognizing that a voice may need to perform differently for DJ than it does for an audiobook recap. We bring expertise in voice casting, direction, recording and production, and work closely with Speak to set the quality bar for AI voice models across experiences including AI DJ, Generative AI Ads, Personalized Podcasts, Agent Voice Chat and more.

As a Senior Product Quality Analyst, you’ll bring a dedicated evaluation perspective to the team. You’ll own how we define and measure AI voice quality, bringing together Voice Production’s creative bar, Speak’s technical bar and the wider industry bar. Your goal won’t simply be to determine whether Spotify has the “best” AI voice technology on the market. You’ll help us answer a more important question: is our technology the best at serving Spotify’s specific needs?

What You'll Do

  • Own the quality bar for Spotify’s AI voice models, defining what “good enough” means for different products, audiences, languages and use cases.
  • Independently design evaluation rubrics and build an evaluation approach that measures qualities such as naturalness, tone, pacing, pronunciation, accent, audio quality and overall experience.
  • Plan and carry out evaluation campaigns, turning qualitative and quantitative findings into clear recommendations for Voice Production, Speak and product teams.
  • Establish an ongoing evaluation rhythm, including when and how we reassess model quality as our technology and products evolve.
  • Benchmark Spotify’s AI voices against third-party models and competitors to understand where our experiences lead, where they differ and where there are opportunities to improve.
  • Help determine appropriate quality trade-offs as Spotify expands into additional languages and regions, considering the product use case and needs of each market.
  • Partner closely with voice experts, machine learning teams, product partners and vendors to maintain a consistent quality bar across demanding and sometimes competing priorities.
  • Surface the most meaningful gaps in model performance and use evaluation insights to help influence future research and technical priorities.

Who You Are

  • You have experience in product quality, evaluation, data curation or a closely related field where human judgment is used to assess model or product performance.
  • You know how to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics.
  • You are comfortable designing and running both qualitative and MOS-style evaluations and synthesizing the results into actionable insights.
  • You have an understanding of voice or audio quality, including qualities such as naturalness, pacing, tone, accent and pronunciation, or the ability to develop that expertise quickly.
  • You have strong judgment and can maintain a consistent quality bar while balancing different product requirements, markets and stakeholder perspectives.
  • You are comfortable working autonomously, identifying what needs to be evaluated and establishing the processes and cadence to make that evaluation useful over time.
  • You communicate clearly across creative, technical and product teams and can act as a reliable point of contact for internal partners and external vendors.
  • You are curious about generative AI, speech technology and the evolving AI voice landscape and can translate changes in the industry into meaningful benchmarks for Spotify.

Where You'll Be

  • This role is based in London
  • We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens. At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Spotify. Details may have changed since; confirm with the employer before you apply.

Probably open to people in the United KingdomApply for this job Write my CV for this job Early access
Pay
Not stated
Required
MOS-style evaluations
In person
Office
Posted
August 17, 2026
Company
Spotify

Similar jobs open to people in the United Kingdom

Post-Production LeadElevenLabs · United States · Ireland · Spain · Europe…Senior Product Manager, Translation Quality & PlatformLILT · USA · United KingdomSenior Product DesignerCloudtalk · UK, Ireland, Germany, Netherlands, Spain, Portugal, Poland, Sweden, Denmark, Norway, Finland, Switzerland, Austria, BelgiumSenior Product DesignerRevenueCat · EMEA, LATAM, Canada, USA
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job