First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Senior AI Product Analyst – Voice AI Agents

Senior AI Product Analyst – Voice AI Agents

MEDvidi

PolandData and AI

Also posted for Portugal

Open to people in Poland and PortugalApply for this job Write my CV for this job Early access
Pay
Not stated
Required
SQL, Python, Russian (Fluent), English (B2 or higher)
Experience
5+ years
Benefits
Health insurance, Wellness, Paid time off, Sick leave
Company
MEDvidi

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in Poland

    The employer lists this job as remote there: “Poland”.

  • Open to people in Portugal

    The employer lists this job as remote there: “Portugal”.

  • Not open to people in the other 19 countries we cover, as far as the post says.

The job post

MEDvidi is an AI-powered mental healthcare platform setting a new standard for safe, effective, and scalable psychiatric care in the United States. We combine licensed providers with proprietary AI tools to deliver consistent, outcomes-driven treatment for conditions like ADHD, anxiety, depression, and more. MEDvidi's technology automates charting, follow-ups, and treatment planning, freeing providers to focus on patient care while improving efficiency and clinical quality.

At MEDvidi, the AI Receptionist Team builds and improves Voice AI Agents that interact directly with patients and automate critical parts of the patient journey. These systems handle real-world conversations, support operational workflows, and help patients navigate care more efficiently.

As these agents become more autonomous and handle increasingly complex interactions, understanding how they behave in production becomes a critical product and business challenge.

We're hiring an AI Product Analyst to help us evaluate, monitor, and improve Voice AI systems operating at scale. You'll work at the intersection of Product, Engineering, Operations, and AI, helping the team understand how AI behaves in the real world, where it creates value, where it fails, and what should be improved next.

Why this role

  • Work on one of the most visible AI products inside MEDvidi.
  • Help shape the future of Voice AI in healthcare.
  • Influence product decisions using real production evidence.
  • High ownership in a fast-moving, product-driven medical tech company.

Responsibilities

  • Analyze production behavior of Voice AI Agents and conversational AI workflows.
  • Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations.
  • Work directly with call transcripts, logs, generated outputs, and operational datasets to uncover patterns and actionable insights.
  • Design evaluation frameworks for measuring AI quality, reliability, and business impact.
  • Build monitoring systems and dashboards for AI performance visibility.
  • Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience.
  • Detect quality shifts, anomalies, and emerging failure modes in production environments.
  • Partner closely with Product, Engineering, QA, and Operations teams on AI initiatives.
  • Support rapid decision-making in fast-changing and ambiguous environments.

This role is not for you if

  • You prefer working only with structured datasets and predefined metrics.
  • You are uncomfortable analyzing raw conversations, transcripts, and AI-generated outputs.
  • You expect clearly defined answers rather than investigating ambiguous problems.
  • You are not interested in understanding how AI systems fail in production.

Requirements

  • 5+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems.
  • Strong SQL skills.
  • Python for analytical investigations and working with large-scale text datasets.
  • Experience working with ML pipelines or AI-powered products
  • Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes.
  • Experience building monitoring systems, analytical frameworks, or operational dashboards.
  • Strong communication skills and ability to translate analysis into product decisions.
  • Ability to work effectively in ambiguous and fast-changing environments.
  • Fluent Russian; English level B2 or higher.
  • Ability to work CET-overlapping hours.

Would be a plus

  • Experience with conversational AI or AI agents.
  • Experience evaluating LLM outputs.
  • Experience with AI quality metrics and evaluation methodologies.
  • Experience with prompt iteration and AI evaluation frameworks.

What we offer

  • High-impact environment: A chance to influence how AI is used in real patient interactions.
  • Growth & compensation: Competitive compensation and clear growth opportunities.
  • Remote-first: Fully remote, long-term B2B collaboration.
  • Health & wellness: Health insurance after the probation period, plus sports & wellness compensation.
  • Career development: Career growth, including personalized English lessons via Preply.
  • Time off: 19 working days of vacation per year, 4 additional wellness days, and paid sick leave for the first 5 working days.
  • Culture: Thoughtful gifts for important life events.

Ready to make an impact? Send us your profile, let's build something meaningful together.

MEDvidi is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and contractors. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

First Monday isn’t the employer or a recruiter and isn’t affiliated with MEDvidi. Details may have changed since; confirm with the employer before you apply.

Open to people in Poland and PortugalApply for this job Write my CV for this job Early access
Pay
Not stated
Required
SQL, Python, Russian (Fluent), English (B2 or higher)
Experience
5+ years
Benefits
Health insurance, Wellness, Paid time off, Sick leave
Company
MEDvidi

Similar jobs open to people in Poland

Senior AI EngineerCraftware · PolandSenior Data & AI Solutions AnalystPEOPLEMORE P.S.A. · PolandSenior AI EngineerEPAM Systems · PolandSenior Machine Learning Founding EngineerYard Corporate · Poland
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job