First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Machine Learning Engineer, Ops

Machine Learning Engineer, Ops

Cantina

Europe · United StatesData and AIPosted July 27, 2026
Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Python, PyTorch, Kubernetes, CI/CD, Cloud infrastructure, vLLM, SGLang, TensorRT-LLM, TensorRT, Triton Inference Server
Equity
Equity
Benefits
Health insurance, Dental and vision, Paid time off, Sick leave
Posted
July 27, 2026
Company
Cantina

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US

    The employer lists this job as remote there: “Europe · United States”.

  • Probably open to people in the UK, Ireland, Germany, the Netherlands, Belgium, Austria, Switzerland, Sweden, Denmark, Norway, Finland, Poland, Spain and Portugal · Check the post

    The listing’s location: “Europe · United States”.

  • Not open to people in the other 6 countries we cover, as far as the post says.

The job post

About Cantina:

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role:

We are looking for an ML Engineer to own the production inference stack for our text-to-speech (TTS) and speech recognition (ASR) models, end to end. Our research team delivers trained model checkpoints; you will productionize them as low-latency, real-time streaming services that run cost-efficiently on GPUs. The role covers the inference engines, the Kubernetes infrastructure they run on, and the performance benchmarking and accuracy validation that let us ship changes safely. You will bridge research and production, and own latency, throughput, cost and accuracy as we scale.

What You’ll Do:

  • Build and optimize streaming inference engines for TTS and ASR models, including multi-stage model pipelines.

  • Optimize latency (time to first chunk, p50/p99) and throughput using continuous batching, CUDA Graphs, torch.compile and mixed precision.

  • Maintain numerical parity with the reference implementation through automated accuracy regression tests, per stage and end to end.

  • Deploy and operate GPU inference services on Kubernetes: autoscaling, containerization and infrastructure as code.

  • Build CI/CD for model artifacts, with model versioning and reproducible releases.

  • Own observability and performance benchmarking: p50/p99 latency, real-time factor (RTF), GPU utilization and cost per request.

  • Partner with research to productionize new models.

What You’ll Bring:

  • Hands-on experience deploying, scaling and optimizing ML models in production, beyond consuming model APIs.

  • Working knowledge of the full inference stack, from CUDA kernels to serving frameworks, with depth in some layers; expertise across all of them is not expected.

  • GPU performance optimization: profiling (Nsight Systems, PyTorch Profiler), memory bandwidth, CPU-GPU synchronization.

  • Solid understanding of model serving: continuous batching, KV cache management, request scheduling.

  • Production experience with Kubernetes, CI/CD and cloud infrastructure.

  • Strong Python and PyTorch, and a rigorous approach to performance benchmarking.

  • Experience with speech or audio models (TTS, ASR, voice conversion).

  • Experience with inference frameworks such as vLLM (vLLM-Omni), SGLang, TensorRT-LLM, TensorRT or Triton Inference Server.

Compensation:

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles:

  • Competitive salary and generous company equity

  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina

  • 42 days of paid time off, including:

    • 15 PTO days

    • 10 sick days

    • 15 company holidays

    • 2 floating holidays

  • Generous parental leave & fertility support

  • 401(k) retirement savings plan

  • Lifestyle spending account – $500/month to use however you’d like

  • Complimentary lunch and snacks for in-office employees

  • One Medical membership, and more!

First Monday isn’t the employer or a recruiter and isn’t affiliated with Cantina. Details may have changed since; confirm with the employer before you apply.

Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Python, PyTorch, Kubernetes, CI/CD, Cloud infrastructure, vLLM, SGLang, TensorRT-LLM, TensorRT, Triton Inference Server
Equity
Equity
Benefits
Health insurance, Dental and vision, Paid time off, Sick leave
Posted
July 27, 2026
Company
Cantina

Similar jobs open to people in the United States

Machine Learning Engineer — Inference OptimizationFeatherless AI · Remote · WorldwideMachine Learning Engineer (Answers Relevance)Reddit · USMachine Learning EngineerWynd Labs · Remote · USAI & ML EngineerAsteri AI · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job