First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/ML Ops Engineer

ML Ops Engineer

Pragmatike

Ukraine · Czech Republic · Latvia…EngineeringPosted September 23, 2026Recruitment agency
Open to people in Poland, Spain and PortugalApply for this job Write my CV for this job Early access
Pay
Not stated
Required
vLLM, TGI, Triton, Container orchestration, Python, Terraform, Helm, MLOps tooling, English (Fluent)
Nice to have
Kubeflow, MLflow, KubeAI
Experience
4+ years
Starts
ASAP
Posted
September 23, 2026
Company
Pragmatike

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in Poland, Spain and Portugal

    The employer lists this job as remote there: “Ukraine · Czech Republic · Latvia · Spain · Albania · Lithuania · Greece · Bosnia & Herzegovina · Croatia · Estonia · Serbia · Poland · Armenia · Portugal · Italy · Malta · Türkiye · Montenegro · Romania”.

  • Not open to people in the other 18 countries we cover, as far as the post says.

The job post

Location: Fully remote (EMEA timezone)
Start date: ASAP
Languages: Fluent English required
Industry: Cloud Computing / AI / European Deep-Tech SaaS

About the Role

Pragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services. The company is redefining how compute is delivered by providing GPU-powered infrastructure for AI/ML workloads, secure storage, and high-speed data transfer through a decentralized architecture that significantly reduces environmental impact compared to traditional cloud providers.

We are seeking a ML Ops Engineer with strong experience in production-grade model serving and infrastructure for AI systems. This is a highly technical, hands-on role focused on building scalable, reliable, and efficient ML inference platforms powering real-time AI applications.

You will be responsible for designing and operating the core infrastructure that serves machine learning models at scale. You will work closely with infrastructure, platform, and applied AI teams to ensure high availability, low latency, and cost-efficient inference systems. Strong ownership, production mindset, and experience with distributed GPU systems are essential.

Your Responsibilities

  • Build and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton, or equivalent

  • Design and implement robust deployment pipelines with blue/green and canary rollout strategies for ML models

  • Develop and maintain auto-scaling systems, multi-model serving architectures, and intelligent request routing layers

  • Optimize GPU utilization, memory efficiency, network throughput, and model artifact storage performance

  • Design observability systems for tracking inference latency, throughput, GPU usage, cost metrics, and system health

  • Manage model registries and CI/CD pipelines enabling automated and reproducible model deployments

  • Own the full lifecycle of ML systems from development through production, including operational support and on-call responsibilities

  • Define engineering best practices and contribute to platform scalability in a fast-moving startup environment

Required Qualifications

  • 4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems

  • Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent

  • Strong background in container orchestration and operating GPU-based workloads in production

  • Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines

  • Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)

  • Strong understanding of distributed systems, performance tuning, and production reliability engineering

  • Ability to effectively use AI coding assistants to accelerate development and debugging workflows

  • Ownership mindset with the ability to operate independently in a remote-first environment

Preferred Qualifications

  • Experience with ML platforms such as Kubeflow, MLflow, or KubeAI

  • Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems

  • Experience with cost optimization across different GPU types and inference workloads

  • Background in early-stage startups or greenfield infrastructure projects

  • Proven experience building production systems from scratch rather than maintaining legacy platforms

Why Join Us

  • Take ownership of critical infrastructure powering a rapidly scaling AI-native cloud platform

  • Build foundational ML inference systems from the ground up in a high-growth, well-funded startup

  • Work at the intersection of distributed systems, GPU computing, and sustainable cloud architecture

  • Gain deep expertise in next-generation AI infrastructure and large-scale model serving systems

  • Influence core engineering decisions and define best practices that will scale with the company.

Pragmatike is committed to a fair, transparent, and inclusive recruitment process. We do not discriminate based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation.

In accordance with GDPR, your personal data will be processed lawfully, fairly, and securely, and used solely for recruitment purposes, including sharing it with our client(s) for employment consideration.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Pragmatike. Details may have changed since; confirm with the employer before you apply.

Open to people in Poland, Spain and PortugalApply for this job Write my CV for this job Early access
Pay
Not stated
Required
vLLM, TGI, Triton, Container orchestration, Python, Terraform, Helm, MLOps tooling, English (Fluent)
Nice to have
Kubeflow, MLflow, KubeAI
Experience
4+ years
Starts
ASAP
Posted
September 23, 2026
Company
Pragmatike

Similar jobs open to people in Poland

Software Engineer (LLMOps)Maisa AI · PolandAI Engineer 100% REMOTEDS STREAM · PolandGenerative AI Operations Engineer (GenAI Ops)EPAM Systems · PolandOAI Engineer (Agentic / GenAI)Opsfleet · Remote · EEA
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job