First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/Senior AI DevOps / LLMOps

Senior AI DevOps / LLMOps

Techbiz Global

Krakow, Poland · Krosno, Poland…EngineeringPosted June 19, 2026Recruitment agency
Open to people in Germany and PolandApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Kubernetes (K8s), Kubeflow, Ray, GitHub Actions/GitLab CI, Terraform, Pulumi, Weights & Biases, MLflow, LangSmith, CUDA drivers
Experience
10+ years; 2+ years
Posted
June 19, 2026
Company
Techbiz Global

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in Germany and Poland

    The employer lists this job as remote there: “Krakow, Poland · Krosno, Poland · Lublin, Poland · Poland, Poland · Poznan, Poland · Warsaw, Poland · Pilsen, Czechia · Praha, Czechia · Riga, Latvia · Vilnius, Lithuania · Athens, Greece · Crete, Greece · Budapest, Hungary · Miskolc, Hungary · Brussels, Belgium · Liège, Belgium · Mons, Belgium · Namur, Belgium · Sofia, Bulgaria · Bordeaux, France · Grenoble, France · Lille, France · Lyon, France · Montpellier, France · Nantes, France · Paris, France · Toulouse, France · Baden-Baden, Germany · Bad Homburg, Germany · Augsburg, Germany · Aachen, Germany · Bergisch Gladbach, Germany · Berlin, Germany · Bernau, Germany · Bielefeld, Germany · Bramsche, Germany · Chemnitz, Germany · Darmstadt, Germany · Dresden, Germany · Dusseldorf, Germany · Düsseldorf, Germany · Essen, Germany · Frankfurt, Germany · Freiburg, Germany · Geoergsmarienhütte, Germany · Görlizt, Germany · Göttingen, Germany · Greifswald, Germany · Halle, Germany · Hamburg, Germany · Hannover, Germany · Heinsberg, Germany …”.

  • Probably open to people in Belgium and Portugal · Location only

    The listing’s location: “Krakow, Poland · Krosno, Poland · Lublin, Poland · Poland, Poland · Poznan, Poland · Warsaw, Poland · Pilsen, Czechia · Praha, Czechia · Riga, Latvia · Vilnius, Lithuania · Athens, Greece · Crete, Greece · Budapest, Hungary · Miskolc, …”.

  • Not open to people in the other 17 countries we cover, as far as the post says.

The job post

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Senior AI DevOps / LLMOps specialist to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.

Key Responsibilities

  1. Automation of Build-to-Production

- Design and implement robust CI/CD pipelines tailored for AI, covering model weights,

dataset versioning, and application code.

- Develop specialized workflows for PromptOps, ensuring that system prompts are

version-controlled, tested for regressions, and deployed with the same rigor as traditional

code.

-Automate the deployment of Agentic workflows, managing the complexities of stateful

AI interactions and multi-agent handoffs.

2. AI Infrastructure as Code (IaC)

- Provision and manage high-performance compute environments (GPU clusters, TPU

pods) using Terraform, Pulumi, or Ansible.

- Define and enforce Policy-as-Code for AI endpoints to ensure compliance with security,

cost-usage limits, and data residency requirements.

- Maintain a consistent environment across Hybrid Infrastructure, ensuring seamless

parity between On-Premises development and Cloud production.

3. Safe Experimentation & Controlled Releases

- Architect Progressive Delivery strategies for AI, including Canary releases, Blue-Green

deployments, and Shadowing (where new models run in parallel with production to

compare outputs).

- Build “Evaluation-in-the-Loop” gates within the pipeline to automatically test for bias,

hallucination, and performance degradation before a release.

- Implement A/B testing frameworks specifically designed for LLM outputs and agentic

behavior.

4. Monitoring & Observability

- Establish deep observability into Inference Endpoints, tracking metrics like tokens-per-

second, latency, and drift in model accuracy.

-Integrate feedback loops that capture production “edge cases” to feed back into the

training and fine-tuning pipelines.

Must-Have Technical Skills:

-Orchestration: Advanced Kubernetes (K8s) skills, specifically with KubeFlow, Ray, or

NVIDIA Triton.

-CI/CD & IaC: Expertise in GitHub Actions/GitLab CI, and Terraform or Pulumi.

- AI Tooling: Experience with Weights & Biases, MLflow, LangSmith, or Arize

Phoenix.

-Hardware: Understanding of GPU virtualization, CUDA drivers, and on-premises

hardware management.
-Security: Familiarity with Open Policy Agent (OPA) and secret management (Vault).

Experience:

- 10+ years in DevOps, SRE, or Cloud Engineering.

- 2+ years of hands-on experience in MLOps or LLMOps, specifically moving LLMs

from notebook to production.

-Proven experience managing Hybrid Cloud environments (e.g., AWS/Azure + Private

Data Center).

First Monday isn’t the employer or a recruiter and isn’t affiliated with Techbiz Global. Details may have changed since; confirm with the employer before you apply.

Open to people in Germany and PolandApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Kubernetes (K8s), Kubeflow, Ray, GitHub Actions/GitLab CI, Terraform, Pulumi, Weights & Biases, MLflow, LangSmith, CUDA drivers
Experience
10+ years; 2+ years
Posted
June 19, 2026
Company
Techbiz Global

Similar jobs open to people in Germany

Senior Machine Learning Engineer, LLM Inference OptimizationNebius · Remote · EuropeResearch Scientist / Engineer – Reinforcement Learning InfrastructureLuma · Remote · EUSenior DevOps EngineerNewcode.ai · Oslo, Norway · Stockholm, Stockholm…GSenior GTM EngineerGTM Base · Remote · Worldwide
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job