First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/Senior Software Engineer (AI Inference & Runtime Platform)

Senior Software Engineer (AI Inference & Runtime Platform)

AZX

SeattleEngineeringPosted August 30, 2026
Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$140,000–$230,000 a year
Required
Rust, Kubernetes, vLLM, SGLang
Experience
5+ years
Visa
No visa sponsorship
Travel
Yearly
In person
Events, yearly
Equity
Equity
Benefits
Health insurance, Paid time off
Hiring
Assessment, Technical interview
Tests
Take-home task
Posted
August 30, 2026
Company
AZX

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in the US · Location only

    The listing’s location: “Seattle”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

About AZX

Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges.

We’re growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities.

We bootstrapped profitably for our first year and are now backed by leading investors focused on AI, climate and energy.

We work on challenges in clean energy, decarbonization, climate risk, energy systems, and global economics. We’re building our company for long-term success and aim to create the ultimate place to work for those passionate about AI and making a positive impact.

About This Role:

You will be responsible for owning the layer where AI work physically happens: the machines, the isolation boundary, and the models running on them. This role anchors on two systems. The first is our inference control plane — open-weight models and custom task-model zoos, hosted and operated across managed GPU clouds and customer-managed Kubernetes clusters, with scale-to-zero economics, cold-start discipline, and per-token cost accounting that stays correct even when a client disconnects mid-stream — along with the Kubernetes layer those workloads live on: operators, autoscaling, node lifecycle. The second is our agent-sandboxing platform: hardware-isolated microVMs for running untrusted, agent-generated code securely and compliantly by construction, where agents operate with least privilege, never see a credential, and a human gates anything that writes to a system of record. You'll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control-plane endpoint before you go home — building the fork engine, the guest agent, and the multi-substrate model lifecycle. We're looking for individuals who've built this class of stack (an inference-serving or serverless-GPU platform), operated it hard at scale, or ideally both.

Responsibilities:

  • Manage the serving tier for open-weight models: engine deployment and configuration, cold-start strategy, per-model SLOs, and upgrade/canary discipline.

  • Administer the Kubernetes layer for inference and sandbox workloads: operators and CRDs, autoscaling (KEDA/Karpenter-class), GPU scheduling and sharing, and node lifecycle.

  • Own the stateful data plane end to end with restore procedures that are regularly tested.

  • Oversee the sandbox runtime and its host-side control plane: lifecycle, exec, snapshot/fork, teardown, metering, and the threat model of the isolation boundary.

  • Direct the FastAPI control-plane services, Terraform/OpenTofu, Bicep, and the dashboards

  • Run the layer the backend services team builds on, expect to debug into their services, and expect them to read your dashboards.

  • Manage the open-source posture: build to OSS standards and release as it matures, with reviewed PRs, real docs, and reproducible builds.

Core Qualifications

  • 5+ years of shipping production systems in a systems language. Rust is the house language, but polyglots are welcome — deep Go, C/C++, or Zig with genuine appetite for Rust counts. Async runtimes, memory-safety discipline, and debugging at the syscall boundary should be familiar territory.

  • Operated Kubernetes workloads that other people depended on — controllers or operators, scheduling, autoscaling, node lifecycle. You've been paged, and the experience changed how you build.

  • Strong ability to threat-model isolation boundaries (namespaces, cgroups, seccomp, hypervisors), including identifying what an untrusted guest could observe, forge, or exhaust, and applying security best practices for agentic execution — least privilege, no credentials in the sandbox, audit trails, and human approval on write actions.

  • Hands-on experience deploying or operating open-weight LLM serving infrastructure (vLLM/SGLang or similar), including packaging models into reliable, metered production endpoints.

  • Performance discipline in distributed systems: you measure before you optimize, and you can tell the story of a latency you killed with the numbers attached.

  • Practical depth in some of our core stack — Rust (tokio), Python/FastAPI, Kubernetes operators (controller-runtime/Kubebuilder/CRDs), KEDA, Karpenter, GPU device plugins/DRA — with a genuine willingness to research your way into the rest.

  • Familiarity with isolation technology (Firecracker, Kata, gVisor, or comparable), secrets management and egress control (Vault/KMS-class), and hosting stateful systems (vector stores like pgvector/Qdrant, graph stores like Neo4j) with backup and failover discipline.

  • Comfort operating across cloud and GPU substrates — AWS/Azure/GCP plus managed GPU clouds — using infrastructure-as-code (Terraform/OpenTofu, Bicep) and observability tooling (OpenTelemetry).

  • Bachelor's Degree; Master's is a plus

Why AZX!

  • Be part of a fast-growing, profitable, mission-driven company with industry-leading clients tackling the massive opportunity of AI transformation in critical industries.

  • Competitive early-stage startup compensation (based on capabilities, experience, and location)

  • Bonus eligibility

  • Health insurance with meaningful coverage for dependents

  • Flexible paid time off

  • Equity

  • Fully remote culture with a cluster of teammates in Seattle

Additional Information:

  • Must be able to travel 2x/year for company summits

  • Applicants must be currently authorized to work in the United States on a full-time basis.

  • We are unable to sponsor or take over sponsorship of employment visas at this time.

  • Please note that our interview process includes a written take-home assignment followed by a live two-hour technical session with our engineering team, so if that format isn't a good fit, we'd ask that you not apply

  • Please only apply to a maximum of 2 roles at a time, any applicants who apply to more then 2 roles within a 6 month period will automatically be disqualified

Next Steps:

If this job sounds like a great fit but you don’t check ALL of these qualification boxes, we’d still love to hear from you!

First Monday isn’t the employer or a recruiter and isn’t affiliated with AZX. Details may have changed since; confirm with the employer before you apply.

Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$140,000–$230,000 a year
Required
Rust, Kubernetes, vLLM, SGLang
Experience
5+ years
Visa
No visa sponsorship
Travel
Yearly
In person
Events, yearly
Equity
Equity
Benefits
Health insurance, Paid time off
Hiring
Assessment, Technical interview
Tests
Take-home task
Posted
August 30, 2026
Company
AZX

Similar jobs open to people in the United States

Senior Golang Software Engineer (Infrastructure)Mirantis · USSenior Software Engineer – Kubernetes platformCloudflare · Remote · USSenior/Staff Software EngineerVectara · Remote · USSenior Backend Engineer – Backend PlatformClose · United States of America
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job