First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/GPU Infrastructure Engineer

GPU Infrastructure Engineer

Polargrid

Remote · CanadaEngineeringPosted October 15, 2026
Open to people in CanadaApply for this job Write my CV for this job Early access
Pay
CA$150,000–CA$190,000 a year
Required
BGP, DNS, TCP/TLS, Load balancing, InfiniBand, RDMA, vLLM, SGLang, TensorRT-LLM, bare-metal GPU fleets
Nice to have
Go, Rust
Posted
October 15, 2026
Company
Polargrid

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in Canada

    The employer lists this job as remote there: “Remote (Canada)”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. A customer brings a model or a serving image. We run it on dedicated GPUs behind one endpoint, serve each request from the nearest site, and move traffic to the next nearest site when one fails.

Our goal is to make AI inference fast, reliable, and secure for customers running production workloads.

The Role

This role is responsible for scaling PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters. The GPU Infrastructure Engineer will own how new sites and nodes come online, from provisioning and burn-in through validation and a staged move into production. They will define when a site is ready for customer traffic, and make sure each new site joins the network without hurting latency or reliability.

A core responsibility is running the global routing layer that sends each request to the best place to serve it. The GPU Infrastructure Engineer will work with live signals such as network latency, capacity and health, and tune routing against real traffic to keep latency low and predictable.

The role also owns reliability across the network. The GPU Infrastructure Engineer will set and track availability targets, build the health checks and automation that detect and route around failing hardware and models, keep recovery fast, and test failure handling regularly.

The GPU Infrastructure Engineer will build the observability, release and network systems needed to run a distributed GPU fleet without operations work growing with every new site. This includes end-to-end tracing and latency alerting, safe staged rollouts, network configuration as code, and security and DDoS protection at the edge.

Requirements

- Experience operating distributed systems across multiple sites or regions with high availability targets

- Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing

- Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle

- InfiniBand or RDMA networking experience

- Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT

- Deep observability skills focused on p95/p99 latency and gray failures, not just uptime

- Experience designing failover, graceful degradation and automated recovery

- Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure

- Ability to plan capacity on constrained, uneven hardware supply

- Experience building internal tooling or control planes, ideally in Go or Rust

Nice to Have

- DDoS mitigation experience

- Running DNS infrastructure at scale

- Hardware security: TPM, measured boot or confidential computing

- Real-time streaming inference, including voice and audio

- Operating remote datacenter sites with on-site technicians

- Certificate automation across many domains

- Deterministic simulation testing

First Monday isn’t the employer or a recruiter and isn’t affiliated with Polargrid. Details may have changed since; confirm with the employer before you apply.

Open to people in CanadaApply for this job Write my CV for this job Early access
Pay
CA$150,000–CA$190,000 a year
Required
BGP, DNS, TCP/TLS, Load balancing, InfiniBand, RDMA, vLLM, SGLang, TensorRT-LLM, bare-metal GPU fleets
Nice to have
Go, Rust
Posted
October 15, 2026
Company
Polargrid

Similar jobs open to people in Canada

Software Engineer, GPU InfrastructureCohere · Seattle · Canada · New York · CaliforniaSenior Infrastructure Engineer, DevopsCaldera · Remote · WorldwideSenior Site Reliability EngineerParallel Domain · Remote · US, CanadaSenior Full Stack Engineer – (AI Growth Team)GoodTime · Remote · Canada
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job