First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/Staff Software Engineer, Inference Routing

Staff Software Engineer, Inference Routing

Polargrid

Remote · CanadaEngineeringPosted November 16, 2026
Open to people in CanadaApply for this job Write my CV for this job Early access
Pay
CA$220,000–CA$265,000 a year
Required
Go, Rust, Distributed systems
Posted
November 16, 2026
Company
Polargrid

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in Canada

    The employer lists this job as remote there: “Remote (Canada)”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.

The role

You will own the routing layer: the service that decides which GPU serves each request. You will build it, run it in production and set its technical direction.

This is a hands-on staff role. Most of your time goes to designing and writing the router and the placement logic behind it. You will work closely with the engineers who run our network and our GPU sites, and you will help hire the engineers who join you.

The work

Every request has to land on a GPU that is healthy, has room and is close enough to be fast. The hard part is that capacity and health change constantly across many sites, and the router has to make good decisions quickly with information that is always slightly out of date. It also has to fail safely: when a site or server goes down, traffic moves without customers noticing.

What you bring

  • Deep knowledge of how networks, proxies and load balancers work underneath, from building or running production systems.

  • Strong distributed systems fundamentals: consistency, failure handling, retries and backpressure.

  • You write production code in a systems language such as Go or Rust.

  • You measure latency at the tail, not just the average, and know how to find where it comes from.

  • You have been on call for what you built.

  • You have set technical direction that other engineers built on.

  • You write clearly.

  • You use AI tools well and check their work.

You do not need GPU or ML experience. What matters is that you understand the systems underneath deeply and want to build a new one from the start.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Polargrid. Details may have changed since; confirm with the employer before you apply.

Open to people in CanadaApply for this job Write my CV for this job Early access
Pay
CA$220,000–CA$265,000 a year
Required
Go, Rust, Distributed systems
Posted
November 16, 2026
Company
Polargrid

Similar jobs open to people in Canada

Staff Engineer, Site ReliabilityBabylist · United StatesStaff Software Engineer, BackendCustomer.io · Remote · AmericasAI EngineerDurable · VancouverStaff Software EngineerArc · Remote · US, Canada
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job