First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

One email to confirm your address, and another when your group is invited. Free during the beta. By requesting access you agree to the Terms & Conditions and the Privacy Policy.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity

Remote · USEngineeringPosted October 28, 2026
Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$250,000–$485,000 a year
Required
Kubernetes, Go, Rust, C++, NVIDIA, CUDA
Nice to have
InfiniBand, RoCE, RDMA, vLLM, SGLang, TensorRT-LLM
Posted
October 28, 2026
Company
Perplexity

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US

    The employer lists this job as remote there: “San Francisco · Remote (United States) · Toronto · Seattle · New York City”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

Perplexity serves hundreds of millions of queries a month, and every one of them fans out into multiple AI inference requests running in real time. Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build models while also managing networking, securing capacity, and operating the underlying GPU clusters, responsibilities we want a dedicated platform team to own. Your job is to take ownership of that infrastructure and hide its complexity behind a unified, self-serve platform for running training and inference workloads.

Responsibilities

  • Build a self-serve compute platform. Design and own the systems that let inference engineers and researchers launch training jobs and operate inference services without managing GPU provisioning, cluster configuration, or provider-specific infrastructure.

  • Operate the GPU fleet. Own provisioning, lifecycle management, reliability, and capacity integration across providers, giving teams a consistent way to use compute regardless of where it runs.

  • Solve for GPU scarcity. Build the scheduling and placement logic that finds available capacity across providers, packs it efficiently, and gets the right workload onto the right hardware under real constraints.

  • Support two very different workloads. Keep long-running distributed training jobs healthy while simultaneously guaranteeing the availability and latency of production inference services on the same fleet.

  • Own the Kubernetes for GPU orchestration. Write the operators and CRDs, and manage many clusters across providers so the platform behaves the same everywhere we run.

  • Make failure boring. Build the fault tolerance, autoscaling, and observability that keep the fleet utilized and let workloads survive node loss, provider hiccups, and capacity shifts without human intervention.

  • Set technical direction across teams. Partner with inference and cloud infrastructure engineers to turn operational constraints into a coherent platform architecture and roadmap.

Qualifications

We expect you to have real depth in most of these:

  • Deep Kubernetes experience — custom operators, CRDs, and multi-cluster federation, not just running kubectl apply.

  • You've managed GPU clusters at scale: NVIDIA hardware, CUDA, and the networking that makes them fast (InfiniBand or RoCE).

  • You've orchestrated compute across multiple clouds (CoreWeave, AWS, GCP, or similar) and understand how different each one really is.

  • Strong distributed systems fundamentals: scheduling, resource allocation, and fault tolerance under load.

  • You write infrastructure and systems-level code in Go, Rust or C++.

  • You've supported both long-running training jobs and high-availability inference services, and you know why they pull infrastructure in opposite directions.

  • You own problems end-to-end and do well when the path forward isn't laid out for you.

Additional experience we value

  • Inference serving stacks: vLLM, SGLang, or TensorRT-LLM.

  • Slurm or other HPC schedulers.

  • GPU kernel work in CUDA or Triton — not required, but notable.

  • High-speed interconnects: InfiniBand, RoCE, or RDMA in production.

  • Observability for ML workloads: Prometheus, Grafana, or Weights & Biases.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Perplexity. Details may have changed since; confirm with the employer before you apply.

Open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
$250,000–$485,000 a year
Required
Kubernetes, Go, Rust, C++, NVIDIA, CUDA
Nice to have
InfiniBand, RoCE, RDMA, vLLM, SGLang, TensorRT-LLM
Posted
October 28, 2026
Company
Perplexity

Similar jobs open to people in the United States

Software Engineer, InfrastructureDescript · Remote · USSenior Software Engineer – DGX CloudNVIDIA · Remote · CanadaSenior Infrastructure Engineer – GPU ComputeBoundless Networks · United StatesMember of Technical Staff, Model Training (infra & platform), Remote- Full TImeXperteez Technology · Remote · US
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job