Staff Software Engineer, AI Inference Gateway

US · 3 weeks ago

$500 to $500 a hour

About the job

Staff Software Engineer, AI Inference Gateway Salad Technologies · Remote · Full-time The role SaladCloud runs inference on thousands of geodistributed workstation and consumer GPUs — NVIDIA and AMD — that nobody else can use. Sitting in front of that fleet is a unique AI Gateway written in Rust, built on Pingora and WireGuard, that serves real-time and batch inference and embeddings to customers as a single, reliable API. You'll own it. This is an infrastructure role with real autonomy. You'll design and ship the systems that decide how requests are fulfilled, when to add or drop capacity, and how to bill for every token — and you'll be the person who knows whether a new model...