Inference Engineer

San Francisco
Hybridmid
First seen2 months ago
Apply on AdaptionYou will apply on Adaption's own site.Star Adaption to hear about new roles →

Mid-level Inference Engineer role in San Francisco focusing on model serving performance using vLLM, SGLang, and TensorRT-LLM.

Summary, tech stack, seniority and salary here are extracted or inferred by Remoet, not the employer's own words.

Tech stack

PythonC++RustvLLMSGLangTensorRT-LLMCUDANCCL

Benefits

Flexible workAnnual travel stipendWeekly meal allowanceComprehensive medical benefitsGenerous paid time off
First seen2 months ago
Apply on AdaptionYou will apply on Adaption's own site.Star Adaption to hear about new roles →