Distributed LLM Inference Engineer

San Francisco

Hybridmid

Confirmed open105 days ago

First seen4 months ago

Remoet re-checks every listing roughly once a day.

Apply on AnyscaleYou will apply on Anyscale's own site.Star Anyscale to hear about new roles →

Mid-level Distributed LLM Inference Engineer role using Ray and PyTorch in a hybrid office setting.

Summary, tech stack, seniority and salary here are extracted or inferred by Remoet, not the employer's own words.

Salary

$170,112 - $247,000/year

Tech stack

RayPyTorchvLLMTensorRT-LLMTensorFlowTritonTVMMLIRCUDA

Benefits

Stock OptionsHealthcare plans401k Retirement PlanEducation & Wellbeing StipendPaid Parental LeaveFertility BenefitsPaid Time OffCommute reimbursementIn-office meals

Confirmed open105 days ago

First seen4 months ago

Remoet re-checks every listing roughly once a day.

Apply on AnyscaleYou will apply on Anyscale's own site.Star Anyscale to hear about new roles →