Inference Infrastructure Architect (Remote)

China
Remote (Restricted)senior
mainland China
Confirmed open33 minutes ago
First seentoday
Remoet re-checks every listing roughly once a day.
Apply on TelnyxYou will apply on Telnyx's own site.Star Telnyx to hear about new roles →

Senior Inference Infrastructure Architect role building LLM serving platforms on bare-metal Kubernetes, fully remote within mainland China.

Summary, tech stack, seniority and salary here are extracted or inferred by Remoet, not the employer's own words.

Tech stack

vLLMSGLangKubernetesOpenAIDeepEPDeepGEMMEPLBFlashMLAllm-dNVIDIA DynamoKubernetes Gateway APIEnvoyRay ServeKubeRayMooncakeHiCache3FSDragonflyVolcanoKueueLeaderWorkerSetHAMiKata ContainersOpenStack IronicNVIDIA GPU OperatorPrometheusGrafanaDCGMOpenTelemetryPythonGo

Benefits

Newest hardware accessFounding team member roleOpen-source contribution supportConference travel supportVisa sponsorship
Confirmed open33 minutes ago
First seentoday
Remoet re-checks every listing roughly once a day.
Apply on TelnyxYou will apply on Telnyx's own site.Star Telnyx to hear about new roles →