Inference Infrastructure Architect (Remote)

China
Remote (Restricted)senior
China
Confirmed open23 days ago
First seen2 months ago
Remoet re-checks every listing roughly once a day.
Apply on TelnyxYou will apply on Telnyx's own site.Star Telnyx to hear about new roles →

Senior Inference Infrastructure Architect role building LLM serving platforms using vLLM and Kubernetes in mainland China.

Summary, tech stack, seniority and salary here are extracted or inferred by Remoet, not the employer's own words.

Tech stack

vLLMSGLangKubernetesPythonGoOpenAI-compatible endpointDeepEPDeepGEMMEPLBFlashMLAllm-dNVIDIA DynamoKubernetes Gateway APIEnvoyRay ServeKubeRayMooncakeHiCache3FSDragonflyVolcanoKueueLeaderWorkerSetHAMiKata ContainersOpenStack IronicNVIDIA GPU OperatorPrometheusGrafanaDCGMOpenTelemetry

Benefits

Conference travel supportVisa sponsorshipGlobal team collaboration

More open roles at Telnyx

Infrastructure Engineer, Data
Warsaw, Dublin, London / Remote (Restricted)
Machine Learning Engineer, Fraud & Abuse Detection
Dublin, Ireland; São Paulo, Brazil; Buenos Aires, Argentina / Remote (Restricted)
Software Engineer, Elixir - Telephony
Brazil; Argentina; Texas / Remote (Restricted)
Senior Software Engineer, Python
United States / Remote (Restricted)
Senior Machine Learning Engineer (Voice & Video AI)
Dublin, Amsterdam, Krakow / Hybrid
Developer Advocate, Edge & IoT
United States / Remote (Restricted)
See every role at Telnyx
Confirmed open23 days ago
First seen2 months ago
Remoet re-checks every listing roughly once a day.
Apply on TelnyxYou will apply on Telnyx's own site.Star Telnyx to hear about new roles →