Distributed LLM Inference Engineer
Summary
Full-time role at Anyscale. RoleRadar classifies it as ml & ai engineering. Listed locations: San Francisco; Palo Alto. Skills mentioned include PyTorch, TensorFlow, CUDA, Triton, vLLM / TensorRT and Ray.
Generated by RoleRadar from facts in the posting. We don't reproduce the job description; read it in full on Anyscale's job page.
Key facts
- Salary
- $170K–$245K/yr
Published in the employer's job board data.
- Location
- San Francisco
- Palo Alto
- Workplace
- Hybrid
From the workplace field on the employer's job board.
- Countries
- United States
Inferred by RoleRadar from the listed locations.
- Experience
- Not stated in the posting
- PhD
- Not mentioned
- Visa sponsorship
- Not stated in the posting
- Team
- Engineering