Member of Technical Staff

About the Role

Join a small AI infrastructure team focused on improving the speed and cost efficiency of large language model inference. You will work across model serving, GPU kernels, and production infrastructure, with meaningful ownership from customer conversations through implementation.

What You'll Do

• Deliver day-one support for new open-source models, tuning them for latency and throughput.

• Optimize model-serving systems, including batching, KV cache, speculative decoding, and quantization.

• Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.

• Desi...

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis.