ML Inference Engineer II — Optimize LLMs at Scale

Amazon AI is seeking a Machine Learning Engineer II to join the Inference Optimization team in Santa Clara, CA. You will drive price-performance for LLM inference on Sage Maker, Bedrock and Hyperpod, building model servers and tuning CUDA kernels for large language models.

You will work cross-functionally with researchers and engineers to deploy production-ready inference optimizations, evaluate new techniques like speculative decoding and disaggregated inference, and contribute to scalable,

Are you ready to take on the ML Inference Engineer II — Optimize LLMs at Scale role at Amazon Inc.?

We are currently recruiting a ML Inference Engineer II — Optimize LLMs at Scale for our team in Santa Clara, CA, United States.

This is a great position to take on the ML Inference Engineer II — Optimize LLMs at Scale role at Amazon Inc.