Senior ML Inference Engineer Custom Hardware

Annapurna Labs (U.S.) Inc. is seeking a Senior Software Development Engineer to own the design and implementation of the inference data plane for large models.

You will build software for efficient execution on custom hardware, covering model execution, memory management, data movement, and serving integration. Responsibilities include developing compute kernels, validating end-to-end LLM architectures, and integrating backends into ML serving frameworks.

As a Senior ML Inference Engineer for Custom Hardware, you will play an important part at Amazon Web Services (AWS) in Cupertino, CA, United States.

We invite applications for the Senior ML Inference Engineer for Custom Hardware position located in Cupertino, CA, United States.

The following role is for a Senior ML Inference Engineer for Custom Hardware with Amazon Web Services (AWS).

Our group is growing, and we are hiring a Senior ML Inference Engineer for Custom Hardware in Cupertino, CA, United States.