Principal Engineer - Gen AI training and inferencing

Overview

PRINCIPAL SOFTWARE DEVELOPMENT ENGINEER — The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient Generative AI training/inferencing  will be part of a core team of highly talented specialists and work on scaling training and inference for the latest Generative AI models.

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.

The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient Generative AI training/inferencing  will be part of a core team of incredibly talented specialists and work on scaling training and inference for the latest Generative AI models.

The ideal candidate has deep technical understanding of the latest generative AI applications like large language models (LLMs), large multimodal models (LMMs), image/video generation, has experience training models at scale and is passionate about innovating efficient approaches to enable distributed training and inference at scale on AMD devices.

• Exciting Opportunities:
  As a Senior member on the team, you will be at the forefront of innovation, working with the latest Gen AI models and algorithms. You will have the opportunity to shape the future of AI model training and inference optimizations across a variety of applications.
• Talented Team:
  Join a team of highly skilled industry specialists who are passionate about pushing the boundaries of AI. Collaborate with like-minded professionals and learn from the best in the field.
• Cutting-edge Technology:
  Work with state-of-the-art GenAI algorithms and software enabling you to stay ahead of the curve and drive advancements in AI model training at scale and deployment.
• Impactful Work:
  Your contributions will directly influence how cutting-edge Gen AI models across the industry are efficiently trained at scale as well as inferencing deployed to serve millions of customers, making a significant difference in various industries and applications.

• Propose and apply innovative techniques to support both training and inferencing including transformer architectures, parallelism strategies to train on large clusters, and low-precision training.
• Implement novel efficient architectures for Generative AI models for training and inference and showcase benefits on AMD.
• Work with open-source frameworks and communities (e.g., PyTorch, JAX, Hugging Face) to integrate AMD optimized models, libraries and publish training recipes.
• Collaborate with software and hardware teams to E2E co-optimize performance on current and future AMD solutions.
• Publish and promote your work within AMD and at external venues.

• Strong technical expertise in Gen AI model training and inference, and familiarity with deep learning frameworks like PyTorch/JAX.
• Strong technical expertise in algorithmic innovation toward efficient Gen AI applications for both training and inference.
• Experience with publications in areas such as efficient model architectures, optimized training, or innovative parallelism strategies; plus if publications include conferences like NeuRIPS, CVPR, ECCV/ICCV, ICML, ICLR, etc.
• Experience productizing generative AI models and training foundation models at scale.
• Excellent written, verbal, and presentation skills; ability to coordinate internally and externally.
• Several years of experience in AI, deep learning and related software development.

PhD or master’s degree or above; with major in CS, EE, Mathematics, or a related field.

Markham, Ontario, Canada (Hybrid). Can also consider Calgary, Alberta, Canada. #HYBRID

Benefits offered are…