Principal Engineer, MLE, SMAI

Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.

The Smart Manufacturing and AI team at Micron Technology is looking for an ambitious Machine Learning Engineer (Principal Engineer). Our mission is to provide leading machine learning, custom GenAI, and Agentic AI solutions that support Micron’s leadership in the competitive memory solutions market. Qualified applicants will have experience with various data and cloud technologies and strong skills in modeling data, querying, and deploying scalable data pipelines to complete machine learning models and AI agents.

You will work closely with Data Scientists, Data Engineers, and expert users to build and launch scalable AI/ML solutions that generate value and insight from Micron’s manufacturing processes and systems.

• Architect and complete large-scale custom model training and fine‑tuning jobs (SFT, RLHF) on multi‑node, multi‑GPU clusters.
• Optimize training throughput and memory efficiency using distributed training strategies (FSDP, Deep Speed, Megatron‑LM) and mixed‑precision techniques (FP16/BF16).
• Build and develop autonomous AI Agents capable of multi‑step reasoning, planning, and tool execution to automate complex manufacturing workflows.
• Implement Agentic frameworks (e.g., Lang Chain, Lang Graph, CrewAI) to orchestrate LLM interactions with internal APIs, databases, and software tools.
• Profile and debug GPU performance bottlenecks using tools like Nsight Systems or PyTorch Profiler to improve hardware utilization.
• Develop and sustain data/solution pipelines that support machine learning models and GenAI applications.
• Build and optimize data structures in data management systems (Snowflake, and Google Cloud platforms) to enable AI/ML and Agentic solutions.
• Build and maintain CI/CD pipelines of machine learning and AI Agent solutions in the cloud.

• 10+ years of experience with deep expertise in GPU architecture (memory hierarchy, tensor cores, NVLink) and GPU resource management across cloud and on‑prem environments.
• 5+ years in performance optimization, parallel computing, and low‑level systems. Strong C++ skills and experience with GPGPU frameworks. CUDA is preferred, but HIP, OpenCL, or Metal are acceptable.
• Hands‑on experience building end‑to‑end ML systems, including distributed training techniques (DDP, FSDP, model parallelism) and automated pipelines for training, testing, and deployment.
• Strong proficiency in LLMs, including timely engineering, fine‑tuning (LoRA/QLoRA), inference optimization (vLLM, Tensor
  
  RT‑LLM), and development of GenAI applications/agents using Lang Chain, Llama Index, Auto Gen, and PyTorch.
• Proficient programming skills in Python (preferred) or Java are required, along with experience in CI/CD and cloud‑native tools such as Git, Jenkins, Docker, and Kubernetes. Candidates should have strong communication abilities and perform well in dynamic settings. A Bachelor’s or Master’s degree or equivalent experience in Computer Science, Statistics, or a related field is expected.

• A Ph.D. in Computer Science or Statistics, or comparable experience, is highly desired.
• Experience with HPC job schedulers (e.g., Slurm) and managing large scale GPU workloads on Kubernetes using tools like Ray and Kubeflow.
• Knowledge of CUDA programming, Triton kernels, and building custom C++ extensions for PyTorch to accelerate workloads.
• Experience crafting and orchestrating collaboration between specialized agents in multi‑agent architectures.
• Deep knowledge of mathematics, probability, statistics, and algorithms. Proven track record to evolve data science prototypes into production systems, with knowledge of computer vision and/or signal processing techniques for classification and feature extraction.

Micron benefits are designed to help you stay well, provide peace of mind and help you prepare for the future. We offer a choice of medical,…