×
Register Here to Apply for Jobs or Post Jobs. X

ROCm AI System Software Architect

Job in Markham, Ontario, Canada
Listing for: Advanced Micro Devices
Full Time position
Listed on 2026-01-01
Job specializations:
  • Software Development
    AI Engineer, Software Engineer
Salary/Wage Range or Industry Benchmark: 90000 - 120000 CAD Yearly CAD 90000.00 120000.00 YEAR
Job Description & How to Apply Below

WHAT YOU DO AT AMD CHANGES EVERYTHING

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture.

We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond.

Together, we advance your career.

THE PERSON

You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C/C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers.

THE ROLE

We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging/profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions.

KEY RESPONSIBILITIES
  • Develop and deliver advanced AI software solutions for AMD customers and users.
  • Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML/llama.cpp, as well as emerging open-source AI software.>
  • Implement state‑of‑the‑AI models and enhance their performance.
  • Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement.
  • Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows.
PREFERRED EXPERIENCE
  • Expertise in system software design and optimization, with experience on cross-platform development and programming languages C/C++ and Python.
  • Proven problem‑solving skills and effective communication abilities.
  • Experience with AI frameworks, inference stacks, and GPU‑accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non‑linear operators.
  • Compiler and low‑level GPU programming is a plus.
  • Solid understanding of AI/ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations.
  • Open‑source software development experience is a plus.
ACADEMIC CREDENTIALS
  • Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field.
BENEFITS

Benefits offered are described: AMD benefits at a glance.

EEO STATEMENT

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.

We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

#J-18808-Ljbffr
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary