Senior Staff Engineer, AI Software

Overview

We are looking for a seasoned engineer to lead the co‑design of software and hardware solutions that optimize AI model inference performance, focusing on memory bottlenecks and architectural decisions for high‑bandwidth memory (HBM) and memory‑centric compute.

Location: Daily onsite presence at our San Jose, CA office / U.S. headquarters.

• Lead the co‑design of software and hardware solutions that optimize AI model inference performance, with a focus on overcoming memory bottlenecks.
• Analyze and optimize LLM and agentic AI workloads across the full software stack, identifying opportunities for hardware‑aware acceleration.
• Profile and characterize model execution to expose memory wall limitations and guide architectural decisions for HBM and memory‑centric compute.
• Collaborate with hardware teams to influence memory architecture, acceleration strategies, and compute placement based on real workload behavior.
• Develop, optimize, and benchmark inference and serving solutions using frameworks such as PyTorch and vLLM.
• Define best practices and provide technical mentorship across software‑hardware co‑design efforts.

• Bachelor’s with 15+ years, or Master’s with 13+ years, or PhD with 10+ years of industry experience.
• Strong experience writing high‑performance AI framework software development for GPUs or other accelerators.
• End‑to‑end understanding of the AI infrastructure and software stack, from model definition through deployment and serving.
• Solid understanding of LLM model architectures and workflows, including modern transformer‑based designs.
• Solid understanding of agentic AI architecture and workflows.
• Hands‑on expertise with the PyTorch framework.
• Practical experience with vLLM for high‑throughput model inference and serving.
• Knowledge of the memory wall problem and its impact on AI system performance.
• Strong knowledge of memory architecture, including HBM, and familiarity with memory‑centric acceleration and compute approaches.
• Proficiency working in a Linux development environment.
• Proficient with development tooling, git, and issue tracking (e.g., Jira).

$189,000 – $301,000 USD

• 4+ weeks of paid time off per year, plus holidays and sick leave.
• Family support: fertility care and adoption stipend, medical travel support, and virtual vet care for pets.
• Emotional wellness resources including on‑demand apps and free confidential therapy sessions.
• Health and fitness support with onsite café, gym, and virtual classes.
• Flexible work environment to support a healthy work–life balance.
• Competitive medical, dental, vision, and 401(k) plans with an inclusive rewards plan.

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

We provide comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long‑term conditions, neurodivergent individuals, or those requiring pregnancy‑related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

All hiring decisions are made by our human recruiting team and hiring managers to ensure every candidate is evaluated fairly and holistically.