Skip to content
×

Architecture & Performance Modeling Engineer, AI Inference Silicon; Senior​/Principal

Listing for: AItoolnavio
Full Time position Listed on 2026-11-19
Job specializations:
Salary/Wage Range or Industry Benchmark: 220000 - 350000 USD Yearly USD 220000.00 350000.00 YEAR

Job Description & How to Apply Below

Position: Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal) based in the United States.

In this role, you will help define the architecture and performance of next-generation AI inference accelerators designed to power increasingly complex large language models.
You will work closely with chip architects to evaluate architectural options, identify performance bottlenecks, and translate quantitative analysis into actionable design recommendations.
Your work will begin before RTL implementation, using analytical models and advanced simulation tools to guide critical hardware decisions.
You will take ownership of performance modeling for a next-generation chip while contributing to the development of a shared modeling framework.
The role spans compute architecture, memory systems, data movement, interconnects, and multi-chip communication.
You will also analyze real-world AI inference workloads, including prefill and decode operations, to optimize latency, throughput, and hardware utilization.
This is an opportunity to influence the design of cutting-edge AI silicon in a highly collaborative, technically ambitious engineering environment.

Accountabilities:
  • Collaborate with chip architects to translate architectural questions into structured modeling studies, defining assumptions, alternatives, performance metrics, and recommendations.
  • Conduct architectural trade-off analyses across compute engines, memory capacity and bandwidth, dataflow, DMA, command processing, on-chip interconnects, and chip-to-chip communication.
  • Evaluate different hardware configurations and identify opportunities to improve performance while respecting power, area, system, and implementation constraints.
  • Analyze representative AI inference workloads across prefill and decode phases, different batch sizes and context lengths, and dense and mixture-of-experts (MoE) models.
  • Identify performance bottlenecks affecting latency, throughput, and hardware utilization, translating findings into practical architectural improvements.
  • Develop and enhance analytical, transaction-level, and cycle-level performance models, selecting the appropriate level of detail to balance accuracy and development speed.
  • Build, maintain, and extend reusable models within a native Rust simulation framework.
  • Validate and correlate model predictions against RTL simulations, emulation results, and silicon measurements as they become available.
  • Maintain regression coverage and clear documentation of modeling assumptions, limitations, discrepancies, and results.
  • Communicate findings effectively to architecture and engineering teams, providing ongoing recommendations as workloads, specifications, and design decisions evolve.
  • Take primary responsibility for modeling a next-generation chip while contributing to the continuous improvement of the team's modeling infrastructure.
Requirements:
  • At least 5 years of professional experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, GPUs, or similar hardware platforms.
  • Proven experience using performance models to influence architectural decisions, identify bottlenecks, evaluate design alternatives, and support recommendations with quantitative analysis.
  • Strong understanding of computer architecture fundamentals, including pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnect architectures.
  • Hands-on experience developing analytical, transaction-level, or cycle-level performance models, including first-order estimates to validate and interpret simulation results.
  • Ability to work effectively with incomplete specifications, document assumptions, and balance modeling accuracy with rapid iteration.
  • Strong programming skills in Rust, or expert-level C/C++ proficiency combined with a willingness to work extensively in Rust.
  • Proficiency in Python for workload analysis, experimentation, data processing, and performance visualization.
  • Ability to read and interpret System Verilog RTL and verification results, reconcile implementation details with architectural specifications, and calibrate models as hardware designs mature.
  • Excellent analytical, problem-solving, and communication skills, with the ability to explain performance results, assess confidence levels, and recommend clear next steps.
  • Ability to collaborate closely with…

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary