Skip to content
×

Compiler Engineer

Listing for: Hanzo AI
Full Time position Listed on 2026-11-15
Job specializations:
Salary/Wage Range or Industry Benchmark: 150000 - 230000 USD Yearly USD 150000.00 230000.00 YEAR

Job Description & How to Apply Below

Role overview

Build compiler and runtime capabilities that make neural-network inference faster and more efficient. The work spans graph optimization, intermediate-representation lowering, and hardware-specific code generation for GPUs, TPUs, and newer accelerator types.

Responsibilities
  • Develop compiler optimizations and graph transformation passes for language-model inference.
  • Use compiler intermediate representations to generate efficient machine code and kernel calls.
  • Improve memory handling and inference techniques such as key-value caching, speculative decoding, and paged attention.
  • Benchmark and profile performance, tracking throughput and cost.
Requirements
  • Strong C++ or Rust skills and a deep understanding of compiler architecture, including intermediate representations, optimization passes, and backends.
  • Familiarity with MLIR, LLVM, or machine-learning compilation tools such as TVM, XLA, TensorRT, or Torch Dynamo.
  • Understanding of GPU architecture, including tensor cores, shared memory, and warp scheduling.
  • Careful approach to performance measurement, micro-benchmarks, and regression testing.
Nice to have
  • Experience writing CUDA or Metal kernels for attention or fused operations.
  • Contributions to open-source compiler or runtime projects.
Benefits and work setup
  • Remote-first work across distributed locations, with autonomy and opportunities to contribute publicly to open-source projects.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary