Compiler Engineer
Job in
Charlotte, Mecklenburg County, North Carolina, 28201, USA
Listing for:
Hanzo AI
Full Time
position
Listed on 2026-11-15
Job specializations:
-
Software Development
Job Description & How to Apply Below
Build compiler and runtime capabilities that make neural-network inference faster and more efficient. The work spans graph optimization, intermediate-representation lowering, and hardware-specific code generation for GPUs, TPUs, and newer accelerator types.
Responsibilities- Develop compiler optimizations and graph transformation passes for language-model inference.
- Use compiler intermediate representations to generate efficient machine code and kernel calls.
- Improve memory handling and inference techniques such as key-value caching, speculative decoding, and paged attention.
- Benchmark and profile performance, tracking throughput and cost.
- Strong C++ or Rust skills and a deep understanding of compiler architecture, including intermediate representations, optimization passes, and backends.
- Familiarity with MLIR, LLVM, or machine-learning compilation tools such as TVM, XLA, TensorRT, or Torch Dynamo.
- Understanding of GPU architecture, including tensor cores, shared memory, and warp scheduling.
- Careful approach to performance measurement, micro-benchmarks, and regression testing.
- Experience writing CUDA or Metal kernels for attention or fused operations.
- Contributions to open-source compiler or runtime projects.
- Remote-first work across distributed locations, with autonomy and opportunities to contribute publicly to open-source projects.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction