Founding Kernel Engineer, GPU Kernels
Job in
Phoenix, Maricopa County, Arizona, 85001, USA
Listing for:
Touchdown Labs
Full Time
position
Listed on 2026-11-15
Job specializations:
-
Software Development
Job Description & How to Apply Below
Role overview
Develop and qualify GPU kernels that improve real model workloads while preserving numerical correctness. The work spans framework dispatch, compilers, device code, and profiling across accelerator architectures; optimization choices should be supported by reproducible measurements and an end-to-end workload benefit.
Responsibilities- Find costly operators and execution gaps from representative workload traces.
- Implement, select, fuse, or generate kernels for relevant operations such as attention, matrix math, routing, normalization, and data movement.
- Trace framework operations through graph capture, compiler lowering, runtime dispatch, and device execution.
- Profile launch overhead, occupancy, instruction mix, memory traffic, synchronization, stalls, and numerical error.
- Compare vendor libraries, compiler paths, generated kernels, and custom implementations before taking on maintenance burden.
- Build correctness tests, benchmark harnesses, architecture guards, fallbacks, and end-to-end performance evidence.
- Strong C++ and GPU programming fundamentals.
- Experience with CUDA, ROCm/HIP, Triton, or a comparable accelerator programming environment.
- Understanding of memory hierarchy, parallel decomposition, synchronization, precision, and numerical correctness.
- Ability to use profilers, disassemblers, and benchmarks to substantiate performance claims.
- Familiarity with framework dispatch and the compiler/runtime path around kernels.
- Ability to maintain architecture-specific guards, correctness coverage, and portable fallbacks.
Compiler IR or code generation; attention, GEMM, MoE, or communication kernels; collectives and multi-GPU execution; mixed-precision compute; or upstream open-source contributions.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction