HPC Optimization and Performance Model Engineer

About Us:

At Huawei Technologies Switzerland AG, we are a leading technology firm dedicated to developing cutting-edge solutions that redefine industry standards and push technological boundaries. Our core focus is on creating advanced computing architectures that can efficiently support and enhance the performance of artificial intelligence systems. We believe in innovation as a driving force for improvement and are committed to achieving excellence in all areas of research and development.

Usually the performance of libraries on modern hardware is still determined by measurement: implementations are chosen by benchmarking and their parameters by search or heuristics; neither result are portable to arbitrary hardware. Our team works towards developing an approach to determine it analytically instead, with an arbitrary machine model (for any system) and a parametrized representation for algorithms, which we compose to predict performance, enable autotuning and guide co-design.

• System characterization & micro benchmarking - develop a microbenchmark suite for machine model coefficients:
  • Explore options for encoding and initializing machine characteristics: transfer costs, latencies, synchronization overheads, and compute rates.
  • Measurement methodology: how raw timings become model coefficients — fit quality, run-to-run variance, outlier handling, and reproducibility across machines.
  • Coverage of matrix/tensor engines and mixed- and low-precision arithmetic, rather than inferring their roofs from SIMD
  • New backends (GPU or accelerator) and extension of the measured hierarchy to inter-node levels
• Implementation side:
  Extend current GraphBLAS backends and model application
  • Dense linear-algebra implementation, integration and model-validation/co-design.
  • Explore cost-model-driven autotuning: predicting blocking, thread count, and data placement ahead of execution.

• MSc or PhD in Computer Science, Engineering, or a related technical discipline
• Strong knowledge of computer architecture and solid parallel processing: memory hierarchies, OpenMP (or similar), NUMA, SIMD etc.
• Strong C/C++ programing skills for architecture/parallel processing and some python for orchestration and analysis
• Experience in benchmarking & performance engineering for parallel code
• Research experience in one of:
  • Analytical performance modeling:
    Roofline(s), Communication modeling(Hockney, LogP etc), Machine models (BSP, Multi-BSP)
  • Dense or sparse linear-algebra libraries and kernel optimization (BLAS/GEMM, GraphBLAS)
  • Applied statistics and numerical methods: regression and robust estimation, experiment design, portability, reproducibility etc.
  • Distributed execution(MPI etc), GPU/accelerator programming, or Autotuning

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• Be part of innovative projects that make a difference.
• Access to state-of-the-art technology and tools.