Low-level kernel performance tuning
Practice profiling a matrix multiplication kernel and explaining which memory or compute limits you would address first.
The Kernel Engineer role requires pushing custom architecture to its theoretical limits for critical deep learning operations such as GEMMs and FlashAttention.
Source posting