Inference framework internals
Prepare an explanation of how vLLM, SGLang or TensorRT-LLM handle batching and memory, and where you would extend one of them.
The Principal LLM Inference Engineer role requires familiarity with the internals of open-source inference frameworks and the ability to extend or replace them.
Source posting