Inference performance optimization
Prepare an example of how you improved latency, throughput, or cost in a production system, with the measurements you used.
The role is responsible for making the inference stack as fast and efficient as possible, with inference performance as its north star.
Source posting