vLLM integrates PyNvVideoCodec to offload video decoding to GPU NVDEC
vLLM says it has integrated PyNvVideoCodec to offload video decoding from CPU to GPU NVDEC, reporting 2x+ throughput at 8×H100. The project says the change ships with CUDA vLLM releases.