vllm.v1.kv_offload.cpu
¶
Modules:
-
common– -
gpu_worker– -
manager– -
policies– -
shared_offload_region– -
spec– -
swap_blocks_triton–Triton kernel + tuned constants for the
swap_blocks_batchfast path.