Skip to content

vllm.v1.kv_offload.tiering.fs

Modules:

  • io –
  • manager –

    FileSystemTierManager: pure-Python filesystem tier for KV cache offloading.

  • thread_pool –

    Thread pool: