vllm.entrypoints.serve.instrumentator.basic

Functions:

• kv_event_sources –

  KV-event publisher config per DP rank; empty on render-only servers.

kv_event_sources(raw_request) async

KV-event publisher config per DP rank; empty on render-only servers.

Source code in vllm/entrypoints/serve/instrumentator/basic.py

@router.get("/kv_event_sources")
async def kv_event_sources(raw_request: Request):
    """KV-event publisher config per DP rank; empty on render-only servers."""
    client: EngineClient | None = raw_request.app.state.engine_client
    return client.get_kv_event_sources() if client is not None else {}