Skip to content

vllm.distributed.aux_output_connector

Modules:

  • connector –

    Scheduler-side control plane for execution auxiliary outputs.

  • routed_experts –

    Routed-experts auxiliary output keys, publication, and materialization.

  • store –

    In-process auxiliary-output storage.

  • worker –

    Worker-side auxiliary-output data plane.