Skip to content

vllm.config.weight_transfer

Classes:

WeightTransferConfig

Configuration for weight transfer during RL training.

Attributes:

  • backend (Literal['nccl', 'ipc', 'sparse_nccl', 'sharded_rdt', 'nccl_m2n'] | str) –

    The backend to use for weight transfer. Validated against the

Source code in vllm/config/weight_transfer.py 
 8
 9
10
11
12
13
14
15
16
17
@config
class WeightTransferConfig:
    """Configuration for weight transfer during RL training."""

    backend: Literal["nccl", "ipc", "sparse_nccl", "sharded_rdt", "nccl_m2n"] | str = (
        "nccl"
    )
    """The backend to use for weight transfer. Validated against the
    `WeightTransferEngineFactory` registry at engine creation time.
    """

backend = 'nccl' class-attribute instance-attribute

The backend to use for weight transfer. Validated against the WeightTransferEngineFactory registry at engine creation time.