Skip to content

vllm.utils.b12x

Accessors for the optional b12x package.

Functions:

has_b12x()

Return whether the B12X package is installed.

Source code in vllm/utils/b12x.py 
48
49
50
def has_b12x() -> bool:
    """Return whether the B12X package is installed."""
    return _HAS_B12X

reuse_packed_weight_storage(current, replacement)

Reuse packed tensor addresses when a compatible weight is reloaded.

Source code in vllm/utils/b12x.py 
128
129
130
131
132
133
134
@torch.no_grad()
def reuse_packed_weight_storage(current: Any, replacement: Any) -> Any:
    """Reuse packed tensor addresses when a compatible weight is reloaded."""
    if current is None or not _same_packed_layout(current, replacement):
        return replacement
    _copy_packed_tensors(current, replacement)
    return current