Skip to content

vllm.entrypoints.scale_out.token_in_token_out.mm_serde

Encode/decode utilities for multimodal tensors and field metadata over JSON/HTTP, used by the disaggregated generate endpoint.

Functions:

decode_mm_kwargs_item(data)

Deserialize a base64 string back to a MultiModalKwargsItem.

Source code in vllm/entrypoints/scale_out/token_in_token_out/mm_serde.py 
24
25
26
27
def decode_mm_kwargs_item(data: str) -> MultiModalKwargsItem:
    """Deserialize a base64 string back to a MultiModalKwargsItem."""
    raw = pybase64.b64decode(data)
    return _decoder.decode(raw)

encode_mm_kwargs_item(item)

Serialize a MultiModalKwargsItem to a base64 string.

Source code in vllm/entrypoints/scale_out/token_in_token_out/mm_serde.py 
17
18
19
20
21
def encode_mm_kwargs_item(item: MultiModalKwargsItem) -> str:
    """Serialize a MultiModalKwargsItem to a base64 string."""
    bufs = _encoder.encode(item)
    assert len(bufs) == 1, "All tensors should be inline"
    return pybase64.b64encode(bufs[0]).decode("ascii")