Skip to content

vllm.model_executor.models.paligemma

Classes:

PaliGemmaImageEmbeddingInputs

Bases: TensorSchema

Dimensions: - bn: Batch size * number of images - ifs: Image feature size - hs: Hidden size (must match language model backbone)

Source code in vllm/model_executor/models/paligemma.py 
71
72
73
74
75
76
77
78
79
class PaliGemmaImageEmbeddingInputs(TensorSchema):
    """Dimensions:
    - bn: Batch size * number of images
    - ifs: Image feature size
    - hs: Hidden size (must match language model backbone)
    """

    type: Literal["image_embeds"] = "image_embeds"
    data: Annotated[torch.Tensor, TensorShape("bn", "ifs", "hs")]

PaliGemmaImagePixelInputs

Bases: TensorSchema

Dimensions: - bn: Batch size * number of images - c: Number of channels (3) - h: Height - w: Width

Source code in vllm/model_executor/models/paligemma.py 
59
60
61
62
63
64
65
66
67
68
class PaliGemmaImagePixelInputs(TensorSchema):
    """Dimensions:
    - bn: Batch size * number of images
    - c: Number of channels (3)
    - h: Height
    - w: Width
    """

    type: Literal["pixel_values"] = "pixel_values"
    data: Annotated[torch.Tensor, TensorShape("bn", 3, "h", "w")]