vllm.utils.mem_constants
¶
Attributes:
-
GB_bytes–The number of bytes in one gigabyte (GB).
-
GiB_bytes–The number of bytes in one gibibyte (GiB).
-
KB_bytes–The number of bytes in one kilobyte (KB).
-
KiB_bytes–The number of bytes in one kibibyte (KiB).
-
MB_bytes–The number of bytes in one megabyte (MB).
-
MiB_bytes–The number of bytes in one mebibyte (MiB).
GB_bytes = 1000000000
module-attribute
¶
The number of bytes in one gigabyte (GB).
GiB_bytes = 1 << 30
module-attribute
¶
The number of bytes in one gibibyte (GiB).
KB_bytes = 1000
module-attribute
¶
The number of bytes in one kilobyte (KB).
KiB_bytes = 1 << 10
module-attribute
¶
The number of bytes in one kibibyte (KiB).
MB_bytes = 1000000
module-attribute
¶
The number of bytes in one megabyte (MB).
MiB_bytes = 1 << 20
module-attribute
¶
The number of bytes in one mebibyte (MiB).