vllm.v1.worker.gpu.sample
¶
Modules:
-
batch_shard– -
gumbel– -
logits_processor–Custom logits processors for the V2 model runner.
-
logprob– -
output– -
prompt_logprob– -
sampler– -
thinking_budget– -
trace_replay– -
watermark–