vllm.model_executor.layers.fusion
¶
Modules:
-
fused_act_quant–Producer side of the QuantizedActivation contract for activation layers.
-
mm_input_norm–Fused Normalisation on the Device.
-
quant_activation–A QuantizedActivation is a pre-quantized activation produced by a fused kernel
-
relu2_fp8_quant–