Skip to content

vllm.models.qwen4_exp.nvidia

Modules:

  • hyperconnection –

    HyperConnection (Gated Residual) utilities — NVIDIA model variant.

  • indexer_qsa –

    Qwen4Exp weight-free QSA indexer.

  • low_latency_gemm –

    Qwen4Exp decode GEMM selection on Hopper and Blackwell.

  • model –

    Inference-only Qwen4Exp model.

  • model_state –

    Model-runner state for Qwen4Exp PLE inputs.

  • mtp –

    Inference-only Qwen4Exp MTP (Multi-Token Predictor) model.

  • ngram_embedding –

    Qwen4Exp n-gram embeddings with device and pinned-host storage.

  • ops –

    NVIDIA-only Qwen4Exp kernels; import leaf modules directly.

  • ple_layer –

    GPU-resident Qwen4Exp position-learning enhancement layers.

  • qsa –

    NVIDIA QSA owner with Triton kernels.