Skip to content

vllm.v1.worker.gpu.ec_connector

Classes:

  • ECConnector –

    EC connector interface used by the V2 GPU model runner.

ECConnector

EC connector interface used by the V2 GPU model runner.

Source code in vllm/v1/worker/gpu/ec_connector.py 
23
24
25
26
27
28
29
30
31
32
33
class ECConnector:
    """EC connector interface used by the V2 GPU model runner."""

    @contextmanager
    def maybe_get_output(
        self, scheduler_output: "SchedulerOutput"
    ) -> Generator[ECConnectorOutput | None, None, None]:
        yield None

    def no_forward(self, scheduler_output: "SchedulerOutput") -> ModelRunnerOutput:
        return EMPTY_MODEL_RUNNER_OUTPUT