vllm.distributed.ec_transfer.ec_connector

Modules:

• base –

  ECConnectorBase Class for Distributed Encoder Cache &

• cpu –
• example_connector –
• factory –
• metrics –
• mooncake –

  Internal building blocks for the Mooncake encoder-cache connector.

• mooncake_ec_connector –

  Encoder-cache connector backed by Mooncake TransferEngine.

• mooncake_store_embedding –

  Mooncake Store support for cross-Encoder output reuse.

• utils –

  EC connector helper utilities.