vllm.distributed.kv_transfer.kv_pipe
Modules:
Name | Description |
---|---|
base | This file defines an interface |
mooncake_pipe | |
pynccl_pipe | This module implements a PyNccl pipe for sending and receiving |
Modules:
Name | Description |
---|---|
base | This file defines an interface |
mooncake_pipe | |
pynccl_pipe | This module implements a PyNccl pipe for sending and receiving |