vllm.v1.sample
Modules:
| Name | Description |
|---|---|
logits_processor | |
metadata | |
ops | |
rejection_sampler | |
sampler | A layer that samples the next tokens from the model's outputs. |
tpu | |
Modules:
| Name | Description |
|---|---|
logits_processor | |
metadata | |
ops | |
rejection_sampler | |
sampler | A layer that samples the next tokens from the model's outputs. |
tpu | |