Skip to content

vllm.model_executor.models.phi3

Inference-only Phi3 model code inherit from Llama.py

Phi3ForCausalLM

Bases: LlamaForCausalLM

Source code in vllm/model_executor/models/phi3.py 
10
11
12
13
14
15
16
17
18
19
class Phi3ForCausalLM(LlamaForCausalLM):

    packed_modules_mapping = {
        "qkv_proj": [
            "qkv_proj",
        ],
        "gate_up_proj": [
            "gate_up_proj",
        ],
    }

packed_modules_mapping class-attribute instance-attribute 

packed_modules_mapping = {
    "qkv_proj": ["qkv_proj"],
    "gate_up_proj": ["gate_up_proj"],
}