π§ Model
phi-4
by microsoft
phi-4 is an open-source AI model by microsoft
π Updated 12/31/2025
Technical Specifications
Parameters14.66
ArchitecturePhi3ForCausalLM
View Config (3 entries)
{
"architectures": [
"Phi3ForCausalLM"
],
"model_type": "phi3",
"tokenizer_config": {
"bos_token": "<|endoftext|>",
"chat_template": "{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}",
"eos_token": "<|im_end|>",
"pad_token": "<|dummy_85|>"
}
}
πΎ
Est. VRAM Required
~11 GB
Estimation Formula
VRAM = params Γ 0.6 + 2 GB
Based on FP16 precision.
β οΈ Does not account for KV cache or parallel overhead.
π Estimate only. Actual requirements may vary.
π Daily sync (11:00 Beijing)
Based on open-source metadata snapshot. Last synced: Dec 31, 2025
π§ Architecture Explorer
Neural network architecture
1 Input Layer
2 Hidden Layers
3 Attention
4 Output Layer
Parameters 14.66B
Technical Specifications
Parameters14.66
ArchitecturePhi3ForCausalLM
0View Config (3 entries)
{
"architectures": [
"Phi3ForCausalLM"
],
"model_type": "phi3",
"tokenizer_config": {
"bos_token": "<|endoftext|>",
"chat_template": "{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}",
"eos_token": "<|im_end|>",
"pad_token": "<|dummy_85|>"
}
}
π Limitations & Considerations
- β’ Benchmark scores may vary based on evaluation methodology and hardware configuration.
- β’ VRAM requirements are estimates; actual usage depends on quantization and batch size.
- β’ FNI scores are relative rankings and may change as new models are added.
- β License Unknown: Verify licensing terms before commercial use.
- β’ Source: Huggingface
π Related Resources
π Related Papers
No related papers linked yet. Check the model's official documentation for research papers.
π Training Datasets
Training data information not available. Refer to the original model card for details.