Qwen2 Modelfile

Qwen2 Modelfile

创建 Modelfile

FROM qwen2-1_5b-instruct-q4_k_m.gguf

# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 0.7
PARAMETER top_p 0.8
PARAMETER repeat_penalty 1.05
PARAMETER top_k 20

TEMPLATE """{{ if and .First .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}"""

# set the system message
SYSTEM """
You are a helpful assistant.
"""

创建模型

ollama create qwen2 -f Modelfile

运行服务

ollama run qwen2
LICENSED UNDER CC BY-NC-SA 4.0