Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
text
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
new_line
new_line
https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
model
resource
https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
new_line
new_line
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
text
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
new_line
new_line
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
text
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
new_line
new_line
https://github.com/ggml-org/llama.cpp/pull/14349
https://github.com/ggml-org/llama.cpp/pull/14349
link
new_line
new_line
Start server with a command like this:
text
Start server with a command like this:
new_line
new_line
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja
```
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja
```
code_fence
new_line
new_line
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
text
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
new_line
new_line
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
text
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')

https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF

Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)

Outlined the details of the script and results in my llama.cpp PR to add the jinja template:

https://github.com/ggml-org/llama.cpp/pull/14349

Start server with a command like this:

```
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja
```

and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp

In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
👍
kiuckhuang Plugyy alien7s myxlmynx ubergarm acidburn2501 eaddario mseri rodionmdk imweijh Name108 wsbagnsv1 hao3760 urbanswelt dussinus holderman1206 abnerxue001
🤗
pabloce John6666 omaryshchenko StephenGenusa Plugyy merve pcuenq eaddario graelo
❤️
imweijh