Hello community!
text
Hello community!
new_line
new_line
TL;DR
text
TL;DR
new_line
We are proudly announcing that the SoTA Llama-3_1-Nemotron-Ultra-253B is now available for Apple Silicon 192gb+ machines thanks to mlx>=0.26.1 and newest 
text
We are proudly announcing that the SoTA Llama-3_1-Nemotron-Ultra-253B is now available for Apple Silicon 192gb+ machines thanks to mlx>=0.26.1 and newest 
mlx-lm
`mlx-lm`
inline_code
 runtime! 
text
 runtime! 
new_line
Enjoy! 
text
Enjoy! 
new_line
https://huggingface.co/LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5
LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5
model
resource
https://huggingface.co/LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5
new_line
new_line
new_line
new_line
All the details covered in README.md file (As we hope). 
text
All the details covered in README.md file (As we hope). 
new_line
You can try to run on LMStudio if you are not comfortable with the native 
text
You can try to run on LMStudio if you are not comfortable with the native 
mlx_lm.server
`mlx_lm.server`
inline_code
 runner using our modified 
text
 runner using our modified 
.jinja
`.jinja`
inline_code
 template and custom 
text
 template and custom 
tokenizer_config.json
`tokenizer_config.json`
inline_code
. 
text
. 
new_line
new_line
@mlx-community
mention
mlx-community
text
@prince-canuma
mention
prince-canuma
text
@bartowski
mention
bartowski
text
@lmstudio-community
mention
lmstudio-community
Hello community!

TL;DR
We are proudly announcing that the SoTA Llama-3_1-Nemotron-Ultra-253B is now available for Apple Silicon 192gb+ machines thanks to mlx>=0.26.1 and newest `mlx-lm` runtime! 
Enjoy! 
https://huggingface.co/LibraxisAI/Llama-3_1-Nemotron-Ultra-253B-v1-MLX-Q5



All the details covered in README.md file (As we hope). 
You can try to run on LMStudio if you are not comfortable with the native `mlx_lm.server` runner using our modified `.jinja` template and custom `tokenizer_config.json`. 

@mlx-community @prince-canuma @bartowski @lmstudio-community
🚀
John6666