neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
text
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
new_line
new_line
Requant of the big llama, using 20% less memory 
text
Requant of the big llama, using 20% less memory 
new_line
new_line
https://huggingface.co/neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
https://huggingface.co/neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8
link
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Requant of the big llama, using 20% less memory 

https://huggingface.co/neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8