Requesting MTP support for the Devstral 2 123B LLM
#23
by alexanderacuna - opened
As the title says, requesting a MTP version. Llama.cpp now supports it. MTP could greatly increase the token generation for an LLM of this size and dense. Please consider adding MTP support.