We thought it would be easier, but finally we have integrated CuDNN Paged Attention to our models!
text
We thought it would be easier, but finally we have integrated CuDNN Paged Attention to our models!
new_line
new_line
new_line
Read article here: 
text
Read article here: 
https://app.thestage.ai/blog/Integrating-cuDNN-Paged-Attention-to-TheStage-AI-Inference?id=8
https://app.thestage.ai/blog/Integrating-cuDNN-Paged-Attention-to-TheStage-AI-Inference?id=8
link
new_line
new_line
Llama-8B with CuDNN paged attention, including B200 support: 
text
Llama-8B with CuDNN paged attention, including B200 support: 
https://huggingface.co/TheStageAI/Elastic-Llama-3.1-8B-Instruct
TheStageAI/Elastic-Llama-3.1-8B-Instruct
model
resource
https://huggingface.co/TheStageAI/Elastic-Llama-3.1-8B-Instruct
new_line
Mistral-Small-24B with CuDNN paged attention, including B200 support: 
text
Mistral-Small-24B with CuDNN paged attention, including B200 support: 
https://huggingface.co/TheStageAI/Elastic-Mistral-Small-3.1-24B-Instruct-2503
TheStageAI/Elastic-Mistral-Small-3.1-24B-Instruct-2503
model
resource
https://huggingface.co/TheStageAI/Elastic-Mistral-Small-3.1-24B-Instruct-2503
new_line
We thought it would be easier, but finally we have integrated CuDNN Paged Attention to our models!


Read article here: https://app.thestage.ai/blog/Integrating-cuDNN-Paged-Attention-to-TheStage-AI-Inference?id=8

Llama-8B with CuDNN paged attention, including B200 support: https://huggingface.co/TheStageAI/Elastic-Llama-3.1-8B-Instruct
Mistral-Small-24B with CuDNN paged attention, including B200 support: https://huggingface.co/TheStageAI/Elastic-Mistral-Small-3.1-24B-Instruct-2503

🚀
hypothetical Aanuoluwapo65 unmodeled-tyler John6666 quazim hinairo
🔥
quazim hinairo
😎
quazim hinairo