nthngdy
/

Llama-3.2-3B-Instruct_qfilt

model_hub_mixin

pytorch_model_hub_mixin

Model card Files Files and versions

This model has been pushed to the Hub using the PytorchModelHubMixin integration:

Library: [More Information Needed]
Docs: [More Information Needed]

Downloads last month: 2,599

Safetensors

Model size

28.7k params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using nthngdy/Llama-3.2-3B-Instruct_qfilt 1

Collection including nthngdy/Llama-3.2-3B-Instruct_qfilt

Q-Filters

Pre-computed Q-Filters for efficient KV cache compression. • 15 items • Updated Mar 3, 2025 • 7