Quants - a crusoeai Collection

crusoeai 's Collections

Quants

updated Apr 24, 2024

Auto-generated quantized models courtesy of CrusoeAI compute.

crusoeai/dolphin-2.9-llama3-70b-GGUF

71B • Updated Apr 25, 2024 • 887 • 12
crusoeai/dolphin2.9-llama3-70b-4.5bpw-exl2

Text Generation • Updated Apr 24, 2024 • 2 • 2
crusoeai/dolphin2.9-llama3-70b-2.5bpw-exl2

Text Generation • Updated Apr 24, 2024 • 5 • 2
crusoeai/dolphin2.9-llama3-70b-2.25bpw-exl2

Text Generation • Updated Apr 24, 2024 • 1 • 1