VPTQ-community

community

AI & ML interests

None defined yet.

OpenSourceRonin

in VPTQ-community/README 5 months ago

using VPTQ for my own models

#3 opened 6 months ago by

OpenSourceRonin

updated 19 models 10 months ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

6B • Updated Mar 20, 2025 • 7

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

2B • Updated Mar 20, 2025 • 6

VPTQ-community/Meta-Llama-3-70B-v16-k65536-65536-woft

8B • Updated Mar 20, 2025 • 6

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-woft

6B • Updated Mar 20, 2025 • 8

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-ft

6B • Updated Mar 20, 2025 • 6

VPTQ-community/Meta-Llama-3-8B-v12-k4096-4096-woft

2B • Updated Mar 20, 2025 • 6

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-256-woft

3B • Updated Mar 20, 2025 • 6

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-65536-woft

4B • Updated Mar 20, 2025 • 6

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20, 2025 • 8

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20, 2025 • 15

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-0-woft

3B • Updated Mar 20, 2025 • 4

VPTQ-community/Qwen2.5-14B-Instruct-v16-k65536-65536-woft

3B • Updated Mar 20, 2025 • 7

VPTQ-community/Meta-Llama-3-8B-v6-k4096-4096-woft

2B • Updated Mar 20, 2025 • 7

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20, 2025 • 40 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

2B • Updated Mar 20, 2025 • 13

VPTQ-community/Qwen2.5-14B-Instruct-v8-k256-256-woft

2B • Updated Mar 20, 2025 • 7

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

2B • Updated Mar 20, 2025 • 7

VPTQ-community/Meta-Llama-3-8B-v4-k4096-0-woft

2B • Updated Mar 20, 2025 • 8

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20, 2025 • 8