Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
canada-quant
/
hy3-w4a16-mtp
like
5
Follow
Canada Quant Labs
36
Text Generation
Safetensors
5 datasets
English
Chinese
vllm
hy_v3
hy3
hunyuan
w4a16
gptq
int4
compressed-tensors
Mixture of Experts
mixture-of-experts
mtp
speculative-decoding
llmcompressor
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
2*6000 Pro possible ?
#1
by
mtcl
- opened
Jul 19
Discussion
mtcl
Jul 19
Is this possible to load on 2x6000 pros?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
