HF Transformers integration
#3
by ybelkada - opened
This PR introduces the transformers integration which should be on par with: https://github.com/huggingface/transformers/pull/27942 so that any user can use Mixtral-8x7B-v0.1 with transformers using AutoModelForCausalLM interface.
The config needs a slight modification (mistral -> mixtral) and added all safetensors weights
ybelkada changed pull request title from Upload MixtralForCausalLM to HF Transformers integration
pstock changed pull request status to merged