Transformers How to use DataIntelligenceTeam/mistral-7b-instruct-v0.2-bnb-4bit with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("DataIntelligenceTeam/mistral-7b-instruct-v0.2-bnb-4bit", device_map="auto") 
