Hugging Face's logo

cxllin
/
Llama2-7b-tinytext

Text Generation
Transformers
English
general
Model card Files
xet
 Community
1
How to use from
vLLM
Install from pip and serve model 
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cxllin/Llama2-7b-tinytext"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cxllin/Llama2-7b-tinytext",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker 
docker model run hf.co/cxllin/Llama2-7b-tinytext
Quick Links

LLaMA-2-7b-Tinytext

your alt-text if image link breaks

Model Details

Llama2-7b-tinytext is a fine-tuned language model ontop of TinyPixel/Llama-2-7B-bf16-sharded,

Model Description

TODO

  • Developed by: Collin Heenan
  • Model type: [More Information Needed]
  • Language(s) (NLP): English
  • Finetuned from model: TinyPixel/Llama-2-7B-bf16-sharded

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

TODO

Direct Use

TODO

Bias, Risks, and Limitations

TODO

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train cxllin/Llama2-7b-tinytext