LLM (Chat)
Collection
2 items • Updated
Convert from TinyLlama/TinyLlama-1.1B-Chat-v1.0 and 4 bits quantized.
Require onnxruntime>=0.17.0
- Downloads last month
- 5
Model tree for BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4
Base model
TinyLlama/TinyLlama-1.1B-Chat-v1.0
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4');