From scratch
Collection
Finisha SLM ✨ • 87 items • Updated
How to use Finisha-F-scratch/Copina with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="Finisha-F-scratch/Copina")
messages = [
{"role": "user", "content": "Who are you?"},
]
pipe(messages) # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("Finisha-F-scratch/Copina")
model = AutoModelForCausalLM.from_pretrained("Finisha-F-scratch/Copina")
messages = [
{"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))How to use Finisha-F-scratch/Copina with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Finisha-F-scratch/Copina"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Finisha-F-scratch/Copina",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker model run hf.co/Finisha-F-scratch/Copina
How to use Finisha-F-scratch/Copina with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "Finisha-F-scratch/Copina" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Finisha-F-scratch/Copina",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "Finisha-F-scratch/Copina" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Finisha-F-scratch/Copina",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'How to use Finisha-F-scratch/Copina with Docker Model Runner:
docker model run hf.co/Finisha-F-scratch/Copina
Hey! Copina est une assistante SLM, conçu pour générer des compliments en anglais :)
Copina est un modèle, affiné a partir de learnia (pré-entrainer par LLm-Clem) Afin de vous complimenter en anglais.
vous pouvez l'utiliser quand vous doutez de vous, ou pour générer des compliments mignons.
Copina s'utilise normalement, De la manière la plus simple
Copina, comme toute IA basés sur des SLM a des limitations :
Bonne utilisation !