Instructions to use sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH") model = AutoModelForCausalLM.from_pretrained("sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH
- SGLang
How to use sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH with Docker Model Runner:
docker model run hf.co/sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH
Qwen2.5-7B-Intuitor-MATH-1EPOCH
This model is a fine-tuned version of Qwen/Qwen2.5-7B trained on the MATH dataset for one epoch using the Intuitor method.
Description
Intuitor is an implementation of Reinforcement Learning from Internal Feedback (RLIF), presented in the paper Learning to Reason without External Rewards. RLIF enables large language models to learn from intrinsic signals—specifically "self-certainty"—without relying on external rewards, gold labels, or verifiers. Intuitor replaces external rewards in Group Relative Policy Optimization (GRPO) with self-certainty scores, allowing for effective unsupervised learning across reasoning domains like mathematics and code generation.
Citation
@article{zhao2025learning,
title = {Learning to Reason without External Rewards},
author = {Zhao, Xuandong and Kang, Zhewei and Feng, Aosong and Levine, Sergey and Song, Dawn},
journal = {arXiv preprint arXiv:2505.19590},
year = {2025}
}
- Downloads last month
- 24
Model tree for sunblaze-ucb/Qwen2.5-7B-Intuitor-MATH-1EPOCH
Base model
Qwen/Qwen2.5-7B