Instructions to use BAAI/AREX-Turbo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use BAAI/AREX-Turbo with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="BAAI/AREX-Turbo")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("BAAI/AREX-Turbo")
model = AutoModelForMultimodalLM.from_pretrained("BAAI/AREX-Turbo", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use BAAI/AREX-Turbo with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "BAAI/AREX-Turbo"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AREX-Turbo",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/BAAI/AREX-Turbo

SGLang

How to use BAAI/AREX-Turbo with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "BAAI/AREX-Turbo" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AREX-Turbo",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "BAAI/AREX-Turbo" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BAAI/AREX-Turbo",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use BAAI/AREX-Turbo with Docker Model Runner:
```
docker model run hf.co/BAAI/AREX-Turbo
```

cfli commited on Jul 24

Commit

1298127

verified ·

1 Parent(s): 979ad6c

Add files using upload-large-folder tool

Browse files

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -169,7 +169,7 @@ AREX-Turbo is released under the [Apache License 2.0](LICENSE).
 ## Citation
 ```bibtex
-@misc{lu2026arexrecursivelyselfimprovingagent,
       title={AREX: Towards a Recursively Self-Improving Agent for Deep Research},
       author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu},
       year={2026},

 ## Citation
 ```bibtex
+@misc{baai2026arex,
       title={AREX: Towards a Recursively Self-Improving Agent for Deep Research},
       author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu},
       year={2026},