How fast can you create an endpoint in Hugging Face Inference Endpoints with a new model + vLLM to deploy a state-of-the-art OCR model?
text
How fast can you create an endpoint in Hugging Face Inference Endpoints with a new model + vLLM to deploy a state-of-the-art OCR model?
new_line
new_line
Let’s break it down step by step.
text
Let’s break it down step by step.
new_line
new_line
1️⃣ Create your endpoint
text
1️⃣ Create your endpoint
new_line
Go to Hugging Face Endpoints → + NEW
text
Go to Hugging Face Endpoints → + NEW
new_line
Select Deploy from Hub → rednote-hilab/dots.ocr → Configure 🛠️
text
Select Deploy from Hub → rednote-hilab/dots.ocr → Configure 🛠️
new_line
new_line
2️⃣ Configure hardware & container
text
2️⃣ Configure hardware & container
new_line
Pick hardware: AWS/GPU/L4 ⚡
text
Pick hardware: AWS/GPU/L4 ⚡
new_line
Set container: vLLM 🐇
text
Set container: vLLM 🐇
new_line
Click Create ✅
text
Click Create ✅
new_line
new_line
3️⃣ Update endpoint settings
text
3️⃣ Update endpoint settings
new_line
Container: Container URI: vllm/vllm-openai:nightly → Update
text
Container: Container URI: vllm/vllm-openai:nightly → Update
new_line
Advanced: add flag --trust-remote-code → Update ⚠️
text
Advanced: add flag --trust-remote-code → Update ⚠️
new_line
new_line
4️⃣ Run inference
text
4️⃣ Run inference
new_line
Download the script 📝: 
text
Download the script 📝: 
https://huggingface.co/datasets/ariG23498/useful-scripts/blob/main/dots-ocr-endpoint-infernece.py
ariG23498/useful-scripts
dataset
resource
https://huggingface.co/datasets/ariG23498/useful-scripts/blob/main/dots-ocr-endpoint-infernece.py
new_line
Set your HF_TOKEN and update base_url in the script.
text
Set your HF_TOKEN and update base_url in the script.
new_line
Run it. ✅
text
Run it. ✅
new_line
new_line
Your OCR model is now live via HF Inference Endpoints!
text
Your OCR model is now live via HF Inference Endpoints!
How fast can you create an endpoint in Hugging Face Inference Endpoints with a new model + vLLM to deploy a state-of-the-art OCR model?

Let’s break it down step by step.

1️⃣ Create your endpoint
Go to Hugging Face Endpoints → + NEW
Select Deploy from Hub → rednote-hilab/dots.ocr → Configure 🛠️

2️⃣ Configure hardware & container
Pick hardware: AWS/GPU/L4 ⚡
Set container: vLLM 🐇
Click Create ✅

3️⃣ Update endpoint settings
Container: Container URI: vllm/vllm-openai:nightly → Update
Advanced: add flag --trust-remote-code → Update ⚠️

4️⃣ Run inference
Download the script 📝: https://huggingface.co/datasets/ariG23498/useful-scripts/blob/main/dots-ocr-endpoint-infernece.py
Set your HF_TOKEN and update base_url in the script.
Run it. ✅

Your OCR model is now live via HF Inference Endpoints!
🔥
John6666
🤗
John6666