⚡ Blackwell-native Vision Reasoning at the edge ⚡
text
⚡ Blackwell-native Vision Reasoning at the edge ⚡
new_line
new_line
Released a NVFP4A16-variant of nvidia/Cosmos-Reason2-2B:
text
Released a NVFP4A16-variant of nvidia/Cosmos-Reason2-2B:
new_line
https://huggingface.co/embedl/Cosmos-Reason2-2B-NVFP4A16
embedl/Cosmos-Reason2-2B-NVFP4A16
model
resource
https://huggingface.co/embedl/Cosmos-Reason2-2B-NVFP4A16
new_line
new_line
💖 Optimized for Blackwell with minimal accuracy drop compared to its FP16 counterpart.  
text
💖 Optimized for Blackwell with minimal accuracy drop compared to its FP16 counterpart.  
new_line
new_line
Thorough on-device benchmarks on AGX Thor in the modelcard. 🤓 📊  
text
Thorough on-device benchmarks on AGX Thor in the modelcard. 🤓 📊  
new_line
new_line
Try it out: 
text
Try it out: 
new_line
docker run --rm -it \
  --network host \
  --shm-size=8g \
  --ulimit memlock=-1 \
  --ulimit stack=67108864 \
  --runtime=nvidia \
  --name=vllm-serve \
  -e HF_TOKEN=hf_*** \
  -e HF_HOME=/root/.cache/huggingface \
  nvcr.io/nvidia/vllm:26.01-py3 \
  vllm serve "embedl/Cosmos-Reason2-2B-NVFP4A16" \
    --host 0.0.0.0 \
    --port 8000 \
    --tensor-parallel-size 1 \
    --max-model-len 16384 \
    --gpu-memory-utilization 0.9
```
docker run --rm -it \
  --network host \
  --shm-size=8g \
  --ulimit memlock=-1 \
  --ulimit stack=67108864 \
  --runtime=nvidia \
  --name=vllm-serve \
  -e HF_TOKEN=hf_*** \
  -e HF_HOME=/root/.cache/huggingface \
  nvcr.io/nvidia/vllm:26.01-py3 \
  vllm serve "embedl/Cosmos-Reason2-2B-NVFP4A16" \
    --host 0.0.0.0 \
    --port 8000 \
    --tensor-parallel-size 1 \
    --max-model-len 16384 \
    --gpu-memory-utilization 0.9
```
code_fence
⚡ Blackwell-native Vision Reasoning at the edge ⚡

Released a NVFP4A16-variant of nvidia/Cosmos-Reason2-2B:
https://huggingface.co/embedl/Cosmos-Reason2-2B-NVFP4A16

💖 Optimized for Blackwell with minimal accuracy drop compared to its FP16 counterpart.  

Thorough on-device benchmarks on AGX Thor in the modelcard. 🤓 📊  

Try it out: 
```
docker run --rm -it \
  --network host \
  --shm-size=8g \
  --ulimit memlock=-1 \
  --ulimit stack=67108864 \
  --runtime=nvidia \
  --name=vllm-serve \
  -e HF_TOKEN=hf_*** \
  -e HF_HOME=/root/.cache/huggingface \
  nvcr.io/nvidia/vllm:26.01-py3 \
  vllm serve "embedl/Cosmos-Reason2-2B-NVFP4A16" \
    --host 0.0.0.0 \
    --port 8000 \
    --tensor-parallel-size 1 \
    --max-model-len 16384 \
    --gpu-memory-utilization 0.9
```
🔥
WilhelmT John6666 HProg