🚀 Transformers are not here to take part but take over... and down goes real-time object detection! 💥
text
🚀 Transformers are not here to take part but take over... and down goes real-time object detection! 💥
new_line
new_line
Enter Real-time DEtection Transformer (RT-DETR) 🦾 as suggested capable of real-time object detection. 🎯
text
Enter Real-time DEtection Transformer (RT-DETR) 🦾 as suggested capable of real-time object detection. 🎯
new_line
new_line
Object DEtection Transformer (DETR) is not new (
text
Object DEtection Transformer (DETR) is not new (
@Meta
mention
Meta
 did it eons ago) but it had the issue of every other transformer, high computational cost 💸
text
 did it eons ago) but it had the issue of every other transformer, high computational cost 💸
new_line
new_line
RT-DETR brings an efficient hybrid encoder to expeditiously process multi-scale features by decoupling intra-scale interaction and cross-scale fusion to improve speed 🏎️
text
RT-DETR brings an efficient hybrid encoder to expeditiously process multi-scale features by decoupling intra-scale interaction and cross-scale fusion to improve speed 🏎️
new_line
new_line
Gist is RT-DETR speeds up object detection by redesigning its encoder to process features more efficiently and selecting higher quality initial object queries. ⚡
text
Gist is RT-DETR speeds up object detection by redesigning its encoder to process features more efficiently and selecting higher quality initial object queries. ⚡
new_line
new_line
It also allows adjusting the number of decoder layers to balance speed and accuracy for different real-time scenarios. ⚖️
text
It also allows adjusting the number of decoder layers to balance speed and accuracy for different real-time scenarios. ⚖️
new_line
new_line
This makes RT-DETR faster and more accurate than previous YOLO models. 🏆
text
This makes RT-DETR faster and more accurate than previous YOLO models. 🏆
new_line
new_line
How much better😎/faster? ⏱️
text
How much better😎/faster? ⏱️
new_line
new_line
RT-DETR-R50 achieved 53.1% AP on COCO and 108 FPS on a T4 GPU, while RT-DETR-R101 achieved 54.3% AP and 74 FPS, outperforming advanced YOLO models in both speed and accuracy. 🚀✨
text
RT-DETR-R50 achieved 53.1% AP on COCO and 108 FPS on a T4 GPU, while RT-DETR-R101 achieved 54.3% AP and 74 FPS, outperforming advanced YOLO models in both speed and accuracy. 🚀✨
new_line
new_line
📄 Paper: 
text
📄 Paper: 
DETRs Beat YOLOs on Real-time Object Detection (2304.08069)
https://huggingface.co/papers/2304.08069
2304.08069
paper
resource
https://huggingface.co/papers/2304.08069
new_line
new_line
🧠 Models: 
text
🧠 Models: 
https://huggingface.co/models?search=pekingu/rt-detr
https://huggingface.co/models?search=pekingu/rt-detr
link
🚀 Transformers are not here to take part but take over... and down goes real-time object detection! 💥

Enter Real-time DEtection Transformer (RT-DETR) 🦾 as suggested capable of real-time object detection. 🎯

Object DEtection Transformer (DETR) is not new (@Meta did it eons ago) but it had the issue of every other transformer, high computational cost 💸

RT-DETR brings an efficient hybrid encoder to expeditiously process multi-scale features by decoupling intra-scale interaction and cross-scale fusion to improve speed 🏎️

Gist is RT-DETR speeds up object detection by redesigning its encoder to process features more efficiently and selecting higher quality initial object queries. ⚡

It also allows adjusting the number of decoder layers to balance speed and accuracy for different real-time scenarios. ⚖️

This makes RT-DETR faster and more accurate than previous YOLO models. 🏆

How much better😎/faster? ⏱️

RT-DETR-R50 achieved 53.1% AP on COCO and 108 FPS on a T4 GPU, while RT-DETR-R101 achieved 54.3% AP and 74 FPS, outperforming advanced YOLO models in both speed and accuracy. 🚀✨

📄 Paper: https://huggingface.co/papers/2304.08069

🧠 Models: https://huggingface.co/models?search=pekingu/rt-detr
🚀
merterbak clem osanseviero louisbrulenaudet
👍
blender66cat Artificial-superintelligence
🔥
zaanind