Florence-2 has a great capability of detecting various objects in a zero-shot setting with the task prompt "<OD>". However, if you want to detect specific objects that the base model is not able to in its current form, you can easily finetune it for this particular task. Below I show how to finetune the model to detect tables in a given image, but a similar process can be applied to detect any objects. Thanks to 
text
Florence-2 has a great capability of detecting various objects in a zero-shot setting with the task prompt "<OD>". However, if you want to detect specific objects that the base model is not able to in its current form, you can easily finetune it for this particular task. Below I show how to finetune the model to detect tables in a given image, but a similar process can be applied to detect any objects. Thanks to 
@andito
mention
andito
, 
text
, 
@merve
mention
merve
, and 
text
, and 
@SkalskiP
mention
SkalskiP
 for sharing the fix for finetuning the Florence-2 model. Please also check their great blog post at 
text
 for sharing the fix for finetuning the Florence-2 model. Please also check their great blog post at 
https://huggingface.co/blog/finetune-florence2
https://huggingface.co/blog/finetune-florence2
link
. 
text
. 
new_line
new_line
Colab notebook: 
text
Colab notebook: 
https://colab.research.google.com/drive/1Y8GVjwzBIgfmfD3ZypDX5H1JA_VG0YDL?usp=sharing
https://colab.research.google.com/drive/1Y8GVjwzBIgfmfD3ZypDX5H1JA_VG0YDL?usp=sharing
link
new_line
Finetuned model: 
text
Finetuned model: 
https://huggingface.co/ucsahin/Florence-2-large-TableDetection
ucsahin/Florence-2-large-TableDetection
model
resource
https://huggingface.co/ucsahin/Florence-2-large-TableDetection
Florence-2 has a great capability of detecting various objects in a zero-shot setting with the task prompt "<OD>". However, if you want to detect specific objects that the base model is not able to in its current form, you can easily finetune it for this particular task. Below I show how to finetune the model to detect tables in a given image, but a similar process can be applied to detect any objects. Thanks to @andito, @merve, and @SkalskiP for sharing the fix for finetuning the Florence-2 model. Please also check their great blog post at https://huggingface.co/blog/finetune-florence2. 

Colab notebook: https://colab.research.google.com/drive/1Y8GVjwzBIgfmfD3ZypDX5H1JA_VG0YDL?usp=sharing
Finetuned model: https://huggingface.co/ucsahin/Florence-2-large-TableDetection
🚀
andito qubvel-hf John6666 Metin osanseviero sosoai kevinjeswani danelcsb dblasko maddosaientisuto radames HiDolen
🔥
alperiox radames
6579e0eaa9e58aec614e9d97
https://cdn-avatars.huggingface.co/v1/production/uploads/6579e0eaa9e58aec614e9d97/zklEVBvTRHoIvVjuVLRom.jpeg
Sangbum Choi
danelcsb
user
64dcd996e3e44e8000cdd9cb
https://cdn-avatars.huggingface.co/v1/production/uploads/64dcd996e3e44e8000cdd9cb/jLrOsWrKrKYx0NhVkJaF0.jpeg
Umitcan Sahin
ucsahin
user
625dc5dd943e346492b6cdb7
/avatars/ee643b69c74bd7ae5ad59df4d05ac38d.svg
Abdul Hanan Ch
maddosaientisuto
user
659e5506b03a0f0e4f648a2f
/avatars/fd2da0bbd9845ba9b2091b4ae24c83a6.svg
Chi Haozhuang
FisherZz
user