Falcon Perception
Perception-centric systems are typically implemented with a modular encoder-decoder pipeline: a vision backbone for feature extraction and a separate decoder (or late-fusion module) for task prediction. This raises a central question: is this architectural separation essential or can a single early-fusion stack do both perception and task modeling at scale? We introduce Falcon Perception, a unified dense Transformer that processes image patches and text tokens in a shared parameter space from the first layer, using a hybrid attention pattern (bidirectional among image tokens, causal for prediction tokens) to combine global visual context with autoregressive, variable-length instance generation. To keep dense outputs practical, Falcon Perception retains a lightweight token interface and decodes continuous spatial outputs with specialized heads, enabling parallel high-resolution mask prediction.
  Our design promotes simplicity: we keep a single scalable backbone and shift complexity toward data and training signals, adding only small heads where outputs are continuous and dense. On SA-Co, Falcon Perception improves mask quality to 68.0 Macro-F_1 compared to 62.3 of SAM3. We also introduce PBench, a benchmark targeting compositional prompts (OCR, spatial constraints, relations) and dense long-context regimes, where the model shows better gains. Finally, we extend the same early-fusion recipe to Falcon OCR: a compact 300M-parameter model which attains 80.3% on olmOCR and 88.64 on OmniDocBench.
69ccc9d13f84a0971be66c5b
Aviraj Bevli
69ccc9d13f84a0971be66c5c
Sofian Chaybouti
claimed_verified
2026-04-02T15:32:13.333Z
64be47be36eb058cd9145e0f
https://cdn-avatars.huggingface.co/v1/production/uploads/64be47be36eb058cd9145e0f/U2Tckm5kSQjzhq_tWuIzO.jpeg
Sofian Chaybouti
SofianChay
user
SofianChay
69ccc9d13f84a0971be66c5d
Yasser Dahou
claimed_verified
2026-04-01T12:43:01.830Z
6460e69a933afb0106a8877e
/avatars/e6a583751a7322742e066d90fc5610e8.svg
Yasser Dahou
yasserDahou
user
yasserDahou
69ccc9d13f84a0971be66c5e
Hakim Hacid
69ccc9d13f84a0971be66c5f
Ngoc Dung Huynh
69ccc9d13f84a0971be66c60
Phuc H. Le Khac
claimed_verified
2026-04-02T08:17:21.612Z
60d3b119b8448e1785bbda25
/avatars/978cb3e31545dc14cad5061737659d3d.svg
Phúc Lê Khắc
lkhphuc
user
lkhphuc
69ccc9d13f84a0971be66c61
Sanath Narayan
69ccc9d13f84a0971be66c62
Wamiq Reyaz Para
69ccc9d13f84a0971be66c63
Ankit Singh
Falcon Perception
Perception-centric systems are typically implemented with a modular encoder-decoder pipeline: a vision backbone for feature extraction and a separate decoder (or late-fusion module) for task prediction. This raises a central question: is this architectural separation essential or can a single early-fusion stack do both perception and task modeling at scale? We introduce Falcon Perception, a unified dense Transformer that processes image patches and text tokens in a shared parameter space from the first layer, using a hybrid attention pattern (bidirectional among image tokens, causal for prediction tokens) to combine global visual context with autoregressive, variable-length instance generation. To keep dense outputs practical, Falcon Perception retains a lightweight token interface and decodes continuous spatial outputs with specialized heads, enabling parallel high-resolution mask prediction.
  Our design promotes simplicity: we keep a single scalable backbone and shift complexity toward data and training signals, adding only small heads where outputs are continuous and dense. On SA-Co, Falcon Perception improves mask quality to 68.0 Macro-F_1 compared to 62.3 of SAM3. We also introduce PBench, a benchmark targeting compositional prompts (OCR, spatial constraints, relations) and dense long-context regimes, where the model shows better gains. Finally, we extend the same early-fusion recipe to Falcon OCR: a compact 300M-parameter model which attains 80.3% on olmOCR and 88.64 on OmniDocBench.