Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Images
Hepatocellular Carcinoma diagnosis relies heavily on the interpretation of gigapixel Whole Slide Images. However, current computational approaches are constrained by fixed-resolution processing mechanisms and inefficient feature aggregation, which inevitably lead to either severe information loss or high feature redundancy. To address these challenges, we propose Hepato-LLaVA, a specialized Multi-modal Large Language Model designed for fine-grained hepatocellular pathology analysis. We introduce a novel Sparse Topo-Pack Attention mechanism that explicitly models 2D tissue topology. This mechanism effectively aggregates local diagnostic evidence into semantic summary tokens while preserving global context. Furthermore, to overcome the lack of multi-scale data, we present HepatoPathoVQA, a clinically grounded dataset comprising 33K hierarchically structured question-answer pairs validated by expert pathologists. Our experiments demonstrate that Hepato-LLaVA achieves state-of-the-art performance on HCC diagnosis and captioning tasks, significantly outperforming existing methods. Our code and implementation details are available at https://pris-cv.github.io/Hepto-LLaVA/.
699d88e89491ce7a9c688a08
Yuxuan Yang
699d88e89491ce7a9c688a09
Zhonghao Yan
claimed_verified
2026-02-27T16:44:19.385Z
64fbd4e69a62bb2791b3a665
https://cdn-avatars.huggingface.co/v1/production/uploads/64fbd4e69a62bb2791b3a665/ZEMtU8O0z98ryeRCG3l_K.jpeg
Zhonghao Yan
zzzyzh
user
zzzyzh
699d88e89491ce7a9c688a0a
Yi Zhang
699d88e89491ce7a9c688a0b
Bo Yun
claimed_verified
2026-03-25T10:51:57.147Z
68e8d35fe36fce6d5a5bb53d
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/ybZaZDlhKN2fxVz1D4O_r.png
yunbo
yunbo1132
user
yunbo1132
699d88e89491ce7a9c688a0c
Muxi Diao
699d88e89491ce7a9c688a0d
Guowei Zhao
699d88e89491ce7a9c688a0e
Kongming Liang
699d88e89491ce7a9c688a0f
Wenbin Li
699d88e89491ce7a9c688a10
Zhanyu Ma
Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Images
Hepatocellular Carcinoma diagnosis relies heavily on the interpretation of gigapixel Whole Slide Images. However, current computational approaches are constrained by fixed-resolution processing mechanisms and inefficient feature aggregation, which inevitably lead to either severe information loss or high feature redundancy. To address these challenges, we propose Hepato-LLaVA, a specialized Multi-modal Large Language Model designed for fine-grained hepatocellular pathology analysis. We introduce a novel Sparse Topo-Pack Attention mechanism that explicitly models 2D tissue topology. This mechanism effectively aggregates local diagnostic evidence into semantic summary tokens while preserving global context. Furthermore, to overcome the lack of multi-scale data, we present HepatoPathoVQA, a clinically grounded dataset comprising 33K hierarchically structured question-answer pairs validated by expert pathologists. Our experiments demonstrate that Hepato-LLaVA achieves state-of-the-art performance on HCC diagnosis and captioning tasks, significantly outperforming existing methods. Our code and implementation details are available at https://pris-cv.github.io/Hepto-LLaVA/.
A specialized multi-modal large language model for hepatocellular carcinoma diagnosis that uses a novel sparse attention mechanism to model tissue topology and outperforms existing methods.
Multi-modal Large Language Model Sparse Topo-Pack Attention tissue topology semantic summary tokens HepatoPathoVQA HCC diagnosis captioning tasks