Spaces:
Build error
Build error
Commit
·
7aa947f
1
Parent(s):
77c8482
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,4 +10,37 @@ pinned: false
|
|
| 10 |
license: mit
|
| 11 |
---
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
license: mit
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# RATCHET: RAdiological Text Captioning for Human Examined Thoraxes
|
| 14 |
+
|
| 15 |
+
RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting. Based on the architecture featured in [Attention Is All You Need](https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf). This network is trained and validated on the MIMIC-CXR v2.0.0 dataset.
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
### Architecture
|
| 19 |
+
|
| 20 |
+
<p align="center">
|
| 21 |
+
<img src="assets/model_transformer.png" alt="RATCHET Architecture" width="300"/>
|
| 22 |
+
</p>
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
### Results
|
| 26 |
+
|
| 27 |
+
<p align="center">
|
| 28 |
+
|
| 29 |
+
<img src="https://upload.wikimedia.org/wikipedia/commons/7/7a/Cardiomegally.PNG" alt="Cardiomegaly" height="300"/>
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
<img src="assets/attn_plot.png" alt="Cardiomegaly Attention Plot" height="300"/>
|
| 33 |
+
|
| 34 |
+
</p>
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
##### Generated Text:
|
| 38 |
+
|
| 39 |
+
> In comparison with the study of \_\_\_, there is little overall change. Again there is substantial enlargement of the cardiac silhouette with a dual-channel pacer device in place. No evidence of vascular congestion or acute focal pneumonia. Blunting of the costophrenic angles is again seen.
|
| 40 |
+
|
| 41 |
+
|
| 42 |
+
### More Examples
|
| 43 |
+
|
| 44 |
+
<p align="center">
|
| 45 |
+
<img src="assets/examples.png" alt="More Captioning Examples" max-height="400"/>
|
| 46 |
+
</p>
|