Update

• This repo is under development. I have created a Hugging Face space for testing the inference: vicca

VICCA

VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human Feedback [paper]

Authors

• Sayeh GHOLIPOUR PICHA
• Dawood Al Chanti
• Alice Caplier

Acknowledgements

This repo build upon the awesome work of the following repos:

• Grounding Dino
• Open-GroundingDino
• ControlNet
• DETR
• Lung Segmentation

Please cite them as well if you found this code useful.

Installation

[Under Development]

  python 

Badges

Add badges from somewhere like: shields.io

Run Locally

Clone the project

  git clone https://github.com/sayeh1994/vicca.git

Download the weights and checkpoints from here.

Please merge the folders from the downloaded file to the project folder.

Go to the project directory and install the new environment from the yml file:

  conda env create -f environment.yml

Run the inference.py

  python inference.py \
    --image_path VG/38708899-5132e206-88cb58cf-d55a7065-6cbc983d.jpg \
    --text_prompt "Cardiomegaly with mild pulmonary vascular congestion."

Training

TODO

• Add the Training Scripts
• Creating a library out of it