This project explores deep learning methods for generating medical reports from chest X-ray images using the Indiana University Chest X-ray dataset.
- ResNet50 (Encoder) + GPT-2 (Decoder) β PyTorch
- DenseNet121 (Encoder) + LSTM (Decoder) β TensorFlow
Both models are trained, evaluated, and include report samples.
notebooks/
βββ 01_resnet50_gpt2.ipynb # PyTorch: ResNet50 + GPT-2 (with output & evaluation)
βββ 02_densenet121_lstm.ipynb # TensorFlow: DenseNet121 + LSTM (with output & evaluation)
Each notebook includes:
- BLEU Scores
- ROUGE Metrics
- Generated medical reports
- Visual and qualitative comparison of both architectures
- Clone the repository
git clone https://github.com/yaekobB/medical-report-gen.git cd medical-report-gen - Install dependencies
pip install torch tensorflow transformers matplotlib
- Open the notebooks Use Jupyter Notebook, Colab, or VSCode with Python support.
Dataset Name: Chest X-rays (Indiana University)
Kaggle Link: https://www.kaggle.com/datasets/raddar/chest-xrays-indiana-university
π Note: This dataset is not included in the repo. Download it from Kaggle and adjust the path in the notebook if needed.
Included in notebooks:
Sample generated reports
Evaluation scores
Output visualizations
π License This project is open-sourced under the MIT License.
π¬ Feel free to reach out or open an issue with feedback or contributions!
Let me know if you'd like me to turn this into a README with badges, links to Colab, or sample image previews!