Synthesizing new retinal symptom images by multiple generative models

by Y.-C. Liu, H.-H. Yang, C.-H. Huck Yang, J.-H. Huang, M. Tian, H. Morikawa, J. Tegner
Year:2018

Bibliography

Synthesizing new retinal symptom images by multiple generative models
Y.-C. Liu, H.-H. Yang, C.-H. Huck Yang, J.-H. Huang, M. Tian, H. Morikawa, J. Tegner
ACCV Workshop of AI in Retina Image Analysis, 2018

Abstract

​Age-Related Macular Degeneration (AMD) is an asymptomatic retinal disease which may result in loss of vision. There is limited access to high-quality relevant retinal images and poor understanding of the features defining sub-classes of this disease. Motivated by recent advances in machine learning we specifically explore the potential of generative modeling, using Generative Adversarial Networks (GANs) and style transferring, to facilitate clinical diagnosis and disease understanding by feature extraction. We design an analytic pipeline which first generates synthetic retinal images from clinical images; a subsequent verification step is applied. In the synthesizing step we merge GANs (DCGANs and WGANs architectures) and style transferring for the image generation, whereas the verified step controls the accuracy of the generated images. We find that the generated images contain sufficient pathological details to facilitate ophthalmologists' task of disease classification and in discovery of disease relevant features. In particular, our system predicts the drusen and geographic atrophy sub-classes of AMD. Furthermore, the performance using CFP images for GANs outperforms the classification based on using only the original clinical dataset. Our results are evaluated using existing classifier of retinal diseases and class activated maps, supporting the predictive power of the synthetic images and their utility for feature extraction.

Synthesizing new retinal symptom images by multiple generative models.pdf

Keywords

Age-Related Macular Degeneration (AMD) Machine learning Generative Adversarial Networks (GANs)
KAUST

"KAUST shall be a beacon for peace, hope and reconciliation, and shall serve the people of the Kingdom and the world."

King Abdullah bin Abdulaziz Al Saud, 1924 – 2015

Contact Us

  • 4700 King Abdullah University of Science and Technology

    Thuwal 23955-6900, Kingdom of Saudi Arabia

     

Quick links

© King Abdullah University of Science and Technology. All rights reserved