Overview

DeepLogismosRetina is the front-end application with graphical user interface (GUI) that performs 3D segmentation of retina surfaces in OCT (optical coherence tomography) images using Deep LOGISMOS (a hybrid of LOGISMOS and deep learning) segmentation method with built-in support of Just-Enough Interaction (JEI) that allows the user to edit automated Deep LOGISMOS results via intuitive and efficient interactions with the underlying algorithm.

DeepLogismosRetina is a completely new application that is different from OCTExplorer. The main purpose of OCTExplorer is to perform segmentation and additional analysis using limited number of pre-defined settings. DeepLogismosRetina aims to provide a open workflow that can be configured by the users to meet their specific requirements.

FeatureDeepLogismosRetinaOCTExplorer
Input image formatITK supported formats, e.g. NIfTIVender proprietary formats, e.g. *.vol
Output surface file formatDocumented JSON and NIfTIUndocumented custom XML
Additional analysis outputNoUndocumented various formats
Utilize deep learning resultsYesNo
LOGISMOS graph optimizationMulti-thread EIBFSSingle-thread Boykov-Kolmogorov
Number of surfaces to segmentConfigurableFixed
Gradient based costConfigurableFixed
Algorithm settingDocumented JSON configurationPre-tuned for typical macular and ONH
Editing segmentation errorsJEI modifies cost and maintain topologyUse splines to modify surface individually

 

Because of the highly configurable nature of DeepLogismosRetina and its dependency on the quality of deep learning workflow (not provided) output, the configurations included in the downloadable examples are not the universally optimal settings that can achieve the best possible results on any OCT image.

Contents

The main download is DeepLogismosRetina.zip file for 64-bit Windows and it contains the following.

  • DataViewerLayer.exe: The data visualization application designed for visualization of 3D retina OCT (Optical Coherence Tomography) image and its segmentation represented as labels and surfaces.
  • DeepLogismosRetina.exe: The main segmentation application that utilizes the data visualization capabilities implemented in DataViewerLayer.
  • DataViewerLayer_Users_Guide.pdf: The document that describes the data visualization and user interaction features shared by both applications.
  • DeepLogismosRetina_Users_Guide.pdf: The document focuses on the segmentation workflow, JEI features and detailed descriptions of configuration and output surface data file formats.
  • Other supporting files that enable portable applications such that the two executables can be run with any installation or administrator privilege.

In addition, ExampleData.zip is also available for download. It contains several example images, probability maps, configurations, and results.

Contact

License

DeepLogismosRetina is provided as is and can be used only for non-commercial research purposes.

Citing DeepLogismosRetina

  • Please refer to the algorithm as DeepLogismosRetina.
  • Acknowledge that the configurations are adjusted and tuned with respect to the specific characteristics of your own data.
  • Cite some or all of the following papers that focus on different aspects of the algorithm.
    1. Hybrid Deep Logismos segmentation.
    2. The essentials of LOGISMOS and JEI.
    3. Incorporating in-region cost into LOGISMOS.
    4. Fundamental of LOGISMOS segmentation.
@Article{Chen2024,
  author = {Zhi Chen and Honghai Zhang and Edward F. Linton and Brett A. Johnson
and Yun Jae Choi and Mark J. Kupersmith and Milan Sonka and Mona K. Garvin and Randy
H. Kardon and Jui-Kai Wang},
  title = {Hybrid deep learning and optimal graph search method for optical
coherence tomography layer segmentation in diseases affecting the optic nerve},
  journal = {Biomed. Opt. Express},
  publisher = {Optica Publishing Group},
  year = {2024},
  volume = {15},
  number = {6},
  pages = {3681--3698},
  month = {Jun},
  url = {https://opg.optica.org/boe/abstract.cfm?URI=boe-15-6-3681},
  doi = {10.1364/BOE.516045},
}

@InCollection{Zhang2020JEIChapter,
  author    = {Honghai Zhang and Kyungmoo Lee and Zhi Chen and Satyananda Kashyap and Milan Sonka},
  booktitle = {Handbook of Medical Image Computing and Computer Assisted Intervention},
  publisher = {Academic Press},
  title     = {Chapter 11 - {LOGISMOS-JEI}: Segmentation using optimal graph search and just-enough interaction},
  year      = {2020},
  editor    = {S. Kevin Zhou and Daniel Rueckert and Gabor Fichtinger},
  isbn      = {978-0-12-816176-0},
  pages     = {249-272},
  series    = {The Elsevier and MICCAI Society Book Series},
  doi       = {10.1016/B978-0-12-816176-0.00016-8},
}

@Article{Garvin2009,
  author   = {M. K. Garvin and M. D. Abramoff and X. Wu and S. R. Russell and T. L. Burns and M. Sonka},
  title    = {Automated {3-D} Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images},
  journal  = {IEEE Transactions on Medical Imaging},
  year     = {2009},
  volume   = {28},
  number   = {9},
  pages    = {1436--1447},
}

@Article{Li2006,
  author  = {Li, Kang and Wu, Xiaodong and Chen, Danny Z and Sonka, Milan},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  title   = {Optimal surface segmentation in volumetric images --- a graph-theoretic approach},
  year    = {2006},
  number  = {1},
  pages   = {119--134},
  volume  = {28},
}

Support

Development was supported, in part, by the following funding sources:

  • VA-RR&D I50RX003002, I01RX003797, I01RX001786
  • NIH-NIBIB EB044640
  • NIH-NEI EY031544, EY023279, EY032522

Download

Please fill the information form below to request access to software download links.

Definitions

Provider - Institution providing the Original Material:

  • The University of Iowa Research Foundation

Provider's Scientists:

  •       Honghai Zhang
  •       Zhi Chen
  •       Jui-Kai (Ray) Wang
  •       Xiaodong Wu
  •       Milan Sonka

Recipient - Institution receiving the Original Material:

  • Institution employing person requesting download: xxxxx

Recipient's Scientist(s): xxxxx

  • Person requesting download: xxxxx

Software: DeepLogismosRetina, including:

        LOGISMOS

        All which are partially described in:

Zhi Chen, Honghai Zhang, Edward F. Linton, Brett A. Johnson, Yun Jae Choi, Mark J. Kupersmith, Milan Sonka, Mona K. Garvin, Randy H. Kardon, Jui-Kai (Ray) Wang. A Hybrid Deep Learning and Optimal Graph Search Method for Optical Coherence Tomography Layer Segmentation in Diseases Affecting the Optic Nerve. Biomed. Opt. Express. 2024. Accepted manuscript.

Honghai Zhang, Kyungmoo Lee, Zhi Chen, Satyananda Kashyap, Milan Sonka. Handbook of Medical Image Computing and Computer Assisted Intervention. Chapter 11 - LOGISMOS-JEI: Segmentation using optimal graph search and just-enough interaction. Academic Press 2020. pp. 249--272.

M. K. Garvin, M. D. Abramoff, X. Wu, S. R. Russell, T. L. Burns, M. Sonka. Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images. IEEE Transactions on Medical Imaging. 2009 vol. 28 pp. 1436--1447.

Kang Li, Xiaodong Wu, Danny Z Chen, Mialn Sonka. Optimal surface segmentation in volumetric images --- a graph-theoretic approach. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006 vol. 28 pp. 119--134.

Patents

  • United States Patent 7,995,810, "System and Methods for Image segmentation in N- dimensional space". Inventors: K Li, X Wu, DZ Chen, M Sonka
  • And any other patents and applications claiming priority to the above.

Terms and Conditions of this Agreement

  1. The Effective Date of this Software Transfer Agreement is the date electronically agreed to by Recipient's Scientist as part of this license.
  2. The Software is the property of Provider and is to be used by Recipient solely for research purposes only at Recipient's institution and only under the direction of the Recipient's Scientist(s). The Software may not be used in the diagnosis or treatment of patients and Recipient and Recipient Scientist(s) may not use Software in a manner which generates income or remuneration for Recipient and Recipient Scientist(s).
  3. The Recipient's Scientist(s) agrees not to transfer or provide the Software to anyone else at Recipient's institution or any third party without the prior written consent of Provider. The Software being used is further restricted to a single computer. Recipient's Scientist shall refer any request for the Software to Provider.
  4. No rights are provided to Recipient under the patents above or any patents, patent applications, copyrights, trade secrets or other proprietary rights of Provider. In particular, no rights are provided to use the Software or any related intellectual property of Provider for making, using, or distributing the intellectual property, material or derivatives thereof in exchange for any form of compensation or reimbursement. However, nothing in this paragraph or any other section of this Agreement shall be construed to interfere with, restrict or otherwise limit Recipient's rights to receive or spend the grant proceeds under any Prime Award and Provider encourages Recipient to explore state, Federal and internal funding opportunities using the Software.
  5. The provision of the Software to Recipient shall not alter any preexisting right to the Software, including the customary rights granted to the federal government or non-profit foundations.
  6. Any Software delivered pursuant to this Agreement is understood to be experimental in nature. PROVIDER MAKES NO REPRESENTATIONS AND EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED. THERE ARE NO EXPRESS OR IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, OR THAT THE USE OF THE MATERIAL WILL NOT INFRINGE ANY PATENT, COPYRIGHT, TRADEMARK OR OTHER PROPRIETARY RIGHTS.
  7. Except to the extent prohibited by law, Recipient assumes all liability for damages which may arise from its use, storage or disposal of the Software. Provider will not be liable to Recipient for any loss, claim or demand made by Recipient, made against Recipient or by any other party, due to or arising from the use of the Software by the Recipient, except to the extent permitted by law when caused by the gross negligence or willful misconduct of Provider.
  8. Software is being provided to Recipient at no cost.
  9. Recipient agrees that Provider and Provider's Scientist(s) shall receive appropriate recognition in any publication or presentation resulting from the use of agreed upon Software.
  10. Recipient agrees to use the Software in compliance with all applicable statues and regulations, including, for example, Export Control.

Institution: The University of Iowa Research Foundation
Address: 200 S. Capitol Street, 2660 University Capitol Centre, Iowa City, IA 52242-5500
Authorized Official: Zev Sunleaf
Title: Executive Director