Comparing methods of detecting and segmenting unruptured intracranial aneurysms on TOF-MRAS: The ADAM challenge.

Details

Ressource 1Download: Timmins2021ADAMchallenge-published.pdf (3959.46 [Ko])
State: Public
Version: Final published version
License: CC BY 4.0
Serval ID
serval:BIB_175BEC70013C
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
Comparing methods of detecting and segmenting unruptured intracranial aneurysms on TOF-MRAS: The ADAM challenge.
Journal
NeuroImage
Author(s)
Timmins K.M., van der Schaaf I.C., Bennink E., Ruigrok Y.M., An X., Baumgartner M., Bourdon P., De Feo R., Noto T.D., Dubost F., Fava-Sanches A., Feng X., Giroud C., Group I., Hu M., Jaeger P.F., Kaiponen J., Klimont M., Li Y., Li H., Lin Y., Loehr T., Ma J., Maier-Hein K.H., Marie G., Menze B., Richiardi J., Rjiba S., Shah D., Shit S., Tohka J., Urruty T., Walińska U., Yang X., Yang Y., Yin Y., Velthuis B.K., Kuijf H.J.
ISSN
1095-9572 (Electronic)
ISSN-L
1053-8119
Publication state
Published
Issued date
09/2021
Peer-reviewed
Oui
Volume
238
Pages
118216
Language
english
Notes
Publication types: Journal Article ; Research Support, Non-U.S. Gov't
Publication Status: ppublish
Abstract
Accurate detection and quantification of unruptured intracranial aneurysms (UIAs) is important for rupture risk assessment and to allow an informed treatment decision to be made. Currently, 2D manual measures used to assess UIAs on Time-of-Flight magnetic resonance angiographies (TOF-MRAs) lack 3D information and there is substantial inter-observer variability for both aneurysm detection and assessment of aneurysm size and growth. 3D measures could be helpful to improve aneurysm detection and quantification but are time-consuming and would therefore benefit from a reliable automatic UIA detection and segmentation method. The Aneurysm Detection and segMentation (ADAM) challenge was organised in which methods for automatic UIA detection and segmentation were developed and submitted to be evaluated on a diverse clinical TOF-MRA dataset. A training set (113 cases with a total of 129 UIAs) was released, each case including a TOF-MRA, a structural MR image (T1, T2 or FLAIR), annotation of any present UIA(s) and the centre voxel of the UIA(s). A test set of 141 cases (with 153 UIAs) was used for evaluation. Two tasks were proposed: (1) detection and (2) segmentation of UIAs on TOF-MRAs. Teams developed and submitted containerised methods to be evaluated on the test set. Task 1 was evaluated using metrics of sensitivity and false positive count. Task 2 was evaluated using dice similarity coefficient, modified hausdorff distance (95 <sup>th</sup> percentile) and volumetric similarity. For each task, a ranking was made based on the average of the metrics. In total, eleven teams participated in task 1 and nine of those teams participated in task 2. Task 1 was won by a method specifically designed for the detection task (i.e. not participating in task 2). Based on segmentation metrics, the top two methods for task 2 performed statistically significantly better than all other methods. The detection performance of the top-ranking methods was comparable to visual inspection for larger aneurysms. Segmentation performance of the top ranking method, after selection of true UIAs, was similar to interobserver performance. The ADAM challenge remains open for future submissions and improved submissions, with a live leaderboard to provide benchmarking for method developments at https://adam.isi.uu.nl/.
Keywords
Challenge, Segmentation, Detection, Aneurysms, Angiography, Aneurysms, Angiography, Challenge, Detection, Segmentation
Pubmed
Web of science
Open Access
Yes
Create date
03/06/2021 12:47
Last modification date
21/11/2022 8:27
Usage data