Cerebral Aneurysm Detection and Analysis Challenge 2020 (CADA)

Rupture of an intracranial aneurysm often results in subarachnoid hemorrhage, a life-threatening condition with high mortality and morbidity. The Cerebral Aneurysm Detection and Analysis (CADA) competition was organized to support the development and benchmarking of algorithms for the detection, analysis, and risk assessment of cerebral aneurysms in X-ray rotational angiography (3DRA) images. 109 anonymized 3DRA datasets were provided for training, and 22 additional datasets were used to test the algorithmic solutions. Cerebral aneurysm detection was assessed using the F2 score based on recall and precision, and the fit of the delivered bounding box was assessed using the distance to the aneurysm. Segmentation quality was measured using Jaccard and a combination of different surface distance measurements. Systematic errors were analyzed using volume correlation and bias. Rupture risk assessment was evaluated using the F2 score. 158 participants from 22 countries registered for the CADAchallenge. The detection solutions presented by the community are mostly accurate (F2 score 0.92) with a small number of missed aneurysms with diameters of 3.5 mm. In addition, the delineation of these structures is very good with a Jaccard score of 0.915. The rupture risk estimation methods achieved an F2 score of 0.7. The performance of the detection and segmentation solutions is equivalent to that of human experts. In rupture risk estimation, the best results are obtained by combining different image-based, morphological and computational fluid dynamic parameters using machine learning methods.