Assessing the Performance of Artificial Intelligence Models: Insights from the American Society of Functional Neuroradiology Artificial Intelligence Competition

References

1. 1.↵
   1. Lui YW,
   2. Chang PD,
   3. Zaharchuk G, et al

   . Artificial intelligence in neuroradiology: current status and future directions. AJNR Am J Neuroradiol 2020;41:E52–59 doi:10.3174/ajnr.A6681 pmid:32732276

   Abstract/FREE Full Text
2. 2.↵
   1. Kim DW,
   2. Jang HY,
   3. Kim KW, et al

   . Design characteristics of studies reporting the performance of artificial intelligence algorithms for diagnostic analysis of medical images: results from recently published papers. Korean J Radiol 2019;20:405–10 doi:10.3348/kjr.2019.0025 pmid:30799571

   CrossRefPubMed
3. 3.↵
   1. Yu AC,
   2. Mohajer B,
   3. Eng J

   . External validation of deep learning algorithms for radiologic diagnosis: a systematic review. Radiol Artif Intell 2022;4:e210064 doi:10.1148/ryai.210064 pmid:35652114

   CrossRefPubMed
4. 4.↵
   1. Armato S,
   2. Drukker K,
   3. Hadjiiski L

   . AI in medical imaging grand challenges: translation from competition to research benefit and patient care. Br J Radiol 2023;96:20221152 doi:10.1259/bjr.20221152 pmid:37698542

   CrossRefPubMed
5. 5.↵
   1. Duhaime AC,
   2. Gean AD,
   3. Haacke EM, et al

   ; Common Data Elements Neuroimaging Working Group Members. Pediatric Working Group Members. Common data elements in radiologic imaging of traumatic brain injury. Arch Phys Med Rehab 2010;91:1661–66 doi:10.1016/j.apmr.2010.07.238 pmid:21044709

   CrossRefPubMed
6. 6.↵
   1. McHugh ML

   . Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 2012;22:276–82 doi:10.11613/BM.2012.031 pmid:23092060

   CrossRefPubMedWeb of Science
7. 7.↵
   1. Duggan GE,
   2. Reicher JJ,
   3. Liu Y, et al

   . Improving reference standards for validation of AI-based radiography. Br J Raediol 2021;94:20210435 doi:10.1259/bjr.20210435 pmid:34142868

   CrossRefPubMed
8. 8.↵
   1. Chin C-L,
   2. Lin BJ,
   3. Wu GR, et al

   . An automated early ischemic stroke detection system using CNN deep learning algorithm. In: Proceedings of the 2017 IEEE 8th International Conference on Awareness Science and Technology (iCAST). November 8–10, 2017. Taichan, Taiwan; 368–72 doi:10.1109/ICAwST.2017.8256481

   CrossRef
9. 9.↵
   1. Agarwal S,
   2. Wood D,
   3. Grzeda M, et al

   . Systematic review of artificial intelligence for abnormality detection in high-volume neuroimaging and subgroup meta-analysis for intracranial hemorrhage detection. Clin Neuroradiol 2023;33:943–56 doi:10.1007/s00062-023-01291-1 pmid:37261453

   CrossRefPubMed
10. 10.↵
    1. Daugaard Jørgensen M,
    2. Antulov R,
    3. Hess S, et al

    . Convolutional neural network performance compared to radiologists in detecting intracranial hemorrhage from brain computed tomography: a systematic review and meta-analysis. Eur J Radiol 2022;146:110073 doi:10.1016/j.ejrad.2021.110073 pmid:34847397

    CrossRefPubMed
11. 11.↵
    1. Chilamkurthy S,
    2. Ghosh R,
    3. Tanamala S, et al

    . Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet 2018;392:2388–96 doi:10.1016/S0140-6736(18)31645-3 pmid:30318264

    CrossRefPubMed
12. 12.↵
    1. Meyer JS,
    2. Takashima S,
    3. Terayama Y, et al

    . CT changes associated with normal aging of the human brain. J Neurol Sci 1994;123:200–08 doi:10.1016/0022-510x(94)90224-0 pmid:8064316

    CrossRefPubMed
13. 13.↵
    1. Cauley KA,
    2. Hu Y,
    3. Fielden SW

    . Aging and the brain: a quantitative study of clinical CT images. AJNR Am J Neuroradiol 2020;41:809–14 doi:10.3174/ajnr.A6510 pmid:32327433

    Abstract/FREE Full Text
14. 14.↵
    1. Baecker L,
    2. Garcia-Dias R,
    3. Vieira S, et al

    . Machine learning for brain age prediction: introduction to methods and clinical applications. eBioMedicine 2021;72:103600 doi:10.1016/j.ebiom.2021.103600 pmid:34614461

    CrossRefPubMed
15. 15.↵
    1. Lee J,
    2. Burkett BJ,
    3. Min H-K, et al

    . Deep learning-based brain age prediction in normal aging and dementia. Nat Aging 2022;2:412–24 doi:10.1038/s43587-022-00219-7 pmid:37118071

    CrossRefPubMed
16. 16.↵
    1. Cumplido-Mayoral I,
    2. García-Prat M,
    3. Operto G, et al

    ; OASIS study. Biological brain age prediction using machine learning on structural neuroimaging data: multi-cohort validation against biomarkers of Alzheimer’s disease and neurodegeneration stratified by sex. eLife 2023;12:e81067 doi:10.7554/eLife.81067 pmid:37067031

    CrossRefPubMed
17. 17.↵
    1. Jonsson BA,
    2. Bjornsdottir G,
    3. Thorgeirsson TE, et al

    . Brain age prediction using deep learning uncovers associated sequence variants. Nat Commun 2019;10:5409 doi:10.1038/s41467-019-13163-9 pmid:31776335

    CrossRefPubMed
18. 18.↵
    1. Wood DA,
    2. Kafiabadi S,
    3. Busaidi AA, et al

    . Accurate brain-age models for routine clinical MRI examinations. Neuroimage 2022;249:118871 doi:10.1016/j.neuroimage.2022.118871 pmid:34995797

    CrossRefPubMed
19. 19.↵
    1. Bermudez C,
    2. Plassard AJ,
    3. Chaganti S, et al

    . Anatomical context improves deep learning on the brain age estimation task. Magn Reson Imaging 2019;62:70–77 doi:10.1016/j.mri.2019.06.018 pmid:31247249

    CrossRefPubMed
20. 20.↵
    1. Cellina M,
    2. Cè M,
    3. Irmici G, et al

    . Artificial intelligence in emergency radiology: where are we going? Diagnostics (Basel) 2022;12:3223v doi:10.3390/diagnostics12123223

    CrossRefPubMed
21. 21.↵
    1. Guo J,
    2. Li B

    . The application of medical artificial intelligence technology in rural areas of developing countries. Health Equity 2018;2:174–81 doi:10.1089/heq.2018.0037 pmid:30283865

    CrossRefPubMed
22. 22.↵
    1. Flanders AE,
    2. Prevedello LM,
    3. Shih G, et al

    ; RSNA-ASNR 2019 Brain Hemorrhage CT Annotators. Construction of a Machine Learning Dataset through Collaboration: the RSNA 2019 Brain CT Hemorrhage Challenge. Radiol Artif Intell 2020;2:e190211 doi:10.1148/ryai.2020190211 pmid:33937827

    CrossRefPubMed