Accuracy of Machine Learning Algorithms for the Diagnosis of Autism Spectrum Disorder: Systematic Review and Meta-Analysis of Brain Magnetic Resonance Imaging Studies

dc.contributor.authorMoon, Sun Jae
dc.contributor.authorHwang, Jinseub
dc.contributor.authorKana, Rajesh
dc.contributor.authorTorous, John
dc.contributor.authorKim, Jung Won
dc.contributor.otherEwha Womans University
dc.contributor.otherDaegu University
dc.contributor.otherUniversity of Alabama Tuscaloosa
dc.contributor.otherHarvard University
dc.contributor.otherBeth Israel Deaconess Medical Center
dc.contributor.otherHarvard Medical School
dc.contributor.otherUniversity of Alabama Birmingham
dc.date.accessioned2023-09-28T20:40:08Z
dc.date.available2023-09-28T20:40:08Z
dc.date.issued2019
dc.description.abstractBackground: In the recent years, machine learning algorithms have been more widely and increasingly applied in biomedical fields. In particular, their application has been drawing more attention in the field of psychiatry, for instance, as diagnostic tests/tools for autism spectrum disorder (ASD). However, given their complexity and potential clinical implications, there is an ongoing need for further research on their accuracy. Objective: This study aimed to perform a systematic review and meta-analysis to summarize the available evidence for the accuracy of machine learning algorithms in diagnosing ASD. Methods: The following databases were searched on November 28, 2018: MEDLINE, EMBASE, CINAHL Complete (with Open Dissertations), PsycINFO, and Institute of Electrical and Electronics Engineers Xplore Digital Library. Studies that used a machine learning algorithm partially or fully for distinguishing individuals with ASD from control subjects and provided accuracy measures were included in our analysis. The bivariate random effects model was applied to the pooled data in a meta-analysis. A subgroup analysis was used to investigate and resolve the source of heterogeneity between studies. True-positive, false-positive, false-negative, and true-negative values from individual studies were used to calculate the pooled sensitivity and specificity values, draw Summary Receiver Operating Characteristics curves, and obtain the area under the curve (AUC) and partial AUC (pAUC). Results: A total of 43 studies were included for the final analysis, of which a meta-analysis was performed on 40 studies (53 samples with 12,128 participants). A structural magnetic resonance imaging (sMRI) subgroup meta-analysis (12 samples with 1776 participants) showed a sensitivity of 0.83 (95% CI 0.76-0.89), a specificity of 0.84 (95% CI 0.74-0.91), and AUC/pAUC of 0.90/0.83. A functional magnetic resonance imaging/deep neural network subgroup meta-analysis (5 samples with 1345 participants) showed a sensitivity of 0.69 (95% CI 0.62-0.75), specificity of 0.66 (95% CI 0.61-0.70), and AUC/pAUC of 0.71/0.67. Conclusions: The accuracy of machine learning algorithms for diagnosis of ASD was considered acceptable by few accuracy measures only in cases of sMRI use; however, given the many limitations indicated in our study, further well-designed studies are warranted to extend the potential use of machine learning algorithms to clinical settings.en_US
dc.format.mediumelectronic
dc.format.mimetypeapplication/pdf
dc.identifier.citationMoon, S. J., Hwang, J., Kana, R., Torous, J., & Kim, J. W. (2019). Accuracy of machine learning algorithms for the diagnosis of autism spectrum disorder: Systematic review and meta-analysis of brain magnetic resonance imaging studies. JMIR Mental Health, 6(12), e14108. https://doi.org/10.2196/14108
dc.identifier.doi10.2196/14108
dc.identifier.orcidhttps://orcid.org/0000-0003-3786-6935
dc.identifier.orcidhttps://orcid.org/0000-0002-5278-4260
dc.identifier.orcidhttps://orcid.org/0000-0002-5362-7937
dc.identifier.orcidhttps://orcid.org/0000-0002-8329-1493
dc.identifier.urihttps://ir.ua.edu/handle/123456789/11735
dc.languageEnglish
dc.language.isoen_US
dc.publisherJMIR
dc.subjectautism spectrum disorder
dc.subjectmachine learning
dc.subjectsensitivity and specificity
dc.subjectsystematic review
dc.subjectmeta-analysis
dc.subjectOPERATING CHARACTERISTIC CURVE
dc.subjectCLASSIFICATION
dc.subjectNETWORK
dc.subjectCONNECTIVITY
dc.subjectCHILDREN
dc.subjectMRI
dc.subjectPsychiatry
dc.titleAccuracy of Machine Learning Algorithms for the Diagnosis of Autism Spectrum Disorder: Systematic Review and Meta-Analysis of Brain Magnetic Resonance Imaging Studiesen_US
dc.typeReview
dc.typetext
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
10.219614108.pdf
Size:
387.22 KB
Format:
Adobe Portable Document Format