English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Preprint

Cascaded multimodal deep learning in the differential diagnosis, progression prediction, and staging of Alzheimer's and frontotemporal dementia

MPS-Authors
/persons/resource/persons71665

Valk,  Sofie L.       
Otto Hahn Group Cognitive Neurogenetics, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons19872

Mueller,  Karsten
Method and Development Group Neural Data Science and Statistical Computing, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons277751

Wu,  Qiong
Department Neurology, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons227150

Babayan,  Anahit       
Department Neurology, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons20065

Villringer,  Arno       
Department Neurology, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons201756

Scherf,  Nico       
Method and Development Group Neural Data Science and Statistical Computing, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

/persons/resource/persons19981

Schroeter,  Matthias L.       
Department Neurology, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

Guarnier_pre.pdf
(Preprint), 2MB

Supplementary Material (public)
There is no public supplementary material available
Citation

Guarnier, G., Reinelt, J., Molloy, E. N., Mihai, P. G., Einaliyan, P., Valk, S. L., et al. (2024). Cascaded multimodal deep learning in the differential diagnosis, progression prediction, and staging of Alzheimer's and frontotemporal dementia. medRxiv. doi:10.1101/2024.09.23.24314186.


Cite as: https://hdl.handle.net/21.11116/0000-000F-F5C6-D
Abstract
Dementia syndromes are complex sequelae whose multifaceted nature poses significant challenges in the diagnosis, prognosis, and treatment of patients. Despite the availability of large open-source data fueling a wealth of promising research, effective translation of preclinical findings to clinical practice remains difficult. This barrier is largely due to the complexity of unstructured and disparate preclinical and clinical data, which traditional analytical methods struggle to handle. Novel analytical techniques involving Deep Learning (DL), however, are gaining significant traction in this regard. Here, we have investigated the potential of a cascaded multimodal DL-based system (TelDem), assessing the ability to integrate and analyze a large, heterogeneous dataset (n=7159 patients), applied to three clinically relevant use cases. Using a Cascaded Multi-Modal Mixing Transformer (CMT), we assessed TelDems validity and (using a Cross Modal Fusion Norm - CMFN) model explainability in (i) differential diagnosis between healthy individuals, AD, and three sub-types of frontotemporal lobar degeneration (ii) disease staging from healthy cognition to mild cognitive impairment (MCI) and AD, and (iii) predicting progression from MCI to AD. Our findings show that the CMT enhances diagnostic and prognostic accuracy when incorporating multimodal data compared to unimodal modeling and that cerebrospinal fluid (CSF) biomarkers play a key role in accurate model decision making. These results reinforce the power of DL technology in tapping deeper into already existing data, thereby accelerating preclinical dementia research by utilizing clinically relevant information to disentangle complex dementia pathophysiology.