A multi-task learning framework for AD assessment: Hybrid attention and multimodal representation. Credit: Yang Lizhuang
A multi-task learning framework, DEMENTIA, has been developed by Prof. Li Hai and his team at the Hefei Institutes of Physical Science of the Chinese Academy of Sciences, to improve the early detection and assessment of Alzheimer’s disease (AD). The research was recently published in the IEEE Journal of Biomedical and Health Informatics.
As the global population ages, AD is becoming increasingly prevalent, making early detection critical for improving patient outcomes. Language decline is often one of the earliest indicators of cognitive decline. While automated speech analysis offers a non-invasive and cost-effective approach to detecting AD, existing methods face significant challenges, including complexity, poor interpretability, and limited integration of diverse data types, which hinder accuracy and clinical applicability.
To overcome these limitations, Prof. Li Hai’s team developed the DEMENTIA framework. This innovative approach integrates speech, text, and expert knowledge using a hybrid attention mechanism, significantly enhancing both the accuracy and clinical interpretability of AD detection.
Leveraging advanced large language model technologies, the framework captures intricate intra- and inter-modal interactions, improving detection accuracy and enabling the prediction of cognitive function scores.
Furthermore, comprehensive interpretability analyses demonstrated the model’s robust clinical decision-support capabilities and its adaptability across diverse datasets.
The findings underscore the potential of speech-based tools for early AD screening and monitoring cognitive decline. By providing a more accurate and interpretable solution, the DEMENTIA framework holds significant promise for addressing the challenges posed by an aging population, offering both scientific and societal value.
More information:
Zhenglin Zhang et al, DEMENTIA: A Hybrid Attention-Based Multimodal and Multi-Task Learning Framework With Expert Knowledge for Alzheimer’s Disease Assessment From Speech, IEEE Journal of Biomedical and Health Informatics (2024). DOI: 10.1109/JBHI.2024.3509620
Provided by
Chinese Academy of Sciences
Citation:
Innovative voice-based approach enables early detection of Alzheimer’s disease (2025, January 27)
retrieved 27 January 2025
from https://medicalxpress.com/news/2025-01-voice-based-approach-enables-early.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.
