AI digital twins using multimodal data to predict AD/ADRD and MCI in older adults

Awardee Organization(s): DreamFace Technologies LLC
Principal Investigator(s): Mohammad H. Mahoor, PhD
Official Project Title: Building Deep Digital Twins for Prediction of AD/ADR/MCI in Older Adults
AITC Partner: PennAITech
Website(s): https://dreamfacetech.com/

The Alzheimer’s Association predicts that the number of Americans aged 65 and older with Alzheimer’s disease-related dementia (ADRD) will reach over 12 million people by 2050. ADRD often stars with mild cognitive impairment (MCI), which is characterized by challenges in memory, language, and thinking skills. Early MCI detection is vital for identifying those at risk of dementia, offering support, advice, and ongoing monitoring. Currently, older adults with MCI are diagnosed clinically; however, their daily challenges are often not noticeable to those whom they encounter irregularly. Artificial Intelligence (AI) holds promise for early cognitive impairment detection, with many AI studies focusing on expensive clinical assessments and medical scans like positron emission tomography (PET) and MRI. There is a pressing need for additional research to advance innovative, cost-effective, and accessible approaches for early detection and prediction of AD and MCI. Human digital twins are at the forefront of aging and longevity research, aiming to create personalized AI models that comprehensively simulate an individual’s behavioral, biological, physical, mental, and socio-emotional attributes using health and medical records. These models hold the potential to revolutionize our understanding, prediction, and management of the aging process, offering personalized healthcare solutions. This pilot project aims to investigate AI techniques that leverage multi-modal audio-visual data, along with other available data modalities, to develop human digital twins for research in aging and, more specifically, for predicting MCI and the early onset of AD/ADRD. We design and implement a Deep Digital Twins (DDT) model using Conditional Variational Autoencoders (CVAEs) suitable for heterogeneous multi-modal data including speech, transcribed speech, and facial videos. We then evaluate the efficacy of the proposed model using publicly available datasets such as the I-CONECT and ADReSS datasets, which contain multi-modal data and other metadata suitable for our project. We hypothesize that DDTs trained using multi-modal comprehensive data can predict MCI/AD with high fidelity and accuracy compared to uni-modal data. We compare our proposed DDT with state-of-the-art models in the literature. We assess the models’ performance, taking into account the impact of diverse data to ensure they remain unbiased. The expected outcome of this research are knowledge and prototyped Deep Digital Twins capable of assessing and predicting MCI/AD conditions in older adults. It is expected that the DDTs generate the longitudinal trajectories sampled from the data as well as predict the subject’s future condition.

View Resource

AI-based device-free Wi-Fi sensing technology to assess daily activities and mobility in low-income older adults with and without cognitive impairment

Awardee Organization(s): Viginia Commonwealth University
Principal Investigator(s): Jane Chung, PhD, RN | Eyuphan Bulut, PhD | Ingrid Pretzer-Aboff, PhD, RN
Official Project Title: A Device Free WiFi Sensing System to Assess Daily Activities and Mobility in Low-Income Older Adults With and Without Cognitive Impairment
AITC Partner: PennAITech
Website(s):
https://nursing.vcu.edu
https://egr.vcu.edu

Low-income older adults face an increased risk of cognitive impairment and dementia. Cognitive impairment affects the ability to perform and manage daily activities and mobility behaviors. Detecting the changes in these abilities early is crucial but often difficult among low-income older adults due to limited resources. Our ultimate goal is to meet the unmet needs of low-income older adults by creating a cutting-edge system that uses Wi-Fi signals to localize and recognize different patterns of in-home activities and mobility. We will employ machine learning algorithms to process the Channel State Information of the collected Wi-Fi signals and extract different activity features. Our system will automatically categorize and quantify daily activities such as sitting, walking, meal preparation, watching TV, phone use, and leaving the home. Our project will gather Wi-Fi signal-based activity patterns and frequencies, selfreported physical function and psychosocial health data, and older adults’ feedback on technology acceptance and implementation. This innovative project aims to empower low-income older adults by harnessing the power of Wi-Fi sensing technology and machine learning to detect cognitive decline as early as possible. By providing an accessible and cost-effective solution, we can improve the lives of vulnerable older adults and enhance their brain health.

View Resource

AI-based diagnostic clinical decision support system using collective intelligence and imitation learning to improve primary care diagnostics for older adults

Awardee Organization(s): University of Pennsylvania
Principal Investigator(s): Gary Weissman, MD, MSHP
Official Project Title: Advancing Diagnostic Excellence for Older Adults Through Collective Intelligence and Imitation Learning
AITC Partner: PennAITech
Website(s): https://www.med.upenn.edu

Diagnostic errors are common in the primary care setting and lead to direct patient harms, increased healthcare costs, and decrease patient satisfaction. Older adults are especially at risk for such diagnostic errors because of their higher comorbidity burden, medical complexity, increased rates of frailty and cognitive impairment, and decreased representation in clinical datasets and research studies. Artificial intelligence (AI) and machine learning (ML) methods have good face validity for offering clinical decision support (CDS) in this setting to promote diagnostic excellence. However, there is little data to suggest that any particular diagnostic CDS is transparent, reproducible, equitable, and effective at improving the diagnostic process. Therefore, our objective is to create a diagnostic CDS system for use in primary care clinics to facilitate the diagnostic process, present suggestions about important features of the history and exam to consider that are tailored to patient characteristics, and promote diagnostic excellence for older adults. This proposal overcomes existing limitations to training diagnostic CDS systems in primary care where there is a broad diagnostic scope and tremendous clinical uncertainty around training labels. To accomplish this, we will rely on imitation learning and collective intelligence to build AI/ML models that provide predicted suggestions into diagnosis and tests based on expected behaviors from peer clinicians caring for similar patients. These models will be trained using existing data from the electronic health record and deployed in a pilot study across diverse primary care clinics to assess their diagnostic accuracy and acceptability to clinicians, patients, and their caregivers.

View Resource

AI-based home cognitive assessment to monitor AD/ADRD-related cognitive changes in older adults

Awardee Organization(s): Beth Israel Deaconess Medical Center
Principal Investigator(s): Daniel Press, MD
Official Project Title: Developing a Home Cognitive Vital Sign to Detect Cognitive Changes in AD
AITC Partner: PennAITech
Website(s): https://www.bidmc.org/daniel-press-laboratory

For the first time, patients with Early Alzheimer’s disease (AD) are beginning disease modifying therapies such as lecanemab in large numbers. With the advent of these therapies, there is a critical need to monitor their cognitive function more closely as they are both at risk for acute cognitive decline, caused by amyloid related imaging abnormality (ARIA), and for chronic decline, to accurately measure disease progression. Unfortunately, there are no clinical tools currently in use to monitor cognition daily at home. Such a tool could not only detect acute changes, such as from ARIA or delirium, but might also be able to accurately measure disease progression over longer time scales, to personalize therapies. We have designed a simple spatial working memory test, the SWiM test, a 1-minute task in the form of a “serious game” that can be performed daily at home and potentially measure disease progression. In addition, this test can act as a “cognitive vital sign”, allowing patients and their caregivers to monitor attentional ability daily to detect the cognitive changes that presage either symptomatic ARIA or delirium. We intend to assess the feasibility and the utility of the task in its first “at home” use in 25 patients with early AD, most in our Disease-modifying Immunotherapies for Alzheimer’s Disease (DiAD) program. Participants and their caregivers will perform the task daily for six months. We are using a combination of standard (Item Response Theory) analytics and advanced machine learning algorithms to assess patient performance.

View Resource

AI-driven AD/ADRD risk prediction models using explainable machine learning and bias identification and mitigation techniques to aid point-of-care clinical decision support

Awardee Organization(s): University of Virginia | University of Pennsylvania
Principal Investigator(s): Aidong Zhang, PhD | Carol Manning, PhD | Li Shen, PhD | Mary Regina Boland, PhD, MPhil
Official Project Title: Fairness and Robust Interpretability of Prediction Approaches for Aging and Alzheimer’s Disease
AITC Partner: PennAITech
Website(s):
https://engineering.virginia.edu
https://www.cs.virginia.edu/~az9eg/website/home.html
https://www.med.upenn.edu

Machine learning (ML) approaches have been increasingly used for facilitating clinical decision-making in Alzheimer’s Disease (AD) and AD related dementia (ADRD). However, recent research has shown that existing ML techniques are prone to unintentional biases towards protected attributes such as age, race, sex, gender, and/or ethnicity. Moreover, although deep learning (DL) models have been a great success in many applications including AD/ADRD prediction, DL models are usually expressed in a way that is not interpretable. Thus, ML approaches using health data may incur ethical and trustworthiness concerns that may result in the unfair treatment of patients. As decision-making systems for aging and AD/ADRD become popular, a major challenge is how to ethically integrate AI/ML methods into the lives of people, given that ethical principles may often be violated in existing methods. This has become an important issue for both the ML community and the AD/ADRD community. Moreover, ML approaches that are not transparent can be prone to repeating discriminatory patterns from prior data or generating new ones based on biased learned patterns. This project develops electronic health records (EHRs) based ML methods for Penn Medicine EHR AD/ADRD datasets that are fair, generalizable, and interpretable solutions that would help inform the clinician for AD/ADRD diagnosis and care management. We focus on studying fairness and interpretability, two important factors for making AI methods trustworthy, particularly during deployment or use of the methods. We study how bias affects our prediction models. Also, we will develop explainable methods to increase clinical interpretability.

View Resource

AI-enhanced virtual reality music intervention for AD/ADRD care

Awardee Organization(s): University of Tennessee, Knoxville
Principal Investigator(s): Xiaopeng Zhao, PhD
Official Project Title: MUSICARE-VR: Music Intervention with Virtual Reality for Alzheimer’s Care
AITC Partner: PennAITech
Website(s): https://mabe.utk.edu/

MUSICARE-VR is an innovative system that combines the benefits of music intervention with the connective power of virtual reality to improve the well-being of people with Alzheimer’s disease and related dementia (PwADRD). By providing engaging music sessions in a virtual environment, MUSICARE-VR aims to enhance cognitive function, physical activity, emotional positivity, and social connectedness among PwADRD, especially those living in isolation. The system will be developed using cutting-edge virtual reality technologies. PwADRD will participate in personalized, interactive music activities led by skilled music therapists, fostering a sense of achievement and encouraging repeated engagement. A key feature of MUSICARE-VR is the integration of artificial intelligence (AI), which will adapt music interventions in real-time based on users’ emotional and physiological responses, ensuring an engaging and effective experience. AI-powered virtual agents will also join the sessions, enhancing social interactions and overall engagement. To ensure the system’s success, MUSICARE-VR will be developed through a user-centered, iterative design process. The feasibility and acceptance of the system will be evaluated among PwADRD and their caregivers, with a focus on usability, engagement metrics, and participant feedback. By combining music intervention, virtual reality, and AI, MUSICARE-VR promises to be a groundbreaking tool for improving the quality of life of PwADRD and their caregivers.

View Resource

AI-enhanced wearable for continuous blood pressure monitoring to improve cardiovascular health in older adults

Awardee Organization(s): PyrAmes Inc.
Principal Investigator(s): Xina Quan, PhD
Official Project Title: Improved Algorithms for Wearable Blood Pressure Monitoring for Older Adults
AITC Partner: PennAITech
Website(s): https://pyrameshealth.com/

Older adults with high blood pressure (BP) are at increased risk of severe health concerns, e.g. heart disease, congestive heart failure, ischemic stroke, cerebral hemorrhage, vascular dementia and Alzheimer’s disease. Frequent measurements improve BP control, leading to improved outcomes.
A significant barrier to BP control is obtaining sufficient measurements for effective management. Continuous monitoring with invasive arterial lines is limited to critical care facilities. Periodic cuff measurements through ambulatory BP monitoring provide an indication of BP variation, but devices are cumbersome and uncomfortable, leading to incorrect or insufficient usage.
A more convenient, cost-effective BP monitoring method providing passive measurements and actionable information potentially leads to reduced risk from cardiovascular disease. PyrAmes has developed a comfortable, easy-to-use sensor band to monitor BP, enabling long-term, personalized BP management. It is soft, flexible, and lightweight, and has been validated for use with patients with fragile skin. Our innovative approach uses patented capacitive sensors to capture pulse waveform data, which is processed on a connected mobile device with neural networks to accurately determine BP values and provide detailed information about cardiovascular health.
Our first device, Boppli®, was FDA-cleared in 2023 for continuously monitoring the BP of critically-ill neonates. Our adult monitor uses identical sensors and validated software infrastructure and has shown initial feasibility. This project accelerates development for the older adult population, leading to FDA clearance and commercialization.
Our technology has the potential to become as ubiquitous for BP measurement as pulse oximeters are today, due to its accuracy, convenience, and ease of use.

View Resource

AI-powered point-of-care system for motor function assessment to determine MCI, frailty, and fall risk

Awardee Organization(s): University of Missouri
Principal Investigator(s): Trent M. Guess, PhD
Official Project Title: Motor Function Assessment for Mild Cognitive Impairment, Frailty, and Fall Risk
AITC Partner: PennAITech
Website(s):

Homepage


https://mizzoumotioncenter.com/

Fall risk, mild cognitive impairment (MCI), and frailty are three interrelated health conditions that diminish quality of life for older adults and put them at higher risk for adverse outcomes, including hospitalization, disability, and death. A common characteristic shared by these conditions is a decline in motor function, most often manifested by degradation in balance and gait performance. Comprehensive early detection of motor declines may offer our best chance of addressing these geriatric conditions. While there is growing interest in using sensors to measure movement and balance, currently available technologies are prohibitively expensive or do not capture multiple aspects of movement. As a solution, we have developed the Mizzou Point-of-Care Assessment System (MPASS), which integrates measurements from multiple sensors to provide an objective, comprehensive dataset of human movement and cognitive performance. The total cost of the testing platform is under $1,500 and MPASS motor function assessments typically take less than 15 minutes. Our goal is to integrate the MPASS with artificial intelligence (AI) approaches to translate the system into a clinically effective tool that quickly, affordably, and accurately assesses risk for falling, MCI, and frailty, in real-world clinical and community settings. Specifically, we will collect data on MPASS motor function, cognitive testing, fall history, and frailty for 30 persons with MCI and 50 community dwelling adults. We will then employ AI to develop prediction algorithms that distinguish persons with MCI, fall risk, and frailty. Finally, we will develop clinically usable outputs based on the prediction algorithms.

View Resource

AI-powered web app using computer vision to analyze knee joint space in older adults using only plain radiographs

Awardee Organization(s): University of Georgia
Principal Investigator(s): Soheyla Amirian, PhD
Official Project Title: AI-Powered Web Application to Analyze Knee Joint Space for Aging Population
AITC Partner: PennAITech
Website(s): https://engineering.uga.edu/team_member/soheyla-amirian/

Osteoarthritis (OA) stands as a prevailing chronic joint affliction, affecting millions of individuals globally, particularly those aged 65 or older. We propose the development of an innovative AI-powered web application, tailored to facilitate the monitoring and analysis of knee joint space, and by extension, the progression of knee OA. This web application will serve as a beacon of hope for aging individuals suffering from the burden of knee OA. By building, training, and validating deep learning computer vision algorithm, we aim to empower patients, their caregivers, and healthcare providers with an intuitive and cost-effective solution. Our overarching goal is thus to provide a platform that allows for the quantitative and longitudinal assessment of knee joint space, thereby enhancing our understanding of the degeneration process in the aging knee. Beyond the technical intricacies, our mission is deeply rooted in delivering a solution that is accessible to those who need it the most. This technology will bridge geographical distances, transcending traditional healthcare limitations and opening new avenues for remote patient care. As we delve into the specific aims of this project, it is vital to underscore the potential impact it holds for individuals afflicted by knee OA, the individuals who care for them, and the healthcare professionals committed to their well-being. The specific aims are: (1) To develop an AI-powered web application to quantitatively assess and analyze knee joint space using only plain radiographs.Osteoarthritis (OA) stands as a prevailing chronic joint affliction, affecting millions of individuals globally, particularly those aged 65 or older. We propose the development of an innovative AI-powered web application, tailored to facilitate the monitoring and analysis of knee joint space, and by extension, the progression of knee OA. This web application will serve as a beacon of hope for aging individuals suffering from the burden of knee OA. By building, training, and validating deep learning computer vision algorithm, we aim to empower patients, their caregivers, and healthcare providers with an intuitive and cost-effective solution. Our overarching goal is thus to provide a platform that allows for the quantitative and longitudinal assessment of knee joint space, thereby enhancing our understanding of the degeneration process in the aging knee. Beyond the technical intricacies, our mission is deeply rooted in delivering a solution that is accessible to those who need it the most. This technology will bridge geographical distances, transcending traditional healthcare limitations and opening new avenues for remote patient care. As we delve into the specific aims of this project, it is vital to underscore the potential impact it holds for individuals afflicted by knee OA, the individuals who care for them, and the healthcare professionals committed to their well-being. The specific aims are: (1) To develop an AI-powered web application to quantitatively assess and analyze knee joint space using only plain radiographs. (2) To establish a prospective adult cohort with knee OA to clinically validate the AI-powered web application.

View Resource

Auto_ML

Auto_ML is a Python-based library designed to automate the whole machine learning process. It focuses on simplifying the model selection, feature engineering, hyperparameter tuning, data formatting, robust scaling and analytics. It supports binary and multiclass classification, regression, linear-model-esque interpretation from non-linear models, feature learning, and categorical ensembling. The package includes traditional models, as well as deep learning models, gradient boost models, and catboost models.

Link: https://pypi.org/project/auto_ml/

View Resource