You can download our latest newsletter here. We are launching our webinar series for this academic year. The purpose of this webinar is to foster a dialogue exploring clinical, ethical and technological opportunities and challenges associated with the use of technology to promote aging, and to introduce different perspectives at the intersection of informatics and gerontology.
View ResourcePennAITech Resources
The overarching goal of the Technology Identification and Training Core is to use evidence from the literature, stakeholder and expert inputs to identify the technology needs of older Americans, as well as develop training activities for artificial intelligence (AI) and technology for scientists, engineers, clinicians, medical professionals, patients, policy makers, and investors.
View ResourcePennAITech Youtube Channel
The overarching goal of the Penn Artificial Intelligence and Technology (PennAITech) Collaboratory for Healthy Aging is to identify, develop, evaluate, commercialize, and disseminate innovative technology and artificial intelligence (AI) methods and software to support older adults and those with Alzheimer’s Disease (AD) and Alzheimer’s Disease and Related Dementias (ADRD) in their home environment. The Collaboratory is motivated by the need for a comprehensive pipeline from technology-based monitoring of older adults in the home, collection and processing monitoring data, integration of those data with clinical data from electronic health records, analysis with cutting-edge AI methods and software, and deployment of validated AI models at point of care for decision support. We share PennAITech videos (e.g., webinars, call for applications) in this youtube channel.
View ResourcePredicting depression and burden in AD/ADRD caregivers by using machine learning to analyze clinician–caregiver interactions
Awardee Organization(s): University of Pennsylvania
Principal Investigator(s): Nancy A. Hodgson, PhD, RN, FAAN
Official Project Title: Using AI to predict depression & burden AD/ADRD caregiving conversations
AITC Partner: PennAITech
Website(s): https://www.nursing.upenn.edu/live/profiles/7116-nancy-hodgson
Clear communication between clinicians and caregivers of people living with dementia (PLWD) is essential to delivering quality dementia care. Objective, empirical assessment of these clinical communications can support the timely evaluation and management of care needs for PLWD and their caregivers but is currently too time-consuming and prone to clinician bias.
This is a secondary analysis of data collected during an implementation study evaluating the translation of an evidence-based dementia program. Conversational speech data from 125 hour-long (on average) sessions between clinicians and dementia caregivers along with repeat assessments of caregiver depression and burden will be leveraged to predict clinically meaningful treatment outcomes, (caregiver burden, depression and PLWD healthcare utilization) via a machine learning (ML) model.
The study aims to: 1) use an ML model to identify patterns in clinical conversations linked to dementia caregiver depression and burden, 2) detect patterns predicting PLWD healthcare utilization (e.g., 911 calls, hospitalizations) and 3) analyze ML outputs to enable early, targeted interventions. This third aim will be guided by an advisory group of healthcare providers and dementia caregivers. The results will demonstrate the potential of ML and data science to improve health outcomes for over 11 million U.S. dementia caregivers. The long-term goal is to develop a scalable technology-based intervention to address caregiver depression and burden, reduce costly care, and enhance quality of life.
Radio frequency-based off-body real-time remote monitoring of medication adherence for older adults
Awardee Organization(s): etectRx
Principal Investigator(s): Tony C. Carnes, PhD
Official Project Title: Real-Time Remote Monitoring of Confirmed Medication Adherence
AITC Partner: PennAITech
Website(s): https://etectrx.com
Medication non-adherence is responsible for up to $300 billion of avoidable healthcare costs in the United States with patients over 60 years of age consuming 50% of dispensed prescription drugs. This project enables real-time, remote monitoring of medication ingestions and enhances patient and caregiver feedback to help patients stay adherent and thus extend the time they are able to age grace fully at home.
The existing FDA-cleared IDCap system detects ingested medication signals using a watch or lanyard-style reader worn by the patient and forwards information to a server through an app on a patient’s smart phone. In this proposal we are looking to remove the individuals’ worn reader from the system and replace it with a series of readers placed in multiple locations in a person’s home to ensure ingestion detection without the user changing their usual behavior. Additionally, the new readers will interface with Alexa to facilitate audible and visual reminders and confirmations of medication ingestion. If the end user allows, remote care providers will be able to participate in the adherence journey and intervene when needed.
Smart patch and intervention system using RFID technology to prevent medical patch overdose among individuals with AD/ADRD
Awardee Organization(s): Vaaji LLC
Principal Investigator(s): Sandeep Patil, MD, PhD | William Z. Potter, MD, PhD
Official Project Title: Prevention of Patch Poisoning in Elderly Alzheimer’s Patients
AITC Partner: PennAITech
Website(s): https://vaaji.io
Patients with Alzheimer’s are prone to medication errors with serious consequences. Some errors, however, may be preventable if detected early. This project will develop smart patch technology to track errors in real time to prevent adverse outcomes.
Fatalities or emergency hospitalizations can occur due to transdermal patch overdose/poisoning by placing more than the prescribed number on the body. Transdermal therapies typically have excess drug over what is intended to be delivered during the period when the patch is specified to be on body. Thus, an overdose can also happen if a new patch is placed without removing the older patch. A wide range of overdose symptoms occur with most commonly used drugs [cholinergic drug patch(s)] for Alzheimer’s. In severe cases, these include rapid dehydration, and renal failure, and/or low heart rate potentially leading to sudden cardiac arrest and death.
Early detection of one or more excess patches AND prompt removal within a defined period protects against effects of overdose. A prototype patch(s) will be built with a signaling tag that can be easily detected by a fixed reader. We will then assess the performance of this prototype patch system as Healthy Volunteers move freely in different sections of the Home Care Suite. Successful implementation of this technology will contribute to healthy aging at home and improve the well-being of the patients and their caregivers.
Smartphone app using heuristic AI to help caregivers prioritize and manage neuropsychiatric symptoms of AD/ADRD
Awardee Organization(s): New York University Rory Meyers College of Nursing
Principal Investigator(s): Ab Brody, PhD, RN, FAAN
Official Project Title: Aliviado Dementia Care Machine Learning Algorithm Development for Caregiving
AITC Partner: PennAITech
Website(s):
https://www.aliviado.org
http://nursing.nyu.edu
https://www.hign.org
Care partners (CP) of persons living with dementia (PLWD) provide crucial support and find significant meaning in the care they provide. They show compassion to those they are caring for, and resilience in the face of adversity. Yet, many CP lack high-quality, evidence-based guidance for addressing care needs of PLWD. One key area that is often challenging to CP, yet where they have little support, is in addressing neuropsychiatric symptoms (NPS) such as agitation or wandering. Most PLWD experience more than one NPS at a time and thus not only do CP lack support in managing these symptoms, they don’t know which symptom to focus on first to reduce their burden and improve the quality of life of the PLWD. This is particularly true in underserved and marginalized communities who are less likely to have access to comprehensive dementia care or supportive services. Higher NPS, particularly in marginalized CP, greatly increases the risk of CP burden, physical and mental health challenges. To help CP make decisions about what NPS to prioritize, we will use artificial intelligence/machine learning (AI/ML) to develop a precision clinical decision support algorithm to assist CP in prioritizing which NPS to treat. The algorithm will be inserted into a user-friendly smartphone application which CP can download through the iOS or Android app store. The app will increase access to high-quality dementia support, empower CP to better manage NPS and improve the quality of life for both themselves and the PLWD.
View ResourceSpeech processing-based novel algorithm for proactive, automated screening of African American home healthcare patients at risk for MCI and early dementia
Awardee Organization(s): VNS Health | Columbia University Irving Medical Center
Principal Investigator(s): Maryam Zolnoori, PhD
Official Project Title: A Speech-Processing Algorithm for Automatic Screening of African American Patients with Mild Cognitive Impairment and Early Dementia in Home Health Settings
AITC Partner: PennAITech
Website(s):
https://www.cuimc.columbia.edu
http://vnshealth.org
Mild cognitive impairment (MCI) and early-stage dementia (ED) are prevalent concerns, impacting one-in-five adults over age 60. Alarmingly, a significant percentage of these cases remain undiagnosed, leading to missed timely interventions. Our data emphasizes that African American seniors are particularly vulnerable, with existing disparities in healthcare access, biases, and varying health literacy levels exacerbating the situation. A novel observation we intend to leverage is the correlation between linguistic shifts and the onset of cognitive issues. Language, a foundational element of cognition, exhibits early perturbations during cognitive decline. The nuances of these changes can vary across racial boundaries, influenced by dialectic variations such as African American Vernacular English. In this pivotal study, our objective is to architect a diagnostic tool to detect nascent signs of MCI-ED by analyzing African American patients’ verbal communications during regular health consultations. By meticulously recording, processing, and extracting linguistic and phonetic features from these conversations, complemented by additional clinical data, we aim to devise a potent screening algorithm. This initiative aligns seamlessly with the National Institute on Aging’s focus on early identification of cognitive impairment in the elderly. The prospective outcome, an innovative algorithm, holds promise to enhance timely MCI-ED diagnosis efficacy, especially among African American individuals, thereby optimizing care quality and addressing longstanding disparities.
View ResourceUsing a human-centered approach to design, build, and evaluate conversational care technologies that scaffold meaningful care discussions between older adults and their informal caregivers
Awardee Organization(s): University of Michigan
Principal Investigator(s): Robin Brewer, PhD
Official Project Title: Conversational Care Technologies
AITC Partner: PennAITech
Website(s): www.umich.edu, www.si.umich.edu
This project focuses on designing and developing conversational care technologies for older adults and their caregivers. In prior work, we surveyed informal caregivers and older adult care receivers to understand their care routines. Survey findings showed how nearly 20% of care partners used voice assistants in their homes, signaling an opportunity to extend research on older adults’ conversational technology use to include care partners. Next, we conducted a diary study and interviews with caregivers and care receivers to investigate gaps in care interactions and conversations. We found that care receivers experienced more communication frustrations than caregivers and that older adult caregivers wanted more opportunities to influence their care routines.
In this project, we will use these findings to develop in-home conversational technologies that use prompts to structure care conversations between older adults and their caregivers.
We contribute a nuanced dyadic perspective to care relationships as most care research focuses solely on caregiver perspectives. We also extend conversational technology research beyond information seeking to include more social uses by developing conversational technology applications with mainstream voice technologies (e.g., Amazon Alexa) to support improved care relationships, social and emotional well-being, and quality of life.
Using AI-powered digital twins for personalized chronic care coordination and healthy aging for older adults
Awardee Organization(s): Health Tequity LLC
Principal Investigator(s): Katherine Kim, PhD, MPH, MBA
Official Project Title: A novel digital twin for chronic care coordination and healthy aging
AITC Partner: PennAITech
Website(s): www.HealthTequity.net
Chronic illnesses such as diabetes and hypertension challenge goals of healthy aging, with burdens on individuals, family caregivers, and the healthcare system. Uncontrolled chronic illnesses are a risk factor for cognitive decline, Alzheimer’s disease and related dementias, and frailty. We need solutions for older adults to age with independence, to lead healthier lives, and to maintain access to their healthcare services when needed. The questions we want to answer are: What are all the possible behavioral, lifestyle, and medical treatment options for people with chronic illness? When and how should those interventions be rolled-out for the best outcomes over time as people age (trajectories)? How could you weigh all the potential scenarios and make the best decisions?
We use data from remote monitoring, clinical care, and healthcare utilization, to develop Health Digital Twins (HDTs) for community-dwelling older adults with diabetes and/or hypertension and insights for both the individual and healthcare providers. Digital twins can be defined as (physical and/or virtual) machines or computer-based models that are simulating or “twinning” the life of a physical entity (an object, process, human, or a human-related feature). We generate HDTs via deep phenotyping and application of two state-of-the-art AI methods to take advantage of the pros and limit the cons of each: a generative model using variational autoencoder and a large language model coupled with retrieval- augmented generation. HDTs leverage population level data across urban and rural settings and combines it with a patient’s unique data, to deliver personalized recommendations.