AI-driven computer vision for fall prediction and detection for older adults with AD/ADRD

Awardee Organization(s): Iris Technology Inc.
Principal Investigator(s): David Stout
Official Project Title: AI-Assisted Fall Detection and Remote Monitoring for Seniors with ADRD
AITC Partner: PennAITech
Website(s): www.poweredbyiris.io

Falls are a significant contributor to health decline in older adults. Iris Technology Inc is using a proprietary AI Vision architecture to build a better fall detection and prevention solution for use in health care facilities and eventually home care environments. Our proprietary AI architecture, Deep Detection™, will revolutionize how we detect and even prevent falls by allowing us to create highly accurate models with minimal training data, and by generalizing and incorporating context to provide deeper insights. Our solutions operate entirely on the edge, ensuring patient privacy in the health care setting and giving users total control over their data. In partnership with UPenn and the National Institute of Aging, our project is focused on harnessing the unique capabilities of our AI to create a model that can more accurately detect fall events and learn when the risk of a fall is high to support preventative intervention. Our ultimate vision is to build a full suite of tools and a library of models that can facilitate better, more personalized care for seniors that both enables greater independence and fully protects their privacy without the need for expensive or unscalable monitoring. There is an ever-growing need to develop good technology that can ease the increasing burden on caregivers and help ensure that seniors are receiving the highest levels of care. Iris Technology’s mission is to empower people to solve humanity’s unsolvable problems, and we are confident that we can help to develop cutting-edge AI that will help solve real-world problems facing seniors and caregivers today.

View Resource

AI-enabled conversation platform to measure mental status and manage psychotropic medication use for older adults

Awardee Organization(s): George Washington University | Crosswater Digital Media
Principal Investigator(s): Lorens Helmchen, PhD
Official Project Title: AI-Enabled Conversations to Measure Mental Status and Manage Psychotropic Medication Use
AITC Partner: PennAITech
Website(s): www.gwu.edu

Continuous monitoring of cognitive function among the elderly is vital for early detection and proper management of Alzheimer’s Disease and related dementias. Similarly, continuous monitoring of changes in mood is indispensable for the appropriate dosing of psychotropic medication. Yet, current means of monitoring cognitive function and mood among the elderly are often infrequent, inconsistent, and imprecise because they rely on the completion of standardized questionnaires that may fail to flag clinically relevant leading indicators. This project aims to deploy and validate the use of digital “conversation companions”, a remote patient-monitoring technology that can be installed on tablet computers and smartphones by untrained caregivers or the elderly themselves. The recordings and transcripts of the conversations between elderly residents and these digital companions will be used to train machine-learning algorithms that can measure the presence and severity of dementia and depression and predict fall risk. Expert clinicians, family members, and community stakeholders will ensure that the predictions are clinically informative, actionable, transparent, and culturally appropriate. As the technology can be used by patients on their own and as the voice and the visuals of the digital conversation companions can be adapted to a patient’s linguistic and cultural background, this technology can reach traditionally under-served patient populations such as racial minorities and those living in remote areas. This technology will allow caregivers to detect small and subtle changes in an individual’s cognitive function and mood in a way that is less intrusive, more frequent, more consistent, and more precise than current practice.

View Resource

AI-enabled near-field coherent sensing radio sensors to detect respiratory distress for advanced AD/ADRD patients who are unable to self-report

Awardee Organization(s): Weill Cornell Medicine
Principal Investigator(s): Veerawat Phongtankuel, MD, MS
Official Project Title: Detecting Respiratory Distress in Patients with Advanced ADRD Using Radio Sensors
AITC Partner: PennAITech
Website(s): www.weill.cornell.edu

This project focuses on designing and developing conversational care technologies for older adults and their caregivers. In prior work, we surveyed informal caregivers and older adult care receivers to understand their care routines. Survey findings showed how nearly 20% of care partners used voice assistants in their homes, signaling an opportunity to extend research on older adults’ conversational technology use to include care partners. Next, we conducted a diary study and interviews with caregivers and care receivers to investigate gaps in care interactions and conversations. We found that care receivers experienced more communication frustrations than caregivers and that older adult caregivers wanted more opportunities to influence their care routines.
In this project, we will use these findings to develop in-home conversational technologies that use prompts to structure care conversations between older adults and their caregivers. We contribute a nuanced dyadic perspective to care relationships as most care research focuses solely on caregiver perspectives. We also extend conversational technology research beyond information seeking to include more social uses by developing conversational technology applications with mainstream voice technologies (e.g., Amazon Alexa) to support improved care relationships, social and emotional well-being, and quality of life.

View Resource

ALIRO: AI Driven Data Science

ALIRO is an easy-to-use data science assistant. It allows researchers without machine learning or coding expertise to run supervised machine learning analysis through a clean web interface. It provides results visualization and reproducible scripts so that the analysis can be taken anywhere. And, it has an AI assistant that can choose the analysis to run for you. Dataset profiles are generated and added to a knowledgebase as experiments are run, and the AI assistant learns from this to give more informed recommendations as it is used. Aliro comes with an initial knowledgebase generated from the PMLB benchmark suite.

 

View Resource

Alliance of Minority Physicians

The mission of AMP is to develop leaders in clinical, academic, and community medicine through active recruitment, career development, mentorship, social opportunities and community outreach geared towards underrepresented faculty, house staff, and medical students at UPHS, CHOP, and the Perelman School of Medicine. Dr. Iris Reyes provides faculty leadership for AMP.

View Resource

Alzbiomarker

The Alzbiomarker database organizes decades of data on fluid biomarkers for Alzheimer’s disease. Biomarker measurements are curated from published studies and meta-analyzed. Version 1.0 through 2.1 contains studies comparing measurements in Alzheimer’s disease to cognitively healthy individuals and studies comparing progressive MCI to stable MCI. Version 3.0 includes comparisons of biomarker levels in non-AD neurological conditions to Alzheimer’s disease. The data can be downloaded by requesting data from contacting alzbiomarker@alzforum.org

View Resource

China Health and Retirement Longitudinal Study (CHARLS)

The China Health and Retirement Longitudinal Study (CHARLS) aims to collect a high quality nationally representative sample of Chinese residents ages 45 and older to serve the needs of scientific research on the elderly. The baseline national wave of CHARLS is being fielded in 2011 and includes about 10,000 households and 17,500 individuals in 150 counties/districts and 450 villages/resident committees. The individuals will be followed up every two years. CHARLS adopts multistage stratified PPS sampling. As an innovation of CHARLS, a software package (CHARLS-Gis) is being created to make village sampling frames.

 

CHARLS is based on the Health and Retirement Study (HRS) and related aging surveys such as the English Longitudinal Study of Aging (ELSA) and the Survey of Health, Aging and Retirement in Europe (SHARE). The pilot survey of CHARLS was conducted in two provinces (Gansu and Zhejiang) in 2008 and collected data from 48 communities/villages in 16 counties/districts, covering 2,685 individuals living in 1,570 households. The response rate of the pilot survey was 85%.

 

The CHARLS questionnaire includes the following modules: demographics, family structure/transfer, health status and functioning, biomarkers, health care and insurance, work, retirement and pension, income and consumption, assets (individual and household), and community level information.

 

CHARLS has received critical support from Peking University, the National Natural Science Foundation of China, the Behavioral and Social Research Division of the NIA and the World Bank.

 

View Resource

Combining AI-enabled RGBd+ stereo vision and thermal sensors for home monitoring and telehealth

Awardee Organization(s): Bestie Bot
Principal Investigator(s): Richard Everts
Official Project Title: RGBd+ Thermal Computer Vision Platform for Home Monitoring and Telehealth
AITC Partner: PennAITech
Website(s): www.bestiebot.com

We’re developing a new class of a home-based, AI-enabled monitoring system that uses standard computer vision and thermal sensors to detect falls, notify caretakers in case of falland perform basic health diagnostics, all with industry-exceeding privacy and accuracy.
Specifically, we will:
1. Detect falls more reliably in day and night conditions
2. Increase the capabilities of remote health checks through mobility and thermal testing
3. Reduce AI biases for the BIPOC population through our data generation tools and methods
Using unique sensor fusion along with a patented new AI system, our goal is to vastly increase the reliability, adoption, and privacy of in-home monitoring systems for use by those aging in place and their families.

View Resource

Critical Path For Alzheimer’s Disease (CPAD)

The Critical Path For Alzheimer’s Disease (CPAD) is a de-identified database directed by Critical Path Institute. The database collects patient-level data from 12811 patients across 36 clinical trials of AD and MCI. It contains demographic information, APOE4 genotype, concomitant medications, and cognitive scales, such as MMSE and ADAS-Cog. It also provides limited treatment-arm data and limited AD biomarker data including biofluid, tau or amyloid positron emission tomography (PET), EEG data. All data in this database have been remapped to the CDISC SDTM v3.1.2 data standard.

This database is open to CPAD members, as well as to external qualified researchers who submit, and are approved for, a request for access.

View Resource