UMIACS Faculty Receive MPower Funding to Improve Mental Telehealth Services Using AI

UMIACS Faculty Receive MPower Funding to Improve Mental Telehealth Services Using AI

Computer scientists at the University of Maryland, College Park, are collaborating with child behavioral specialists at the University of Maryland, Baltimore, to improve telehealth services for children living in rural areas of the state, who are now even more isolated due to COVID-19.

Aniket Bera, an assistant research professor in the University of Maryland Institute for Advanced Computer Studies (UMIACS), is principal investigator of the $90K award. Bera and Dinesh Manocha, the Paul Chrisman Iribe Professor of Computer Science, are working with psychiatric experts in Baltimore to develop artificial intelligence (AI) tools to improve mental health diagnoses for children via webcam.

The focus of the study will be on the children’s caregivers, the researchers say, who are typically the primary target for child behavioral interventions.

But due to COVID-19, behavioral specialists are much less likely to meet with children or their caregivers in-person—particularly in rural areas of the state—prompting the need for providing both diagnoses and treatment options via a virtual telehealth network.

Bera and Manocha, who are experts in developing AI tools that can interpret human emotion, will build a system that can leverage visual and vocal or text attention mechanisms from caregivers, capturing the fine-grained interplay between visual cues and language.

“From an AI perspective, the application of automated engagement strategies for child behavioral healthcare is novel,” says Bera. “And the use of a multimodal recognition algorithm will advance the quality of AI engagement research.”

The researchers will collect data from more than 2,000 minutes of virtual family therapy sessions through three mediums: video, to capture facial expressions and movement; sound, for pitch and speech pattern; and heartrate by wrist monitor.

Using this data, the researchers will develop an AI tool that can produce both an engagement and an emotional state score for each telehealth session.

Both the caregiver, which is usually a parent, and the provider—a nurse, psychologist, social worker or counselor—will submit reports on each session for the researchers to better assess their AI tool.

This automated engagement tool will give feedback to the provider in real-time, adds Bera, ultimately enhancing provider engagement training and improving quality of care.

The project is part of the MPowering the State’s COVID-19 Response Fund(link is external), designed to support innovative, high-impact collaborations between UMCP and UMB that will mitigate the impact of the COVID-19 pandemic for people who are the most at risk, or who are experiencing the greatest disparities in healthcare.

(Original news story written by Maria Herd)

September 1, 2020

Prev   Next

Current Headlines

University of Maryland Announces Launch of Research Leaders Fellows Program

UMD Rises to No. 19 in U.S. News Rankings of Top Public Colleges

Fu, Marcus Team for New AFOSR Project on Simulation Optimization

Multi-Institutional Team Receives $4.3 Million Grant to Master the Evolution of the Transition Between Land and Sea

Space Weather Mission Gets $1.25 Million and a Green Light for Feasibility Studies

UMD-Post Poll: Americans Prefer Not to Pack Polls on Election Day

Gifts and Grants Support HAIR Network’s COVID-19 Prevention and Mitigation Campaign

Cornelia Fermüller is PI for 'NeuroPacNet,' a $1.75M NSF funding award

News Resources

Return to Newsroom

Search News

Archived News

Events Resources

Events Calendar

Additional Resources

UM Newsdesk

Faculty Experts


social iconstwitterlinkedinrssYouTube
Division of Research
University of Maryland
College Park, MD 20742-1541
© Copyright 2017 University of Maryland

Did You Know

UMD was ranked 8th in the nation by employers seeking to hire new graduates, according to a recent survey by the Wall Street Journal.