The MGH-Psychiatry and MIT Media Lab Research Collaboration

In 2015, the Depression Clinical and Research Program at Massachusetts General Hospital (MGH) and the Massachusetts Institute of Technology Media Lab’s Affective Computing Group joined forces to establish the MGH-MIT Alliance. The goal of this collaboration is to employ machine learning and artificial intelligence to digitally phenotype depression, which refers to exploring people’s interactions with various devices, including smartphones, to assess their well-being. This has led to the birth of two studies: the Grand Challenge Study and Sensor-Based Characterization of Depression (SENSCODE).

The Grand Challenge Study

From 2016 to 2018, the MGH-MIT Alliance conducted the Grand Challenge Study, a pilot study that analyzed various physiological data and smartphone activity in patients with depression via wristband sensors and smartphone applications.


Primary Aims

The study had three main aims:

  1. To assess the acceptability and feasibility of wearing non-invasive, ambulatory, physiological monitoring devices in patients with major depression.

    We collected surveys from the participants about the comfort of using different devices for the study. Also, we measured adherence and compared it with other similar depression studies where wearable devices are not used. Finally, we asked participants who decided to leave the study if their decision was due to the monitoring technology and sensors used during the study.
  2. To examine the relationship between continuous physiologic measures, sleep measures, and vocal data with traditional measurements of depression (i.e., clinical rating scales).

    We analyzed how the collected measures co-vary with the measured therapeutic effects (i.e., changes in standardized clinical measures of depression). We also explored other predictive relationships between the objective continuously measured variables and treatment outcomes.
  3. To assess the utility of physiologic sensors and vocal data to: a) provide an objective diagnosis of depression; b) predict early treatment response; c) anticipate signs of relapse.

    On the basis of aforementioned analysis, we identified the most relevant biomarkers of depression to diagnose depression.

Method

In total, 31 participants with major depressive disorder completed the study. To assess depression severity, the Mini International Neuropsychiatric Interview and the Hamilton Depression Rating Scale were administered by a licensed clinician. Participants wore two E4 Empatica wristband sensors (pictured below), one on each wrist, for 22 hours a day/7 days a week. These sensors tracked the following: electrodermal activity, heart rate, movement, and skin surface temperature. Additionally, smartphone applications were utilized to track socialization behavior (e.g. number of calls and texts received and sent) and movement.

The Empatica E4 Wristband

Pictured above is the Empatica E4 wristband sensors that were worn by all participants.

Results

  1. On average, participants uploaded approximately 17 and 15.5 hours of daily data from left and right-hand sensors, respectively.
  2. Data analysis deemed 39 features as important for estimating HDRS scores. Of those 39 features, the ten most predictive features included seven from smartphone applications, such as screen time, while the other three were physiological measures related to electrodermal activity and heart rate variability.

Conclusions

  1. The utilization of wristband sensors and smartphone applications to digitally phenotype depression was shown to be feasible due to the high compliance rates.
  2. Data suggest that the time-split scenario estimated depression severity most accurately, suggesting that it may have a high potential to be adopted into clinical settings that assess changes in depressive symptoms.
  3. Digitally phenotyping depression will help clinicians provide support to patients, especially since clinicians may be able to tell if their patients’ depression is worsening or relapsing.

For more information, visit our publications page!

Sensor-Based Characterization of Depression (SENSCODE)

A follow-up from the Grand Challenge Study, SENSCODE employs smartphone applications and wristband sensors to monitor phone usage, physical activity, physiological sensors, sleep patterns, and vocal characteristics in patients with depression who are undergoing treatment.

Primary Aims

The study has three main aims:

  1. To create a model that detects depression through physiological data, surveys, and vocalizations.

    Participants will wear two wristband sensors that automatically track electrodermal activity, heart rate, movements, sleep, and temperature. Moreover, participants will have to complete daily surveys measuring alcohol consumption, overall health, and mood and vocal tasks. Lastly, participants’ depression severity and symptomatology will be assessed by trained clinicians using various reliable and valid inventories.
  2. To identify which physiological data are most relevant to depression and to explore patterns between changes in depression and physiological data.

    By collecting various physiological data and tracking depression severity and symptomatology, the Coalition will search for links and patterns in the data, such as the relationship between changes in motion or sleep behavior and depression.
  3. To develop a model that will predict how people with depression will respond to treatments.

    The data collected from the study will help the Coalition establish a model that will be able to determine early treatment response, as well as signs of depression relapses.

Method

For 12-weeks, the following will be recorded via the wristband sensors:

  • Body Temperature
  • Electrodermal Activity
  • Heart Rate
  • Motion
  • Sleeping Habits

Additionally, smartphone applications will record the following:

  • Alcohol Consumption
  • Mood
  • Number of Phone Calls and Text Messages Received and Sent
  • Overall Health
  • Screen Time
  • Vocalizations from Vocal Tasks

Depression data will be collected by a physician, psychologist, or master-level clinician using clinical measures, such as the Hamilton Depression Rating Scale and the SCID Mood Module.


The recorded data will be encrypted, de-identifiable, and secured. You will have access only to your data.

Still Curious?

Visit our FAQ Page

|

Check out our peer-reviewed publications

|

Or email us!