重口味SM

Smartphones could help monitor mental health by recording ambient sounds: U of T researchers

""
(Anass Bachar/EyeEm/Getty Images)

A multidisciplinary research team from the 重口味SM is looking at the possibility of using smartphones to monitor certain aspects of mental health.

By recording short bursts of ambient noise and mapping that audio over time, the team found that keeping a regular daily routine was negatively correlated with subjects self-reporting a symptom of depression.

The team is led by Daniel Di Matteo, a PhD candidate in the Faculty of Applied Science & Engineering who is supervised by Professor Jonathan Rose in the Edward S. Rogers Sr. department of electrical and computer engineering and psychiatrist Martin Katzman of Toronto鈥檚 S.T.A.R.T. clinic for mood and anxiety disorders. Their new app turns on a smartphone鈥檚 microphone for 15 seconds every 5 minutes. The team installed the app on the phones of 112 volunteer subjects to record ambient noise over a two-week period.

The team then extracted the average volume of noise for short, discrete durations. When plotted over time, the volume data shows peaks and troughs like a wave whose regularity can be quantified.

To achieve a measurement of regularity this way, by means of ambient noise, has not been done before.

鈥淚t鈥檚 well known 鈥 though not perfectly understood 鈥 that there鈥檚 a connection between mental health and regularity in your days,鈥 says Di Matteo.

鈥淭his regularity measurement is a statistic, like blood pressure might be in a medical study. We looked for a relationship between this statistic and the subject鈥檚 mental health questionnaire scores.鈥

The findings of this explorative study, the first of three, were .

The driving force behind the research is to gather and objectively process passive, continuous data to compare alongside a broad range of symptoms from social anxiety disorder, generalized anxiety disorder, depression and general impairment.

鈥淐onsider how mental health monitoring currently works,鈥 says Rose. 鈥淧atients visit their therapist every week or so by going to a clinic or office. The patient chooses how to present themselves and the therapist interprets what they hear.鈥

But with a smartphone in every backpack, pocket or purse these days, there鈥檚 an opportunity to gather data far more frequently. And because intermittent recording goes unnoticed, the data-gathering is passive so the act of measuring isn鈥檛 changing what鈥檚 being measured.

This visualization shows a subject鈥檚 environmental audio volume data over the course of a week.

One of the challenges for an observational study like this 鈥 as with many similar studies in this field 鈥 is managing privacy protections.

The research ethics board set limitations on how the team could use the audio. They couldn鈥檛 listen to it, nor could they keep it for longer than a few weeks; any discernible words had to be stored in isolation so that conversations couldn鈥檛 be recreated.

It has long been known that the presence or absence of voices is associated with depression. A second study, currently in review, considers this word-based data while a third will look at the predictive potential of an app that includes data for location, on/off screen activity and motion detection.

Building a medical model of mental health based on smartphone data could be a valuable asset for the field.

鈥淲hen someone鈥檚 going into depression they just kind of fade away,鈥 says Rose. 鈥淚magine an app with the capability to notify a spouse or a parent when this happens. Imagine one that could more finely track the efficacy of a prescription.鈥

Rose says his imagination 鈥 and research 鈥 has been fired up by such scenarios for seven years since the inception of the Centre for Automation in Medicine and his collaboration with Katzman and fellow researchers at S.T.A.R.T.

鈥淚t鈥檚 a true partnership,鈥 says Rose of his research partners in the clinic. 鈥淭hey learn what鈥檚 possible with machine learning while we learn aspects of psychiatry and statistics. We don鈥檛 just do what they tell us.鈥

The research received support from the Natural Sciences and Engineering Research Council of Canada.

The Bulletin Brief logo

Subscribe to The Bulletin Brief

Engineering