Researchers from Dartmouth College have developed MoodCapture, an AI-powered smartphone application that uses facial recognition technology to detect early signs of depression. The app utilizes the front-facing camera on a user’s smartphone to capture unguarded facial expressions, which the software then analyzes using AI algorithms.
The system was trained using a large data set of photos that linked specific facial expressions and contextual background elements with feelings of depression. More than 120,000 images were collected from 177 individuals diagnosed with major depressive disorder over a 90-day period. During this time, participants used a companion app to answer a brief Patient Health Questionnaire (PHQ-8) three times daily. If a person indicated they felt down, depressed, or hopeless, the app would capture their facial expression unbeknownst to the user to maintain authenticity.
Apart from the expressions, the AI algorithm was also trained to consider factors such as phone angle, lighting, photo location, dominant color, and background elements in the images. With machine learning and deep learning, the AI model can discern nuanced facial expressions that correlate with depression.
Depression is a major health issue worldwide, contributing to an estimated 800,000 suicides annually, therefore, early detection is vital. Apps like MoodCapture have the potential to detect the onset of depression before a user is even aware they’re at risk. However, the researchers emphasize that there are also ethical considerations to take into account with this technology. Privacy concerns, targeted advertising, and the potential misuse of mood-related data by authorities are all issues that need to be addressed.
As technological advancements continue to be made, there are hopes that integrated AI and increasingly sophisticated cameras could allow our smartphones to detect our moods and mental health status. The use of on-device AI could help mitigate some of the privacy concerns associated with these monitoring apps.
Nonetheless, the researchers have developed a powerful tool with potential to revolutionize the early detection and treatment of depression, empowering individuals to access appropriate care more timely. Through recognizing early signs of depression, the MoodCapture app brings optimism for improved mental health management and treatment accessibility in the future.
