A Glimpse Into the Future of Mental Health: How Your Phone Could Detect Depression

Sumitra's Open Notebook
4 min readOct 4, 2024

--

Imagine a world where your smartphone doesn’t just help you connect with friends, play music, or check emails — but also silently monitors your mental health, offering a gentle nudge when it senses you’re feeling down. It might sound like something from a science fiction novel, but it’s becoming a reality thanks to cutting-edge research in artificial intelligence (AI).

Meet Professor Sang Won Bae from Stevens Institute of Technology. Bae, alongside his brilliant doctoral student Rahul Islam, is developing AI-powered tools designed to detect depression just by analyzing subtle changes in your body — all through your phone. And no, this doesn’t require you to do anything different from what you’re already doing. Simply using your phone as usual is enough for these systems to work their magic.

The Eyes Tell All: Enter PupilSense

The first tool Bae’s team is working on is called PupilSense, and it’s all about your eyes. For decades, scientists have known that your pupils — those black circles in the middle of your eyes — can reveal more than just what you’re looking at. Their size and how they react to light can be tied to your mood. Specifically, changes in your pupillary reflexes (how they dilate or contract) can signal depressive episodes.

So, Bae’s idea was simple but powerful: what if your smartphone could take quick, invisible measurements of your pupils whenever you open your favorite apps? You wouldn’t even notice. Yet, in the background, the AI would be silently comparing how your pupils behave to how they should in someone who feels healthy. And in early tests, this tool, embedded right into volunteers’ smartphones, was 76% accurate in flagging depressive symptoms.

The process? Whenever you open your phone, PupilSense quickly snaps a short photo stream of your eyes, calculates the size of your pupils, and runs those numbers through an AI model. No need for wearable devices or medical gadgets — just your everyday phone.

Reading Faces: The Mystery Behind FacePsy

But the team didn’t stop at eyes. They also created a second tool, FacePsy, which studies the expressions on your face and how you move your head. You may not realize it, but facial muscles give away a lot about how you’re feeling inside. When you’re happy, sad, or somewhere in between, tiny, almost unnoticeable movements can tell the story.

For example, FacePsy looks at whether you smile more often than usual. But here’s the twist: more smiling doesn’t always mean more happiness. Sometimes, especially for people struggling with depression, a smile can be a way to mask what they’re really feeling. It’s like putting on a brave face for the world. Bae’s team found that in some cases, an increase in smiling could actually be a subtle sign of depression.

FacePsy also tracks head gestures, like how you move your head when you’re talking or looking at something. One surprising discovery? People who showed more side-to-side head movements in the morning were more likely to report feeling depressed. Meanwhile, those who seemed to keep their eyes wide open — appearing more alert — were also linked to potential depressive symptoms. It’s as if the body, in trying to mask the struggle, gives away little clues that something isn’t right underneath.

Privacy-Protective and Non-Invasive

You might wonder: if these tools are monitoring your eyes and face, is that a privacy concern? Bae and Islam thought of that too. They made sure that the images taken by FacePsy are deleted almost immediately after analysis. So, there’s no need to worry about your selfies being stored or shared. Everything happens in real-time, and the data is used only to help you, not to invade your privacy.

These AI tools are non-invasive, meaning you don’t need to wear any special devices or follow any new routines. Just use your phone like you normally would, and in the background, your phone could help catch early signs of depression before you even realize it.

Why This Matters

Depression affects about 300 million people around the world, and yet it’s often hard to detect. Many people either don’t realize they’re struggling or are reluctant to talk about it. But with these new AI tools, Bae hopes to make mental health detection as seamless as checking your messages.

The next steps? Bae and his team are refining these systems to make them even more accurate and accessible. They believe these tools could be the future of depression detection — helping individuals and even doctors catch the signs early and offer help sooner. It’s technology with heart: a small way your smartphone could soon become a silent partner in protecting your mental health.

Who knew that behind the glint of your phone screen, the eyes and smiles it captures could one day be keys to unlocking better well-being for millions of people?

--

--

Sumitra's Open Notebook
Sumitra's Open Notebook

Written by Sumitra's Open Notebook

"Welcome to Sumitra's Open Notebook, where curiosity meets creativity! I’m Sumitra, a writer with a passion for exploring everything."

Responses (1)