UNIGE Faculty of MedicineFacMed Hack #1Digital Phenotyping of Mental Health

← All challenges

2

Beyond the human eye: behaviour from video and audio

Some of the most telling signs in mental health last less than a second: a micro-movement, a glance held too long, the moment words and face tell different stories. Trained clinicians catch some of them; coding them by hand is slow and varies between coders. Here, video and audio of play, conversation and therapy become behavioural signatures precise enough to follow one person across sessions, a step towards precision and personalised medicine. Over two days, vision-language models, audio-visual models and pose tracking meet open footage and human coders, and clinicians question and correct the labels in plain language. Leads: change across sessions, movement patterns shared by overlapping conditions.

Contribute

Here you contribute rather than judge: sharpen the question, open a perspective, bring a resource, or build on somebody’s idea. No votes, no likes. What helps makes it into the challenge.

Sign in to read and contribute

← 1. Physiology you can trust: tracking change between visits3. What speech reveals: memory and mood in clinical audio →