Friday 28 February 2025
The quest for a more accurate diagnosis of mental health disorders has led researchers to explore innovative approaches, and a recent paper offers an intriguing solution. By leveraging large language models (LLMs), scientists have developed a system that can effectively identify symptoms of depression and anxiety from online posts.
The study focused on the Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder-7 (GAD-7) questionnaires, commonly used to diagnose major depressive disorder and generalized anxiety disorder. Researchers trained LLMs using a dataset of clinician-annotated social media posts, which provided valuable insights into the language patterns and tone associated with mental health symptoms.
The team’s approach involved fine-tuning proprietary models like GPT-3.5 and GPT-4o, as well as open-source models such as llama-3.1-8b and mixtral-8x7b. By doing so, they were able to teach the LLMs to recognize specific symptoms, including feelings of sadness, hopelessness, and fatigue.
To evaluate the effectiveness of their system, researchers tested it on a dataset of online posts from individuals who had previously undergone diagnostic assessments for mental health disorders. The results showed that the LLM-based approach achieved high levels of accuracy in identifying symptoms, with F1 scores ranging from 0.49 to 0.65 for various symptoms.
While this study is not without its limitations, it represents a significant step forward in developing AI-powered tools for mental health diagnosis. By analyzing online posts, which are often readily available and easily accessible, researchers can gain valuable insights into an individual’s mental state. This could ultimately lead to more accurate diagnoses, reduced healthcare costs, and improved treatment outcomes.
The implications of this research extend beyond the realm of mental health diagnosis. As AI language models become increasingly sophisticated, they may be used to analyze a wide range of digital data, from social media posts to medical records, to provide valuable insights into human behavior and well-being. The potential for these tools to revolutionize healthcare and other fields is vast, and it will be exciting to see how this research evolves in the coming years.
Cite this article: “AI-Powered Diagnosis of Mental Health Disorders Through Online Posts”, The Science Archive, 2025.
Mental Health, Depression, Anxiety, Language Models, Diagnosis, Online Posts, Ai-Powered Tools, Healthcare, Digital Data, Symptom Recognition







