Using Absolutist Word Frequency from Online Searches to Measure Population Mental Health Dynamics

Abstract

Purpose
The assessment of population mental health relies on survey data from representative samples, which come with considerable costs. Drawing on research which established that absolutist words (e.g. never) are semantic markers for depression, we propose a new measure of population mental health based on the frequency of absolutist words in online search data (Absolute Thinking Index; ATI). Our aims were to first validate the ATI, and to use it to model public mental health dynamics in France and the UK during the current COVID-19 pandemic.

Methods
To do so, we extracted time series for a validated dictionary of 19 absolutist words, from which the ATI was computed (weekly averages, 2019-2020, n = 208) using Google Trends. We then tested the relationship between ATI and longitudinal survey data of population mental health in the UK (n = 36,520) and France (n = 32,000). After assessing the relationship between ATI and survey measures of depression and anxiety in both populations, and dynamic similarities between ATI and survey measures (France), we tested the ATI’s construct validity by showing how it was affected by the pandemic and how it can be predicted by COVID-19-related indicators. A final step consisted in replicating ATI’s construct validity tests in Japan, thereby providing evidence for the ATI’s cross-cultural generalizability.

Results
ATI was linked with survey depression scores in the UK, r = .68, 95%CI[.34,.86], ß = .23, 95%CI[.09,.37] in France and displayed similar trends. We finally assessed the pandemic’s impact on ATI using Bayesian structural time-series models. These revealed that the pandemic increased ATI by 3.2%, 95%CI[2.1,4.2] in France and 3.7%, 95%CI[2.9,4.4] in the UK. Mixedeffects models showed that ATI was related to COVID-19 new deaths in both countries ß = .14, 95%CI[.14,.21]. This pattern was replicated in Japan, with a pandemic impact of 4.9%, 95%CI[3.1,6.7] and an influence of COVID-19 death of ß = .90, 95%CI[.36,.1.44].

Conclusion
Our results demonstrate the validity of the ATI as a measure of population mental health (depression) in France, the UK and to some extent in Japan. We propose that researchers use it as cost-effective public mental health “thermometer” for applied and research purposes.