Validity of Mind Monitoring System as a Mental Health Indicator using Voice

Validity of Mind Monitoring System as a Mental Health Indicator using Voice

Volume 2, Issue 3, Page No 338-344, 2017

Author’s Name: Naoki Hagiwaraa), Yasuhiro Omiya1, Shuji Shinohara2, Mitsuteru Nakamura2, Masakazu Higuchi2, Shunji Mitsuyoshi2, Hideo Yasunaga3, Shinichi Tokuno2

View Affiliations

1Research and Product Development, PST Inc., 231-0023, Japan

2Verbal Analysis of Pathophysiology Graduate School of Medicine, The University of Tokyo, 113-0033, Japan

3Department of Clinical Epidemiology & Health Economics School of Public Health, The University of Tokyo, 113-0033, Japan

a)Author to whom correspondence should be addressed. E-mail:

Adv. Sci. Technol. Eng. Syst. J. 2(3), 338-344 (2017); a  DOI: 10.25046/aj020343

Keywords: Voice analysis, Mental health care, Mobile phone



Problem Downloading File? Alternate Link

Export Citations

We have been developing a method of evaluating the mental health condition of a person based on the sound of their voice. Currently, we have applied this technology to create a smartphone application that shows the vitality and the mental activity as mental health condition indices. Using voice to measure one’s mental health condition is a non-invasive method. Moreover, this application can be used continually through a smartphone call. Unlike a periodic checkup every year, it could be used for monitoring on a daily basis. The purpose of this study is to compare the vitality index to the widely used Beck depression inventory (BDI) and to evaluate its validity. This experiment was conducted at the Center of Innovation Program of the University of Tokyo with 50 employees of one corporation as participants between early December 2015 and early February 2016. Each participant was given a smartphone with our application that recorded his/her voice automatically during calls. In addition, the participants had to read and record a fixed phrase daily. The BDI test was conducted at the beginning of the experimental period. The vitality index was calculated based on the voice data collected during the first two weeks of the experiment and was considered as the vitality index at the time when the BDI test was conducted. When the vitality and the mental activity indicators were compared to BDI score, we found that there was a negative correlation between the BDI score and these indices. Additionally, these indices were a useful method to discriminate a participant of high risk of disease with a high BDI score. And the mental activity index shows a higher performance than the vitality index.

Received: 06 April 2017, Accepted: 28 April 2017, Published Online: 17 May 2017

  1. R. C. Kessler, H. S. Akiskal, M. Ames, H. Birnbaum, P. Greenberg, R. M. A. Hirschfeld, R. Jin, K. R. Merikangas, G. E. Simon, P. S. Wang, “Prevalence and effects of mood disorders on work performance in a nationally representative sample of U.S. workers” Am. J. Psychiat., 163, 1561–1568, 2006.
  2. World Health Organization, The Global Burden of Disease: 2004 Update, WHO Press, Geneva, Switzerland, 46–49, 2004.
  3. A. T. Beck, C. H. Ward, M. Mendelson, J. Mock, J. Erbaugh, “An inventory for measuring depression” Arch. Gen. Psychiat., 4, 561–571, 1961.
  4. A. T. Beck, R. A. Steer, M. G. Carbin, “Psychometric properties of the Beck depression inventory twenty-five years of evaluation” Clin. Psych. Rev., 8, 77–100, 1988.
  5. S. Izawa, N. Sugaya, K. Shirotsuki, K. C. Yamada, N. Ogawa, Y. Ouchi, Y. Nagano, K. Suzuki, S. Nomura, “Salivary dehydroepiandrosterone secretion in response to acute psychosocial stress and its correlations with biological and psychological changes” Biol. Psychol., 79( 3), 294–298, 2008.
  6. C.W. Hoge, C.A. Castro, S.C. Messer, D. McGurk, D.I. Cotting, R.L. Koffman, “Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care” New Eng. J. Med., 351(1), 13–22, 2004.
  7. R. N. McLay, W. E. Deal, J. A. Murphy, K. B. Center, T. T. Kolkow, T. A. Grieger, “On-the-record screenings versus anonymous surveys in reporting PTSD” Am. J. Psychiat., 165(6), 775–776, 2008.
  8. M. Perrin, L. DiGrande, K. Wheeler, L. Thorpe, M. Farfel, R. Brackbill “Differences in PTSD prevalence and associated risk factors among World Trade Center disaster rescue and recovery workers” Am. J. Psychiat., 164(9), 1385–1394, 2007.
  9. S. Mitsuyoshi, F. Ren, Y. Tanaka, S. Kuroiwa, “Non-verbal voice emotion analysis system” Int. J. Innov. Comput. I., 2(4), 819–830, 2006.
  10. S. Mitsuyoshi, “Emotion recognizing method, sensibility creating method, device, and software” U.S. Patent 7 340 393, 2003.
  11. S. Shinohara, M. Nakamura, Y. Omiya, N. Hagiwara, S. Mitsuyoshi, S. Tokuno, “A mental health assessment method based on emotional level derived from voice” (Manuscript in preparation)
  12. N. Hagiwara, Y. Omiya, S. Shinohara, M. Nakamura, M. Higuchi, S. Mitsuyoshi, H. Yasunaga, S. Tokuno, “Validity of the mind monitoring system as a mental health indicator” in IEEE BIBE 2016, Taichung, 2016.
  13. A. Sekiyama, “Interleukin-18 is involved in alteration of hipothalamic-pituitary-adrenal axis activity by stress” in Society of Biological Psychiatry Annual Meeting, San Diego, USA, 2007.
  14. S. Tokuno, S. Mitsuyoshi, G. Suzuki, G. Tsumatori, “Stress evaluation by voice: a novel stress evaluation technology” in 9th International Conference on Early Psychosis, Tokyo, 2014.
  15. S. Shinohara, S. Mitsuyoshi, M. Nakamura, Y. Omiya, G. Tsumatori, S. Tokuno, “Validity of a voice-based evaluation method for effectiveness of behavioural therapy” in MINDCARE 2015, Milan, 2015.
  16. Y. Omiya, N. Hagiwara, T. Kirita, S. Shinohara, M. Nakamura, S. Mitsuyoshi, S. Tokuno, “Development of a monitoring system of mental health state using call voice with a smartphone” in HCG symposium, Toyama, 2015.
  17. Y. Omiya, “Development of the mind monitoring system (MIMOSYS) which can be able to monitor mental health status using call voice with a smartphone” in 7th Asia Pacific Regional Conference of IASP, Tokyo, 2016.
  18. S. Mitsuyoshi, Y. Tanaka, F. Ren, K. Shibasaki, M. Kato, T. Murata, T. Minami, H. Yagura, “Emotion voice analysis system connected to the human brain” in IEEE NLP-KE 2007, Beijing, China, 2007.
  19. D. P. Goldberg, Manual of the General Health Questionnaire, NFER Publishing, Windsor, England, 1978.