EMOECHO: A MULTIMODAL DESKTOP ROBOT SYSTEM FOR REAL-TIME DEPRESSION DETECTION AND MONITORING

Ruiji Xu, Yan Ling, Keji Mao, Guanglin Dai

References

  1. [1] C. Otte, S.M. Gold, B.W. Penninx, C.M. Pariante, A. Etkin,M. Fava, D.C. Mohr, and A.F. Schatzberg, Major depressivedisorder, Nature reviews. Disease primers, 2, 2016, 16065.
  2. [2] Lyu, E., X. Yang, W. Liu, J. Wang, S. Song, and Q.-H. M.Max, An autonomous eye-in-hand robotic system for pickingobjects in a supermarket environment with non-holonomicconstraint, International Journal of Robotics and Automation,37(4), 2022, 352–361.
  3. [3] T. Shaik, X. Tao, N. Higgins, L. Li, R. Gururajan, X. Zhou,and U.R. Acharya, Remote patient monitoring using artificialintelligence: Current state, applications, and challenges, WIREsData Mining and Knowledge Discovery, 13(2), 2023.
  4. [4] Wu, J., X. Wu, Y. Hua, S. Lin, Y. Zheng, and J. Yang,Exploring Social Media for Early Detection of Depression inCOVID-19 Patients, Proceedings of the ACM Web Conference2023, New York, NY, USA, 2023, 3968–3977.
  5. [5] B. Saraceno, The WHO world health report 2001 on mentalhealth, Epidemiologia e Psichiatria Sociale, 11(2), 2002, 83-87.
  6. [6] U.M. Bello, P. Kannan, M. Chutiyami, D. Salihu, A.M.Y.Cheong, T. Miller, J.W. Pun, A.S. Muhammad, F.A. Mahmud,and H.A. Jalo, et al., Prevalence of anxiety and depressionamong the general population in africa during the COVID-19pandemic: A systematic review and meta-analysis, Frontiersin public health, 10, 2022, 814981.
  7. [7] D.L. Surkalim, M. Luo, R. Eres, K. Gebel, J. van Buskirk, A.Bauman, and D. Ding, The prevalence of loneliness across 113countries: Systematic review and meta-analysis, BMJ (Clinicalresearch ed.), 376, 2022, e067068.
  8. [8] P.D. McGorry, J. Edwards, C. Mihalopoulos, S.M. Harrigan,and H.J. Jackson, EPPIC: An evolving system of early detectionand optimal management, Schizophrenia bulletin, 22(2), 1996,305-26.
  9. [9] Dubois, B., H. Hampel, H. H. Feldman, P. Scheltens, P. Aisen,S. Andrieu, H. Bakardjian, H. Benali, L. Bertram, K. Blennow,et al., Preclinical alzheimer’s disease: Definition, natural history,and diagnostic criteria, Alzheimer’s Dementia, 12(3), 2016,292–323.
  10. [10] Agley, J., Y. Xiao, R. Nolan, and L. Golzarri-Arroyo, Qualitycontrol questions on amazon’s mechanical turk (MTurk): Arandomised trial of impact on the USAUDIT, PHQ-9, andGAD-7, Behaviour Research Methods, 54(2), 2022, 885–897.
  11. [11] S. Johnson, C. Dalton-Locke, J. Baker, C. Hanlon, T.T.Salisbury, M. Fossey, K. Newbigging, S.E. Carr, J. Hensel, G.Carr`a, et al., Acute psychiatric care: Approaches to increasingthe range of services and improving access and quality of care,World psychiatry : official journal of the World PsychiatricAssociation (WPA), 21(2), 2022, 220-236.
  12. [12] S. Almeida, M. Camacho, J.B. Barahona-Corrˆea, J. Oliveira, R.Lemos, D.R. da Silva, J.A. da Silva, T.M. Baptista, J. Gr´acio,and A.J. Oliveira-Maia, Criterion and construct validity ofthe Beck Depression Inventory (BDI-II) to measure depressionin patients with cancer: The contribution of somatic items,International journal of clinical and health psychology : IJCHP,23(2), 2023, 100350.
  13. [13] A. Hajek, I. Sabat, S. Neumann-B¨ohme, J. Schrey¨ogg,P.P. Barros, T. Stargardt, and H.H. K¨onig, Prevalence anddeterminants of probable depression and anxiety during theCOVID-19 pandemic in seven countries: Longitudinal evidencefrom the European COvid Survey (ECOS), Journal of affectivedisorders, 299, 2022, 517-524.
  14. [14] A.Y. Kim, E.H. Jang, S.H. Lee, K.Y. Choi, J.G. Park, andH.C. Shin, Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep ConvolutionalNeural Network Approach, Journal of medical Internetresearch, 25, 2023, e34474.
  15. [15] M.J. Johnson, M.A. Johnson, J.S. Sefcik, P.Z. Cacchione, C.Mucchiani, T. Lau, and M. Yim, Task and Design Requirementsfor an Affordable Mobile Service Robot for Elder Care in an All-Inclusive Care for Elders Assisted-Living Setting, InternationalJournal of Social Robotics, 12(5), 2020, 989-1008.
  16. [16] N.L.A. Rashid, Y. Leow, P. Klainin-Yobas, S. Itoh, andV.X. Wu, The effectiveness of a therapeutic robot, ‘Paro’, onbehavioural and psychological symptoms, medication use, totalsleep time and sociability in older adults with dementia: Asystematic review and meta-analysis, International Journal ofNursing Studies, 145, 2023, 104530.
  17. [17] Cobanoglu, N., B. M. Yilmaz, E. Tatlicioglu, and E. Zergeroglu,Repetitive control of robotic manipulators in operational space:A neural network-based approach, International Journal ofRobotics and Automation, 37(3), 2022, 302–309.
  18. [18] M. Hamilton, A rating scale for depression, Journal ofNeurology, Neurosurgery, and Psychiatry, 23(1), 1960, 56-62.
  19. [19] P. Hassanpour, S. Buchwald, A.H.P. Mehta, S.B. Goldberg,and K. Walsh, Sexual violence and shame: A meta-analysis,Trauma, Violence & Abuse, 2025, 15248380241308828.
  20. [20] C.A. Levinson, K. Osborn, M. Hooper, I. Vanzhula, and C.Ralph-Nearman, Evidence-based assessments for transdiagnos-tic eating disorder symptoms: Guidelines for current use andfuture directions, Assessment, 31(1), 2024, 145-167.
  21. [21] Y. Wang, Y.S. Chan, E. Lee, D. Shi, C.Y. Lee, and J. Diao,Monitoring Escherichia coli in water through real-time loop-mediated isothermal amplification on biochips, Micromachines,15(9), 2024, 1112.10
  22. [22] H.U.D. Ahmed Khan, U.I. Bajwa, N.I. Ratyal, F. Zhang, andM.W. Anwar, Deception detection in videos using the facialaction coding system, Multimedia Tools and Applications,84(9), 2025, 6429-6443.
  23. [23] K.A. Alshaikh, O.A. Almatrafi, and Y.B. Abushark, BERT-based model for aspect-based sentiment analysis for analysingarabic open-ended survey responses: A case study, IEEE Access,12, 2023, 2288–2302.
  24. [24] Y. Zhang, L. Zhang, and M.A. Hossain, Adaptive 3D facialaction intensity estimation and emotion recognition, ExpertSystems with Applications, 42(3), 2015, 1446-1464.
  25. [25] Y. Saishu, A.H. Poorjam, and M.G. Christensen, A CNN-basedapproach to identification of degradations in speech signals,EURASIP Journal on Audio, Speech, and Music Processing,2021(1), 2021.
  26. [26] G. He, X. Zheng, W. Li, L. Zheng, and Y. He, The dark sideof employee collaboration with robots: Exploring its impacton self-esteem threat and burnout, International Journal ofHuman–Computer Interaction, 41(1), 2025, 85-101.
  27. [27] M. McKinney, A. Garland, D. Cillessen, J. Adamczyk,D. Bolintineanu, M. Heiden, E. Fowler, and B.L. Boyce,Unsupervised multimodal fusion of in-process sensor datafor advanced manufacturing process monitoring, Journal ofManufacturing Systems, 78, 2025, 271-282.
  28. [28] M. Yang, Y. Liu, Y. Tao, and B. Hu, Spike memory transformer:An energy-efficient model in distributed learning frameworkfor autonomous depression detection, IEEE Internet of ThingsJournal, 2025, 1-1.
  29. [29] S. Zamani, R. Sinha, M. Nguyen, and S. Madanian, Enhancingemotional well-being with IoT data solutions for depression:A systematic review, IEEE Journal of Biomedical and HealthInformatics, 29(3), 2025, 1919-1930.
  30. [30] Z. Chen, D. Wang, L. Lou, S. Zhang, X. Zhao, S. Jiang, J.Yu, and J. Xiao, Text-guided multimodal depression detectionvia cross-modal feature reconstruction and decomposition,Information Fusion, 117, 2025, 102861.
  31. [31] T. He, J. Chen, M.S. Hossain, and Z. Lyu, Enhanced detectionof early Parkinson’ s disease through multi-sensor fusion onsmartphone-based IoMT platforms, Information Fusion, 117,2025, 102889.
  32. [32] U. Jaishankar, and J.H. Nirmal, Comparative analysis ofdifferent meta heuristic optimisation algorithms in depressiondetection system, 2024 First International Conference onSoftware, Systems and Information Technology (SSITCON),Tumkur, India, 2024, 1–7.
  33. [33] D. Huang, C. Lv, Z. Chen, Z. Li, and J. Zheng, Abnormalitiesin modular connectivity of functional brain networks andcognitive changes in patients with anti-N-methyl-D-aspartatereceptor encephalitis, Brain Research, 1820, 2023, 148605.
  34. [34] C. Li, H. Gao, Y. Yang, X. Qu, and W. Yuan, Segmentationmethod of high-resolution remote sensing image for fast targetrecognition, International Journal of Robotics and Automation,34(3), 2019.
  35. [35] Kreiensieck, E., Y. Ai, and L. Zhang, A ComprehensiveEvaluation of Openface 2.0 Gaze Tracking, InternationalConference on Human-Computer Interaction, 2023, 532–549.

Important Links:

Go Back