Clinical Chatbot Design and Triage Accuracy in Urgent Care Platforms

Authors

  • Min-Ji Seok Department of Preventive Medicine, School of Medicine, Ewha Womans University, Seoul, Republic of Korea Author
  • Ye-Jun Ko Department of Preventive Medicine, School of Medicine, Ewha Womans University, Seoul, Republic of Korea Author

Keywords:

Clinical Chatbots, Triage Accuracy, Health Informatics, Urgent Care, Clinical Chatbot Design

Abstract

The rapid integration of artificial intelligence in healthcare has positioned clinical chatbots at the forefront of initial patient encounters, particularly within urgent care platforms. This paper systematically investigates the relationship between clinical chatbot design features and diagnostic triage accuracy through clinical modeling based on real-world urgent care platform data. We evaluate how specific user interface designs, conversational structures, and underlying clinical algorithms influence the precision of assigning patient acuity levels. The study utilizes a retrospective observational design, analyzing patient-chatbot interactions and comparing chatbot-generated triage recommendations with physician-validated outcomes. Through extensive clinical pathway analysis, we identify critical design components that mitigate user misinterpretation and enhance data elicitation. Findings reveal that conversational agents incorporating adaptive questioning, empathetic phrasing, and dynamic symptom tracking significantly outperform static symptom checkers in triaging complex urgent care scenarios. The research contributes to the broader health informatics literature by providing empirical evidence on the necessary alignment between user-centered design and clinical risk algorithms. Ultimately, these insights provide actionable guidelines for developing safer, more accurate virtual triage systems in high-volume acute care environments, reducing the risks of both over-triage and under-triage while optimizing resource allocation.

References

1. Gonçalves, R.L.; Pagano, A.S.; Reis, Z.S.N.; Brackstone, K.; Lopes, T.C.P.; Cordeiro, S.A.; Nunes, J.M.; Afagbedzi, S.K.; Head, M.; Meira, W., Jr.; et al. Usability of Telehealth Systems for Noncommunicable Diseases in Primary Care From the COVID-19 Pandemic Onward: Systematic Review. J. Med. Internet Res. 2023, 25, e44209.

2. Hants, L.; Bail, K.; Paterson, C. Clinical Decision-making and the Nursing Process in Digital Health Systems: An Integrated Systematic Review. J. Clin. Nurs. 2023, 32, 7010–7035.

3. Sousa, V.L.P.; Dourado Júnior, F.W.; Anjos, S.D.J.S.B.D.; Moreira, A.C.A. Nursing Teleconsultation in Primary Health Care: Scoping Review. Rev. Lat. Am. Enferm. 2024, 32, e4329.

4. Zha, H.; Liu, K.; Tang, T.; Yin, Y.-H.; Dou, B.; Jiang, L.; Yan, H.; Tian, X.; Wang, R.; Xie, W. Acceptance of Clinical Decision Support System to Prevent Venous Thromboembolism among Nurses: An Extension of the UTAUT Model. BMC Med. Inform. Decis. Mak. 2022, 22, 221.

5. Xiao, M.; Cui, S.; Wang, L. Digital Twin-Based Integrated Modeling and Maintenance Framework in the Power Grid Data Center Scenario. Cyber-Phys. Energy Syst. 2026, 2, 73–89.

6. Gervasi, M.; Bove, L.; Corallo, A.; Miglietta, M.; Negro, L.; Pellegrino, G.; Ria, F.; Visaggio, C.A. Systems of Digital Twins: A Systematic Literature Review and a Formal Framework. Digit. Eng. 2026, 9, 100100.

7. Ramirez, C.A.; Agrawal, P.; Thompson, A.E. An Approach Integrating Model-Based Systems Engineering, IoT, and Digital Twin for the Design of Electric Unmanned Autonomous Vehicles. Systems 2025, 13, 73.

8. Rafsanjani, H.N.; Nabizadeh, A.H. Towards Digital Architecture, Engineering, and Construction (AEC) Industry through Virtual Design and Construction (VDC) and Digital Twin. Energy Built Environ. 2023, 4, 169–178.

9. Rouleau, G.; Wu, K.; Ramamoorthi, K.; Boxall, C.; Liu, R.H.; Maloney, S.; Zelmer, J.; Scott, T.; Larsen, D.; Wijeysundera, H.C.; et al. Mapping Theories, Models, and Frameworks to Evaluate Digital Health Interventions: Scoping Review. J. Med. Internet Res. 2024, 26, e51098.

10. Ramadan, O.M.E.; Elsharkawy, N.B.; Hafiz, A.H.; Katooa, N.E.; Abunar, A.; Attallah, D.M.A.; Dewan, M.; Alruwaili, M.M.; Alruwaili, A.N.; Alshammari, A.M.; et al. Neonatal Nurses’ e-Health Literacy and Technology-mediated Clinical Practice: A Cross-Sectional Analysis of Digital Health Competencies and Practice Patterns. BMC Nurs. 2025, 24, 1199.

11. Kaihlanen, A.M.; Gluschkoff, K.; Laukka, E.; Heponiemi, T. The information system stress, informatics competence and well-being of newly graduated and experienced nurses: A cross-sectional study. BMC Health Serv. Res. 2021, 15, 1096.

12. Talaia, M., Pisoni, A., & Onetti, A. (2016). Factors influencing the fund raising process for innovative new ventures: An empirical study. Journal of Small Business and Enterprise Development, 23(2), 363–378.

13. Moghadam, H.M.; Foroozan, H.; Gheisarnejad, M.; Khooban, M.H. A Survey on New Trends of Digital Twin Technology for Power Systems. J. Intell. Fuzzy Syst. 2021, 41, 3873–3893.

14. Elsisi, A.; Zamrawi, A.; Emad, S. A Comprehensive Review of Structural Health Monitoring for Steel Bridges: Technologies, Data Analytics, and Future Directions. Appl. Sci. 2025, 15, 12090.

15. Yang, D.; Karimi, H.R.; Kaynak, O.; Yin, S. Developments of Digital Twin Technologies in Industrial, Smart City and Healthcare Sectors: A Survey. Complex Eng. Syst. 2021, 1, 3.

16. Canadian Nurses Association [CNA]. Nursing Practice in Digitally Enabled Care Environments. Position Statement.

2024. Available online: https://hl-prod-ca-oc-download.s3-ca-central-1.amazonaws.com/CNA/2f975e7e-4a40-45ca-863c-5ebf0a138d5e/UploadedImages/documents/policy-advocacy/CNA-Position-Statement_Nursing-Practice-in-Digitally-Enabled-Care-Environments_E.pdf (accessed on 1 November 2025).

17. Chen, Z. F., Ji, Y. G., & Men, L. R. (2023). Effective social media communication for startups in China: Antecedents and outcomes of organization–Public dialogic communication. New Media & Society, 25(12), 3613–3640.

18. Hielscher, T.; Khalil, S.; Virgona, N.; Hadigheh, S.A. A Neural Network Based Digital Twin Model for the Structural Health Monitoring of Reinforced Concrete Bridges. Structures 2023, 57, 105248.

19. Raghunathan, K.; McKenna, L.; Peddle, M. Baseline evaluation of nursing students’ informatics competence for digital health practice: A descriptive exploratory study. Digit. Health 2023, 9, 20552076231179051.

20. Najafi, B.; Veranyan, N.; Zulbaran-Rojas, A.; Park, C.; Nguyen, H.; Nakahara, Q.K.; Elizondo-Adamchik, H.; Chung, J.; Mills, J.L.; Montero-Baker, M.; et al. Association Between Wearable Device-Based Measures of Physical Frailty and Major Adverse Events Following Lower Extremity Revascularization. JAMA Netw. Open 2020, 3, e2020161.

21. Cay, G.; Lee, M.; Armstrong, D.G.; Najafi, B. SmartBoot: Real-Time Monitoring of Patient Activity via Remote Edge Computing Technologies. Sensors 2025, 25, 4490.

22. Madni, A.M.; Madni, C.C.; Lucero, S.D. Leveraging Digital Twin Technology in Model-Based Systems Engineering. Systems 2019, 7, 7.

23. Buchanan, C.; Howitt, M.L.; Wilson, R.; Booth, R.G.; Risling, T.; Bamford, M. Predicted Influences of Artificial Intelligence on the Domains of Nursing: Scoping Review. JMIR Nurs. 2020, 3, e23939.

Downloads

Published

2026-01-21

Issue

Section

Articles