Trust Formation Associated with Algorithmic Triage Acceptance in Emergency Service Users
Keywords:
Algorithmic Triage, Emergency Medical Services, Trust Calibration, Simulation Trial, Trust FormationAbstract
The rapid development and integration of clinical decision support systems have made algorithmic triage a viable solution for managing patient overflow in emergency medical services. However, the deployment of such systems is severely bottlenecked by the challenge of user acceptance, which depends heavily on the dynamics of trust formation. This study examines how emergency service users form, calibrate, and maintain trust when interacting with algorithmic triage applications. Utilizing a randomized, high-fidelity trial simulation, we evaluated the responses of emergency department service users who interacted with varying configurations of an automated triage system. The simulation systematically manipulated algorithmic transparency, feedback response times, and error rates across diverse clinical urgency scenarios. Quantitative outcomes measured through standardized trust scales and behavioral compliance metrics were combined with qualitative user experience data. The findings indicate that trust is a highly malleable, multi-dimensional construct that is heavily influenced by the explanation interfaces provided during the triage process. We show that explainable AI features significantly improve trust calibration, helping to prevent both over-reliance and under-reliance. Furthermore, cognitive load and baseline technological trust act as critical mediating variables in the trust-acceptance pathway. The insights gained from this simulation trial provide concrete, evidence-based recommendations for healthcare designers and clinical administrators aiming to implement safe, transparent, and highly accepted algorithmic triage systems.References
1. Byrne, G.J.; Pachana, N.A. Development and validation of a short form of the Geriatric Anxiety Inventory—The GAI-SF. Int. Psychogeriatr. 2011, 23, 125–131.
2. Ribeiro, O.; Paúl, C.; Simões, M.R.; Firmino, H. Portuguese version of the Geriatric Anxiety Inventory: Transcultural adaptation and psychometric validation. Aging Ment. Health 2011, 15, 742–748.
3. Dang, H.; Tatipamula, M.; Nguyen, H.X. Cloud-Based Digital Twinning for Structural Health Monitoring Using Deep Learning. IEEE Trans. Ind. Inform. 2022, 18, 3820–3830.
4. Marvel, M. R., Wolfe, M. T., & Kuratko, D. F. (2020). Escaping the knowledge corridor: How founder human capital and founder coachability impacts product innovation in new ventures. Journal of Business Venturing, 35(6), 106060.
5. Lu, X.; Wei, C.; Sun, L.; Zhang, W. Bridge Damage Localization Through Response Reconstruction with Multiple BP-ANNs Under Vehicular Loading. Appl. Sci. 2024, 14, 10226.
6. Madubuike, O.C.; Anumba, C.J.; Khallaf, R. A Review of Digital Twin Applications in Construction. J. Inf. Technol. Constr. 2022, 27, 145–172.
7. Shi, L.; Ding, Y.; Cheng, B. Development and Application of Digital Twin Technique in Steel Structures. Appl. Sci. 2024, 14, 11685.
8. Yao, J.-F.; Yang, Y.; Wang, X.-C.; Zhang, X.-P. Systematic Review of Digital Twin Technology and Applications. Vis. Comput. Ind. Biomed. Art 2023, 6, 10.
9. Vuoto, A.; Funari, M.F.; Lourenço, P.B. On the Use of the Digital Twin Concept for the Structural Integrity Protection of Architectural Heritage. Infrastructures 2023, 8, 86.
10. Nowell, L.S.; Norris, J.M.; White, D.E.; Moules, N.J. Thematic Analysis: Striving to Meet the Trustworthiness Criteria. Int. J. Qual. Methods 2017, 16, 1609406917733847.
11. Tricco, A.C.; Lillie, E.; Zarin, W.; O’Brien, K.K.; Colquhoun, H.; Levac, D.; Moher, D.; Peters, M.D.J.; Horsley, T.; Weeks, L.; et al. PRISMA Extension for Scoping Reviews (PRISMAScR): Checklist and Explanation. Ann. Intern. Med. 2018, 169, 467–473.
12. Kim, S.; Park, C.; Park, S.; Kim, D.J.; Bae, Y.S.; Kang, J.H.; Chun, J.W. Measuring digital health literacy in older adults: Development and validation study. J. Med. Internet Res. 2025, 27, e65492.
13. Gao, Y.; Qian, S.; Li, Z.; Wang, P.; Wang, F.; He, Q. Digital Twin and Its Application in Transportation Infrastructure. In Proceedings of the 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence, DTPI 2021, Beijing, China, 15 July–15 August 2021.
14. Nagle, L.; Kleib, M.; Furlong, K. Digital health in Canadian schools of nursing part A: Nurse educators’ perspectives. Qual. Adv. Nurs. Educ. 2020, 6, 1–17.
15. Heider, F. (1958). The psychology of interpersonal relations. John Wiley & Sons, Inc.
16. Ries, E. (2011). El método Lean Startup cómo crear empresas de éxito utilizando la innovación continua. Deusto.
17. Liu, X.; Liu, H.; Serratella, C. Application of Structural Health Monitoring for Structural Digital Twin. In Proceedings of the Offshore Technology Conference Asia 2020, OTCA 2020, Kuala Lumpur, Malaysia, 24–27 March 2020.
18. Iranshahi, K.; Brun, J.; Arnold, T.; Sergi, T.; Müller, U.C. Digital Twins: Recent Advances and Future Directions in Engineering Fields. Intell. Syst. Appl. 2025, 26, 200516.
19. Villafañe, J. (1999). La gestión profesional de la imagen corporativa. Pirámide.
20. Bornholdt, M.; Herbrand, M.; Smarsly, K.; Zehetmaier, G. Digital-Twin-Based Structural Health Monitoring of Dikes. CivilEng 2025, 6, 39.
21. Pregnolato, M.; Gunner, S.; Voyagaki, E.; De Risi, R.; Carhart, N.; Gavriel, G.; Tully, P.; Tryfonas, T.; Macdonald, J.; Taylor, C. Towards Civil Engineering 4.0: Concept, Workflow and Application of Digital Twins for Existing Infrastructure. Autom. Constr. 2022, 141, 104421.
22. Zhang, J.; Zhao, L.; Ren, G.; Li, H.; Li, X. Special Issue “Digital Twin Technology in the AEC Industry”. Adv. Civ. Eng. 2020, 2020, 8842113.
23. Benner, P. From novice to expert. Am. J. Nurs. 1982, 82, 402–407.
24. Espanha, R.; Ávila, P.; Veloso, P. Inquérito de Literacia em Saúde Portugal: Relatório; CIES-IUL (ISCTEIUL) e Fundação Calouste Gulbenkian: Lisboa, Portugal, 2016.
25. Ministério da Saúde/Direção-Geral da Saúde. Relatório—Plano de Ação para a Literacia em Saúde 2019–2021; Direção-Geral da Saúde: Lisboa, Portugal, 2022.
26. Pocinho, M.; Farate, C.; Dias, C.A. Validação psicométrica da escala UCLA-Loneliness para idosos portugueses. Interações Soc. E Novas Mod. 2010, 10, 18.
27. Aponte, J.; Nokes, K.M. Electronic health literacy of older Hispanics with diabetes. Health Promot. Int. 2017, 32, 482–489.
28. Yin, H.; Gao, C.; Quan, Z.; Zhang, Y. The relationship between frailty, walking ability, and depression in elderly Chinese people. Medicine 2023, 102, e35876.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Authors

This work is licensed under a Creative Commons Attribution 4.0 International License.
Articles are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0), unless otherwise stated.