UVM AHEC
Document Type
Poster
Publication Date
2024
Focus Area
Medical Practice Transformation
Abstract
Artificial Intelligence (AI) is increasingly being integrated into healthcare settings in order to enhance various aspects of the encounter including the writing of medical notes. This innovation is particularly beneficial as it allows physicians to devote more attention to patients rather than multitasking with note-writing. In Spring 2024, the University of Vermont Health Network piloted Ambient AI in note generation with 50 Primary care providers. The objective in this study is to evaluate patient satisfaction with the quality of these AI-Generated notes focusing on readability and comprehensibility. Additionally, it assesses patient perceptions of their interactions with primary care providers who utilized Ambient AI, exploring whether patients felt more focused attention from providers.
To achieve these objectives, a designed survey was deployed that targeted 12,260 patients who met specific criteria of seeing a primary care provider in the post roll-out period. The primary instrument used in this study was a detailed survey, designed to capture nuanced feedback on the AI-Generated medical notes and the overall patient-provider interaction. The survey, constructed to be clear and easily understandable, avoided technical jargon by using terms like “audio recording” instead of “AI” to prevent confusion. It was distributed anonymously and took approximately ten minutes to complete. The survey period spanned from July 25, 2024 to August 2, 2024 at 11:59 PM. It also included questions aimed at determining if experiences varied among patients who were not native English speakers helping address potential disparities.
The population studied was comprised of 12,260 patients who had appointments with primary care providers in Vermont after April 16, 2024 which marked the end of the Ambient AI pilot program. These patients were selected based on their interaction with AI-Driven Note Taking system. The survey data will be evaluated and tested for statistical significance.
Preliminary results suggest that the AI-Generated notes are of high quality, providing readable and comprehensible notes for patients. This study highlights the patient experience of AI Generated primary care visit notes as well as the need for improving AI technology to ensure equitable healthcare experiences for all patients.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Recommended Citation
Cordero, Francisco; Pudi, Varsha; Harrington, Edward; Jacobs, Alicia MD; and Cangiano, Michelle MD, "Patient Perception of Artificial Intelligence Generated Note Quality" (2024). UVM AHEC. 15.
https://scholarworks.uvm.edu/uvmahec/15