Study Points to Need for Performance Standards for EHR Usability and Safety

July 18, 2018 —A novel new study provides compelling evidence that the design, development and implementation of electronic health records (EHRs) need to be improved to make them easier to use by clinicians and, ultimately, safer for patients.

The study, entitled “A usability and safety analysis of electronic health records: a multi-center study,” was published July 2 by the Journal of the American Medical Informatics Association. It was conducted by researchers with MedStar Health’s National Center for Human Factors in Healthcare, the American Medical Association (AMA) and others, and was funded by the AMA. Researchers focused on the two largest EHR vendors, Epic and Cerner, who comprise more than 50 percent of the market. They conducted the study at two sites per vendor, or four health systems.

Twelve to 15 emergency physicians per site were given common tasks mimicking real patient cases—placing orders for medical imaging, lab tests and medications. Researchers collected data pertaining to length of time and number of clicks to complete each task plus the degree of accuracy. The findings showed huge variability in performance across the sites. For example, time to complete an imaging order varied from 25 seconds at one site to more than a minute at another. Placing an imaging order required an average of eight clicks at one site, while the same task at a different site averaged 31. For a medication order, one site recorded no errors while another had a 30 percent error rate.

“While there are many benefits to using EHRs, there are also usability and safety challenges that can lead to patient harm,” said the study’s lead author Raj Ratwani, Ph,D,, center director and scientific director of the MedStar Human Factors Center, and a leading researcher of EHR safety and usability.

To have their products certified, EHR vendors are required by the federal government to employ user-centered design as they develop systems and to conduct usability testing near the end of the process. But EHR usability challenges persist due to several reasons outlined in the study. One large factor is that EHRs are configured and customized by the vendor and health system during implementation, and the resulting product may be significantly different from the one that was tested by the vendor to meet government requirements for usability and safety.

“Our findings reaffirm the importance of considering patient care and physician input in the development and implementation of EHRs,” said study co-author Michael Hodgkins, M.D., chief medical information officer of the AMA. “There are multiple variables impacting the end-user experience that contribute to physician burnout, a diminished patient-physician relationship and unrealized cost savings. While design can be an important factor, so too can implementation choices made onsite. Increased collaboration between vendors, information technology purchasers and physicians is needed to optimize experiences and address current needs.”

The study’s authors conclude, “Our results suggest that basic performance standards for all implemented EHRs should be considered in order to ensure usable and safe systems. Both EHR vendors and providers should work together to ensure that usable and safe products are implemented and used.”

Study authors are: