Impact of Simulated Electronic Health Records on Informatics Competency of Students in Informatics Course
Article information
Abstract
Objectives
Nursing has embraced online education to increase its workforce while providing flexible advanced education to nurse professionals. Faculty use virtual simulation and other adaptive learning technologies to enhance learning efficiency and student outcomes in online courses. The purpose of this study was to assess the impact of simulated Electronic Health Records (EHRs) on informatics competency in a graduate online informatics course.
Methods
A two-group independent measures study design was adopted to assess students’ perception of a simulated EHR while comparing differences in informatics competencies between an intervention group and a control group. A simulated EHR assignment was provided to students in the intervention group, and a paper assignment was provided to those in the control group. The informatics competency of the students was measured using the Self-Assessment of Informatics Competency Scale for Health Professionals (SICS).
Results
Students who were enrolled in a family nurse practitioner program in fall of 2019 participated in this study (n = 39). The students expressed positive perceptions of a simulated EHR experience. The SICS results indicated that students in the intervention (simulated EHR) group showed higher informatics competency than those in the control group.
Conclusions
The positive results of this study support incorporating simulated EHR exercises in online courses. Higher informatics competency in the intervention group implies that the use of simulated EHR facilitated learning of complicated informatics concepts.
I. Introduction
Due to a nursing faculty shortage nationwide and demands for flexible learning [1,2], nursing has had to embrace online education to accommodate a growing number of potential students [3]. Advances in information and communication technology have made high-quality online courses a feasible option in a versatile learning environment [4,5]. Online education has shifted the focus of nursing faculty to continuously enhance online learning using technologies for students to bridge the gap between knowledge acquisition and practice. In online nursing courses, web-based and virtual simulation technologies are used to improve student learning efficiency [6–8].
Online learning focuses on individual students, is speedy and flexible in time and place, enhances knowledge through easy access to information, and facilitates interaction through discussion forums and collaboration. However, online learning is vulnerable to the criticisms that it is simply a different delivery mechanism for existing methods of learning, that it lacks personal interactions and a learning community, that it is subject to technical problems, and that it is ineffective when hands-on practical skills need to be learned [9,10]. In response to these criticisms, web-based and virtual simulation have been adapted to maximize learning efficiency for online nursing curricula.
A graduate online informatics course was developed for a Family Nurse Practitioner (FNP) program at a university in North Carolina. While the course has been well received, the motivation for this study is rooted in the concern that students struggle to apply sophisticated and complex informatics concepts and knowledge in practice. A simulated hands-on experience incorporated into the course might facilitate student application of knowledge, advance skills, and improve clinical decision-making based on informatics.
The purpose of this study was to assess the impact of a simulated Electronic Health Record (EHR) experience in a graduate online informatics course. Specific outcomes were measured to answer the following research questions: (1) What is the students’ perception of a simulated EHR? (2) What are the Informatics Competency Scale’ scores? (3) What is the difference between an intervention and control group on the Informatics Competency Scale’ score?
II. Methods
1. Study Materials
EHRs have become the major source of patient information and documentation in healthcare, and they support the quality and safety of care [11]. With expanding use of EHRs, the integrity and quality of data and information input and shared by clinicians is becoming important. Well-structured EHRs have been proven to improve the quality of patient care [12]. However, there are growing concerns that clinicians misunderstand and misuse some functions of EHRs, supporting the need for informatics education and training by simulation [13]. Thus, we adapted simulated EHR as a hand-on experience in this course.
DocuCare by Wolters Kluwer is a simulated EHR developed for academic use [14]. It allows students to learn how patient data and information are constructed and encourages critical thinking about patient documentation using patient scenarios in a safe and true-to-life setting while allowing instructor feedback [14]. It was hypothesized that when Docu-Care is used in a graduate informatics course, it would have a synergistic effect on student learning.
2. Study Design and Setting
A two-group independent measures design was utilized to test the impact of a simulated EHR experience in a graduate online informatics course.
A graduate nursing informatics course for an FNP program ran on the Canvas platform, a cloud-based e-learning management system in the Fall 2019 semester. The course materials and structures of the intervention and control groups were the same. All students participated in five interactive discussion forums, took two exams, and submitted two paper assignments. In the intervention group, one of the two paper assignments was replaced with a DocuCare (simulated EHR) assignment.
3. Study Sample
Students enrolled in the course in the Fall 2019 semester were the sample of the study. The student participants were randomly assigned by the automatic grouping of Canvas to either the intervention group or the control group.
4. Study Instruments
Survey questionnaires (a total of six items with a 4-point Likert-scale) were developed by a research team for the research question, “What is the students’ perception of a simulated EHR?” The Self-Assessment of Informatics Competency Scale for Health Professionals (SICS) [15] tool was used to collect data for the research questions, “What are the Informatics Competency Scale’s scores?” and “What is the difference between the intervention group and the control group on the Informatics Competency Scale’ score?” The SICS (total 18 items with 5-point Likert-scale) has strong reliability (Cronbach’s alpha = 0.93) and measures three domains of informatics competency: basic computer skills, role, and applied computer skills (clinical informatics).
5. Study Procedure
This study received approval through the University’s Institutional Review Board (No. 19-0251) as exempt research.
1) Scenario customization
Ten built-in patient scenarios were taken from DocuCare and customized for students in an FNP program. All scenarios were modified following a patient visit to an outpatient clinic to see an FNP. Each scenario’s health information, such as vital signs, lab data, and nursing orders were simulated accordingly. Modified scenarios and simulated health data were displayed for students’ use in DocuCare.
2) DocuCare (simulated EHR) assignment
Each scenario in DocuCare included vital signs, laboratory data (e.g., urine analysis, complete blood count, X-ray), and some nursing orders with a brief explanation of the reason for the patient’s visit. Each student in the intervention group was trained on how to use DocuCare (e.g., reviewing patients’ information, ordering labs, writing assessment notes) through a 15-minute instruction video one week before starting the assignment. Also, written instructions on the DocuCare assignment were posted on Canvas. Once students accessed DocuCare, they were asked to select one from 10 customized scenarios. They were asked to identify the attributes of data and information from DocuCare and then synthesize knowledge (e.g., care plans) based on the identified data and information. Although time varied for individual students, it took about one hour to work through one scenario. The students were required to write a structured report after the DocuCare experience.
The students in the control group, the non-simulated EHR group, were assigned a paper assignment. They wrote a descriptive report of a computerized health information system of their own choosing to discuss during the same assignment period. Written instructions for this paper assignment were also posted on Canvas for this group.
3) Data collection
Two survey questionnaires were utilized to collect data at the end of the semester. Students in the intervention group completed two surveys: the perception of a simulated EHR (Likert scale of 7 questions with comment) and the SICS. Students in the control group completed only the SICS.
6. Data Analysis
IBM SPSS version 25 (IBM, Armonk, NY, USA) was used to perform statistical analyses. Descriptive data were used to analyze the students’ demographic data. Levene’s test was used to test the assumption of normality. To facilitate comparisons across the informatics competency scale (SICS), the mean scores of each sub-domain and the full scale were calculated for each group. An independent t test was used to analyze differences between the intervention and control groups.
III. Results
There were 40 students enrolled in the course, and all participated in this study, although one student later withdrew consent for their data to be used in the analysis. There were 37 (94.9%) female students and only 2 (5.1%) male students. Thirty-eight students (97.4%) were white, not Hispanic, and only 1 (2.6%) was black, not Hispanic. Twenty-six (66.7%) students were ages of 20 to 39, and 13 (33.3%) of them were over 40 years old. Half of the students (n = 19, 48.7%) reported that they had 2 to 5 years of nursing experience. Most students (n = 38, 97.4%) indicated that they used a computer several times per day, and a similar number of students (n = 37, 94.9%) indicated that they had been using a computer for longer than 2 years. Table 1 shows the characteristics of the students in the intervention and control groups.
Students’ characteristics (n = 39)
1. Perception of a Simulated EHR
Students in the intervention group indicated that the simulated EHR assignment was an enjoyable experience and that they learned something related to the real world. They also indicated that the simulated EHR helped them to understand concepts in informatics. Table 2 shows students’ perception of a simulated EHR.
Perception of simulated EHR in the intervention group (n = 19)
2. Self-Assessment of Informatics Competency Scale for Health Professionals
Overall, the students’ mean SICS score in the intervention group was 24.84 ± 3.79, and that of the control group was 22.29 ± 3.79. The mean score of three subscales, namely, basic computer skills, role, and applied computer skills/clinical informatics, were 4.61, 2.93, and 17.29 in the intervention group and 4.08, 2.66, and 16.19 in the control group, respectively. The total and subscale means in the intervention group showed higher competency scores than those in the control group. Table 3 shows the detailed SICS scores for each group. The t test indicated statistical differences between groups in total (p = 0.04) and the subscales of basic computer skills (p = 0.03) and role (p = 0.09).
Informatics competency score (n = 39)
IV. Discussion
This study demonstrated the impact of simulated EHR on learning in a graduate online informatics course. We adopted DocuCare (simulated EHR) to improve informatics competency. DocuCare with customized scenarios was successfully presented to students enrolled in an FNP program. Overall, the results show that experiencing simulated EHR increased informatics competencies.
About 97% of students who participated in this study were frequent computer users (several times per day) with more than 2 years of computer experience. This implies that most students were computer literate, which may explain the high scores in a sub-domain of the informatics competency scale, basic computer skills, for both the intervention and control groups (Table 3).
Students who experienced the simulated EHR showed higher informatics competency than those in the control group. Both the total informatics competency and competency in each of the three sub domains were high in those who experienced simulated EHR. Activities such as identifying a patient’s important data and information, using a decision support system to visualize blood pressure patterns over a week, and synthesizing new care plans in the complicated EHR through a DocuCare assignment could enhance overall informatics competency. Studies support the rationales and outcomes of this study, which highlight the importance of a simulated EHR experience in nursing curricula and how practicing using EHRs by simulation could improve informatics competency [16–18]. Although the informatics competency measuring tool (SICS) only measures the level of self-confidence, not an absolute value [15], a benchmark for the informatics competency of students in an FNP program in this university was set.
High informatics competency in total and the basic computer skills and the role sub-domains, indicate the positive impact of a simulated EHR on informatics learning in a graduate online informatics course. Further, students in the simulated EHR group expressed between “agree” and “strongly agree” for two questions, “I felt that what I was learning in informatics was related to the real world” and “I understand the concepts in informatics because I used Simulated EHR” in the survey regarding their perception of the simulated EHR (Table 2). This reveals the positive impact of simulated EHR on informatics learning in this course.
Two major limitations were the small sample size (n = 39) and skewed students’ characteristics, which misrepresented the true makeup of the target population. Greater representation of ethnic backgrounds and males might generate different results. Also, if hands-on experience using simulated EHR was provided more than once a semester, outcomes might be different. The generalization of these study findings should be limited until more studies with larger samples are conducted.
In conclusion, given demands for the improvement of online courses, including informatics courses, a study was conducted to improve the informatics competency of students in a graduate online informatics course using simulated EHR. Hands-on experience was developed with DocuCare (simulated EHR) and successfully provided to students in an FNP program. The study results demonstrated that experiencing simulated EHR increased the students’ informatics competency and positively impacted learning of informatics concepts. The informatics competency assessed can be a benchmark for a graduate online informatics course developed for students in an FNP program.
Many nursing courses are moving to online delivery due to the shortage of nursing faculties and the demand for flexible learning. The current study’s approach and results can be used to facilitate the development of effective new online courses while enhancing existing ones.
Acknowledgments
This study was supported by the Academic Partnerships Faculty Research Grant Program (No. G58045).
Notes
Conflict of Interest
Jeeyae Choi is an editor of Healthcare Informatics Research; however, she did not involve in the peer reviewer selection, evaluation, and decision process of this article. Otherwise, no potential conflict of interest relevant to this article was reported.