A comparison of Nursing Activity Score means for missed care dimensions in intensive care unit patients

1. Introduction

The nursing workload is one factor that can affect patient safety and nursing care in the intensive care unit (ICU) (1). Because of the conditions of the patients in ICU, nurses working in the ICU spend more time directly caring for the patients and have various responsibilities (2, 3). Nurse workloads are defined as the amount of performance required to carry out nursing activities. The amount of nursing time, level of nursing qualification; direct patient care weight; the amount of physical activity; and the complexity of care are the attributes of nurses’ workload (4).

Undesirable consequences, such as physical and emotional fatigue, nurse burnout, omission of nursing care, and reduction in quality, have been linked to workload in some studies (5-8). Missed care refers to the delay or omission of any aspect of patient care (9). The review study revealed that a majority of nurses (55-98%) reported leaving at least one task incomplete (10). The most important reported injuries related to missed care include phlebitis, pressure ulcers, skin ulcers, infection, bed falls, delirium, uncontrolled pain, and death (11, 12). Patients can experience short-term and long-term effects when nursing care is intentionally or unintentionally omitted (13).

Thoroughly examining all aspects of missed care during healthcare studies is challenging. In case of incorrect treatment, such as nonstandard bandaging, it can be detected and evaluated, but in the absence of treatment, detection is difficult without special tools like video recording or direct observation (14). Identifying factors related to missed care in the ICU and the effects of nurses’ physical workload on the quality of care are important in any culture. Previous studies relied on nurses' self-reporting to investigate missed care. The current research employed the observation method to evaluate the missed care for enriched data. This study aimed to determine the relationship between the nursing activity score and missed care in patients hospitalized in the ICU in Zanjan, Iran

2. Methods

Study design and setting

This observational and prospective study was carried out in Zanjan City, Iran, between April 3 and September 18, 2021. This study was conducted in a medical ICU of one of the training hospitals in Zanjan (Figure 1).

Sampling

All patients who were admitted to the medical ICU during the study were included in the research. The patient's legal guardian's consent was a necessary inclusion criterion for the study. To identify missed care, the nurses' performance was observed. The study observed the performance of full-time nurses who will participate. The sample size was estimated using the following formula according to study Alizadeh et al., the sample size needed to be 298 patients with α = 0.05, δ =.88, and d = 0.1 (15).

$$n={\left(\frac{Z.\delta }{d}\right)}^2$$

Measures

This study employed three instruments: a questionnaire for patient and nurse profiling, the Nursing Activity Score (NAS), and a missed care checklist.

Patient and nurses’ profile questionnaire

The patient profile included age, gender, diagnosis, GCS, and ICU length of stay. The personal and professional profiles of nurses were constructed based on gender, age, marital status, educational level, and nurse-to-patient ratio.

Nursing activity score (NAS)

This instrument, comprising 23 items, was developed by Miranda et al. (Miranda et al., 2003). This scale measures the percentage of a nurse's time spent directly caring for a critically ill patient during 24 hours in the ICU. The scoring range for the 23 items is from zero to 177 percent. The items comprise titration and monitoring, medication, laboratory, hygiene procedures, support and care of relatives and patients, administrative and managerial tasks, care of drains, ventilatory support, renal support, neurological support, metabolic support, and specific interventions. The inter-rater reliability of the questionnaire was evaluated in this study using Cohen's kappa coefficient. This tool has been confirmed as valid in various countries (15-17). Regarding the validity of the translation process, the NAS was translated based on the standards recommended in the guidelines (18). The NAS was translated into Persian by two English-Persian translators using the forward-backward translation technique. The NAS was independently translated into Persian by two translators. A group of experts, including some of the authors of this article and two other professional translators, reviewed and commented on these two Persian versions of NAS. After being translated back into English by a Persian-English translator, a group of experts confirmed the accuracy of the Persian NAS. Content validity was assessed by 10 experts (6 faculty members from the Department of Intensive Care Nursing and Emergency Nursing and 4 nursing managers). These experts evaluated the content of the Persian NAS. Afterward, the item and scale level content validity indexes were calculated for the Persian NAS tool. The 10 experts rated the relevancy of items using a 4-point Likert scale. The range of acceptable CVI values is greater than 0.80. Furthermore, two researchers simultaneously evaluated the NAS for 30 patients. The score agreement between the two researchers was 93%.

Missed care checklist

Previous studies were used as a basis for providing missed cares in the ICU (19-24). A checklist for missed care was reviewed by a panel of experts. This panel consisted of 6 critical care nursing faculty, 2 intensive care specialists, and 2 ICU head nurses. These experts identified 9 dimensions of missing care. The 9 dimensions of care comprise: 1. Assessment, 2. Mobility and motion, 3. Response to patient’s needs and call alarm within 5 min, 4. Patient education, 5. Hand hygiene, 6. Infection control (eye, skin, mouth, perineum and wound or sore care, IV/central line site care and change of disposable devices according to hospital policy), 7. Oxygen therapy, 8. Implementation of urgency order, 9. The nutritional care. In each of these nine dimensions, there are four items. This checklist employs a rating scale of 0 (not applicable), 1 (not done), 2 (done incompletely), and 3 (done completely), with 3 being the highest score. The mean ratio was used to compute the score of each of the 9 dimensions of missed care, following this formula.

$$\mathit{S}\mathit{c}\mathit{o}\mathit{r}\mathit{e}=\frac{\mathit{T}\mathit{o}\mathit{t}\mathit{a}\mathit{l}\mathit{s}\mathit{c}\mathit{o}\mathit{r}\mathit{e}\mathit{s}\mathit{o}\mathit{f}\mathit{c}\mathit{a}\mathit{r}\mathit{e}\mathit{i}\mathit{t}\mathit{e}\mathit{m}\mathit{s}}{\left(\mathit{T}\mathit{h}\mathit{e}\mathit{n}\mathit{u}\mathit{m}\mathit{b}\mathit{e}\mathit{r}\mathit{o}\mathit{f}\mathit{i}\mathit{t}\mathit{e}\mathit{m}\mathit{s}\mathit{c}\mathit{a}\mathit{r}\mathit{e}-\mathit{N}\mathit{o}\mathit{t}\mathit{a}\mathit{p}\mathit{l}\mathit{i}\mathit{c}\mathit{a}\mathit{b}\mathit{l}\mathit{e}\right)\ast 3}\ast 100$$

The missed care assessment had 4 levels. A scoring range of 1-25 indicates a very high level of missed care, while 26-50 indicates a high level, 51-75 indicates a moderate level, and 76-100 indicates a low level. The missed care checklist for 30 patients was scored by two researchers simultaneously to calculate inter-observer reliability. These two researchers achieved an 89% agreement in their scores.

Procedures

The NAS was compiled for each patient according to the reporting of the previous 24 hours by first author. Missed care in patients was evaluated through direct observation using the missed care checklist. Missed care was observed in the patients whose NAS was calculated. The nurse's care performance was observed on the patient to calculate their NAS. On average, each nurse participating in the study had their care performance observed eight times. Missed cares in patients were observed by a nursing master's intern researcher in the same medical ICU. Nurses were aware of the aim of the study. They were aware their performance would be observed, but the exact timing and details were unknown. The researcher's own presence in the ward allowed for natural observations of nurse behavior and performance.

Ethical considerations

This study was conducted after approving Iran’s National Committee for Ethics in Biomedical Research (IR. ZUMS.1397.324). Written consent was obtained from the legal guardian of the patient and nurses participating in the study. The purpose of the research was explained to the legal guardian of the patient and the nurses.

Statistical analysis

Data were analyzed using IBM SPSS Statistics for Windows, version 24 (IBM Corp., Armonk, N.Y., USA). In this study, the kurtosis and skewness of the data were in the range (2, -2), so the data had a normal distribution. Descriptive statistics were reported as N (%) for categorical variables and the mean and confidence interval (CI) for continuous variables. Analysis of variance (ANOVA) was used to evaluate the mean difference based on the levels of missed care.

Logistic regression was used to assess the association of variables with the level of missed care. The regression analysis used the backward variable selection method because of the high number of variables included in the analysis. The following variables were included in the regression analysis: NAS, patient related variables (gender, age, patient diagnosis, level of consciousness based on GCS and type of oxygen therapy), nurse related variables (gender, age, marriage status, employment status, education level, work experience, working hours/months, and nurse-patient ratio).

To conduct a logistic regression, the high/low of missed care was summarized for each individual as follows. The high-missed care group was defined as ‘very high missed care’ or ‘high missed care’ and the low-missed care group was defined as ‘moderate missed care’ and ‘low missed care. Therefore, for each dimension, missed care was defined as ‘high missed’ if the option was 0-1, and as ‘moderate missed’ if the response was 2-3.

3. Results

Participant

Patient

Most of the patients hospitalized in this ward were men, with a mean age of 60.02±21.17 (95 % CI: -19.98-22.20). Metabolic disorders were the most frequently hospitalized in the medical ICU, and the patients were often intubated (endotracheal) and under ventilation (Table 1).

Nurses

The study involved 38 of 45 nurses. Table 2 shows that most nurses were female, married, with a bachelor's degree, and 3-5 years of experience.

NAS

The mean NAS in this Medical ICU was 76.31± 14.01 (95 % CI: -13.06 -14.89).

Frequency and percentage of missed care in each care

The results of Table 3 showed that the most frequently missed care include: Applying deep vein thrombosis (DVT) prevention (53.8%), skin and vascular assessment of the upper and lower limbs at the place of restriction (49.5%), attention to ventilator settings at the beginning of the shift (46.5%), change the direction of the endotracheal tube to prevent ischemia at least once per shift (34.6%), assessment and recording the patient’s mental state (35.5%), hand hygiene before touching a patient (33.2 %), assessment and recording of SPO2 of the patient (34.6), hand hygiene before performing care procedures (34.2%), checking the correct location of the endotracheal tube and measuring endotracheal tube intracuff pressure at least once per shift (25.9) and measuring gastric residual volume (28.2%).

Frequency and percentage of missed care dimensions

Motion and mobility had high missed care at 1.7%, while oxygen therapy, patient education, and urgency order implementation had low missed care. Missed care was moderate for responding to patient needs and alarms within 5 minutes, hand hygiene, infection control, and nutritional care. The score for missed care was moderate. Table 3 shows that missed care did not happen in 59.3% of cases.

The compare means of NAS according to levels of missed care dimensions

The results of evaluating the mean NAS based on the levels of missed care showed that, except for the evaluation dimensions, hand hygiene, and infection control (p<0.05), there was no mean difference in NAS in other dimensions and the total score of missed care (Table 4). Also, the results of the LSD post hoc test showed that, in the dimension of assessment (p=.018), hand hygiene (p=.013), and infection control (p=.016), the workload based on NAS at the medium level was significantly higher than the low level.

Factors related to the occurrence of missed nursing care

Work experience was the only remaining variable with R2=0.02 in the backward method of logistic regression. The prevalence of missed care was significantly lower in participants with higher work experience (OR =.59, 95% CI: .37–.94, χ2= =4.97, p =.026). Therefore, work experience is a protective factor for missing care.

4. Discussion

Results show that the mean NAS in Medical ICU was 76.31 of 177% (95 % CI: -13.06 -14.89).

In the study by Momennasab et al. in Shiraz (Iran), the mean NAS in the trauma ICUs was 65.3% ± 23.19% (25). The mean NAS in 16 hospitals in Belgium was 68.6% (26). In the study by Camuci et al., the highest mean NAS was reported in the burn ICU at 70.4% (27). In 19 ICUs across seven countries, Padilha et al. observed a mean NAS of 72.8%, ranging from 44.5% in Spain to 101.8% in Norway (28). The disparity in workload among studies may be because of distinctions in ICU typology. The workload of nurses in the burn, trauma, cardiac, and medical ICUs differs, as expected. In certain hospitals, ICUs are specialized for particular diseases, while in others, medical, trauma, and burn patients are admitted in one ICU. The mix of patients with various illnesses affects the nurses' workload.

This study showed that 40.7% of care was missed in 9 dimensions. Chegini et al.'s research discovered that 72.1% of nurses usually miss at least one nursing care during their last shift (29). Results Haftu et al. showed that 299 (74.6%) nurses and midwives commonly missed at least one nursing care in the perinatal setting (30). The study conducted by Ball et al. revealed that 86% of nurses couldn't complete one or more care activities because of insufficient time during their last shift (21). Ball et al. found that 74% of nursing care omissions occurred in general medical and surgical wards (31). Various settings have been used to conduct these studies. Most studies report a higher percentile of missed care than the present study. These studies have been conducted in different environments (wards and ICUs). The results in all these studies were based on self-reporting (21, 29-31), which can lead to either overestimation or underestimation by participants. Although this study was conducted observationally, it made the data more objective than previous studies.

The most missed care was mobility, motion, and hand hygiene dimensions, and the least missed care was the patient education dimension. A study showed that nurses had better hand hygiene practices with fewer instances of missed care, in contrast to our findings..(32). On the other hand, patient mobility is a crucial aspect of ICU recovery, and neglecting it may lead to complications and slow down the healing process (33). It's important for head nurses to supervise the careful administration of this care. Also, our result differs from the results of Chegini et al., who reported a high percentage of missed care in the dimension of patient education (29). Discrepancy in the results is attributed to the difference in the study setting. Due to low levels of consciousness, this dimension was inapplicable for most ICU patients in the present study.

The results of evaluating the mean difference of NAS based on the levels of missed care showed that, except for the dimensions, assessment, hand hygiene and infection control, there was no significant mean difference in NAS in other dimensions and the total score of missed care.

In the present study, infection control and hand hygiene were significantly related to NAS. The increase in workload led to a loss of care. In a study, hand hygiene was associated with workload (34). Hand hygiene and infection control can shorten ICU patients' hospital stays, so it is necessary to teach ICU nurses about the importance of hand hygiene.

Unlike previous research (35-37), the current study found no association between missed care and the personal or professional characteristics of nurses or patient characteristics. The present study has different results as Ball et al. observed a significant relationship between nurse-patient ratio and missed care (21). A review study found that missed nursing care reports were linked to low registered nursing staff (36). Tubbs-Cooley et al. found that missed care was associated with nurses' workload (35). In a review study, it was found that missed nursing care correlated with patient acuity, workload, work environment, and nurse characteristics, resulting in patients staying in the hospital for a longer period (37). The findings of previous studies varied because of differences in nurse-to-patient ratios between general wards and the ICU.

The study discovered that nurses' workload had little effect on the frequency and completeness of some routine care behaviors. Care that was not provided was sometimes documented in the nursing record, as noted in another study (38). De Marinis et al. found nursing records unsuitable for quality care evaluation (39).

In Iran, nurses have faced a high volume of documentation work (40). Although documenting care is vital, it may override patient care, causing nurses to unintentionally or intentionally exclude specific care. Complications from not providing adequate patient care often develop slowly. All healthcare providers, not only the nurse, are responsible for these patient complications. Studies in most countries have reported missed cares, indicating a lack of patient safety culture (21, 29-31). Missed care can be prevented by enhancing nurses' knowledge and changing the culture of patient safety, particularly among nursing managers (22, 41, 42). According to Tubbs-Cooley et al., system factors may be a contributing factor to missed care in this setting (32).

In line with Plein's research, our study found that work experience helps prevent missed care (43). Novice nurses, who had less work experience, were responsible for more patients. They also took care of patients who were far from the nursing station and the treatment room, requiring them to travel a long distance during their shift. These cases increased the workload of nurses. Appropriate staffing and fair work distribution prevent missed care. Missed care was found to be related to the work environment in prior studies (44-46).

5. Conclusion

The study revealed a high incidence of missed care. The study revealed that the mean workload was high in certain dimensions of care such as assessment, hand hygiene, and infection control. The increase in workload for nurses results in lost care. Nonetheless, the utilization of experienced nurses can help mitigate this problem. To assess the factors related to ICU nurses' workload and patient care quality, additional studies are recommended.

6. Strength and limitation

The study's strength was in using the observation method to measure missed care. Compared to previous studies, the data in this study is richer. Altering participant behavior and invading personal privacy are factors that limit observations. Nurses in the study had informed consent and awareness of objectives study, but were not informed of case details to reduce behavior change. By trying to keep the anonymity of the hospital and nurses, the rights of the participants were respected.