2. Diagnostic Errors in Obstetrics and Selected Research Methods
Diagnostic errors in medicine are the failure to establish an accurate and timely explanation of a patient’s health problem or to communicate that explanation to the patient [
6]. When dangerous obstetric conditions are under- or misdiagnosed these errors represent a significant patient safety threat; it is impossible provide the correct treatment without the correct diagnosis. Research in general medicine estimates the incidence of diagnostic errors is 10 to 15%, with studies of hospital autopsies reporting major error rates of 8 to 24% [
7,
8,
9]. This translates to over 12 million Americans estimated to be affected by diagnostic errors each year [
10]. Among malpractice claims, diagnostic errors are the most common, most costly, and most dangerous medical mistakes [
11]. With regards to the impact of diagnostic errors on patients, the first nationwide estimate of morbidity and mortality due to diagnostic errors was published in 2024 and estimates 795,000 annual serious harms or deaths related to diagnostic errors [
12]. In addition, diagnostic errors are costly, estimated to total more than
$100 billion per year [
13].
While the traditional notion of medical diagnosis conjures an internal process in a single doctor’s mind, today’s means of arriving at a diagnosis is a multistep, interdisciplinary process and collaboration between providers, patients, and the health environment and system. Medical diagnosis is a complex, inexact science with an inherent and variable measure of uncertainty. Thus, diagnostic errors often refer not to a provider’s lack of medical knowledge or error in judgment, but rather to failures and opportunities in health systems [
14].
Frameworks such as the Safer Dx model highlight the systems approach to diagnostic errors. The Safer Dx model utilizes the Donabedian structure-process outcome model in which the structure is the complex adaptive sociotechnical system in which the diagnosis takes place [
15]. It defines the sociotechnical dimensions of diagnostic error including team members, clinical context, workflow and communications, technology, organizational features, and the regulatory environment. It also clearly defines the components of the diagnostic process such as the patient-provider encounter, the performance and interpretation of diagnostic tests, follow up of diagnostic information, referrals, and patient-related factors. These factors lead to the intermediate outcome of safe diagnoses and the ultimate goal of improved patient outcomes.
Specific to obstetrics, prior studies suggest provider-level factors contribute to a large proportion of harm during and after pregnancy [
5]. Thus, a focus on the contribution of diagnostic errors in obstetrics has the potential to significantly reduce morbidity and mortality. Following the structure, process, and outcomes of diagnostic errors yields many opportunities for investigation; however, research on diagnostic errors in our field of obstetrics is extremely limited. To date, there are no nationwide estimates of diagnostic errors and harms in the field of obstetrics and existing smaller studies are limited and largely international. There are many approaches to estimate the rate and impact of diagnostic errors. Selected methods for obtaining diagnostic error rates and harm burdens are detailed here, with examples of each (
Table 1).
- 1)
Clinicopathologic autopsy research
First, retrospective clinicopathologic studies using autopsy data can provide information on diagnostic errors for obstetric mortality. This approach can capitalize on objective pathologic evidence to corroborate or dispel the working cause of death and therefore provide concrete information on diagnostic errors.
Published literature on obstetric diagnostic errors from clinicopathologic studies is scarce. To provide an example of this method: a retrospective study of clinicopathologic discrepancies in obstetric mortality in Mozambique studied 91 obstetric-related deaths and complete diagnostic autopsies were used as the gold standard to determine the cause of death. These were compared to the clinical diagnosis and discrepancies were classified as major and minor diagnostic errors. False negative diagnoses were discrepancies for which the autopsy diagnosis was in the assessed diagnostic category, but the clinical diagnosis was in another diagnostic category. False positive diagnoses were classified as discrepancies for which the clinical diagnosis was in the diagnostic category but not the autopsy diagnosis. The authors found 38% had a clinicopathologic discrepancy. By category, the sensitivity for eclampsia was 100% but the positive predictive value only 33%. The sensitivity for peripartum infections was 17% and the positive predictive value 50%. For obstetric hemorrhage, the sensitivity was 62% with a positive predictive value of 95% [
16].
The use of autopsy data to identify obstetric diagnostic errors is limited by the flaws inherent in the autopsy process and by the fact that only cases referred to and accepted by a medical examiner will be included. There may be bias in which cases are referred. In addition, this method provides diagnostic error rates for pregnancy-related mortality but does not include morbidity.
- 2)
Retrospective chart review of clinical criteria
Another approach to discerning obstetric diagnostic errors is to screen patient charts for clinical evidence of morbidity that does not have an associated documented diagnosis. For example, a retrospective review of 5517 vaginal deliveries at a single hospital in France screened for a ten-point fall in hematocrit from predelivery, corresponding to a one-liter blood loss, in charts that did not have a diagnosis of postpartum hemorrhage. These patients were compared to those who were diagnosed with hemorrhage. Among screened patients, 90, or 1.63%, met criteria for a ten-point hematocrit drop, suggesting the majority of hemorrhage leading to significant anemia was recognized. Missed diagnosis was related to the use of visual or estimated blood loss instead of quantitative blood loss [
17].
The process of chart review for clinical evidence of an obstetric diagnosis creates an objective framework to discern diagnostic errors. Taking postpartum hemorrhage as an example, in addition to laboratory evidence of anemia it can be utilized for quantitative blood loss. It can also be applied to other measures such as sepsis and hypertension criteria. One benefit of this process is that once implemented at an institution or across a health system, it is easily replicable. Moving from the idea of identification of diagnostic errors to prevention, chart review for missed diagnoses in the electronic medical record holds great potential to be converted from a retrospective review process to real-time clinical decision support and, even further, to prospective predictive modeling.
- 3)
Obstetric simulation and standardized patients
Another approach is to use simulation to study the misdiagnosis of obstetric conditions. For example, a cross-sectional study in birthing facilities in the Philippines crafted identical simulated case for 103 obstetrics providers for cephalopelvic disproportion, postpartum hemorrhage, and preeclampsia. The overall rate of misdiagnosis was 29.8%. The most common scenarios included, cephalopelvic disproportion (in 25% of cases), postpartum hemorrhage (in 33% of cases), and preeclampsia (in 31% of cases) [
18].
Simulation-based approaches to diagnostic errors have several benefits. They have the immediate advantage of allowing providers to receive real-time feedback on their diagnostic process. They can identify which obstetric conditions have the highest rates of diagnostic errors among providers undergoing simulation to prioritize ongoing education efforts and performance improvement strategies. Knowledge gaps and systems issues brought to the surface via simulation can generate diagnostic tools such as clinical algorithms, checklists, and electronic health record clinical decision support. Through these approaches, lessons learned from simulation can be broadly disseminated to multidisciplinary teams, even if not present for the simulation, and built into provider workflows.
Simulations for diagnostic errors do not typically yield information on real patient cases and rates of diagnostic errors. However, a unique aspect of this study was linkage to real patient data at the providers’ health facilities. Medical charts of patients with obstetric complications at each participating provider’s facility were reviewed for diagnostic errors and patient interviews were conducted for information on health outcomes and costs. The authors found an association between provider misdiagnosis in simulation and the presence of patient complications (OR 2.97, 95% CI 1.41, 3.32), worse outcomes, delays in referrals, and increased out-of-pocket patient costs. This novel method of linking simulation data to health system data and qualitative patient interviews may offer more robust information on which to build quality, patient safety and performance improvement initiatives.
- 4)
Pregnancy-related or -associated morbidity and mortality case reviews
Pregnancy-related or -associated cases of severe morbidity and mortality are typically reviewed at an institutional or health system level via incident reporting systems and mortality at the state or city level by maternal mortality review committees. The goal of these reviews is to seek and analyze comprehensive data from the case, determine whether the harm was associated with pregnancy, and develop recommendations to prevent similar harm in the future.
As a state-specific example, in a New York State Department of Public Health publication of the 117 pregnancy-related deaths (within one year of delivery) in 2018, 78% were deemed preventable. By category of obstetric cause of death, 100% of deaths due to hemorrhage, cardiomyopathy, and mental health were determined to be preventable. In examining the factors contributing to obstetric deaths in New York State, provider-level aspects including medical knowledge, clinical assessment, skill, quality of care, care coordination and continuity, and delay in care were contributory in 36.8% of cases. In 21.9%, facility level issues played a role, including clinical skill, quality of care, care coordination and continuity, policies and procedures, and equipment and technology. In 19.4% of cases, system level factors were at play, such as knowledge, clinical skill, quality of care, and structural racism [
5].
Maternal mortality review committees and institutional level severe obstetric morbidity reviews and root cause analyses offer thorough individualized case reviews that can identify diagnostic errors and offer potential solutions to prevent future instances. They can also situate diagnostic errors within the complex provider and system errors that contribute to pregnancy-related harm. Case reviews, however, rely on deaths or adverse outcomes to be referred for incident review or to a state or local review committee. Thus, an underlying and comprehensive referral infrastructure must be in place. While institution-level adverse event reporting and review captures pregnancy-related morbidity, maternal mortality review committees focus on deaths and thus do not capture non-fatal diagnostic errors.
- 5)
Malpractice and administrative claims databases
A fifth opportunity to identify diagnostic error rates and harms is the use of malpractice claims databases. For example, a study by Gupta et al. queried the US National Practitioner Database for malpractice claims and utilized multivariable logistic regression to identify patient and provider factors associated with inpatient diagnosis-related paid claims [
19]. Approximately 22% of all claims were diagnosis-related, associated with
$5.7 billion in payments over the study period. The also reported patient and provider characteristics associated with diagnosis-related claims, such as patient age and physician level of training.
To our knowledge there have not been similar studies in obstetrics. The major disadvantage of this method is the lack of detail regarding the clinical case and surrounding health systems processes that contributed to the diagnostic error and harm. However, the use of malpractice databases to identify diagnostic errors in obstetrics presents an opportunity for high-level understanding of diagnostic error rates by obstetric condition, patient and provider factors associated with diagnostic errors, and estimates of the financial impact of these harms.