APA FormatNo Plagiarism
Week 3 Lab Assignment
Name:________________________ Instructor Name: _______________
Please use this template to help answer the questions listed in the lab instructions. The “parts” below refer to the parts listed in the lab instructions. Type your answers and post your screenshots in the spaces given below. Then, save this document with your name and submit it inside the course room.
Part 1. Read the assigned article.
Please reach out to your instructor if you did not receive the assigned article for the term by Monday of Week 3.
Part 2. Analyze the article.
Title: Review of [Type out name of Article]
Author(s): [Type out names of Author(s) of the Article]
Summarize the article in one paragraph:
Post a screenshot of a graph/chart from the article that you will analyze:
Analysis
(Answer the following questions thoroughly in complete sentences)
A. What
type
of study is used in the article (quantitative or qualitative)?
Explain
how you came to that conclusion.
B. What
type
of graph or table did you choose for your lab (bar graph, histogram, stem & leaf plot, etc.)? What characteristics make it this type (you should bring in material that you learned in the course)?
C.
Describe the data displayed in your frequency distribution or graph (consider class size, class width, total frequency, list of frequencies, class consistency, explanatory variables, response variables, shapes of distributions, etc.)
D.
Draw a conclusion about the data from the graph or frequency distribution in context of the article.
E. How else might this data have been displayed (Pick two different graphs that could have been used to display the same data as your selected graph/table)?
Discuss
pros and cons
of
2 other presentation options, such as tables or different graphical displays.
Explain
how these graphs would be structured to display the data in the article. Why don’t you think those two graphs were not used in this article?
F. Give the full APA
reference of the article you are using for this lab.
Be sure your name is on the Word document, save it, and then submit it. In the assignment module, click “start assignment” and then “upload file” and “submit assignment”.
7 |
7
image1
Evidence Relating Health Care Provider Burnout and Quality of Care
A Systematic Review and Meta-analysis
Daniel S. Tawfik, MD, MS; Annette Scheid, MD; Jochen Profit, MD, MPH; Tait Shanafelt, MD; Mickey Trockel, MD, PhD;
Kathryn C. Adair, PhD; J. Bryan Sexton, PhD; and John P.A. Ioannidis, MD, DSc
Background: Whether health care provider burnout contrib-
utes to lower quality of patient care is unclear.
Purpose: To estimate the overall relationship between burno
u
t
and quality of care and to evaluate whether published studies
provide exaggerated estimates of this relationship.
Data Sources: MEDLINE, PsycINFO, Health and Psychosocial
Instruments (EBSCO), Mental Measurements Yearbook (EBSCO),
EMBASE (Elsevier), and Web of Science (Clarivate Analytics),
with no language restrictions, from inception through 28 May
2019.
Study Selection: Peer-reviewed publications, in any language,
quantifying health care provider burnout in relation to quality of
patient care.
Data Extraction: 2 reviewers independently selected studies,
extracted measures of association of burnout and quality of care,
and assessed potential bias by using the Ioannidis (excess signif-
icance) and Egger (small-study effect) tests.
Data Synthesis: A total of 11 703 citations were identified, from
which 123 publications with 142 study populations encompass-
ing 241 553 health care providers were selected. Quality-of-care
outcomes were grouped into 5 categories: best practices (n =
14), communication (n = 5), medical errors (n = 32), patient out-
comes (n = 17), and quality and safety (n = 74). Relations be-
tween burnout and quality of care were highly heterogeneous
(I2 = 93.4% to 98.8%). Of 114 unique burnout–quality combina-
tions, 58 indicated burnout related to poor-quality care, 6 indi-
cated burnout related to high-quality care, and 50 showed no
significant effect. Excess significance was apparent (73% of stud-
ies observed vs. 62% predicted to have statistically significa
nt
results; P = 0.011). This indicator of potential bias was most
prominent for the least-rigorous quality measures of best prac-
tices and quality and safety.
Limitation: Studies were primarily observational; neither causal-
ity nor directionality could be determined.
Conclusion: Burnout in health care professionals frequently is
associated with poor-quality care in the published literature. The
true effect size may be smaller than reported. Future studies
should prespecify outcomes to reduce the risk for exaggerated
effect size estimates.
Primary Funding Source: Stanford Maternal and Child Health
Research Institute.
Ann Intern Med. 2019;171:555-567. doi:10.7326/M19-1152 Annals.org
For author affiliations, see end of text.
This article was published at Annals.org on 8 October 2019.
Health care providers face a rapidly changing land-
scape of technology, care delivery methods, and
regulations that increase the risk for professional burn-
out. Studies suggest that nearly half of health care pro-
viders may have burnout symptoms at any given time
(1). Burnout has been linked to adverse effects, includ-
ing suicidality, broken relationships, decreased produc-
tivity, unprofessional behavior, and employee turnover,
at both the provider and organizational levels (2–6).
Recent attention has been focused on the relati
on
between health care provider burnout and reduced
quality of care, with a growing body of primary litera-
ture and systematic reviews reporting associations be-
tween burnout and adherence to practice guidelines,
communication, medical errors, patient outcomes, and
safety metrics (7–11). Most studies in this field use ret-
rospective observational designs and apply a wide
range of burnout assessments and analytic tools to
evaluate myriad outcomes among diverse patient pop-
ulations (12). This lack of a standardized approach to
measurement and analysis increases risk of bias, poten-
tially undermining scientific progress in a rapidly ex-
panding field of research by hampering the ability to
decipher which of the apparent clinically significant re-
sults represent true effects (13). The present analysis
sought to appraise this body of primary and review lit-
erature, developing an understanding of true effects
within the field by using a detailed evaluation for re-
porting biases.
Reporting biases take many forms, each contribut-
ing to overrepresentation of “positive” findings in the
published literature. Publication bias occurs when stud-
ies with negative results are published less frequently
or less rapidly than those with positive results (14). Se-
lective outcome reporting occurs when several out-
comes of potential interest are evaluated, but only
those with positive results are presented or empha-
sized (13). Selective analysis reporting occurs when
several analytic strategies are used, but those that pro-
duce the largest effects are presented. Overall, these
biases result in an excess of statistically significant re-
sults in the published literature, threatening reproduc-
ibility of findings, promoting misappropriation of re-
sources, and skewing the design of studies assessing
interventions to reduce burnout or improve quality (13).
See also:
Editorial comment . . . . . . . . . . . . . . . . . . . . . . . . . 589
Web-Only
Supplement
Annals of Internal Medicine REVIEW
© 2019 American College of Physicians 555
http://www.annals.org
http://www.annals.org
METHODS
We conducted a systematic literature review and
meta-analysis to provide summary estimations of the
relation between provider burnout and quality of care,
estimate study heterogeneity, and explore the potential
of reporting bias in the field. We followed the PRISMA
(Preferred Reporting Items for Systematic reviews and
Meta-Analyses) and MOOSE (Meta-analysis of Observa-
tional Studies in Epidemiology) guidelines for method-
ology and reporting (15, 16).
Data Sources and Searches
We searched MEDLINE, PsycINFO, Health and Psy-
chosocial Instruments (EBSCO), Mental Measurements
Yearbook (EBSCO), EMBASE (Elsevier), and Web of Sci-
ence (Clarivate Analytics) from inception through 28
May 2019, with no language restrictions. We used
search terms for burnout and its subdomains (emo-
tional exhaustion, depersonalization, and reduced per-
sonal accomplishment), health care providers, and
quality-of-care markers, as shown in Supplement Ta-
bles 1 to 3 (available at Annals.org).
Study Selection
We included all peer-reviewed publications report-
ing original investigations of health care provider burn-
out in relation to an assessment of patient care quality.
Providers included all paid professionals delivering
outpatient, prehospital, emergency, or inpatient care,
including medical, surgical, and psychiatric care, to pa-
tients of any age. We chose an inclusive method of
identifying burnout studies, considering assessments to
be related to burnout if the authors defined them as
such and used any inventory intended to identify burnout,
either in part or in full. Likewise, we chose an inclusive
approach to identify quality-of-care metrics, including any
assessment of processes or outcomes indicative of care
quality. We included objectively measured and subjec-
tively reported quality metrics originating from the pro-
vider, other sources within the health care system, or pa-
tients and their surrogates. We considered medical
malpractice allegations a subjective patient-reported
quality metric. Although patient satisfaction is an impor-
tant outcome, it is not consistently indicative of care qual-
ity or improved medical outcomes, suggesting that it may
be related to factors outside the provider’s immediate
control, such as facility amenities and access to care (17–
20). Thus, for the purposes of this review, we excluded
metrics solely indicative of patient satisfaction to reduce
bias from these non–provider-related factors that may af-
fect satisfaction.
We included peer-reviewed, indexed abstracts if
they reported a study population not previously or sub-
sequently reported in a full-length article. For study
populations described in more than 1 full-length arti-
cle, we included the primary result from the paper with
the earliest publication date as the primary outcome,
with any unique outcomes from subsequent articles as
secondary outcomes. We supplemented the database
searches with manual bibliography reviews from in-
cluded studies and related literature reviews (7–9, 21–
24). In line with our aim to look for reporting bias, we
did not expand our search beyond peer-reviewed pub-
lications and did not contact authors for unpublished
data. If an article presented insufficient data to calculate
an effect size, we supplemented the information with
data from subsequent peer-reviewed publications
when available; however, we still attributed these effect
sizes to the initial report. We excluded any studies that
were purely qualitative.
All investigators contributed to the development of
study inclusion and exclusion criteria. The literature re-
view and study selection were conducted by 2 inde-
pendent reviewers in parallel (D.S.T. and either A.S. or
K.C.A.), with ambiguities and discrepancies resolved by
consensus.
Data Extraction and Quality Assessment
We extracted data into a standard template reflect-
ing publication characteristics, methods of assessing
burnout and quality metrics, and strength of the re-
ported relationship. Data were extracted by 2 indepen-
dent reviewers (D.S.T. and A.S.), with discrepancies re-
solved by consensus. We estimated effect sizes and
precision using the Hedges g and SEs, respectively.
The Hedges g estimates effect size similarly to the Co-
hen d, but with a bias correction factor for small sam-
ples. In general, 0.2 indicates small effect; 0.5, medium
effect; and 0.8, large effect.
We classified each assessment of burnout as over-
all burnout, emotional exhaustion, depersonalization,
or low personal accomplishment. We also identified
burnout assessments as standard if defined as an emo-
tional exhaustion score of 27 or greater or a deperson-
alization score of 10 or greater on the Maslach Burno
ut
Inventory, or as the midpoint and higher on validated
single-item scales. We categorized quality metrics within
5 groups—best practices, communication, medical errors,
patient outcomes, and quality and safety—and reverse
coded any “high-quality” metrics such that positive effect
sizes indicate burnout’s relation to poor-quality care.
For publications with several distinct (nonover-
lapping) study populations reported separately, we con-
sidered each population separately for analytic purposes.
For publications with more than 1 outcome for the same
study population, we decided to perform analyses using
only 1 outcome per study, ideally the specified primary
outcome. If no primary outcome was clear, we chose the
first-listed outcome, consistent with reporting conventions
of presenting the primary outcome first. We considered
other outcomes secondary, excluding them from the pri-
mary analyses to avoid bias from intercorrelation but in-
cluding them in selected descriptive statistics and strati-
fied analyses when appropriate.
Data Synthesis and Analysis
We calculated the Hedges g from odds ratios (di-
chotomized data) by using the transformation
log�OR�*
�3
�
or from correlation coefficients (unscaled
continuous data) by using the transformation
2*r
�1 � r2
,
REVIEW Burnout and Quality of Care
556 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.annals.org
http://www.annals.org
both multiplied by a bias correction factor �N � 2
N
con-
sistent with published norms (25, 26). Further details
are provided in the Supplement (available at Annals
.org).
Most studies reported burnout as a dichotomous
variable or with unscaled effect size estimates, facilitat-
ing the aforementioned transformations. We scaled ef-
fect sizes accordingly for the 6 studies reporting burn-
out only as a continuous variable in order to maintain
comparability, adapting our methods from published
guidelines (27, 28). On the basis of known distributions
of burnout scores among providers (29–31), we calcu-
lated the difference between the mean scores of pro-
viders with and without burnout to average 47.6% of
the span of the particular burnout scale used. We thus
converted effect sizes from continuous scales to the
corresponding effect size reflecting a 47.6% change in
scale score when needed to extrapolate to dichoto-
mized burnout. We also performed sensitivity analyses
excluding these few scaled effect sizes. Details of this
process are presented in the Supplement.
Initially, we intended to primarily perform a
random-effects meta-analysis including all primary (or
first-listed) effect sizes, with secondary meta-analyses
stratified by quality metric category and by each unique
burnout–quality metric combination. However, because
of high heterogeneity in the pooled meta-analyses, we
report only summary effects from the unique burnout–
quality metric combinations. We also performed sensi-
tivity analyses limited to studies with standard burnout
assessments and those with independently observed or
objectively measured quality-of-care markers. We used
the empirical Bayes method with Knapp–Hartung mod-
ification to estimate the between-study variance �2 (32).
We evaluated study heterogeneity using I2. Details re-
garding this meta-analytic approach are presented in
the Supplement.
We performed the Ioannidis test to evaluate for ex-
cess significance (33) by identifying the study popula-
tion with the highest precision (1/SE) among those with
the lowest risk of bias (studies using a fully validated
burnout inventory with an objective quality metric). We
then calculated the power of all studies to detect the
effect size of this study and compared the observed
versus expected number of studies with statistically sig-
nificant results by using paired t tests. Next, we strati-
fied excess significance testing by outcome category.
Because small studies may carry increased risk of
bias, we performed the Egger test to look for small-
study effects (34). We regressed standard normal devi-
ate (Hedges g/SE) on precision (1/SE) by using robust
SEs due to clustering of effect sizes at the study popu-
lation level.
We used Stata 15.0 (StataCorp) for all analyses. All
tests were 2-sided. For summary effects, we considered
2 different thresholds of statistical significance, P <
0.050 and the newly proposed P < 0.005 (35, 36). We
made no further corrections for multiple testing.
This study was performed in accordance with the
institutional review board requirements of Stanford
University and was classified as research not involving
human subjects.
Role of the Funding Source
The funders had no role in study design, data col-
lection, analysis, interpretation, or writing of the report.
Figure 1. Evidence search and selection.
Articles identified in MEDLINE
and PsyclNFO (n = 6715)
Articles identified in Web of
Science (n = 3116)
Articles identified in
EMBASE (n = 3871)
Duplicate publications (n = 1999)
Titles/abstracts screened (n = 11 703)
Not relevant (n = 11 390)
Selected for full-text review (n = 313)
Bibliographic reviews (n = 3)
Included in final analysis (n = 123)
Excluded (n = 193)
No burnout predictor: 123
No quality outcome: 46
Review/repeat population: 16
Not quantitative: 7
Not health care providers: 1
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019
557
http://www.annals.org
http://www.annals.org
http://www.annals.org
RESULTS
The search identified 11 703 citations. Screening
resulted in 313 potentially eligible publications re-
trieved in full text—120 of which were included—plus 3
additional publications identified by bibliography re-
view (Figure 1). Overall, we included 123 publications
from 1994 through 2019 (37–159), encompassing 142
distinct study populations, as detailed in Supplement
Table 4 (available at Annals.org). The median sample
size was 376 (interquartile range, 129 to 1417). The 142
study populations included physicians (n = 71 [50%]),
nurses (n = 84 [59%]), and other providers (n = 18
[13%]) for a total of 241 553 health care providers eval-
uated. Quality metrics covered inpatients (n = 122
[86%]); outpatients (n = 62 [44%]); and adult (n = 134
[94%]), pediatric (n = 93 [65%]), medical (n = 135
[95%]), and surgical (n = 89 [63%]) patients. Only 4
studies explicitly specified a primary outcome. Six stud-
ies did not provide sufficient data to derive an effect
size from the original publication but provided usable
Figure 2. Summary of all included burnout–quality metric combinations, showing frequency of effect size reporting (count)
and value of summary effect size (Hedges g).
Burnout Metric
Bur
no
ut
Em
ot
io
na
l e
xh
au
sti
on
Dep
er
so
na
liz
at
io
n
Lo
w p
er
so
na
l a
cc
om
pl
ish
m
en
t
Bur
no
ut
Em
ot
io
na
l e
xh
au
sti
on
Dep
er
so
na
liz
at
io
n
Lo
w p
er
so
na
l a
cc
om
pl
ish
m
en
t
Q
ua
lit
y
M
et
ri
c
Quality and safety
Outcomes
Errors
Communication
Best practices
3
0
25
15
C
ou
nt
10
7
5
3
1
2.0
1.5
1.0
0.5
–0.5
–1.0
–2.0
–1.5
0
H
ed
ge
s
g
20
Inappropriate laboratory tests
Inappropriate timing of discharge
Suboptimal patient care practices
Inappropriate use of patient restraints
Poor adherence to infection control
Inappropriate antibiotic prescribing
Lack of close monitoring
Low best practice score
Neglect of work
Poor adherence to management guidelines
Poor communication
Low patient enablement score
Forgetting to convey information
Low attention to patient impact
Low physcian empathy score
Not fully discussing treatment options
Poor handoff quality
Short consultation length
Self-reported medical errors
Self-reported medication errors
Self-reported treatment/medication errors
Medical error score
Observed medical errors
Accident propensity
Diagnosis delay
Diagnostic errors
Observed medication errors
Self-reported impairment
Adverse events
Health care–associated infections
Patient falls
Length of stay
Urinary tract infections
Mortality
Poor pain control
HIV viral load suppression
Morbidity
Posthospitalization recovery time
Low quality of care
Low patient safety score
Low safety climate score
Low quality during most recent shift
Low work unit safety grade
Poor patient care quality score
Malpractice allegations
Low individual safety grade
Low safety perceptions
Near-miss reporting
Prolonged emergency department visit
REVIEW Burnout and Quality of Care
558 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.annals.org
http://www.annals.org
data published in a subsequent review (39, 66, 69, 107,
115, 117). One research group reported results from a
single study population in 2 publications; the first pub-
lished effect was considered primary, with results from
the later publication considered secondary effects
(112, 160).
Overall burnout, emotional exhaustion, and deper-
sonalization were the primary predictors for 56, 75, and
11 study populations, respectively, from a variety of sur-
vey instruments, as outlined in Supplement Table 5
(available at Annals.org). The 50 distinct quality metrics
included 10 best practices, 8 communication, 10 med-
ical errors, 10 patient outcomes, and 12 quality and
safety measures (26 measured provider perception of
quality, 15 used independent or objective measures of
quality, and 9 included both types of assessments).
As illustrated in Figure 2, 38 (33%) of the 114 dis-
tinct burnout–quality combinations were reported 3 or
more times. The most frequently reported effect re-
lated emotional exhaustion to low quality of care (n =
41), with most of the reported effect sizes in the quality
and safety and medical errors categories. Although all
5 categories of outcomes had estimates more fre-
quently relating burnout in the direction of poor quality
of care (denoted in red in Figure 2), 7 of the 16 esti-
mates pointing in the opposite direction were found in
the communication category. Results were similar when
limited to primary (or first-listed, when primary was not
specified) effect sizes only (Supplement Figure 1, avail-
able at Annals.org).
Meta-analyses combining burnout and quality met-
rics within quality categories revealed I2 values of
93.4% to 98.8%, indicating extremely high heterogene-
ity; therefore, summary effects are provided only at the
level of the 114 distinct burnout–quality combinations,
46 of which included primary effect sizes. Meta-
analyses of these 46 combinations revealed 24 (52%)
with a statistically significant summary effect greater
than 0 (burnout related to poor quality of care), 1 (2%)
with statistically significant summary effects less than 0
(burnout related to high quality of care), and 21 (46%)
with no difference at the P < 0.050 threshold. When the
P < 0.005 threshold was used, the respective numbers
were 18 (39%), 1 (2%), and 27 (59%). Results are sum-
marized in Table 1, and primary effect sizes from all
included studies are shown in Supplement Figure 2
(available at Annals.org).
Results were similar when secondary effect sizes
were included. Of the 114 distinct burnout–quality met-
ric combinations, 58 (51%) had statistically significant
summary effects greater than 0, 6 (5%) had statistically
significant effects less than 0, and 50 (44%) showed no
difference at the P < 0.050 threshold. When the P <
0.005 threshold was used, the respective numbers
were 47 (41%), 6 (5%), and 61 (54%). Results from all
burnout–quality metric combinations are shown in Sup-
plement Figure 3 (available at Annals.org). Our findings
were similar when limited to studies explicitly using
standard burnout definitions, but the observed rela-
tionships were attenuated when limited to indepen-
dent or objective quality metrics, as shown in Table 1.
The most precise study with low risk of bias (143)
reported a small effect size (Hedges g = 0.26, analo-
gous to an odds ratio of 1.5 to 1.6). Using this estimate,
the Ioannidis test found an excess of observed versus
predicted statistically significant studies (73% observed
vs. 62% predicted at the 0.050 significance threshold,
P = 0.011) (Table 2). When stratified by quality metric
category, an excess of statistically significant studies was
seen in the categories of best practices and quality and
safety. Results were similar for the P < 0.005 threshold.
The Egger test did not show small-study effects (inter-
cept, �1.32 [95% CI, �3.48 to 0.85]), indicating that
smaller studies did not systematically overestimate effect
sizes (Figure 3). A funnel plot relating effect size to SE is
shown in Supplement Figure 4 (available at Annals.org).
DISCUSSION
This overview extends previous work in the field by
including a comprehensive evaluation for reporting bi-
ases in the health care provider burnout literature, en-
compassing 145 published study populations that
quantified the relation between burnout and quality of
care over 25 years for 241 553 health care profession-
als. Most of the evidence suggests a relationship be-
tween provider burnout and impaired quality of care,
consistent with recent reviews of various dimensions (7–
10, 22). Although the effect sizes in the published liter-
ature are modestly strong, our finding of excess signif-
icance implies that the true magnitude may be smaller
than reported, and the studies that attempted to lower
the risk of bias demonstrate fewer significant associa-
tions than the full evidence base. That only 4 studies
Table 1. Number and Direction of Summary Effect Sizes for Each Combination of Burnout and Quality Metric*
Criteria for Inclusion Burnout–Quality
Combinations, n†
P < 0.050 Threshold, n (%) P < 0.005 Threshold, n (%)
Hedges g > 0‡ Hedges g < 0§ No Effect�� Hedges g > 0‡ Hedges g < 0§ No Effect��
Primary effects only 46 24 (52) 1 (2) 21 (46) 18 (39) 1 (2) 27 (59)
Primary and secondary effects 114 58 (51) 6 (5) 50 (44) 47 (41) 6 (5) 61 (54)
Standard burnout definitions 24 15 (62) 1 (4) 8 (33) 14 (58) 1 (4) 9 (38)
Independent/objective quality metrics 48 14 (29) 2 (4) 32 (67) 9 (19) 2 (4) 37 (77)
* Summary effect sizes obtained via empirical Bayes meta-analysis.
† Number of distinct burnout–quality combinations represented.
‡ Indicates burnout related to poor-quality care.
§ Indicates burnout related to high-quality care.
�� Not significantly different from 0 at the specified P value threshold.
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 559
http://www.annals.org
http://www.annals.org
http://www.annals.org
http://www.annals.org
http://www.annals.org
http://www.annals.org
specified primary outcomes further supports the possi-
bility of reporting bias causing exaggerated effects.
From a 2015 search of MEDLINE, Web of Science,
and CINAHL (EBSCO), Salyers and colleagues (9) re-
ported effect sizes of r = �0.26 (Hedges g = 0.54) and
r = �0.23 (Hedges g = 0.47) for the relationship be-
tween burnout and quality and safety outcomes, re-
spectively. These effect sizes are somewhat larger than
those observed in the present study. However, the pre-
vious meta-analysis also included markers of patient
satisfaction and included only 82 studies through
March 2015. More recently, a 2017 all-language search
of MEDLINE, EMBASE, and CINAHL by Panagioti and
colleagues (10) identified 47 physician studies and re-
ported a more similar summary odds ratio of 1.96 for
patient safety incidents (approximate Hedges g = 0.37).
However, that review included 42 473 physicians (less
than 20% of the number of providers represented here)
and did not include diverse health care professionals.
The observed relationships between burnout and
quality of care are probably multifactorial. Providers
who have burnout may have less time or commitment
to optimize the care of their patients, may take more
unnecessary risks, or may be unable to pay attention to
necessary details or recognize the consequences of
their actions (71). Conversely, exposure to adverse pa-
tient events or recognition of poor-quality care may re-
sult in emotional or other psychological distress among
providers. This phenomenon often is referred to as sec-
ondary trauma, particularly in relation to sentinel events
or important safety incidents, but it might also arise
from repeated minor incidents (161). The true effect
sizes relating burnout and quality of care in both direc-
tions are important to understand in order to make
sound decisions regarding resource allocation and
study design of interventions, both to improve quality
of care and to diminish burnout.
Recent concerns have arisen regarding variability
in burnout assessment methods, and this inconsistency
was evident in the body of literature compiled here
(12). In this regard, the subset of studies in our analysis
that used the most widely accepted “standard” burnout
assessment methods demonstrated a similar to slightly
increased frequency of significant associations com-
pared with the full evidence base. This finding suggests
that the relationship between burnout and quality of
care in the published literature is not a result of subop-
timal measures or variability in the definition of burn-
out.
Excess significance in the published literature was
noted specifically for adherence to best practice guide-
lines and for quality and safety metrics. Investigations of
burnout in relation to these outcomes are typically ret-
rospective studies of routinely collected outcome met-
rics in existing data sets, without preregistered proto-
cols. The relative ease of defining and evaluating many
outcomes in many ways with these data sets increases
the risk for selective outcome and selective analysis re-
porting, which may have contributed to excess signifi-
cance. We found slightly lower effect sizes, but without
excess significance, for the patient outcomes sub-
group, possibly reflecting the more common use by
these studies of quality metrics with little or no flexibility
in their definition and measurement (such as mortality
or length of stay).
In direct assessment, studies using independent or
objective quality metrics demonstrated less frequent
significant effects. This finding is not surprising, be-
cause previous research suggests that current methods
of objectively measuring quality of care cannot reliably
identify certain events, such as errors in judgment,
technical procedural mistakes, or near misses (10, 162).
Objective metrics also are costly to measure and diffi-
cult to connect to an individual provider because of the
team-based nature of most clinical care, limiting appli-
cation to smaller studies and those in which a quality
metric can be connected reliably to a provider. On the
other hand, subjective quality metrics may be more
sensitive and comprehensive but more prone to bias
(for example, having burnout may create recall bias).
Further research is needed to determine the appropri-
ate balance between insensitivity of objective quality
metrics and potential for recall bias with subjective
quality metrics.
Our analysis found no evidence specifically for
small-study effects, that is, small (more imprecise) stud-
ies reporting larger effects than large studies. These
findings are consistent with those of previous meta-
analyses, which traditionally evaluated for small-study
effects as a surrogate for all forms of reporting bias (9,
10). The discrepancy between our findings of overall
excess significance without evidence of small-study ef-
Table 2. Predicted Versus Observed Significance for Primary* Effect Sizes, Among All Included Studies and Stratified by
Quality Metric Category
Category Studies, n P < 0.050 Threshold P < 0.005 Threshold
Predicted
Significance, %
Observed
Significance, n (%)
P Value Predicted
Significance, %
Observed
Significance, n (%)
P Value
Full cohort 142 62 104 (73) 0.011 46 96 (68) <0.001 Best practices 14 12 9 (64) 0.001 2 8 (57) 0.001 Communication 5 43 3 (60) 0.67 40 3 (60) 0.63 Medical errors 32 50 20 (62) 0.169 33 15 (47) 0.182 Patient outcomes 17 64 9 (53) NP 54 9 (53) NP Quality and safety 74 65 62 (84) <0.001 50 60 (81) <0.001
NP = not pertinent (observed smaller than predicted).
* Or first listed, when the primary effect size was not specified.
REVIEW Burnout and Quality of Care
560 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.annals.org
fects may highlight the insensitivity of the latter test as a
marker of all forms of bias. Moreover, smaller studies in
this field are more likely to have objective measure-
ments, whereas larger studies are more likely to have
subjective measurements. This would dilute the ability
of the small-study effect test to show a typical bias
pattern.
Our study should be viewed in light of its design.
Although most included studies were cross-sectional,
observational, and unable to determine the directional-
ity of a causal relationship, longitudinal studies suggest
bidirectional causality (62, 149, 151, 152). Although 2
independent reviewers conducted extensive searches,
they may have missed some relevant studies. Burnout
has several important outcomes beyond its effects on
quality of care that were not the focus of our analysis
(2–6). Finally, excess significance may be a result of
genuine heterogeneity of effects across studies rather
than reporting bias (33). The effects reported here rep-
resent the results of heterogeneous studies; therefore,
we do not report a single summary effect size. Rather,
we report frequencies of significant summary effect
sizes within burnout–quality metric combinations to
provide a quantitative framework for interpretation
while acknowledging that a distribution of true effect
sizes is expected in this field-wide assessment, in con-
trast to a traditional meta-analysis (163).
We avoided scoring quality assessments of the in-
cluded studies, choosing instead to analyze key aspects
of study quality, as suggested by the proposed report-
ing guidelines for meta-analyses of observational stud-
ies (16). Judging the quality of mostly cross-sectional
observational studies is notoriously difficult, and no
widely accepted tools exist. Salyers and colleagues (9)
created a 10-item tool to assess quality aspects in 82
burnout and quality-of-care studies and did not identify
any relationship between study quality score and effect
size.
Our findings carry several important implications
for future intervention trials and observational studies.
For intervention trials, the potential for exaggerated
published effects should be considered in power calcu-
lations to lower the risk for false-negative results (type II
error). In addition, future studies should attempt to re-
duce the risk of reporting biases. Standardization and
consensus on core outcomes may be useful for future
studies if appropriate targets can be identified (164).
Such standardization may improve comparability
among studies, facilitating traditional meta-analysis es-
timates of the relevant effect sizes. Some outcomes,
such as self-reported medical errors, low quality of
care, and low patient safety score, are particularly prev-
alent in the literature, suggesting that researchers al-
ready consider these outcomes either important or fea-
sible to measure. However, if core outcomes are to be
widely accepted, they must be both important and fea-
sible to measure. Thus, in addition to this “popular
vote” approach, expert consensus is needed to curate
an appropriate list of core outcomes for this field. Other
outcome evaluations might then be discouraged unless
a unique justification is present.
Study registration may further reduce the risk of
study publication bias and increase transparency of un-
published studies. By registering a study publicly at its
outset, researchers can reduce the likelihood that a
study was conceived and conducted but remains un-
Figure 3. Standard normal deviate (Hedges g/SE) in relation to precision (1/SE).
St
an
da
rd
N
or
m
al
D
ev
ia
te
Robust
SE
Parameter
Estimate
–3.48 to 0.85
0.33 to 0.75
1.10
0.10
0.23
<0.001
–1.32
0.54
Intercept
Slope
P Value95% CI
Precision
95% CI
Fitted values
0
0
20
20
–20
40
40
60
60
80
80
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 561
http://www.annals.org
published because of undesirable or lackluster results
(165). In a similar manner, protocol prespecification
may reduce the risk for selective outcome and selective
analysis reporting within published studies, allowing
easier identification of any post hoc analyses. Published
analyses that deviate from the prespecified protocol
would require justification from the authors, and this
approach would alert the readers that those results
may be more susceptible to bias. Currently, these
mechanisms are used rarely in any field of medicine
outside clinical trials, but they could become widely ad-
opted with sufficient advocacy by researchers, publish-
ers, funders, and other stakeholders.
In conclusion, burnout among health care provid-
ers is frequently associated with reduced quality of care
in the published literature. However, few rigorous stud-
ies exist, and the effect size may be smaller than report-
ed—and may be particularly smaller for objective quality
measures. Whether curtailing burnout improves quality
of care, or whether improving quality of care reduces
burnout, is not yet known, and adequately powered
and designed randomized trials (91, 166, 167) will be
indispensable in answering these questions.
From Stanford University School of Medicine, Stanford, Cali-
fornia (D.S.T., T.S., M.T.); Brigham and Women’s Hospital and
Harvard Medical School, Boston, Massachusetts (A.S.); Stan-
ford University School of Medicine, Stanford, California, and
California Perinatal Quality Care Collaborative, Palo Alto, Cal-
ifornia (J.P.); Duke University School of Medicine, Duke Uni-
versity Health System, and Duke Patient Safety Center, Dur-
ham, North Carolina (K.C.A., J.B.S.); and Stanford University
School of Medicine, Stanford University School of Humanities
and Sciences, and Meta-Research Innovation Center at Stan-
ford (METRICS), Stanford, California (J.P.I.).
Note: The lead author had full access to all data in the study
and affirms that the manuscript is an honest, accurate, and
transparent account of the study; that no important aspects of
the study have been omitted; and that any discrepancies from
the study as originally planned have been explained.
Financial Support: By the Stanford Maternal and Child Health
Research Institute.
Disclosures: Dr. Tawfik reports grants from Stanford Maternal
and Child Health Research Institute during the conduct of the
study. Dr. Profit reports grants from the Eunice Kennedy
Shriver National Institute of Child Health and Human Develop-
ment during the conduct of the study and has received hon-
oraria for speaking at scientific meetings on the topic of burn-
out. Dr. Sexton reports grants from the National Institutes of
Health during the conduct of the study. Authors not named
here have disclosed no conflicts of interest. Disclosures can
also be viewed at www.acponline.org/authors/icmje/Conflict
OfInterestForms.do?msNum=M19-1152.
Reproducible Research Statement: Study protocol, statistical
code, and data set: Available from Dr. Tawfik (e-mail, dtawfik
@stanford.edu).
Corresponding Author: Daniel S. Tawfik, MD, MS, 770 Welch
Road, Suite 435, Palo Alto, CA 94304; e-mail, dtawfik
@stanford.edu.
Current author addresses and author contributions are avail-
able at Annals.org.
References
1. Shanafelt TD, West CP, Sinsky C, et al. Changes in burnout and
satisfaction with work-life integration in physicians and the general
US working population between 2011 and 2017. Mayo Clin Proc.
2019. [PMID: 30803733] doi:10.1016/j.mayocp.2018.10.023
2. Shanafelt TD, Boone SL, Dyrbye LN, et al. The medical marriage: a
national survey of the spouses/partners of US physicians. Mayo Clin
Proc. 2013;88:216-25. [PMID: 23489448] doi:10.1016/j.mayocp.2012
.11.021
3. Shanafelt TD, Mungo M, Schmitgen J, et al. Longitudinal study
evaluating the association between physician burnout and changes
in professional work effort. Mayo Clin Proc. 2016;91:422-31. [PMID:
27046522] doi:10.1016/j.mayocp.2016.02.001
4. Windover AK, Martinez K, Mercer MB, et al. Correlates and out-
comes of physician burnout within a large academic medical center.
JAMA Intern Med. 2018;178:856-858. [PMID: 29459945] doi:10
.1001/jamainternmed.2018.0019
5. Hamidi MS, Bohman B, Sandborg C, et al. Estimating institutional
physician turnover attributable to self-reported burnout and associ-
ated financial burden: a case study. BMC Health Serv Res. 2018;18:
851. [PMID: 30477483] doi:10.1186/s12913-018-3663-z
6. van der Heijden F, Dillingh G, Bakker A, et al. Suicidal thoughts
among medical residents with burnout. Arch Suicide Res. 2008;12:
344-6. [PMID: 18828037] doi:10.1080/13811110802325349
7. Dewa CS, Loong D, Bonato S, et al. The relationship between
physician burnout and quality of healthcare in terms of safety and
acceptability: a systematic review. BMJ Open. 2017;7:e015141.
[PMID: 28637730] doi:10.1136/bmjopen-2016-015141
8. Hall LH, Johnson J, Watt I, et al. Healthcare staff wellbeing, burn-
out, and patient safety: a systematic review. PLoS One. 2016;11:
e0159015. [PMID: 27391946] doi:10.1371/journal.pone.0159015
9. Salyers MP, Bonfils KA, Luther L, et al. The relationship between
professional burnout and quality and safety in healthcare: a meta-
analysis. J Gen Intern Med. 2017;32:475-482. [PMID: 27785668] doi:
10.1007/s11606-016-3886-9
10. Panagioti M, Geraghty K, Johnson J, et al. Association
between physician burnout and patient safety, professionalism, and
patient satisfaction: a systematic review and meta-analysis. JAMA In-
tern Med. 2018;178:1317-1330. [PMID: 30193239] doi:10.1001
/jamainternmed.2018.3713
11. Rathert C, Williams ES, Linhart H. Evidence for the quadruple
aim: a systematic review of the literature on physician burnout and
patient outcomes. Med Care. 2018;56:976-984. [PMID: 30339573]
doi:10.1097/MLR.0000000000000999
12. Rotenstein LS, Torre M, Ramos MA, et al. Prevalence of burnout
among physicians: a systematic review. JAMA. 2018;320:1131-1150.
[PMID: 30326495] doi:10.1001/jama.2018.12777
13. Ioannidis JP, Munafò MR, Fusar-Poli P, et al. Publication and
other reporting biases in cognitive sciences: detection, prevalence,
and prevention. Trends Cogn Sci. 2014;18:235-41. [PMID:
24656991] doi:10.1016/j.tics.2014.02.010
14. Dwan K, Gamble C, Williamson PR, et al; Reporting Bias Group.
Systematic review of the empirical evidence of study publication bias
and outcome reporting bias – an updated review. PLoS One. 2013;
8:e66844. [PMID: 23861749] doi:10.1371/journal.pone.0066844
15. Moher D, Liberati A, Tetzlaff J, et al; PRISMA Group. Preferred
reporting items for systematic reviews and meta-analyses: the
PRISMA statement. Ann Intern Med. 2009;151:264-9, W64. [PMID:
19622511]
REVIEW Burnout and Quality of Care
562 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M19-1152
http://www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M19-1152
mailto:dtawfik@stanford.edu
mailto:dtawfik@stanford.edu
mailto:dtawfik@stanford.edu
mailto:dtawfik@stanford.edu
http://www.annals.org
http://www.annals.org
16. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observa-
tional studies in epidemiology: a proposal for reporting. Meta-
analysis Of Observational Studies in Epidemiology (MOOSE) group.
JAMA. 2000;283:2008-12. [PMID: 10789670]
17. Chang JT, Hays RD, Shekelle PG, et al. Patients’ global ratings of
their health care are not associated with the technical quality of their
care. Ann Intern Med. 2006;144:665-72. [PMID: 16670136]
18. Kennedy GD, Tevis SE, Kent KC. Is there a relationship between
patient satisfaction and favorable outcomes? Ann Surg. 2014;260:
592-8; discussion 598-600. [PMID: 25203875] doi:10.1097/SLA
.0000000000000932
19. Rao M, Clarke A, Sanderson C, et al. Patients’ own assessments
of quality of primary care compared with objective records based
measures of technical quality of care: cross sectional study. BMJ.
2006;333:19. [PMID: 16793783]
20. Schmocker RK, Cherney Stafford LM, Winslow ER. Satisfaction
with surgeon care as measured by the Surgery-CAHPS survey is not
related to NSQIP outcomes. Surgery. 2019;165:510-515. [PMID:
30322662] doi:10.1016/j.surg.2018.08.028
21. Chuang CH, Tseng PC, Lin CY, et al. Burnout in the intensive care
unit professionals: a systematic review. Medicine (Baltimore). 2016;
95:e5629. [PMID: 27977605]
22. Dewa CS, Loong D, Bonato S, et al. The relationship between
resident burnout and safety-related and acceptability-related quality
of healthcare: a systematic literature review. BMC Med Educ. 2017;
17:195. [PMID: 29121895] doi:10.1186/s12909-017-1040-y
23. Scheepers RA, Boerebach BC, Arah OA, et al. A systematic re-
view of the impact of physicians’ occupational well-being on the
quality of patient care. Int J Behav Med. 2015;22:683-98. [PMID:
25733349] doi:10.1007/s12529-015-9473-3
24. West CP, Dyrbye LN, Erwin PJ, et al. Interventions to prevent and
reduce physician burnout: a systematic review and meta-analysis.
Lancet. 2016;388:2272-2281. [PMID: 27692469] doi:10.1016/S0140
-6736(16)31279-X
25. Chinn S. A simple method for converting an odds ratio to effect
size for use in meta-analysis. Stat Med. 2000;19:3127-31. [PMID:
11113947]
26. Lajeunesse M. Recovering Missing or Partial Data from Studies: A
Survey of Conversions and Imputations for Meta-analysis. Princeton:
Princeton Univ Pr; 2013.
27. Guyatt GH, Thorlund K, Oxman AD, et al. GRADE guidelines: 13.
Preparing summary of findings tables and evidence profiles-
continuous outcomes. J Clin Epidemiol. 2013;66:173-83. [PMID:
23116689] doi:10.1016/j.jclinepi.2012.08.001
28. Hasselblad V, Hedges LV. Meta-analysis of screening and diag-
nostic tests. Psychol Bull. 1995;117:167-78. [PMID: 7870860]
29. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with
work-life balance among US physicians relative to the general US
population. Arch Intern Med. 2012;172:1377-85. [PMID: 22911330]
30. Tawfik DS, Phibbs CS, Sexton JB, et al. Factors associated with
provider burnout in the NICU. Pediatrics. 2017;139. [PMID:
28557756] doi:10.1542/peds.2016-4134
31. West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, edu-
cational debt, and medical knowledge among internal medicine res-
idents. JAMA. 2011;306:952-60. [PMID: 21900135] doi:10.1001/jama
.2011.1247
32. Knapp G, Hartung J. Improved tests for a random effects meta-
regression with a single covariate. Stat Med. 2003;22:2693-710.
[PMID: 12939780]
33. Ioannidis JP, Trikalinos TA. An exploratory test for an excess of
significant findings. Clin Trials. 2007;4:245-53. [PMID: 17715249]
34. Sterne JA, Sutton AJ, Ioannidis JP, et al. Recommendations for
examining and interpreting funnel plot asymmetry in meta-analyses
of randomised controlled trials. BMJ. 2011;343:d4002. [PMID:
21784880] doi:10.1136/bmj.d4002
35. Benjamin DJ, Berger JO, Johannesson M, et al. Redefine statis-
tical significance. Nat Hum Behav. 2018;2:6-10. [PMID: 30980045]
doi:10.1038/s41562-017-0189-z
36. Ioannidis JPA. The proposal to lower P value thresholds to .005.
JAMA. 2018;319:1429-1430. [PMID: 29566133] doi:10.1001/jama
.2018.1536
37. Abe K, Ohashi A. Development and testing of a staff question-
naire for evaluating the quality of services at nursing homes in Japan.
JAmMedDirAssoc.2009;10:189-95.[PMID:19233059]doi:10.1016/j
.jamda.2008.10.004
38. Ožvačić Adžić Z, Katić M, Kern J, et al. Is burnout in family phy-
sicians in Croatia related to interpersonal quality of care? Arh Hig
Rada Toksikol. 2013;64:255-64. [PMID: 23819934] doi:10.2478
/10004-1254-64-2013-2307
39. Aiken LH, Sermeus W, Van den Heede K, et al. Patient safety,
satisfaction, and quality of hospital care: cross sectional surveys of
nurses and patients in 12 countries in Europe and the United States.
BMJ. 2012;344:e1717. [PMID: 22434089] doi:10.1136/bmj.e1717
40. Angermeier I, Dunford BB, Boss AD, et al. The impact of partic-
ipative management perceptions on customer service, medical er-
rors, burnout, and turnover intentions. J Healthc Manag. 2009;54:
127-40; discussion 141. [PMID: 19413167]
41. Baer TE, Feraco AM, Tuysuzoglu Sagalowsky S, et al. Pediatric
resident burnout and attitudes toward patients. Pediatrics. 2017;139.
[PMID: 28232639] doi:10.1542/peds.2016-2163
42. Baier N, Roth K, Felgner S, et al. Burnout and safety outcomes – a
cross-sectional nationwide survey of EMS-workers in Germany. BMC
Emerg Med. 2018;18:24. [PMID: 30126358] doi:10.1186/s12873
-018-0177-2
43. Balch CM, Oreskovich MR, Dyrbye LN, et al. Personal conse-
quences of malpractice lawsuits on American surgeons. J Am Coll
Surg. 2011;213:657-67. [PMID: 21890381] doi:10.1016/j.jamcollsurg
.2011.08.005
44. Bao Y, Vedina R, Moodie S, et al. The relationship between value
incongruence and individual and organizational well-being out-
comes: an exploratory study among Catalan nurses. J Adv Nurs.
2013;69:631-41. [PMID: 22632178] doi:10.1111/j.1365-2648.2012
.06045.x
45. Basar U, Basim N. A cross-sectional survey on consequences of
nurses’ burnout: moderating role of organizational politics. J Adv
Nurs. 2016;72:1838-50. [PMID: 26988276] doi:10.1111/jan.12958
46. Beckman TJ, Reed DA, Shanafelt TD, et al. Resident physician
well-being and assessments of their knowledge and clinical perfor-
mance. J Gen Intern Med. 2012;27:325-30. [PMID: 21948207] doi:
10.1007/s11606-011-1891-6
47. Block L, Wu AW, Feldman L, et al. Residency schedule, burnout
and patient care among first-year residents. Postgrad Med J. 2013;
89:495-500. [PMID: 23852828] doi:10.1136/postgradmedj-2012
-131743
48. Boamah SA, Read EA, Spence Laschinger HK. Factors influenc-
ing new graduate nurse burnout development, job satisfaction and
patient care quality: a time-lagged study. J Adv Nurs. 2017;73:1182-
1195. [PMID: 27878844] doi:10.1111/jan.13215
49. Bronkhorst B, Vermeeren B. Safety climate, worker health and
organizational health performance: testing a physical, psychosocial
and combined pathway. International Journal of Workplace Health
Management. 2016;9:270-89.
50. Brunsberg KA, Landrigan CP, Garcia BM, et al. Association of
pediatric resident physician depression and burnout with harmful
medical errors on inpatient services. Acad Med. 2019;94:1150-1156.
[PMID: 31045601] doi:10.1097/ACM.0000000000002778
51. Chao M, Shih CT, Hsu SF. Nurse occupational burnout and
patient-rated quality of care: the boundary conditions of emotional
intelligence and demographic profiles. Jpn J Nurs Sci. 2016;13:156-
65. [PMID: 26542752] doi:10.1111/jjns.12100
52. Chen KY, Yang CM, Lien CH, et al. Burnout, job satisfaction, and
medical malpractice among physicians. Int J Med Sci. 2013;10:
1471-8. [PMID: 24046520] doi:10.7150/ijms.6743
53. Cheng C, Bartram T, Karimi L, et al. The role of team climate in
the management of emotional labour: implications for nurse reten-
tion. J Adv Nurs. 2013;69:2812-25. [PMID: 23834619] doi:10.1111
/jan.12202
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 563
http://www.annals.org
54. Cimiotti JP, Aiken LH, Sloane DM, et al. Nurse staffing, burnout,
and health care-associated infection. Am J Infect Control. 2012;40:
486-90. [PMID: 22854376] doi:10.1016/j.ajic.2012.02.029
55. Colindres CV, Bryce E, Coral-Rosero P, et al. Effect of effort-
reward imbalance and burnout on infection control among Ecuador-
ian nurses. Int Nurs Rev. 2018;65:190-199. [PMID: 29114886] doi:10
.1111/inr.12409
56. Cummings GG, Estabrooks CA, Midodzi WK, et al. Influence of
organizational characteristics and context on research utilization.
Nurs Res. 2007;56:S24-39. [PMID: 17625471]
57. Davenport DL, Henderson WG, Mosca CL, et al. Risk-adjusted
morbidity in teaching hospitals correlates with reported levels of
communication and collaboration on surgical teams but not with
scale measures of teamwork climate, safety climate, or working con-
ditions. J Am Coll Surg. 2007;205:778-84. [PMID: 18035261]
58. de Oliveira GS Jr, Chang R, Fitzgerald PC, et al. The prevalence
of burnout and depression and their association with adherence to
safety and practice standards: a survey of United States anesthesiol-
ogy trainees. Anesth Analg. 2013;117:182-93. [PMID: 23687232]
doi:10.1213/ANE.0b013e3182917da9
59. De Stefano C, Philippon AL, Krastinova E, et al. Effect of emer-
gency physician burnout on patient waiting times. Intern Emerg
Med. 2018;13:421-428. [PMID: 28677043] doi:10.1007/s11739-017
-1706-9
60. Deckard G, Meterko M, Field D. Physician burnout: an examina-
tion of personal, professional, and organizational relationships. Med
Care. 1994;32:745-54. [PMID: 8028408]
61. Dorigan GH, Guirardello EB. Effect of the practice environment
of nurses on job outcomes and safety climate. Rev Lat Am Enferma-
gem. 2018;26:e3056. [PMID: 30379243] doi:10.1590/1518-8345
.2633.3056
62. Fahrenkopf AM, Sectish TC, Barger LK, et al. Rates of medication
errors among depressed and burnt out residents: prospective co-
hort study. BMJ. 2008;336:488-91. [PMID: 18258931] doi:10.1136
/bmj.39469.763218.BE
63. Faivre G, Kielwasser H, Bourgeois M, et al. Burnout syndrome in
orthopaedic and trauma surgery residents in France: a nationwide
survey. Orthop Traumatol Surg Res. 2018;104:1291-1295. [PMID:
30341030] doi:10.1016/j.otsr.2018.08.016
64. Galletta M, Portoghese I, D’Aloja E, et al. Relationship between
job burnout, psychosocial factors and health care-associated infec-
tions in critical care units. Intensive Crit Care Nurs. 2016;34:51-8.
[PMID: 26961918] doi:10.1016/j.iccn.2015.11.004
65. Garrouste-Orgeas M, Perrin M, Soufir L, et al. The Iatroref study:
medical errors are associated with symptoms of depression in ICU
staff but not burnout or safety culture. Intensive Care Med. 2015;41:
273-84. [PMID: 25576157] doi:10.1007/s00134-014-3601-4
66. Gasparino RC, Guirardello Ede B, Aiken LH. Validation of the
brazilian version of the nursing work index-revised (B-NWI-r). J Clin
Nurs. 2011;20:3494-501. [PMID: 21749511] doi:10.1111/j.1365-2702
.2011.03776.x
67. Gopal R, Glasheen JJ, Miyoshi TJ, et al. Burnout and internal
medicine resident work-hour restrictions. Arch Intern Med. 2005;
165:2595-600. [PMID: 16344416]
68. Guirardello EB. Impact of critical care environment on burnout,
perceived quality of care and safety attitude of the nursing team. Rev
Lat Am Enfermagem. 2017;25:e2884. [PMID: 28591294] doi:10
.1590/1518-8345.1472.2884
69. Gunnarsdóttir S, Clarke SP, Rafferty AM, et al. Front-line manage-
ment, staffing and nurse-doctor relationships as predictors of nurse
and patient outcomes. a survey of Icelandic hospital nurses. Int J
Nurs Stud. 2009;46:920-7. [PMID: 17229425]
70. Gupta K, Lisker S, Rivadeneira NA, et al. Decisions and repercus-
sions of second victim experiences for mothers in medicine (SAVE
DR MoM). BMJ Qual Saf. 2019;28:564-573. [PMID: 30718333] doi:
10.1136/bmjqs-2018-008372
71. Halbesleben JR, Rathert C. Linking physician burnout and patient
outcomes: exploring the dyadic relationship between physicians
and patients. Health Care Manage Rev. 2008;33:29-39. [PMID:
18091442]
72. Halbesleben JR, Wakefield BJ, Wakefield DS, et al. Nurse
burnout and patient safety outcomes: nurse safety perception versus
reporting behavior. West J Nurs Res. 2008;30:560-77. [PMID:
18187408] doi:10.1177/0193945907311322
73. Hansen RP, Vedsted P, Sokolowski I, et al. General practitioner
characteristics and delay in cancer diagnosis. a population-based co-
hort study. BMC Fam Pract. 2011;12:100. [PMID: 21943310] doi:10
.1186/1471-2296-12-100
74. Hayashino Y, Utsugi-Ozaki M, Feldman MD, et al. Hope modified
the association between distress and incidence of self-perceived
medical errors among practicing physicians: prospective cohort
study. PLoS One. 2012;7:e35585. [PMID: 22530055] doi:10.1371
/journal.pone.0035585
75. Holden RJ, Patel NR, Scanlon MC, et al. Effects of mental de-
mands during dispensing on perceived medication safety and em-
ployee well-being: a study of workload in pediatric hospital pharma-
cies. Res Social Adm Pharm. 2010;6:293-306. [PMID: 21111387] doi:
10.1016/j.sapharm.2009.10.001
76. Holden RJ, Scanlon MC, Patel NR, et al. A human factors frame-
work and study of the effect of nursing workload on patient safety
and employee quality of working life. BMJ Qual Saf. 2011;20:15-24.
[PMID: 21228071] doi:10.1136/bmjqs.2008.028381
77. Huang CH, Wu HH, Chou CY, et al. The perceptions of physicians
and nurses regarding the establishment of patient safety in a re-
gional teaching hospital in Taiwan. Iran J Public Health. 2018;47:852-
860. [PMID: 30087871]
78. Huang CH, Wu HH, Lee YC. The perceptions of patient safety
culture: a difference between physicians and nurses in Taiwan. Appl
Nurs Res. 2018;40:39-44. [PMID: 29579497] doi:10.1016/j.apnr
.2017.12.010
79. Huang EC, Pu C, Huang N, et al. Resident burnout in Taiwan
Hospitals-and its relation to physician felt trust from patients. J For-
mos Med Assoc. 2019. [PMID: 30626545] doi:10.1016/j.jfma.2018.12
.015
80. Johnson J, Louch G, Dunning A, et al. Burnout mediates the
association between depression and patient safety perceptions: a
cross-sectional study in hospital nurses. J Adv Nurs. 2017;73:1667-
1680. [PMID: 28072469] doi:10.1111/jan.13251
81. Kang EK, Lihm HS, Kong EH. Association of intern and resident
burnout with self-reported medical errors. Korean J Fam Med. 2013;
34:36-42. [PMID: 23372904] doi:10.4082/kjfm.2013.34.1.36
82. Kim MH, Mazenga AC, Simon K, et al. Burnout and self-reported
suboptimal patient care amongst health care workers providing HIV
care in Malawi. PLoS One. 2018;13:e0192983. [PMID: 29466443] doi:
10.1371/journal.pone.0192983
83. Kirwan M, Matthews A, Scott PA. The impact of the work envi-
ronment of nurses on patient safety outcomes: a multi-level model-
ling approach. Int J Nurs Stud. 2013;50:253-63. [PMID: 23116681]
doi:10.1016/j.ijnurstu.2012.08.020
84. Klein J, Grosse Frie K, Blum K, et al. Burnout and perceived
quality of care among German clinicians in surgery. Int J Qual Health
Care. 2010;22:525-30. [PMID: 20935011] doi:10.1093/intqhc
/mzq056
85. Kwah J, Fallar R, Weintraub JP, Ripp J. The impact of job burnout
on measures of professionalism in first-year internal medicine resi-
dents at a large urban academic medical center. J Gen Intern Med.
2014;29:S228.
86. Lafreniere JP, Rios R, Packer H, et al. Burned out at the bedside:
patient perceptions of physician burnout in an internal medicine res-
ident continuity clinic. J Gen Intern Med. 2016;31:203-208. [PMID:
26340808] doi:10.1007/s11606-015-3503-3
87. Spence Laschinger HK, Leiter MP. The impact of nursing work
environments on patient safety outcomes: the mediating role of
burnout/engagement. J Nurs Adm. 2006;36:259-67. [PMID:
16705307]
88. Laschinger H, Shamian J, Thomson D. Impact of magnet hospital
characteristics on nurses’ perceptions of trust, burnout, quality of
care, and work satisfaction. Nursing Economic$. 2001;19(5):209-19.
REVIEW Burnout and Quality of Care
564 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.annals.org
89. Lewis EJ, Baernholdt MB, Yan G, et al. Relationship of adverse
events and support to RN burnout. J Nurs Care Qual. 2015;30:144-
52. [PMID: 25148522] doi:10.1097/NCQ.0000000000000084
90. Linzer M, Manwell LB, Williams ES, et al; MEMO (Minimizing
Error, Maximizing Outcome) Investigators. Working conditions in
primary care: physician reactions and care quality. Ann Intern Med.
2009;151:28-36, W6-9. [PMID: 19581644]
91. Linzer M, Poplau S, Brown R, et al. Do work condition interven-
tions affect quality and errors in primary care? results from the
healthy work place study. J Gen Intern Med. 2017;32:56-61. [PMID:
27612486] doi:10.1007/s11606-016-3856-2
92. Liu X, Zheng J, Liu K, et al. Hospital nursing organizational fac-
tors, nursing care left undone, and nurse burnout as predictors of
patient safety: a structural equation modeling analysis. Int J Nurs
Stud. 2018;86:82-89. [PMID: 29966828] doi:10.1016/j.ijnurstu.2018
.05.005
93. Liu Y, Aungsuroch Y. Factors influencing nurse-assessed quality
nursing care: a cross-sectional study in hospitals. J Adv Nurs. 2018;
74:935-945. [PMID: 29148146] doi:10.1111/jan.13507
94. Loerbroks A, Glaser J, Vu-Eickmann P, et al. Physician burnout,
work engagement and the quality of patient care. Occup Med
(Lond). 2017;67:356-362. [PMID: 28510762] doi:10.1093/occmed
/kqx051
95. Lorenz VR, Sabino MO, Corrêa Filho HR. Professional exhaustion,
quality and intentions among family health nurses. Rev Bras Enferm.
2018;71:2295-2301. [PMID: 30365797] doi:10.1590/0034-7167
-2016-0510
96. Lu DW, Dresden S, McCloskey C, et al. Impact of burnout on
self-reported patient care among emergency physicians. West J
Emerg Med. 2015;16:996-1001. [PMID: 26759643] doi:10.5811
/westjem.2015.9.27945
97. MacPhee M, Dahinten VS, Havaei F. The impact of heavy per-
ceived nurse workloads on patient and nurse outcomes. Administra-
tive Sciences. 2017;7:7.
98. Martinussen M, Kaiser S, Adolfsen F, et al. Reorganisation of
healthcare services for children and families: improving collabora-
tion, service quality, and worker well-being. J Interprof Care. 2017;
31:487-496. [PMID: 28481168] doi:10.1080/13561820.2017.1316249
99. Mazurkiewicz RA, Smith KL, Korenstein D, Ripp J. The impact of
resident physician burnout on the quality of care of hospitalized pa-
tients. J Gen Intern Med. 2012;27:S323-S4.
100. Mion G, Libert N, Journois D. [Burnout-associated factors in
anesthesia and intensive care medicine. 2009 survey of the French
Society of Anesthesiology and Intensive Care]. Ann Fr Anesth Re-
anim. 2013;32:175-88. [PMID: 23395149] doi:10.1016/j.annfar.2012
.12.004
101. Mohr DC, Eaton JL, Meterko M, et al. Factors associated with
internal medicine physician job attitudes in the Veterans Health Ad-
ministration. BMC Health Serv Res. 2018;18:244. [PMID: 29622008]
doi:10.1186/s12913-018-3015-z
102. Molina Siguero A, Garcı́a Pérez MA, Alonso González M, et al.
[Prevalence of worker burnout and psychiatric illness in primary care
physicians in a health care area in Madrid]. Aten Primaria. 2003;31:
564-71. [PMID: 12783745]
103. Nantsupawat A, Nantsupawat R, Kunaviktikul W, et al. Nurse
burnout, nurse-reported quality of care, and patient outcomes in thai
hospitals. J Nurs Scholarsh. 2016;48:83-90. [PMID: 26650339] doi:
10.1111/jnu.12187
104. O’Connor P, Lydon S, O’Dea A, et al. A longitudinal and
multicentre study of burnout and error in Irish junior doctors.
Postgrad Med J. 2017;93:660-664. [PMID: 28600343] doi:10
.1136
/postgradmedj-2016-134626
105. Panunto MR, Guirardello Ede B. Professional nursing practice:
environment and emotional exhaustion among intensive care
nurses. Rev Lat Am Enfermagem. 2013;21:765-72. [PMID:
23918023] doi:10.1590/S0104-11692013000300016
106. Passalacqua SA, Segrin C. The effect of resident physician
stress, burnout, and empathy on patient-centered communication
during the long-call shift. Health Commun. 2012;27:449-56. [PMID:
21970629] doi:10.1080/10410236.2011.606527
107. Patrician PA, Shang J, Lake ET. Organizational determinants of
work outcomes and quality care ratings among Army Medical De-
partment registered nurses. Res Nurs Health. 2010;33:99-110.
[PMID: 20151409] doi:10.1002/nur.20370
108. Pedersen AF, Carlsen AH, Vedsted P. Association of GPs’ risk
attitudes, level of empathy, and burnout status with PSA testing in
primary care. Br J Gen Pract. 2015;65:e845-51. [PMID: 26541183]
doi:10.3399/bjgp15X687649
109. Poghosyan L, Clarke SP, Finlayson M, et al. Nurse burnout and
quality of care: cross-national investigation in six countries. Res Nurs
Health. 2010;33:288-98. [PMID: 20645421] doi:10.1002/nur.20383
110. Pratt M, Kerr M, Wong C. The impact of ERI, burnout, and car-
ing for SARS patients on hospital nurses’ self-reported compliance
with infection control. Can J Infect Control. 2009;24:167-72, 174.
[PMID: 19891170]
111. Prins JT, van der Heijden FM, Hoekstra-Weebers JE, et al. Burn-
out, engagement and resident physicians’ self-reported errors. Psy-
chol Health Med. 2009;14:654-66. [PMID: 20183538] doi:10.1080/
13548500903311554
112. Profit J, Sharek PJ, Amspoker AB, et al. Burnout in the NICU
setting and its relation to safety culture. BMJ Qual Saf. 2014;23:806-
13. [PMID: 24742780] doi:10.1136/bmjqs-2014-002831
113. Qureshi HA, Rawlani R, Mioton LM, et al. Burnout phenomenon
in U.S. plastic surgeons: risk factors and impact on quality of life. Plast
Reconstr Surg. 2015;135:619-26. [PMID: 25357156] doi:10.1097/PRS
.0000000000000855
114. Rafferty AM, Ball J, Aiken LH. Are teamwork and professional
autonomy compatible, and do they result in improved hospital care?
Qual Health Care. 2001;10 Suppl 2:ii32-7. [PMID: 11700377]
115. Ridley J, Wilson B, Harwood L, et al. Work environment, health
outcomes and magnet hospital traits in the Canadian nephrology
nursing scene. CANNT J. 2009;19:28-35. [PMID: 19354155]
116. Riquelme I, Chacón JI, Gándara AV, et al; PAINBO Study
Group. Prevalence of burnout among pain medicine physicians and
its potential effect upon clinical outcomes in patients with oncologic
pain or chronic pain of nononcologic origin. Pain Med. 2018;19:
2398-2407. [PMID: 29361180] doi:10.1093/pm/pnx335
117. Rochefort CM, Clarke SP. Nurses’ work environments, care ra-
tioning, job outcomes, and quality of care on neonatal units. J Adv
Nurs. 2010;66:2213-24. [PMID: 20626479] doi:10.1111/j.1365-2648
.2010.05376.x
118. Salyers MP, Fukui S, Rollins AL, et al. Burnout and self-reported
quality of care in community mental health. Adm Policy Ment Health.
2015;42:61-9. [PMID: 24659446]
119. Schmidt SG, Dichter MN, Bartholomeyczik S, et al. The satisfac-
tion with the quality of dementia care and the health, burnout and
work ability of nurses: a longitudinal analysis of 50 German nursing
homes. Geriatr Nurs. 2014;35:42-6. [PMID: 24131899] doi:10.1016
/j.gerinurse.2013.09.006
120. Schwartz SP, Adair KC, Bae J, et al. Work-life balance behav-
iours cluster in work settings and relate to burnout and safety culture:
a cross-sectional survey analysis. BMJ Qual Saf. 2019;28:142-150.
[PMID: 30309912] doi:10.1136/bmjqs-2018-007933
121. Shanafelt TD, Balch CM, Bechamps G, et al. Burnout and med-
ical errors among American surgeons. Ann Surg. 2010;251:995-
1000. [PMID: 19934755] doi:10.1097/SLA.0b013e3181bfdab3
122. Shanafelt TD, Bradley KA, Wipf JE, et al. Burnout and self-
reported patient care in an internal medicine residency program.
Ann Intern Med. 2002;136:358-67. [PMID: 11874308]
123. Shields CG, Fuzzell LN, Christ SL, et al. Patient and provider
characteristics associated with communication about opioids: an ob-
servational study. Patient Educ Couns. 2019;102:888-894. [PMID:
30552013] doi:10.1016/j.pec.2018.12.005
124. Shirom A, Nirel N, Vinokur AD. Overload, autonomy, and burn-
out as predictors of physicians’ quality of care. J Occup Health Psy-
chol. 2006;11:328-42. [PMID: 17059297]
125. Sillero-Sillero A, Zabalegui A. Safety and satisfaction of patients
with nurse’s care in the perioperative. Rev Lat Am Enfermagem.
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 565
http://www.annals.org
2019;27:e3142. [PMID: 31038636] doi:10.1590/1518-8345.2646
.3142
126. Sokolova O, Pogosova N, Isakova S, et al. Impact of primary
care physicians burnout on their adherence to national guidelines for
common CVD. Global Heart. 2018;13:486.
127. Squires M, Tourangeau A, Spence Laschinger HK, et al. The link
between leadership and safety outcomes in hospitals. J Nurs Manag.
2010;18:914-25. [PMID: 21073565] doi:10.1111/j.1365-2834.2010
.01181.x
128. Sturm H, Rieger MA, Martus P, et al; WorkSafeMed Consortium.
Do perceived working conditions and patient safety culture correlate
with objective workload and patient outcomes: a cross-sectional ex-
plorative study from a German university hospital. PLoS One. 2019;
14:e0209487. [PMID: 30608945] doi:10.1371/journal.pone.0209487
129. Sulaiman CFC, Henn P, Smith S, et al. Burnout syndrome
among non-consultant hospital doctors in Ireland: relationship with
self-reported patient care. Int J Qual Health Care. 2017;29:679-684.
[PMID: 28992145] doi:10.1093/intqhc/mzx087
130. Sun BZ, Chaitoff A, Hu B, et al. Empathy, burnout, and antibiotic
prescribing for acute respiratory infections: a cross-sectional primary
care study in the US. Br J Gen Pract. 2017;67:e565-e571. [PMID:
28717000] doi:10.3399/bjgp17X691901
131. Tawfik DS, Profit J, Morgenthaler TI, et al. Physician burnout,
well-being, and work unit safety grades in relationship to reported
medical errors. Mayo Clin Proc. 2018;93:1571-1580. [PMID:
30001832] doi:10.1016/j.mayocp.2018.05.014
132. Teng CI, Shyu YI, Chiou WK, et al. Interactive effects of nurse-
experienced time pressure and burnout on patient safety: a cross-
sectional survey. Int J Nurs Stud. 2010;47:1442-50. [PMID:
20472237] doi:10.1016/j.ijnurstu.2010.04.005
133. Toral-Villanueva R, Aguilar-Madrid G, Juárez-Pérez CA. Burnout
and patient care in junior doctors in Mexico City. Occup Med (Lond).
2009;59:8-13. [PMID: 18796698] doi:10.1093/occmed/kqn122
134. Trockel M, Bohman B, Lesure E, et al. A brief instrument to
assess both burnout and professional fulfillment in physicians: reli-
ability and validity, including correlation with self-reported medical
errors, in a sample of resident and practicing physicians. Acad Psy-
chiatry. 2018;42:11-24. [PMID: 29196982] doi:10.1007/s40596-017
-0849-3
135. Tsiga E, Panagopoulou E, Montgomery A. Examining the link
between burnout and medical error: a checklist approach. Burnout
Research. 2017;6:1-8.
136. Van Bogaert P, Clarke S, Roelant E, et al. Impacts of unit-level
nurse practice environment and burnout on nurse-reported out-
comes: a multilevel modelling approach. J Clin Nurs. 2010;19:1664-
74. [PMID: 20579204] doi:10.1111/j.1365-2702.2009.03128.x
137. Van Bogaert P, Clarke S, Wouters K, et al. Impacts of unit-level
nurse practice environment, workload and burnout on nurse-
reported outcomes in psychiatric hospitals: a multilevel modelling
approach. Int J Nurs Stud. 2013;50:357-65. [PMID: 22695484] doi:
10.1016/j.ijnurstu.2012.05.006
138. Van Bogaert P, Dilles T, Wouters K, et al. Practice environment,
work characteristics and levels of burnout as predictors of nurse re-
ported job outcomes, quality of care and patient adverse events: a
study across residential aged care services. Open Journal of Nurs-
ing. 2014;4:343-55.
139. Van Bogaert P, Kowalski C, Weeks SM, et al. The relationship
between nurse practice environment, nurse work characteristics,
burnout and job outcome and quality of nursing care: a cross-
sectional survey. Int J Nurs Stud. 2013;50:1667-77. [PMID:
23777786] doi:10.1016/j.ijnurstu.2013.05.010
140. Van Bogaert P, Meulemans H, Clarke S, et al. Hospital nurse
practice environment, burnout, job outcomes and quality of care:
test of a structural equation model. J Adv Nurs. 2009;65:2175-85.
[PMID: 20568322]
141. Van Bogaert P, Timmermans O, Weeks SM, et al. Nursing unit
teams matter: impact of unit-level nurse practice environment, nurse
work characteristics, and burnout on nurse reported job outcomes,
and quality of care, and patient adverse events—a cross-sectional sur-
vey.IntJNursStud.2014;51:1123-34.[PMID:24444772]doi:10.1016/j
.ijnurstu.2013.12.009
142. Bogaert PV, Heusden DV, Slootmans S, et al. Staff empower-
ment and engagement in a magnet® recognized and joint commis-
sion international accredited academic centre in Belgium: a cross-
sectional survey. BMC Health Serv Res. 2018;18:756. [PMID:
30285735] doi:10.1186/s12913-018-3562-3
143. Van Gerven E, Vander Elst T, Vandenbroeck S, et al. Increased
risk of burnout for physicians and nurses involved in a patient safety
incident. Med Care. 2016;54:937-43. [PMID: 27213542] doi:10
.1097/MLR.0000000000000582
144. Vifladt A, Simonsen BO, Lydersen S, et al. The association be-
tween patient safety culture and burnout and sense of coherence: a
cross-sectional study in restructured and not restructured intensive
care units. Intensive Crit Care Nurs. 2016;36:26-34. [PMID:
27212614] doi:10.1016/j.iccn.2016.03.004
145. Vogus TJ, Cooil B, Sitterding M, et al. Safety organizing,
emotional exhaustion, and turnover in hospital nursing units.
Med Care. 2014;52:870-6. [PMID: 25222533] doi:10.1097/MLR
.0000000000000169
146. Wawrzyniak AJ, Rodriguez AE. The association between physi-
cian burnout and satisfaction on health outcomes in HIV-infected
outpatients. Psychosomatic Medicine. 2017;79:A102.
147. Weigl M, Schneider A, Hoffmann F, et al. Work stress, burnout,
and perceived quality of care: a cross-sectional study among hospi-
tal pediatricians. Eur J Pediatr. 2015;174:1237-46. [PMID: 25846697]
doi:10.1007/s00431-015-2529-1
148. Welp A, Meier LL, Manser T. Emotional exhaustion and work-
load predict clinician-rated and objective patient safety. Front Psy-
chol. 2014;5:1573. [PMID: 25657627] doi:10.3389/fpsyg.2014
.01573
149. Welp A, Meier LL, Manser T. The interplay between teamwork,
clinicians’ emotional exhaustion, and clinician-rated patient safety: a
longitudinal study. Crit Care. 2016;20:110. [PMID: 27095501] doi:10
.1186/s13054-016-1282-9
150. Wen J, Cheng Y, Hu X, et al. Workload, burnout, and medical
mistakes among physicians in China: a cross-sectional study. Biosci
Trends. 2016;10:27-33. [PMID: 26961213] doi:10.5582/bst.2015
.01175
151. West CP, Huschka MM, Novotny PJ, et al. Association of per-
ceived medical errors with resident distress and empathy: a prospec-
tive longitudinal study. JAMA. 2006;296:1071-8. [PMID: 16954486]
152. West CP, Tan AD, Habermann TM, et al. Association of resident
fatigue and distress with perceived medical errors. JAMA. 2009;302:
1294-300. [PMID: 19773564] doi:10.1001/jama.2009.1389
153. Williams ES, Manwell LB, Konrad TR, et al. The relationship of
organizational culture, stress, satisfaction, and burnout with
physician-reported error and suboptimal patient care: results from
the MEMO study. Health Care Manage Rev. 2007;32:203-12. [PMID:
17666991]
154. Winning AM, Merandi JM, Lewe D, et al. The emotional impact
of errors or adverse events on healthcare providers in the NICU: the
protective role of coworker support. J Adv Nurs. 2018;74:172-180.
[PMID: 28746750] doi:10.1111/jan.13403
155. Yanos PT, Vayshenker B, DeLuca JS, et al. Development and
validation of a scale assessing mental health clinicians’ experiences
of associative stigma. Psychiatr Serv. 2017;68:1053-1060. [PMID:
28617207] doi:10.1176/appi.ps.201600553
156. Yassi A, Cohen M, Cvitkovich Y, et al. Factors associated with
staff injuries in intermediate care facilities in British Columbia, Can-
ada. Nurs Res. 2004;53:87-98. [PMID: 15084993]
157. You LM, Aiken LH, Sloane DM, et al. Hospital nursing, care
quality, and patient satisfaction: cross-sectional surveys of nurses and
patients in hospitals in China and Europe. Int J Nurs Stud. 2013;50:
154-61. [PMID: 22658468] doi:10.1016/j.ijnurstu.2012.05.003
158. Yuguero O, Marsal JR, Buti M, et al. Descriptive study of asso-
ciation between quality of care and empathy and burnout in primary
care. BMC Med Ethics. 2017;18:54. [PMID: 28950853] doi:10.1186
/s12910-017-0214-9
REVIEW Burnout and Quality of Care
566 Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 Annals.org
http://www.annals.org
159. Zarei E, Khakzad N, Reniers G, et al. On the relationship be-
tween safety climate and occupational burnout in healthcare organi-
zations. Safety Science. 2016;89:1-10.
160. Tawfik DS, Sexton JB, Kan P, et al. Burnout in the neonatal
intensive care unit and its relation to healthcare-associated infec-
tions. J Perinatol. 2017;37:315-320. [PMID: 27853320] doi:10.1038
/jp.2016.211
161. Van Gerven E, Vander Elst T, Vandenbroeck S, et al. Increased
risk of burnout for physicians and nurses involved in a patient safety
incident. Med Care. 2016;54:937-43. [PMID: 27213542] doi:10
.1097/MLR.0000000000000582
162. Sari AB, Sheldon TA, Cracknell A, et al. Sensitivity of routine
system for reporting patient safety incidents in an NHS hospital: ret-
rospective patient case note review. BMJ. 2007;334:79. [PMID:
17175566]
163. Ioannidis JP, Patsopoulos NA, Rothstein HR. Reasons or ex-
cuses for avoiding meta-analysis in forest plots. BMJ. 2008;336:
1413-5. [PMID: 18566080] doi:10.1136/bmj.a117
164. Dodd S, Clarke M, Becker L, et al. A taxonomy has been devel-
oped for outcomes in medical research to help improve knowledge
discovery. J Clin Epidemiol. 2018;96:84-92. [PMID: 29288712] doi:
10.1016/j.jclinepi.2017.12.020
165. Dal-Ré R, Ioannidis JP, Bracken MB, et al. Making prospective
registration of observational research a reality. Sci Transl Med. 2014;
6:224cm1. [PMID: 24553383] doi:10.1126/scitranslmed.3007513
166. Parshuram CS, Amaral AC, Ferguson ND, et al; Canadian Crit-
ical Care Trials Group. Patient safety, resident well-being and conti-
nuity of care with different resident duty schedules in the intensive
care unit: a randomized trial. CMAJ. 2015;187:321-9. [PMID:
25667258] doi:10.1503/cmaj.140752
167. West CP, Dyrbye L, Satele D, et al. A randomized controlled trial
evaluating the effect of Compass (Colleagues Meeting to Promote
and Sustain Satisfaction) small group sessions on physician well-
being, meaning, and job satisfaction. J Gen Intern Med. 2015;30:
S89.
INFORMATION FOR AUTHORS
The Annals Information for Authors section is available at www.annals.org
/aim/pages/authors. All manuscripts must be submitted electronically us-
ing the manuscript submission option at Annals.org.
Burnout and Quality of Care REVIEW
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019 567
http://www.annals.org/aim/pages/authors
http://www.annals.org/aim/pages/authors
http://Annals.org
http://www.annals.org
Current Author Addresses: Dr. Tawfik: 770 Welch Road, Suite
435, Palo Alto, CA 94304.
Dr. Scheid: Office BL341G, 221 Longwood Avenue, Boston,
MA 02115.
Dr. Profit: 1265 Welch Road, MSOB x1C07, Stanford, CA
94305.
Dr. Shanafelt: 300 Pasteur Drive, Room H3215, Stanford, CA
94305.
Dr. Trockel: 401 Quarry Road, Room 2303, Stanford, CA
94305.
Drs. Adair and Sexton: 3100 Tower Boulevard, Suite 300, Dur-
ham, NC 27707.
Dr. Ioannidis: 1265 Welch Road, MSOB x306, Stanford, CA
94305.
Author Contributions: Conception and design: D.S. Tawfik,
J.P.A. Ioannidis.
Analysis and interpretation of the data: D.S. Tawfik, J. Profit, T.
Shanafelt.
Drafting of the article: D.S. Tawfik, T. Shanafelt, J.P.A. Ioannidis.
Critical revision for important intellectual content: D.S. Tawfik,
A. Scheid, T. Shanafelt, M. Trockel, J.B. Sexton, J.P.A. Ioannidis.
Final approval of the article: D.S. Tawfik, A. Scheid, J. Profit, T.
Shanafelt, M. Trockel, K.C. Adair, J.B. Sexton, J.P.A. Ioannidis.
Provision of study materials or patients: D.S. Tawfik.
Statistical expertise: D.S. Tawfik.
Obtaining of funding: D.S. Tawfik.
Administrative, technical, or logistic support: D.S. Tawfik, A.
Scheid, J.B. Sexton.
Collection and assembly of data: D.S. Tawfik, A. Scheid, K.C.
Adair.
Annals.org Annals of Internal Medicine • Vol. 171 No. 8 • 15 October 2019
http://www.annals.org
Copyright © American College of Physicians 2019.