post for guru answers only econ ct3
lolo1339
e005055.full.pdf
The role of hospital managers in quality and patient safety: a systematic review
Anam Parand, 1 Sue Dopson,
2 Anna Renz,
1 Charles Vincent
3
To cite: Parand A, Dopson S, Renz A, et al. The role of hospital managers in quality and patient safety: a systematic review. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014- 005055
▸ Prepublication history and additional material for is available. To view please visit the journal (http://dx.doi.org/ 10.1136/bmjopen-2014- 005055).
Received 13 February 2014 Revised 19 August 2014 Accepted 20 August 2014
1Department of Surgery & Cancer, Imperial College London, London, UK 2Said Business School, University of Oxford, Oxford, UK 3Department of Experimental Psychology, University of Oxford, Oxford, UK
Correspondence to Dr Anam Parand; [email protected]
ABSTRACT Objectives: To review the empirical literature to identify the activities, time spent and engagement of hospital managers in quality of care. Design: A systematic review of the literature. Methods: A search was carried out on the databases MEDLINE, PSYCHINFO, EMBASE, HMIC. The search strategy covered three facets: management, quality of care and the hospital setting comprising medical subject headings and key terms. Reviewers screened 15 447 titles/abstracts and 423 full texts were checked against inclusion criteria. Data extraction and quality assessment were performed on 19 included articles. Results: The majority of studies were set in the USA and investigated Board/senior level management. The most common research designs were interviews and surveys on the perceptions of managerial quality and safety practices. Managerial activities comprised strategy, culture and data-centred activities, such as driving improvement culture and promotion of quality, strategy/goal setting and providing feedback. Significant positive associations with quality included compensation attached to quality, using quality improvement measures and having a Board quality committee. However, there is an inconsistency and inadequate employment of these conditions and actions across the sample hospitals. Conclusions: There is some evidence that managers’ time spent and work can influence quality and safety clinical outcomes, processes and performance. However, there is a dearth of empirical studies, further weakened by a lack of objective outcome measures and little examination of actual actions undertaken. We present a model to summarise the conditions and activities that affect quality performance.
INTRODUCTION Managers in healthcare have a legal and moral obligation to ensure a high quality of patient care and to strive to improve care. These managers are in a prime position to mandate policy, systems, procedures and organisational climates. Accordingly, many have argued that it is evident that healthcare managers possess an important and obvious role in quality of care and patient safety and that it is one of the highest priorities of
healthcare managers.1–3 In line with this, there have been calls for Boards to take responsibility for quality and safety out- comes.4 5 One article warned hospital leaders of the dangers of following in the path of bankers falling into recession, constrained by their lack of risk awareness and reluctance to take responsibility.6 To add to the momentum are some high profile publicity of hospital management failures affecting quality and safety, eliciting strong instruction for man- agerial leadership for quality at the national level in some countries.7 8
Beyond healthcare, there is clear evidence of managerial impact on workplace safety.9–12
Within the literature on healthcare, there are non-empirical articles providing propositions and descriptions on managerial attitudes and efforts to improve safety and quality. This lit- erature, made up of opinion articles, editor- ials and single participant experiences, present an array of insightful suggestions and recommendations for actions that hospital
Strengths and limitations of this study
▪ This is the first systematic review of the literature that has considered the evidence on Boards’ and managers’ time spent, engagement and work within the context of quality and safety. This review adds to the widely anecdotal and commen- tary pieces that speculate on what managers should be doing by presenting what they are actu- ally doing.
▪ The review reveals conditions and actions condu- cive to good quality management and offers a model to transparently present these to managers considering their own part in quality and safety.
▪ The search for this review has screened a vast amount of the literature (over 15 000 articles) across a number of databases.
▪ The small number of included studies and their varied study aims, design and population samples make generalisations difficult. With more literature on this topic, distinctions could be made between job positions.
▪ The quality assessment scores are subjective and may not take into consideration factors beyond the quality assessment scale used.
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 1
Open Access Research
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
managers should take to improve the quality of patient care delivery in their organisation.13–17 However, researchers have indicated that there is a limited evi- dence base on this topic.18–21 Others highlight the litera- ture focus on the difficulties of the managers’ role and the negative results of poor leadership on quality improvement (QI) rather than considering actions that managers presently undertake on quality and safety.22 23
Consequently, little is known about what healthcare managers are doing in practice to ensure and improve quality of care and patient safety, how much time they spend on this, and what research-based guidance is avail- able for managers in order for them to decide on appro- priate areas to become involved. Due perhaps to the broad nature of the topic, scientific studies exploring these acts and their impact are likely to be a methodo- logical challenge, although a systematic review of the evi- dence on this subject is notably absent. This present systematic literature review aims to identify empirical studies pertaining to the role of hospital managers in quality of care and patient safety. We define ‘role’ to comprise of managerial activities, time spent and active engagement in quality and safety and its improvement. While the primary research question is on the managers’ role, we take into consideration the contextual factors surrounding this role and its impact or importance as highlighted by the included studies. Our overarching question is “What is the role of hospital managers in quality and safety and its improvement?” The specific review research questions are as follows: ▸ How much time is spent by hospital managers on
quality and safety and its improvement? ▸ What are the managerial activities that relate to
quality and safety and its improvement? ▸ How are managers engaged in quality and safety and
its improvement? ▸ What impact do managers have on quality and safety
and its improvement? ▸ How do contextual factors influence the managers’
role and impact on quality and safety and its improvement?
METHODS Concepts and definitions Quality of care and patient safety were defined on the basis of widely accepted definitions from the Institute of Medicine (IOM) and the Agency for Healthcare Research and Quality Patient Safety Network (AHRQ PSN). IOM define quality in healthcare as possessing the following dimensions: safe, effective, patient-centred, timely, efficient and equitable.4 They define patient safety simply as “the prevention of harm to patients”,24
and AHRQ define it as “freedom from accidental or pre- ventable injuries produced by medical care.”25 Literature was searched for all key terms associated with quality and patient safety to produce an all-encompassing approach. A manager was defined as an employee who has
subordinates, oversees staff, is responsible for staff recruit- ment and training, and holds budgetary accountabilities. Therefore, all levels of managers including Boards of managers were included in this review with the exception of clinical frontline employees, e.g. doctors or nurses, who may have taken on further managerial responsibil- ities alongside their work but do not have a primary offi- cial role as a manager. Those who have specifically taken on a role for quality of care, e.g. the modern matron, were also excluded. Distinction between senior, middle and frontline management was as follows: senior manage- ment holds trust-wide responsibilities26; middle managers are in the middle of the organisational hierarchy chart and have one or more managers reporting to them27; frontline managers are defined as managers at the first level of the organisational hierarchy chart who have front- line employees reporting to them. Board managers include all members of the Board. Although there are overlaps between senior managers and Boards (e.g. chief executive officers (CEOs) may sit on hospital Boards), we aim to present senior and Board level managers separ- ately due to the differences in their responsibilities and position. Only managers who would manage within or govern hospitals were included, with the exclusion of set- tings that solely served mental health or that comprised solely of non-acute care community services (in order to keep the sample more homogenous). The definition of ‘role’ focused on actual engagement, time spent and activities that do or did occur rather than those recom- mended that should or could occur.
Search strategy Literature was reviewed between 1 January 1983 and 1 November 2010. Eligible articles were those that described or tested managerial roles pertaining to quality and safety in the hospital setting. Part of the search strategy was based on guidance by Tanon et al.28
EMBASE, MEDLINE, Health Management Information Consortium (HMIC) and PSYCHINFO databases were searched. The search strategy involved three facets (management, quality and hospital setting) and five steps. A facet (i.e. a conceptual grouping of related search terms) for role was not included in the search strategy, as it would have significantly reduced the sensi- tivity of the search. Multiple iterations and combinations of all search
terms were tested to achieve the best level of specificity and sensitivity. In addition to the key terms, Medical Subject Headings (MeSH) terms were used, which were ‘exploded’ to include all MeSH subheadings. All data- bases required slightly different MeSH terms (named Emtree in EMBASE), therefore four variations of the search strategies were used (see online supplementary appendix 1 for the search strategies). Additional limits placed on the search strategy restricted study partici- pants to human and the language to English. The search strategy identified 15 447 articles after duplicates had been removed.
2 Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
Screening Three reviewers (AP, AR and Dina Grishin) independ- ently screened the titles and abstracts of the articles for studies that fit the inclusion criteria. One reviewer (AP) screened all 15 447 articles, while two additional reviewers screened 30% of the total sample retrieved from the search strategy: AR screened 20% and DG screened 10%. On testing inter-rater reliability, Cohen’s κ correlations showed low agreement between AR and AP (κ=0.157, p<0.01) and between DG and AP (κ=0.137, p<0.00).29 However, there was a high percentage of agreement between raters (95% and 89%, respectively), which reveals a good inter-rater reliability.30 31
Discrepancies were resolved by discussion and consen- sus. The main inclusion criteria were that: the setting was hospitals; the population sample reported on was managers; the context was quality and safety; the aim was to identify the managerial activities/time/engage- ment in quality and safety. The full inclusion/exclusion criteria and screening tool can be accessed in the online supplementary appendices 2–3. Figure 1 presents the numbers of articles included and excluded at each stage of the review process. Four hundred and twenty-three articles remained for
full text screening. One reviewer (AP) screened all arti- cles and a second reviewer (AR) reviewed 7% of these. A moderate agreement inter-rater reliability score was calculated (κ=0.615, p<0.001) with 73% agreement. The primary reoccurring difference in agreement was regard- ing whether the article pertained to quality of care, owing to the broad nature of the definition. Each article was discussed individually until a consensus was reached on whether to include or exclude. Hand searching and cross-referencing were carried out in case articles were missed by the search strategy or from restriction of data- bases. One additional article was identified from hand searching,32 totalling 19 articles included in the system- atic review (figure 1).
Data extraction and methodological quality The characteristics and summary findings of the 19 included studies are presented in table 1. This table is a simplified version of a standardised template that was used to ensure consistency in data extracted from each article. Each study was assessed using a quality appraisal tool developed by Kmet et al,34 which comprised of two checklists (qualitative and quantitative). Random included articles (32%) were scored by Ana Wheelock for scoring consistency. All articles were scored on up to 24 questions with a score between 0 and 2; table 2 shows an example definition of what constitutes ‘Yes’ (2), ‘Partial’ (1) and ‘No’ (0) rating criteria. The total per- centage scores for each study are presented in table 1. All studies were included regardless of their quality scores. Some cumulative evidence bias may results from two larger data sets split into more than one study each.35–38 Through a narrative synthesis, we aimed to
maintain the original meanings, interpretations and raw data offered by the articles.39
RESULTS This section provides an overview description of the reviewed studies and their key findings. The findings are considered under four main headings: managerial time spent on quality and safety; managerial quality and safety activities; managerial impact on quality and safety; and contextual factors related to managers’ quality and safety role. The section ends with a proposed model to summarise the review findings.
Description of the studies From the 19 included studies, the majority were carried out and set in the USA (14 studies) and investigated senior management and/or Boards (13 studies). Of these, 3 focused on senior managers alone (e.g. chief nursing offi- cers), 9 concentrated on Board managers and 1 included a mixture of managerial levels. Only 3 investigated middle managers and 3 examined frontline staff (e.g. clinical dir- ectorate managers and unit nurse managers). The settings of the study were mostly trust or hospital-wide; a few arti- cles were set in specific settings or contexts: elderly care,40
evidence-based medicine,41 staff productivity,42 clinical risk management43 and hospital-acquired infection preven- tion.44 Two studies involved specific interventions,45 46 and 7 studies concentrated specifically on QI rather than quality and safety oversight or routine.35 40 45–49 There were a mixture of 6 qualitative designs (interviews or focus groups); 8 quantitative survey designs and 5 mix-methods designs. All but one study employed a cross-sectional design.46 The primary outcome measure used in most studies was perceptions of managerial quality and safety practices. All reported participant perceptions and a majority presented self-reports, i.e. either a mixture of self- reports and peer reports, or self-reports alone.41 43 45 46
Several studies asked participants about their own and/or other managers’ involvement with regard to their specific QI intervention or quality/safety issue.40 41 44–47 With some variations, the most common research design was to interview or survey senior manager/Board members (par- ticularly Board chairs, presidents and CEOs) perceptions on the Board/senior managers’ functions, practices, prior- ities, agenda, time spent, engagement, challenges/issues, drivers and literacy (e.g. familiarity of key reports) on quality and safety.35–38 48–51 Five of these studies included objective process/outcome measures, such as adjusted mortality rates.35 37 38 49 50 No other studies included clin- ical outcome measures. The quality assessment scores ranged between 50% and
100%; one study scored (what we consider to be) very low (i.e. <55%), eight studies scored highly (i.e. >75%), two other articles scored highly on one out of two of their studies (quantitative/qualitative) and the remaining eight scored a moderate rating in-between. Almost half of the articles did not adequately describe their qualitative
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 3
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
studies. Specifically, 8 failed to fully describe their qualita- tive data collection methods, often not mentioning a stan- dardised topic guide, what questions were asked of participants, or no mention of consent and confidentiality assurances. In 7 studies there was no or vague qualitative data analysis description, including omitting the type of qualitative analysis used. Six of the studies showed no or poor use of verification procedures to establish credibility and 9 reported no or poor reflexivity. Positively, all study designs were evident, the context of studies were clear and the authors showed a connection to a wider body of knowledge. Similarly to the qualitative studies, 7 quantitative
studies did not fully describe, justify or use appropriate analysis methods. However, compared with the qualita- tive studies, the quantitative studies suffered more from sampling issues. Three studies had particularly small samples (e.g. n=35) and one had an especially low response rate of 15%. Participant characteristics were insufficiently described in 5 studies; in one case the authors did not state the number of hospitals included in data analysis. Several studies had obtained ordinal
data but only presented percentages, and only one study reported to appropriately controlled for confounding variables. Across all articles, all but 3 studies reported clear objectives and asserted conclusions clearly sup- ported by the data.
Managerial time spent on quality and safety The studies on Board level managers highlight an inad- equate prioritisation of quality and patient safety on the Board agenda and subsequent time spent at Board meet- ings. Not all hospitals consistently have quality on their Board agenda, e.g. CEOs and chairpersons across 30 orga- nisations reported that approximately a third of all Board meetings had quality on their agenda,35 and necessary quality items were not consistently and sometimes never addressed.36 In all studies examining time spent on quality and safety by the Board, less than half of the total time was spent on quality and safety,32 37 38 48–51 with a majority of Boards spending 25% or less on quality.32 38 45 49–51
Findings imply that this may be too low to have a positive influence on quality and safety, as higher quality performance was demonstrated by Boards that spent
Figure 1 Review stages based on PRISMA flow diagram. 33
4 Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
above 20%/25% on quality.49 50 Board members recog- nised that the usual time spent is insufficient.48 However, few reported financial goals as more important than quality and safety goals,32 and health system Boards only spent slightly more time on financial issues than quality.51
Frontline managers also placed less importance and time on QI,42 identified as the least discussed topic by clinical managers.52
Managerial quality and safety activities A broad range of quality-related activities were identified to be undertaken by managers. These are presented by the following three groupings: strategy-centred; data- centred and culture-centred.
Strategy-centred Board priority setting and planning strategies aligned with quality and safety goals were identified as Board managerial actions carried out in several studies. High percentages (over 80% in two studies) of Boards had formally established strategic goals for quality with spe- cific targets and aimed to create a quality plan integral to their broader strategic agenda.32 37 Contrary findings however suggest that the Board rarely set the agenda for the discussion on quality,37 did not provide the ideas for their strategies32 and were largely uninvolved in strategic planning for QI.48 In the latter case, the non-clinical Board managers felt that they held ‘passive’ roles in quality decisions. This is important considering evidence that connects the activity of setting the hospital quality agenda with better performance in process of care and mortality.38 Additionally, Boards that established goals in four areas of quality and publicly disseminated strategic goals and reported quality information were linked to high hospital performance.35 38 50
Culture-centred Activities aimed at enhancing patient safety/QI culture emerged from several studies across organisational tiers.44 47 48 53 Board and senior management’s activities included encouraging an organisational culture of QI on norms regarding interdepartmental/multidisciplin- ary collaboration and advocating QI efforts to clinicians and fellow senior managers, providing powerful mes- sages of safety commitment and influencing the organi- sation’s patient safety mission.47 53 Managers at differing levels focused on cultivating a culture of clinical excel- lence and articulating the organisational culture to staff.44 Factors to motivate/engage middle and senior management in QI included senior management com- mitment, provision of resources and managerial role accountability.40 46 Findings revealed connections between senior management and Board priorities and values with hospital performance and on middle man- agement quality-related activities. Ensuring capacity for high-quality standards also appears within the remit of management, as physician credentialing was identified as a Board managers’ responsibility in more than one
study.38 48 From this review it is unclear to what degree Board involvement in the credentialing process has a sig- nificant impact on quality.38 41
Data-centred Information on quality and safety is continually supplied to the Board.51 At all levels of management, activities around quality and safety data or information were recognised in 6 studies.35 38 43 45 47 53 Activities included collecting and collating information,43 reviewing quality information,35 38 53 using measures such as incident reports and infection rates to forge changes,53 using patient satisfaction surveys,35 taking corrective action based on adverse incidents or trends emphasised at Board meetings38 and providing feedback.43 47 The studies do not specify the changes made based on the data-related activities by senior managers; one study identified that frontline managers predominantly used data from an incident reporting tool to change policy/ practice and training/education and communication between care providers.45 However, overseeing data gen- erally was found to be beneficial, as hospitals that carried out performance monitoring activities had sig- nificantly higher scores in process of care and lower mortality rates than hospitals that did not.38
Managerial impact on quality and safety outcomes We have considered the associations found between specific managerial involvement and its affect on quality and safety. Here, we summarise the impact and importance of their general role. Of the articles that looked at either outcomes of management involvement in quality or at its perceived importance, 6 articles suggested that their role was benefi- cial to quality and safety performance.32 35 38 40 49 53 Senior management support and engagement was identified as one of the primary factors associated with good hospital-wide quality outcomes and QI programme success.35 38 40 49 Conversely, 6 articles suggest that managers’ involvement (from the Board, middle and front- line) has little, no or a negative influence on quality and safety.35 38 41 42 44 49 Practices that showed no significant association with quality measures included Board’s partici- pation in physician credentialing.35 38 Another noted that if other champion leaders are present, management leader- ship was not deemed necessary.44 Two articles identified a negative or inhibitory effect on evidence-based practices and staff productivity from frontline and middle man- agers.41 42
Contextual factors related to managers’ quality and safety role Most of the articles focused on issues that influenced the managers’ role or their impact, as opposed to dis- cussing the role of the managers. These provide an insight in to the types of conditions in which a manager can best undertake their role to affect quality and safety. Unfortunately it appears that many of these conditions are not in place.
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 5
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
Table 1 Table of characteristics and summary findings of included studies
First author;
year (country) Methods
Sample size
(number of
organisations)
Population
sample (level of
management
reported on
(position of
managers)) Outcome measure
Management roles (managerial quality and safety activities,
time spent and engagement and key perceived
importance and context factors)
Quality
assessment
score for
qualitative
studies
Quality
assessment
score for
quantitative
studies
Findings pertaining
to research questions
(time spent; activities, engagement; impact (including perceived effectiveness); contextual factors)
Baker et al;
2010
(Canada) 32
Mixed methods
(interviews,
case studies,
surveys)
n=15 interviews;
n=4 Board case
studies; n=79
surveys (79
organisations)
Managers (Board
management)
Perceptions of
managers on
management Board
practices in quality
and safety
▸ Less than half (43%) of Boards reported that they addressed quality and patient safety issues in all meetings
▸ One-third of Boards spend 25% of their time or more on quality and patient safety issues
▸ More than 80% of Boards have formally established strategic goals for quality with specific targets, but a majority of Board chairs indicate that their
Boards did not provide the ideas for strategic direction or initiatives
▸ Board chairs reported a low participation in education on quality and safety: 43% reported that all the Board members participated, 19% stated that more
than half participated and 23% said it was less than a quarter of the Board
▸ Most Board chairs (87%) reported Board member induction training on responsibilities for quality and safety, although almost a third (30%) reported
few or no opportunities for education on this, 42% reported some
opportunities and 28% reported many
▸ Approximately half (57%) of the Board chairs acknowledged recruitment of individuals that have knowledge, skills and experience in quality and patient
safety onto the Board. A Board skills matrix included quality and safety as
one of the competency areas
▸ Over half (55%) of board chairs rated their board’s effectiveness in quality and safety oversight as very/extremely effective and 40% as somewhat
effective
16/20 (80%) 12/22
(55%) Time
Activities
Impact
Context
Balding; 2005
(Australia) 46
Mixed methods
(action
research,
surveys and
focus groups)
n=35
(1 hospital)
Managers (middle
management
(nursing managers
and allied health
managers))
Self-reported
perceptions of
managers on their
engagement in a QI
programme
Five elements deemed essential to middle manager engagement:
▸ Senior management commitment and leadership (e.g. senior management provides strategic direction for QI plan)
▸ Provision of resources and opportunities for QI education and information dissemination (e.g. basic QI skills provided to all staff)
▸ Senior and middle manager role accountability (e.g. senior managers and middle managers agree QI roles and expectations)
▸ Middle manager involvement in QI planning (e.g. senior and middle managers plan together)
▸ Middle managers own and operate QI programme (e.g. ongoing review and evaluation of the progress of the QI programme by the middle and senior
managers)
14/20 (70%) 15/22 (68%) Activities
Engagement
Impact
Bradely et al;
2003 (USA) 47
Qualitative
(interviews)
n=45
(8 hospitals)
Clinical staff and
senior management
(senior management
(unspecified))
Perceptions of roles
and activities that
comprise senior
management’s
involvement in
quality improvement
efforts
Five common roles and activities that captured the variation in management
involvement in quality improvement efforts:
▸ Personal engagement of senior managers ▸ Management’s relationship with clinical staff ▸ Promotion of an organisational culture of quality improvement ▸ Support of quality improvement with organisational structures ▸ Procurement of organisational resources for quality improvement efforts
19/20 (95%) NA Activities
Engagement
Impact
Bradely et al;
2006 (USA) 40
Mixed methods
(surveys and
interviews)
n=63 survey
respondents (63
hospitals);
n=102
interviewees (13
hospitals)
Managers (senior
management (chief
operating officer, vice
president, medical
director, CNO, director
of volunteers,
programme director))
Perceptions of
management-related
factors around the
HELP programme
▸ Providing resources for needed staffing or staff training ▸ Promoting the programme among the governing Board, physicians who were
initially less involved, and other administrators
▸ Senior management support reported as the primary enabling factor in the implementation of such programmes (96.6%), along with a lack of support as
the primary reason for not implementing the programme (65.0%)
▸ The interviews supported that having an administrative champion was considered essential to their programme’s success
19/20 (95%) 17/22
(77%)
Activities
Engagement
Impact
Context
Continued
6 Parand
A,etal.BM J O pen
2014;4:e005055.doi:10.1136/bm jopen-2014-005055
O p e n A c c e s s
on 17 January 2019 by guest. Protected by copyright. http://bmjopen.bmj.com/ BMJ Open: first published as 10.1136/bmjopen-2014-005055 on 5 September 2014. Downloaded from
Table 1 Continued
First author;
year (country) Methods
Sample size
(number of
organisations)
Population
sample (level of
management
reported on
(position of
managers)) Outcome measure
Management roles (managerial quality and safety activities,
time spent and engagement and key perceived
importance and context factors)
Quality
assessment
score for
qualitative
studies
Quality
assessment
score for
quantitative
studies
Findings pertaining
to research questions
(time spent; activities, engagement; impact (including perceived effectiveness); contextual factors)
Braithwaite
et al; 2004
(Australia) 52
Mixed methods
(ethnographic
work,
observations
and focus
groups)
n=64 managers
in focus groups
(1 hospital);
ethnographic
case studies
and n=4
observed
(2 hospitals)
Managers (frontline
management (medical
managers, nurse
managers and allied
health managers))
Observations and
self-reported
perceptions of
clinician-managers’
activities
▸ Quality was the least discussed topic (e.g. continuous quality improvement) ▸ The most discussed topic was people (e.g. staffing, delegating) and
organisational issues, e.g. beds and equipment
16/20 (80%) NA Time
Caine and
Kenwrick;
1997(UK) 41
Qualitative
(interviews)
n=10 (2
hospitals)
Managers (middle
management (clinical
directorate managers))
Self-reported
perceptions of
managers on the
managers’ role in
facilitating
evidence-based
practice in their
nursing teams
▸ Managers saw their role in research implementation as a facilitator, ensuring quality and financial objectives and standards were met
▸ Managers perceived their facilitatory behaviours produced a low level of clinical change
▸ Managers are not actively advocating research-based practice and failing to integrate it into everyday practice. Their behaviour inhibited the development
of evidence-based nursing practice
▸ Devolved responsibility of use of research to individual professionals
14/20 (70%) NA Activities
Impact
Fox, Fox and
Wells;
1999 (USA) 42
Quantitative
(surveys and
self kept
activity logs)
n=16
(1 hospital)
Managers (frontline
management (nurse
administrative
managers (NAMs)))
Self-reported
perceptions of
managers on their
activities impacting
unit personnel
productivity and
monitored time/effort
allocated to each
function and
managers’ hours
worked, patient
admissions and
length of stay
▸ The small amount of total management allocated to QI (2.6%) was the least time spent of all management functions
▸ A negative relationship between time spent in QI activities and unit personnel productivity. An increase (from 2.5% to 5%) in QI time/effort by NAMs would
reduce staff productivity significantly by approximately 8%
▸ The greater the experiences of NAMs as managers, the more time spent on QI. These seasoned NAMs spent more time on monitoring, reporting QI
results and quality improvement teams (statistics nor provided)
NA 13/22 (59%) Time
Activities
Impact (objective
outcome measure)
Harris;
2000 (UK) 43
Quantitative
(surveys)
n=42 (42
hospitals)
Managers (middle
management (nurse
managers))
Self-reported
perceptions of
managers on
managers’ quality
and safety practices
▸ The majority of managers (91%) who received collated incident information used it to feed back to their own staff. 60% always fed back to staff, 28%
sometimes did, 2% never did
▸ Of the trusts that had written guidance on types of clinical incident to report, 80% of managers had general guidance and fewer (20%) had written
specialty specific guidance
▸ 76% of managers reported information collation of clinical incidents. Of these, 59% were involved in data collection themselves
NA 13/22 (59%) Activities
Jha and
Epstein;
2010 (USA) 50
Quantitative
(surveys)
n=722 (767
hospitals)
Managers (Board) Perceptions of
managers on the
role of managers in
quality and safety
and quality outcome
measurement
(from HQA) i.e. 19
practices for care in
3 clinical conditions
▸ Two-thirds (63%) of Boards had quality as an agenda item at every meeting ▸ Fewer than half (42%) of the hospitals spent at least 20% of the Board’s time
on clinical quality
▸ 72% of Boards regularly reviewed a quality dashboard ▸ Most respondents reported that their Boards had established, endorsed or
approved goals in four areas of quality: hospital-acquired infections (82%),
medication errors (83%), the HQA/Joint commission core measures (72%),
and patient satisfaction (91%)High-performing hospitals were more likely
than low-performing hospitals to have:
▸ Board reviews of a quality dashboard regularly (<0.001) and of clinical measures (all <0.05)
NA 22/22 (100%) Time
Activities
Impact (objective
outcome measure)
Context
Continued
Parand A,etal.BM
J O pen
2014;4:e005055.doi:10.1136/bm jopen-2014-005055
7
O p e n A c c e s s
on 17 January 2019 by guest. Protected by copyright. http://bmjopen.bmj.com/ BMJ Open: first published as 10.1136/bmjopen-2014-005055 on 5 September 2014. Downloaded from
Table 1 Continued
First author;
year (country) Methods
Sample size
(number of
organisations)
Population
sample (level of
management
reported on
(position of
managers)) Outcome measure
Management roles (managerial quality and safety activities,
time spent and engagement and key perceived
importance and context factors)
Quality
assessment
score for
qualitative
studies
Quality
assessment
score for
quantitative
studies
Findings pertaining
to research questions
(time spent; activities, engagement; impact (including perceived effectiveness); contextual factors)
▸ Quality performance on the agenda at every Board meeting (0.003) ▸ At least 20% of Board time on clinical quality (0.001) ▸ Has a quality subcommittee (0.001)
Jiang et al;
2008 (USA) 37
Quantitative
(surveys)
n=562 (387
hospitals)
Managers (Board and
senior management
(presidents/CEOs))
Perceptions of
managers on
managers’ practices
in quality and safety;
and outcomes of
care (composite
scores of
risk-adjusted M
indicators)
▸ 75% of CEOs reported that most to all of the Board meetings have a specific agenda item devoted to quality. Only 41% indicated that the Boards spend
more than 20% of its meeting time on the specific item of quality.The
following activities were most reported to be performed:
▸ Board establishing strategic goals for QI (81.3%) ▸ Use quality dashboards to track performance (86%) ▸ Follow-up corrective actions related to adverse events (83%)The following
activities were least reported to be performed:
▸ Board involvement in setting the agenda for the discussion on quality (42.4%)
▸ Inclusion of the quality measures in the CEO’s performance evaluation (54.6%)
▸ Improvement of quality literacy of Board members (48.9%) ▸ Board written policy on quality and formally communicated it (30.8%)
NA 20/26 (77%) Time
Activities
Impact (objective
outcome measure)
Context
Jiang et al;
2009 (USA) 38
Quantitative
(surveys)
n=490 (490
hospitals)
Managers
(Board and senior
management (CEOS
and hospital
presidents reports))
Perceptions of
managers on
manager’s practices
in quality and safety;
and POC measures
(20 measures in 4
clinical areas); and
outcome measures
(composite scores of
risk-adjusted M
indicators)
Board practices found to be associated with better performance (all p<0.05) in
POC and adjusted M included:
▸ Having a Board quality committee (83.8%POC, 6.2M versus 80.2%POC, 7.9M without a committee)
▸ Establishing strategic goals for quality improvement (82.8% POC, 6.6M versus 80.3% POC, 7.9M)
▸ Being involved in setting the quality agenda for the hospital (83.2% POC, 6.4M versus 80.9% POC, 7.7M)
▸ Including a specific item on quality in Board meetings (83.2% POC, 6.5M versus 78.5% POC, 8.6M)
▸ Using a dashboard with national benchmarks and internal data that includes indicators for clinical quality, patient safety and patient satisfaction (all above
80% POC and below 6.5M versus all below 80%POC and above 7M)
▸ Linking senior executives’ performance evaluation to quality and patient safety indicators (83.1% POC, 6.6M versus 80.4% POC, 7.6M)Practices that
did NOT show significant association with the quality measures for process
and M include:
▸ Reporting to the Board of any corrective action related to adverse events (82.5% POC, 7.0M versus 81.8% POC, 6.6M)
▸ Board’s participation in physician credentialing (82.8% POC, 6.9M versus 81.5% POC, 6.9M)
▸ Orientation for new Board members on quality(82.9% POC, 6.8M versus 81.7% POC, 7.0M)
▸ Education of Board members on quality issues (82.8% POC, 7.0M versus 81.9% POC, 6.9M)
NA 22/24 (92%) Activities
Impact (objective
outcome measure)
Context
Joshi and
Hines; 2006
(USA) 35
Mixed
methods
(surveys and
interviews)
n=37 survey
respondents;
n=47
interviewees (30
hospitals)
Managers (Board and
senior management
(CEOs, Board chairs))
Perceptions of
managers on
managers’ practices
in quality and safety
and ACM and
risk-adjusted M.
▸ Board engagement in quality was reported as satisfactory (7.58 by CEOs and 8.10 by Chairs on a 1–10 scale where 10 indicates greatest satisfaction)
▸ Board engagement was positively associated with perceptions of the rate of progress in improvement (r=0.44, p =0.05), and marginally associated with
ACM scores (r=0.41, p=0.07)
▸ Approximately one-third of Board meetings are devoted to discussing quality issues (reported at 35% by CEOs and 27% by Chairs)
12/20 (60%) 16/20 (80%) Time
Activities
Engagement
Impact (objective
outcome measure)
Context
Continued
8 Parand
A,etal.BM J O pen
2014;4:e005055.doi:10.1136/bm jopen-2014-005055
O p e n A c c e s s
on 17 January 2019 by guest. Protected by copyright. http://bmjopen.bmj.com/ BMJ Open: first published as 10.1136/bmjopen-2014-005055 on 5 September 2014. Downloaded from
Table 1 Continued
First author;
year (country) Methods
Sample size
(number of
organisations)
Population
sample (level of
management
reported on
(position of
managers)) Outcome measure
Management roles (managerial quality and safety activities,
time spent and engagement and key perceived
importance and context factors)
Quality
assessment
score for
qualitative
studies
Quality
assessment
score for
quantitative
studies
Findings pertaining
to research questions
(time spent; activities, engagement; impact (including perceived effectiveness); contextual factors)
▸ Integrating Quality Planning and Strategic Planning was also rated as satisfactory (7.67 by CEOs and 8.85 by Chairs)
▸ Approximately two-thirds of respondents reported using patient satisfaction surveys (70% and 65% reported by CEOs and Chairs, respectively)
▸ Low level of CEO expertise in QI, as reported by themselves (2.70) and by Board Chairs (3.35%) on a scale of 1–10 where 1 is low familiarity and 10 is
high familiarity
Levey et al;
2007 (USA) 48
Qualitative
(interviews)
n=96 (18
hospitals)
Managers (Board and
senior management
(hospital Board
members, CEOs, chief
medical officers, chief
quality officers,
medical staff leaders))
Perceptions of
managers on
managers’ role in
quality and safety
▸ Few CEOs were willing to take the lead for transformation to a ‘culture of quality’
▸ Board members were largely uninvolved in strategic planning for QI ▸ In terms of the Board’s quality functions, respondents largely agreed that
physician credentialing was their critical responsibility
▸ Non-physicians reported that they felt relegated to ‘passive’ roles in decisions on quality and seemed reluctant to assume leadership roles in the quality
domain
▸ Board meeting agendas maintained a focus on financial issues, although patient safety/care and QI were gaining prominence
▸ About half of the respondents said that quality was not sufficiently highlighted during meetings. Estimates of time devoted to quality and safety
issues at Board meetings were between 10% and 35%
13/20 (65%) NA Time
Activities
Engagement
Context
Mastal, Joshi
and Shulke;
2007 (USA) 36
Qualitative
(interviews and
a focus group)
n=73
interviewees;
1 focus group
(63 hospitals)
Managers (Board and
senior management
(Board chairs, CEOs,
CNOs))
Perceptions of
managers on
managers’ role in
quality and safety
▸ Two CNOs reported that nursing quality was never addressed at Board meetings
▸ Few of the CNOs, CEOs and Board chairs responded that issues are discussed more frequently, such as at every meeting
▸ Quality and patient safety measures for nurses are not consistently addressed during all hospital Board meetings
▸ Staffing concerns are the most frequent measure of nursing quality reported at the Board level
12/20 (60%) NA Time
Context
Poniatowski,
Stanley and
Youngberg;
2005 (USA) 45
Quantitative
(surveys)
n=515 (16
academic
medical
centers)
Managers (frontline
management—unclear
whether frontline or
middle managers (unit
nurse managers))
Self-reported
perceptions of
managers on their
practices with PSN
▸ Managers reviewed on average 65% of the PSN events reportedAs a result of what was learned from PSN data, 162 managers detailed their changes
made to:
▸ Policies and practices (59%) ▸ Training, education and communication between care providers (27%) ▸ Purchase of new equipment and supplies (8%) ▸ Staffing (6%)
NA 10/20 (50%) Activities
Prybil et al;
2010 (USA) 51
Quantitative
(surveys)
n=123 (712
hospitals)
Managers (Board and
senior management
(CEOs and Boards))
Perceptions of
managers on their
role in quality and
safety
▸ Health system Boards spent 23% of their Board meeting time on quality and safety issues. They only spent slightly more on financial issues (25.2%) and
strategic planning (27.2%)
▸ Almost all (96%) CEOs said that the Boards regularly received formal written reports on quality targets
▸ 88% of CEOs said that the Boards had assigned quality and safety oversight to a standing Board committee
▸ All but one (98.9%) of the CEOs stated that they have specific performance expectations and criteria related to quality and safety
▸ CEOs reported 59% of the Boards formally adopted system-wide measures and standards for quality
NA 14/22 (64%) Time
Activities
Context
Continued
Parand A,etal.BM
J O pen
2014;4:e005055.doi:10.1136/bm jopen-2014-005055
9
O p e n A c c e s s
on 17 January 2019 by guest. Protected by copyright. http://bmjopen.bmj.com/ BMJ Open: first published as 10.1136/bmjopen-2014-005055 on 5 September 2014. Downloaded from
Table 1 Continued
First author;
year (country) Methods
Sample size
(number of
organisations)
Population
sample (level of
management
reported on
(position of
managers)) Outcome measure
Management roles (managerial quality and safety activities,
time spent and engagement and key perceived
importance and context factors)
Quality
assessment
score for
qualitative
studies
Quality
assessment
score for
quantitative
studies
Findings pertaining
to research questions
(time spent; activities, engagement; impact (including perceived effectiveness); contextual factors)
Saint et al;
2010 (USA) 44
Qualitative
(interviews)
n=86
(interviewees)
(14 hospitals)
Senior hospital staff
and managers (mixed
levels (nurse
managers, chief
physicians, Chairs of
medicine, chief of
staffs, hospital
directors, CEOs and
clinical non-managerial
staff))
Perceptions of
managers on
managers’ practices
in HAI
▸ Although committed leadership by CEOs can be helpful, it was not always necessary, provided that other hospital leaders were committed to infection
prevention Behaviours of leaders who successfully implemented/facilitated
practices to prevent HAI:
▸ Cultivated a culture of clinical excellence and kept their eye on improving patient care
▸ Developed a vision ▸ Articulated the organisational culture well and conveyed that to staff at all
levels
▸ Focused on overcoming barriers and dealing directly with resistant staff or process issues that impeded prevention of HAI
▸ Cultivated leadership skills and inspired the people they supervised (motivating and energising them to work towards the goal of preventing HAI)
▸ Thought strategically while acting locally; planned ahead and left few things to chance
▸ They did the politicking before issues arose for committee votes ▸ They leveraged personal prestige to move initiatives forward ▸ They worked well across disciplines
16/20 (80%) NA Activities
Engagement
Impact
Vaughn et al;
2006 (USA) 49
Quantitative
(surveys)
n=413 (413
hospitals)
Managers (Board and
senior management
(chief executives and
senior quality
executives; Board,
executives, clinical
leadership))
Perceptions of
managers on
managers’ role in QI
and observed
hospital
quality index
outcomes
(risk-adjusted
measures of
morbidity, M and
medical
complications)
▸ 72% of hospital Boards spent one-quarter of their time or less on quality-of-care issues. About 5% of Boards spent more than half of their time
on these issues
▸ A majority of respondents reported great influence from government and regulatory agencies (87%), consumers (72%) and accrediting bodies (74%)
on quality priorities. Although 44% of respondents also noted that multiple
government and regulatory requirements were unhelpfulBetter QIS are
associated with hospitals where the Board:
▸ Spends more than 25% of their time on quality issues (QIS 83–QIS mean 100 across hospitals)
▸ Receives a formal quality performance measurement report (QIS 302) ▸ Bases the senior executives’ compensation in part on QI performance (QIS
239)
▸ Engages in a great amount of interaction with the medical staff on quality strategy
NA 21/22 (95%) Time
Activities
Engagement
Impact (objective
outcome measure)
Context
Weingart and
Page; 2004
(USA) 53
Qualitative
(case study
documentation
analysis and
meeting
discussions
and focus
group)
n=30
(10 hospitals
and other
stakeholder
organisations)
Managers (senior
management
(executives))
Perceptions of
managers on
manager’s practices
in quality and safety
Executives developed and tested a set of governance best practices in patient
safety, such as:
▸ Creation of a Board committee with explicit responsibility for patient safety ▸ Development of Board level safety reports, introduction of educational
activities for Board members
▸ Participation of Board members in executive walk rounds ▸ Executives reviewed measures to assess safety (e.g. incident reports,
infection rates, pharmacist interventions, readmissions, etc)
▸ Executives endorsed a statement of public commitment to patient safety ▸ Executives believed their behaviours affected their organisations’ patient
safety mission
14/20 (70%) NA Activities
Impact
ACM, appropriate care measure; CEO, chief executive officer; CNO, chief nursing officer; HAI, healthcare-associated infection; HQA, Hospital Quality Alliance; M, mortality; NA, not applicable; POC, process of care; PSN, Patient Safety Net; QI, quality improvement; QIS, quality index scores.
10 Parand
A,etal.BM J O pen
2014;4:e005055.doi:10.1136/bm jopen-2014-005055
O p e n A c c e s s
on 17 January 2019 by guest. Protected by copyright. http://bmjopen.bmj.com/ BMJ Open: first published as 10.1136/bmjopen-2014-005055 on 5 September 2014. Downloaded from
Two studies found that a Board quality committee is a positive variable in quality performance, but that fewer than 60% had them.38 50 Similarly, compensation and per- formance evaluation linked to executive quality perform- ance was identified in 4 articles 35 37 38 49 and associated with better quality performance indicators,38 49 but quality measures were insufficiently included in CEOs’ perform- ance evaluation.35 37 The use of the right measures to drive QI was raised in relation to Board managerial engagement in quality 35 and to impact on patient care improvement,51 yet almost half of this sample did not for- mally adopt system-wide measures and standards for quality. To aid them in these tasks, evidence indicates the common use of QI measure tools, such as a dashboard or scorecard,37 49 50 with promising associations between dashboard use and quality outcomes.38 50
Other factors linked to quality outcomes include man- agement–staff relationship/high interactions between the Board and medical staff when setting quality strategy,49
and managerial expertise. Although a connection between knowledge and quality outcomes was not found,38 high performing hospitals have shown higher self-perceived ability to influence care, expertise at the Board and partici- pation in training programmes that have a quality compo- nent.50 Disappointingly, there is a low level of CEO knowledge on quality and safety reports,35 possibly little Boardroom awareness on salient nursing quality issues,36
and little practice identified to improve quality literacy for the Board.32 37 There is however promise for new man- agers through relevant training at induction and by recruitment of those with relevant expertise.32
The quality management IPO model The input process output (IPO) model is a conceptual framework that helps to structure the review findings in a useful way (see figure 2).54 55 This literature may be conceptualised by considering what factors contribute (input) to managerial activities (process) that impact on quality and safety (output). The three factors are inter- related and interchangeable, presented by the cyclical interconnecting diagram. This diagram enables a clearer mental picture of what a manager should consider for their role in quality and safety. Specifically, the input
factors suggest certain organisational factors that should be put in place alongside individual factors to prepare for such a role (e.g. standardised quality measures, motivation, education and expertise, and a good rela- tionship with clinicians). The processes present the strat- egy, culture and data-centred areas where managers (according to the literature) are and/or should be involved (e.g. driving improvement culture, goal setting and providing feedback on corrective actions for adverse events). The outputs identify managerial influences that are positive, negative or have little or no established asso- ciation with quality performance (e.g. positive outcomes of care, achieving objectives and engaging others in quality of care). This helps to identify areas where it is possible to make an impact through the processes men- tioned. With further empirical studies on this topic, this model could be strengthened to become a more robust set of evidence-based criteria and outcomes.
DISCUSSION Our review examined the role of managers in maintain- ing and promoting safe, quality care. The existing studies detail the time spent, activities and engagement of hospital managers and Boards, and suggest that these can positively influence quality and safety performance. They further reveal that such involvement is often absent, as are certain conditions that may help them in their work. Evidence from the review promotes hospitals to have a
Board quality committee, with a specific item on quality at the Board meeting, a quality performance measure- ment report and a dashboard with national quality and safety benchmarks along with standardised quality and safety measures. Outside of the Boardroom, the implica- tions are for senior managers to build a good infrastruc- ture for staff–manager interactions on quality strategies and attach compensation and performance evaluation to quality and safety achievements. For QI programmes, managers should keep in mind its consistency with the hospital’s mission and provide commitment, resources, education and role accountability. Literature elsewhere supports much of these findings, such as the use of quality measurement tools21 56 better quality-associated
Table 2 Example of rating criteria from Kmet’s quality assessment tool 34
Rating Criteria to verify whether question or objective is sufficiently described
Yes Is easily identified in the introductory section (or first paragraph of methods section). Specifies (where applicable,
depending on study design) all of the following: purpose, participants/target population, and the specific intervention
(s)/association(s)/descriptive parameter(s) under investigation. A study purpose that only becomes apparent after
studying other parts of the paper is not considered sufficiently described
Partial Vaguely/incompletely reported (e.g. “describe the effect of” or “examine the role of” or “assess opinion on many
issues” or “explore the general attitudes”...); or some information has to be gathered from parts of the paper other
than the introduction/background/objective section
No Question or objective is not reported, or is incomprehensible
N/A Should not be checked for this question
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 11
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
compensation, a separate quality committee,16 57 and has also emphasised poor manager–clinician relation- ships as damaging to patients and QI.58 59
Some of the variables that were shown to be associated with good quality performance, such as having a Board committee, compensation/performance and adoption of system-wide measures, were lacking within the study hos- pitals. There are also indications of the need to develop Board and senior managerial knowledge and training on quality and safety. Furthermore, this review indicates that many managers do not spend sufficient time on quality and safety. The included studies suggest time spent by the Board should exceed 20–25%, yet the findings expose that certain Boards devote less time than this. Inadequacies of time allocated to quality at the Board meeting hold concerning implications for quality. If little time is taken to consider quality of care matters at the highest level, an inference is that less attention will be paid to prevention and improvement of quality within the hospital. While the position that the item appears on the agenda is deemed of high importance, it is unimport- ant if the duration on this item is overly brief. In this vein, the inadequate time on quality spent by some may reflect their prioritisation on quality in relation to other matters discussed at the meetings or the value perceived to be gained from discussing it further. It might instead however be indicative of the difficulties in measuring time spent on quality by management. Some of these studies provide us not necessarily with Board managers’ time on quality and safety but their time spent on this at Board meetings. The two may not equate and time spent on quality may not necessarily be well spent.36 The emer- ging inference that managers greatly prioritise other work over quality and safety is not explicit, with further research required to identify what time is actually devoted and required from managers inside and outside of the Boardroom. Perhaps encouragingly, the more
recent studies present more time spent on quality and safety than the earlier studies. Yet even the most recent empirical studies not included in our review conclude that much improvement is required.60
This review presents a wide range of managerial activ- ities, such as public reporting of quality strategies and driving an improvement culture. It further highlights the activities that appear to affect quality performance. Priorities for Boards/managers are to engage in quality, establish goals and strategy to improve care, and get involved in setting the quality agenda, support and promote a safety and QI culture, cultivate leaders, manage resisters, plan ahead and procure organisational resources for quality. Again, much of the findings support the assertions made in the non-empirical litera- ture. Above all, involvement through action, engage- ment and commitment has been suggested to positively affect quality and safety.61 While researchers have stressed the limited empirical evidence showing conclu- sive connection between management commitment and quality,21 some supporting evidence however can be unearthed in research that concentrates on organisa- tional factors related to changes made to improve quality and safety in healthcare.62–64 In addition to this evidence, a few studies have specifically investigated the impact that hospital managers have on quality and safety (rather than examination of their role). These studies have shown senior managerial leadership to be asso- ciated with a higher degree of QI implementation,65
promotion of clinical involvement,66 67 safety climate attitudes68 and increased Board leadership for quality.57
A clear case for the positive influence of management involvement with quality is emerging both from the find- ings of our review and related literature. There is a dearth of empirical research on the role of
hospital managers in quality of care and patient safety and QI. This evidence is further weakened by the largely
Figure 2 The quality management IPO model (IPO, input process output; QI, quality improvement).
12 Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
descriptive nature of many of the studies. They mostly lack theoretical underpinnings and appropriate objective measures. Very few studies reported objective clinical quality outcome measures that better show the influence of managerial actions. Moreover, the content of many of the articles was dominated by the contextual issues sur- rounding managers’ roles, rather than actual manager practices. Some of the outlined managerial actions would further benefit from more detail, e.g. the literature fails to present changes made based on the data-related activ- ities at the Board or senior management level. Only one study clearly demonstrated that senior management and Board priorities can impact on middle management quality-related activities and engagement. Considering the likely influence that seniors have on their managers, examination of the interactions between the different roles held (e.g. Boards setting policies on quality and middle managers implementing them) would improve our understanding of how these differences reflect in their time spent and actions undertaken. Supplementary work could also resolve contradictions that were found within the review, clarifying for example, the positive impact of managerial expertise versus knowledge on quality and who sets the Board agenda for the discussion on quality. Research on this area is particularly required to examine middle and frontline managers, to take into consideration non-managers’ perceptions, and to assess senior managers’ time and tasks outside of the Boardroom. Future studies would benefit from better experimental controls, ideally with more than one time point, verifications and reflections on qualitative work, robust statistical analysis, appropriate study controls, con- sideration of confounding variables, and transparent reporting of population samples, methodologies, and analyses used. Box 1 presents the key messages from this review.
Box 1 Key messages from the systematic literature review
▸ There is a dearth of empirical evidence on hospital managerial work and its influence on quality of care.
▸ There is some evidence that Boards’/managers’ time spent, engagement and work can influence quality and safety clinical outcomes, processes and performance.
▸ Some variables associated with good quality performance were lacking in study hospitals.
▸ Many Board managers do not spend sufficient time on quality and safety.
▸ There is a greater focus on the contextual issues surrounding managers’ roles than on examining managerial activities.
▸ Research is required to examine middle and frontline man- agers, to take into consideration non-managers’ perceptions, and to assess senior managers’ time and tasks outside of the Boardroom. More robust methodologies with objective outcome measures would strengthen the evidence.
▸ We present a model to summarise the evidence-based promo- tion of conditions and activities for managers to best affect quality performance.
Review limitations There are several limitations of the present review per- taining to the search strategy and review process, the limited sample of studies, publication bias, and limita- tions of the studies themselves. Specifically, the small number of included studies and their varied study aims, design and population samples make generalisations dif- ficult. Grouped demographics, such as middle manage- ment, are justified by the overlap between positions. With more literature on this topic, distinctions could be made between job positions. Furthermore, more research on lower levels of management would have pro- vided a better balanced review of hospital managers’ work and contributions to quality. Restricting the lan- guage of studies to English in the search strategy is likely to have biased the findings and misrepresent which countries conduct studies on this topic. There is an over- reliance on perceptions across the studies, which ultim- ately reduces the validity of the conclusions drawn from their findings. As most of the study findings relied on self-reports, social desirability may have resulted in exag- gerated processes and inflated outputs. Although, encouragingly, one of the included studies found that managers who perceived their Boards to be effective in quality oversight were from hospitals that had higher processes-of-care scores and lower risk adjusted mortality. The quality assessment scores should be viewed with caution; such scores are subjective and may not take into consideration factors beyond the quality assessment scale used. Owing to the enormity of this review, the publica- tion of this article is some time after the search run date. As there is little evidence published on this topic, we consider this not to greatly impact on the current relevance of the review, particularly as the literature reviewed spans almost three decades. However, we acknowledge the need for an update of the data as a limitation of this review.
CONCLUSION The modest literature that exists suggests that managers’ time spent, engagement and work can influence quality and safety clinical outcomes, processes and perform- ance. Managerial activities that affect quality perform- ance are especially highlighted by this review, such as establishing goals and strategy to improve care, setting the quality agenda, engaging in quality, promoting a QI culture, managing resisters and procurement of organ- isational resources for quality. Positive actions to con- sider include the establishment of a Board quality committee, with a specific item on quality at the Board meeting, a quality performance measurement report and a dashboard with national quality and safety bench- marks, performance evaluation attached to quality and safety, and an infrastructure for staff–manager interac- tions on quality strategies. However, many of these arrangements were not in place within the study samples. There are also indications of a need for
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 13
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
managers to devote more time to quality and safety. More than one study suggest time spent by the Board should exceed 20–25%, yet the findings expose that certain Boards devote less time than this. Much of the content of the articles focused on such contextual factors rather than on the managerial role itself; more empirical research is required to elucidate managers’ actual activities. Research is additionally required to examine middle and frontline managers, non-manager perceptions, and to assess senior managers’ time and tasks outside of the Boardroom. We present the quality management IPO model to summarise the evidence- based promotion of conditions and activities in order to guide managers on the approaches taken to influence quality performance. More robust empirical research with objective outcome measures could strengthen this guidance.
Acknowledgements The authors would like to thank Miss Dina Grishin for helping to review the abstracts and Miss Ana Wheelock for helping to assess the quality of the articles.
Contributors All coauthors contributed to the study design and reviewed drafts of the article. The first author screened all the articles for inclusion in this review and appraised the study quality. AR and Dina Grishin screened a sample of these at title/abstract and full text, and Ana Wheelock scored the quality of a sample of the included articles.
Funding This work was supported by funding from the Health Foundation and the National Institute for Health Research (grant number: P04636).
Competing interests None.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement The extraction table of the included studies and individual study quality scores can be made available on request to the corresponding author at [email protected].
Open Access This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http:// creativecommons.org/licenses/by/4.0/
REFERENCES 1. Kizer KW. Patient safety: a call to action: safety is a critical
component of quality. MedGenMed 2001;3:10. 2. Kizer KW. Establishing health care performance standards in an era
of consumerism. JAMA 2001;286:1213–17. 3. Berwick D. Will is the way to win the patient safety war. Health Serv
J 2007;117:18–19. 4. Institute of Medicine. Crossing the quality chasm: a new health
system for the 21st century. Washington: National Academy Press, 2001.
5. Gosfield AG, Reinertsen JL. The 100,000 lives campaign: crystallizing standards of care for hospitals. Health Aff 2005;24:1560–70.
6. Denham CR. Is your hospital as safe as your bank?...Time to ask your board. J Patient Saf 2009;5:122–6.
7. Francis R. Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry London: The Stationery Office. 2013 http://www. midstaffspublicinquiry.com/report (accessed 18 Mar 2013)
8. National Advisory Group on the Safety of Patients in England. A promise to learn—a commitment to act: improving the safety of patients in England 2013. https://www.gov.uk/government/uploads/ system/uploads/attachment_data/file/226703/Berwick_Report.pdf (accessed 15 Aug 2013)
9. O’Dea A, Flin R. Site managers and safety leadership in the offshore oil and gas industry. Saf Sci 2001;37:39–57.
10. Zohar D, Luria G. The use of supervisory practices as leverage to improve safety behavior: a cross-level intervention model. J Saf Res 2003;34:567–77.
11. Flin R. “Danger-men at work”: management influence on safety. Hum Factor Ergon Man 2003;13:261–8.
12. Guidotti TL. How can managers visibly promote safety and health protection? J Occup Environ Med 2010;52:1141–2.
13. Conway J. Getting boards on board: engaging governing boards in quality and safety. Jt Comm J Qual Patient Saf 2008;34:214–20.
14. Gautam KS. A call for board leadership on quality in hospitals. Qual Manag Health Care 2005;14:18–30.
15. Caldwell C, Butler G, Grah J. Breakthrough quality: what the board must do. Trustee 2008;61:32–3, 1.
16. Goeschel CA, Wachter RM, Pronovost PJ. Responsibility for quality improvement and patient safety: hospital board and medical staff leadership challenges. Chest 2010;138:171–8.
17. McGinn P, Dave R. What is the board’s role in quality? Trustee 2007;60:40.
18. Øvretveit J. Leading improvement effectively: review of research. 2009. http://www.health.org.uk/public/cms/75/76/313/560/Leading% 20imrpovement%20effectively.pdf?realName=YUaqJk.pdf (accessed 21 Dec 2012)
19. Flin R, Yule S. Leadership for safety: industrial experience. Qual Saf Health Care 2004;13:45–51.
20. West E. Management matters: the link between hospital organisation and quality of patient care. Qual Saf Health Care 2001;10:40–8.
21. Glickman SW, Baggett KA, Krubert CG, et al. Promoting quality: the health-care organization from a management perspective. Int J Qual Health Care 2007;19:341–8.
22. Gaucher E, Kratochwill EW. The leader’s role in implementing total quality management. Qual Manag Health Care 1993;1:10–8.
23. Thorman KE, Capitulo KL, Dubow J, et al. Perinatal patient safety from the perspective of nurse executives: a round table discussion. J Obstet Gynecol Neonatal Nurs 2006;35:409–16.
24. Aspden P, Corrigan JM, Wolcott J, et al. Patient safety: achieving a new standard of care. Institute of Medicine, ed. Washington: National Academies Press, 2004.
25. AHRQ. AHRQ Patient Safety Network Glossary. 2011. http://www. psnet.ahrq.gov/glossary.aspx?indexLetter=P (accessed 19 May 2012)
26. Merali F. NHS managers’ commitment to a socially responsible role: the NHS managers’ views of their core values and their public image. Soc Responsibility J 2005;1:38–46.
27. Mintzberg H. The nature of managerial work. New York: Harper & Row, 1973.
28. Tanon AA, Champagne F, Contandriopoulos AP, et al. Patient safety and systematic reviews: finding papers indexed in MEDLINE, EMBASE and CINAHL. Qual Saf Health Care 2010;19:452–61.
29. Cohen J. A coefficient for agreement for nominal scales. Educ Psych Meas 1960;20:37–46.
30. Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 1990;43:551–8.
31. Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med 2005;37:360–3.
32. Baker GR, Denis JL, Pomey MP, et al. Effective governance for quality and patient safety in Canadian Healthcare organizations: a report to the Canadian Health Services Research Foundation and the Canadian Patient Safety Institute. Ottawa: Canadian Health Services Research Foundation and Canadian Patient Safety Institute, 2010.
33. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009;151:264–9.
34. Kmet LM, Lee RC, Cook LS. Standard quality assessment criteria for evaluating primary research papers from a variety of fields. Edmonton: Alberta Heritage Foundation for Medical Research, 2004.
35. Joshi MS, Hines SC. Getting the board on board: engaging hospital boards in quality and patient safety. Jt Comm J Qual Patient Saf 2006;32:179–87.
36. Mastal MF, Joshi M, Schulke K. Nursing leadership: championing quality and patient safety in the boardroom. Nurs Econ 2007;25:323–30.
37. Jiang HJ, Lockee C, Bass K, et al. Board engagement in quality: findings of a survey of hospital and system leaders. J Healthc Manag 2008;53:121–34.
38. Jiang HJ, Lockee C, Bass K, et al. Board oversight of quality: any differences in process of care and mortality? J Healthc Manag 2009;54:15–29.
39. Walsh D, Downe S. Meta-synthesis method for qualitative research: a literature review. J Adv Nurs 2005;50:204–11.
14 Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
40. Bradley EH, Webster TR, Schlesinger M, et al. The roles of senior management in improving hospital experiences for frail older adults. J Healthc Manag 2006;51:323–36.
41. Caine C, Kenrick M. The role of clinical directorate managers in facilitating evidence-based practice: a report of an exploratory study. J Nurs Manag 1997;5:157–65.
42. Fox RT, Fox DH, Wells PJ. Performance of first-line management functions on productivity of hospital unit personnel. J Nurs Adm 1999;29:12–18.
43. Harris A. Risk management in practice: how are we managing? Clin Perform Qual Health Care 2000;8:142–9.
44. Saint S, Kowalski CP, Banaszak-Holl J, et al. The importance of leadership in preventing healthcare-associated infection: results of a multisite qualitative study. Infect Control Hosp Epidemiol 2010;31:901–7.
45. Poniatowski L, Stanley S, Youngberg B. Using information to empower nurse managers to become champions for patient safety. Nurs Adm Q 2005;29:72–7.
46. Balding C. Embedding organisational quality improvement through middle manager ownership. Int J Health Care Qual Assur 2005;18:271–88.
47. Bradley EH, Holmboe ES, Mattera JA, et al. The roles of senior management in quality improvement efforts: what are the key components? J Healthc Manag 2003;48:15–28.
48. Levey S, Vaughn T, Koepke M, et al. Hospital leadership and quality improvement: rhetoric versus reality. J Patient Saf 2007;3:9–15.
49. Vaughn T, Koepke M, Kroch E, et al. Engagement of leadership in quality improvement initiatives: executive quality improvement survey results. J Patient Saf 2006;2:2–9.
50. Jha A, Epstein A. Hospital governance and the quality of care. Health Aff 2010;29:182–7.
51. Prybil LD, Peterson R, Brezinski P, et al. Board oversight of patient care quality in community health systems. Am J Med Qual 2010;25:34–41.
52. Braithwaite J, Finnegan TP, Graham EM, et al. How important are quality and safety for clinician managers? Evidence from triangulated studies. Clin Governance 2004;9:34–41.
53. Weingart SN, Page D. Implications for practice: challenges for healthcare leaders in fostering patient safety. Qual Saf Health Care 2004;13:52–6.
54. Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004;13:80–4.
55. Kunzle B, Kolbe M, Grote G. Ensuring patient safety through effective leadership behaviour: a literature review. Saf Sci 2010;48:1–17.
56. Naranjo-Gil D. Strategic performance in hospitals: the use of the balanced scorecard by nurse managers. Health Care Manage Rev 2009;34:161–70.
57. Weiner BJ, Alexander JA, Shortell SM. Leadership for quality improvement in health care; empirical evidence on hospital boards, managers, and physicians. Med Care Res Rev 1996;53:397–416.
58. Edwards N, Marshall M, McLellan A, et al. Doctors and managers: a problem without a solution? BMJ 2003;326:609–10.
59. Wilkinson JE, Powell A, Davies H. Are clinicians engaged in quality improvement? A review of the literature on healthcare professionals’ views on quality improvement initiative: Health Foundation Report. 2011. http://www.health.org.uk/public/cms/75/76/ 313/2440/Are%20clinicians%20engaged%20in%20quality% 20improvement.pdf?realName=y8NfS4.pdf (accessed 21 Dec 2012)
60. Jha AK, Epstein AM. A survey of board chairs of English hospitals shows greater attention to quality of care than among their US counterparts. Health Aff 2013;32:677–85.
61. Stanton P. The role of an NHS Board in assuring the quality of clinically governed care and the duty of trust to patients. Clin Governance 2006;11:39–49.
62. Lukas CV, Holmes SK, Cohen AB, et al. Transformational change in health care systems: an organizational model. Health Care Manage Rev 2007;32:309–20.
63. Shortell SM, Bennett CL, Byck GR. Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q 1998;76:593–624, 510.
64. Keroack MA, Youngberg BJ, Cerese JL, et al. Organizational factors associated with high performance in quality and safety in academic medical centers. Acad Med 2007;82:1178–86.
65. Parker VA, Wubbenhorst WH, Young GJ, et al. Implementing quality improvement in hospitals: the role of leadership and culture. Am J Med Qual 1999;14:64–9.
66. Weiner B, Shortell S, Alexander J. Promoting clinical involvement in hospital quality improvement efforts: the effects on top management, board, and physician leadership. Health Serv Res 1997;32:491–510.
67. Duckers MLA, Stegeman I, Spreeuwenberg P, et al. Consensus on the leadership of hospital CEOs and its impact on the participation of physicians in improvement projects. Health Policy 2009;91:306–13.
68. Vogus TJ, Sutcliffe KM. The impact of safety organizing, trusted leadership, and care pathways on reported medication errors in hospital nursing units. Med Care 2007;45:997–1002.
Parand A, et al. BMJ Open 2014;4:e005055. doi:10.1136/bmjopen-2014-005055 15
Open Access
o n
1 7
Ja n
u a ry 2
0 1 9
b y g
u e
st. P ro
te cte
d b
y co p yrig
h t.
h ttp
://b m
jo p e n .b
m j.co
m /
B M
J O p
e n
: first p u
b lish
e d
a s 1
0 .1
1 3
6 /b
m jo
p e
n -2
0 1
4 -0
0 5
0 5
5 o
n 5
S e p te
m b e r 2
0 1 4 . D
o w
n lo
a d e d fro
m
- The role of hospital managers in quality and patient safety: a systematic review
- Abstract
- Introduction
- Methods
- Concepts and definitions
- Search strategy
- Screening
- Data extraction and methodological quality
- Results
- Description of the studies
- Managerial time spent on quality and safety
- Managerial quality and safety activities
- Strategy-centred
- Culture-centred
- Data-centred
- Managerial impact on quality and safety outcomes
- Contextual factors related to managers’ quality and safety role
- The quality management IPO model
- Discussion
- Review limitations
- Conclusion
- References
