Peer-to-peer benchmarking is an important component of rapid-cycle performance improvement in patient safety and quality-improvement efforts. Institutions should carefully examine critical success factors before engagement in peer-to-peer benchmarking in order to maximize growth and change opportunities. Solutions for Patient Safety has proven to be a high-yield engagement for Children’s Hospital of Pittsburgh of University of Pittsburgh Medical Center, with measureable improvement in both organizational process and culture.
Key points
- •
Peer-to-peer benchmarking is an important component of rapid-cycle performance improvement in patient safety and quality-improvement efforts.
- •
Institutions should carefully examine critical success factors before engagement in peer-to-peer benchmarking in order to maximize growth and change opportunities.
- •
Solutions for Patient Safety has proven to be a high-yield engagement for Children’s Hospital of Pittsburgh of University of Pittsburgh Medical Center, with measureable improvement in both organizational process and culture.
Introduction
Attention to quality, safety, and value in health care has undergone significant evolution over the past 25 years. Traditionally, patients, payers, and hospitals have approached the relationship from a relatively siloed perspective. More recently, efforts have been made to reframe the conversation toward a patient-centric, complex adaptive system. The adoption of the Affordable Care Act has served to accelerate this trend, including focus on patient safety, hospital-acquired conditions (HACs), and outcomes. These efforts have caused institutions to reevaluate what, when, and how they use metrics and analytics in order to improve health care delivery. Increasingly, leaders in health care are becoming fluent in quality management science, often referencing other industries for inspiration/guidance in the health care space. Many recognize the Donabedian framework of structure, process, and outcome, in conjunction with various process improvement tools (plan, do, study, act [PDSA], Lean) to drive organizational change efforts.
Externally, institutions face an evolving competitive landscape, with an increased appetite from patients, families, and insurers demanding data transparency on institutional performance. Health systems, payers, and patients find themselves increasingly aligned toward a goal of high-value (defined as outcomes/cost) health care. In addition to competitive market forces, payment incentives by the Centers for Medicare and Medicaid Services in the area of electronic health records (EHRs) and evolving regulatory standards from The Joint Commission (TJC) have provided a strong impetus for health systems to accelerate learning cultures and best-practice adoption.
This article begins with a brief review of the history of measurement, standards, and benchmarking, with a particular focus on pediatric-specific work led by the Agency on Healthcare Research and Quality (AHRQ). The author then discusses the success of the Ohio Collaborative (now known as Solutions for Patient Safety [SPS]), with remarks on critical success factors, including infrastructure in data/analytics and institutional cultural preparedness to ensure the highest yield from a benchmarking exercise.
Finally, the author uses the Children’s Hospital of Pittsburgh of University of Pittsburgh Medical Center’s (UPMC) (CHP) experience with SPS as a case study in peer-peer benchmarking, beginning with the history of the collaborative and the CHP’s decision to participate. Furthermore, the author discusses the initial process of engagement and the effect of participation on the CHP’s quality and safety process improvement efforts, people, and institutional culture.
Introduction
Attention to quality, safety, and value in health care has undergone significant evolution over the past 25 years. Traditionally, patients, payers, and hospitals have approached the relationship from a relatively siloed perspective. More recently, efforts have been made to reframe the conversation toward a patient-centric, complex adaptive system. The adoption of the Affordable Care Act has served to accelerate this trend, including focus on patient safety, hospital-acquired conditions (HACs), and outcomes. These efforts have caused institutions to reevaluate what, when, and how they use metrics and analytics in order to improve health care delivery. Increasingly, leaders in health care are becoming fluent in quality management science, often referencing other industries for inspiration/guidance in the health care space. Many recognize the Donabedian framework of structure, process, and outcome, in conjunction with various process improvement tools (plan, do, study, act [PDSA], Lean) to drive organizational change efforts.
Externally, institutions face an evolving competitive landscape, with an increased appetite from patients, families, and insurers demanding data transparency on institutional performance. Health systems, payers, and patients find themselves increasingly aligned toward a goal of high-value (defined as outcomes/cost) health care. In addition to competitive market forces, payment incentives by the Centers for Medicare and Medicaid Services in the area of electronic health records (EHRs) and evolving regulatory standards from The Joint Commission (TJC) have provided a strong impetus for health systems to accelerate learning cultures and best-practice adoption.
This article begins with a brief review of the history of measurement, standards, and benchmarking, with a particular focus on pediatric-specific work led by the Agency on Healthcare Research and Quality (AHRQ). The author then discusses the success of the Ohio Collaborative (now known as Solutions for Patient Safety [SPS]), with remarks on critical success factors, including infrastructure in data/analytics and institutional cultural preparedness to ensure the highest yield from a benchmarking exercise.
Finally, the author uses the Children’s Hospital of Pittsburgh of University of Pittsburgh Medical Center’s (UPMC) (CHP) experience with SPS as a case study in peer-peer benchmarking, beginning with the history of the collaborative and the CHP’s decision to participate. Furthermore, the author discusses the initial process of engagement and the effect of participation on the CHP’s quality and safety process improvement efforts, people, and institutional culture.
History of measurement, standards, and benchmarking in pediatrics
For more than 20 years, the AHRQ of the US Department of Health and Human Services has been leading the charge for health care quality improvement and patient safety efforts. Beginning in the late 1990s, AHRQ-funded projects began to specifically focus on pediatric patients and processes related to patient safety. Length of stay, hospital mortality, and increased hospital expenditures were the variables examined relative to their association to patient safety events.
In following suit to their adult counterparts, the development of quality indicators raises unique challenges in pediatric institutions. The AHRQ recognizes such considerations:
These challenges include the need to carefully define indicators using administrative data, establish validity and reliability, detect bias and design appropriate risk adjustment, and overcome challenges of implementation and use. However, the special population of children invokes additional, special challenges. Four factors—differential epidemiology of child healthcare relative to adult healthcare, dependency, demographics, and development—can pervade all aspects of children’s healthcare; simply applying adult indicators to younger age ranges is insufficient.
Background on Pediatric Quality Indicators is provided in Box 1 .
Pediatric Quality Indicators
- •
Are used to help identify health care quality and safety problem areas in the hospital that need further investigation as well as for comparative public reporting, trending, and pay-for-performance initiatives
- •
Can provide a check on children’s primary care access or outpatient services in a community by using patient data found in a typical hospital discharge abstract
- •
Apply to special characteristics of the pediatric population
- •
Include risk adjustment where appropriate
- •
Include hospital-level indicators to detect potential safety problems that occur during a patients hospital stay
- •
Include area-level indicators, which are conditions that may be prevented with good outpatient care
- •
Are publicly available without cost
- •
Can be downloaded at www.qualityindicators.ahrq.gov/pdi_download.htm
The Pediatric Quality Indicators are part of a set of software modules of the AHRQ’s Quality Indicators developed by Battelle Memorial Institute, Stanford University, and the University of California, Davis under a contract with the AHRQ. The Pediatric Quality Indicators were released in 2006.
From the AHRQ, In conjunction with the AHRQ, the Child Health Corporatio of America (CHCA), the National Perinatal Information Center, and TJC serve to identify, define, and validate Pediatric Quality Indicators derived from hospital administrative data. The current Pediatric Quality Indicators are noted in Box 2 .
The Pediatric Quality Indicators provide a perspective on potential complications and errors resulting from a hospital admission among children, adolescents, and, where specified, neonates.
Hospital-level indicators
- •
Accidental puncture or laceration
- •
Pressure ulcer
- •
Foreign body left in during procedure
- •
Central venous catheter–related bloodstream infections
- •
Iatrogenic pneumothorax in neonates
- •
Iatrogenic pneumothorax
- •
Neonatal mortality
- •
Bloodstream infections in neonates
- •
Pediatric heart surgery mortality
- •
Pediatric heart surgery volume
- •
Postoperative hemorrhage or hematoma
- •
Postoperative respiratory failure
- •
Postoperative sepsis
- •
Postoperative wound dehiscence
- •
Transfusion reactions
Area-level indicators (eg, county, state)
- •
Asthma admissions
- •
Diabetes short-term complications
- •
Gastroenteritis admissions
- •
Perforated appendix admissions
- •
Urinary tract infection admissions
The AHRQ’s work on pediatric-specific quality indicators (PQIs) served to provide a platform for institutions to benchmark against a valid, national standard. Beginning in 2012, the AHRQ began to provide benchmark data tables, enabling easier comparisons of nationwide comparative rates for the PQIs; data presented include observed rate and both numerator and denominator data for each indicator overall and stratified by sex, age group, and insurance status. An example of the overview benchmark data table for March 2015 is provided in Table 1 , with greater detail in provider-level data table for neonatal iatrogenic pneumothorax in Table 2 .
| Indicator | Label | Numerator | Denominator | Observed Rate per 1000 (=Observed Rate × 1000) |
|---|---|---|---|---|
| Provider-Level Indicators | ||||
| NQI #1 | Neonatal iatrogenic pneumothorax rate | 33 | 186,270 | 0.18 |
| NQI #2 | Neonatal mortality rate | 6851 | 3,041,508 | 2.25 |
| NQI #3 | Neonatal blood stream infection rate | 1596 | 63,379 | 25.18 |
| PDI #1 | Accidental puncture or laceration rate | 1067 | 2,297,161 | 0.46 |
| PDI #2 | Pressure ulcer rate | 62 | 226,690 | 0.27 |
| PDI #3 | Retained surgical item or unretrieved device fragment count | 29 | — | — |
| PDI #5 | Iatrogenic pneumothorax rate | 234 | 2,071,756 | 0.11 |
| PDI #6 | RACHS-1 pediatric heart surgery mortality rate | 447 | 14,168 | 31.55 |
| PDI #7 | RACHS-1 pediatric heart surgery volume | 16,857 | — | — |
| PDI #8 | Perioperative hemorrhage or hematoma rate | 408 | 78,531 | 5.2 |
| PDI #9 | Postoperative respiratory failure rate | 877 | 60,392 | 14.52 |
| PDI #10 | Postoperative sepsis rate | 938 | 65,478 | 14.33 |
| PDI #11 | Postoperative wound dehiscence rate | 48 | 42,923 | 1.12 |
| PDI #12 | Central venous catheter–related blood stream infection rate | 1387 | 1,813,113 | 0.76 |
| PDI #13 | Transfusion reaction count | — | — | — |
| PSI #17 | Birth trauma rate: injury to neonate | 5636 | 2,974,363 | 1.89 |
Stay updated, free articles. Join our Telegram channel
Full access? Get Clinical Tree