Quality indicator development and implementation in maternity units




Measuring the quality of inpatient obstetrical care has generated considerable interest in recent years. Numerous quality measures have been proposed by national and international programmes and by obstetrics societies; however, no agreement has been reached on which measures should be used. Differences in opinions across healthcare professionals complicate the development of a standardised set of quality indicators. The use of structured methods, particularly consensus methods such as Delphi techniques, can help to choose indicators according to quality goals. Once relevant indicators are identified, maternity units should consider using a dashboard to plan and improve their services.


Statistical process control is a statistical method designed to monitor and control processes. This method seems particularly promising for monitoring quality indicators in maternity units. Among statistical process control techniques, cumulative sum charts that monitor pre-selected quality indicators can be easily designed for obstetrics and gynaecology units. Cumulative sum charts provide clinicians with a picture of current practices, and rapidly detect unwanted changes in quality indicator rates.


Introduction


In recent years, measuring the quality of inpatient obstetrical care has attracted considerable attention, for various reasons. First, obstetrics and gynaecology involves multiple activities, including surgical procedures (e.g. caesarean section and fibroid removal), medical gynaecological care (e.g. contraception and management of the menopause), diagnostic procedures (e.g. ultrasonography), and obstetrical care (e.g. prenatal care and delivery). Second, each obstetrical admission may affect the health of not one, but two individuals. In addition, most women admitted for obstetrical reasons are healthy individuals, in whom the goal is full preservation of health, in particular through careful attention to adverse events caused by management errors. Third, obstetrics is one of the medical specialties most heavily affected by patient complaints. In 2008 in France, 66% of obstetrical malpractice lawsuits led to convictions. The same year, for each of eight serious complaints of obstetrical malpractice, the courts awarded 1–3 million Euros in damages. In the US, 89% of American College of Obstetricians and Gynecologists fellows responding to the 2006 Professional Liability Survey indicated that they had been sued during their careers. The growth of medical liability litigation is increasingly leading physicians to practice defensive medicine, which increases healthcare costs. Fourth, healthcare is now widely viewed as a commodity and patients as consumers. Thus, patients expect greater safety, higher quality of care, and access to objective data, reflecting the quality of medical services.


To improve patient outcomes, and to better meet patient expectations, healthcare authorities and professionals now use a wide range of quality-improvement tools and methods. Over the past decade, the development and implementation of quality indicators (also known as performance indicators or quality measures) has been largely driven by the introduction of computerised administrative and clinical databases, as well as by new policies requiring the publication of performance data. Many government agencies and professional bodies have developed quality indicators for various fields, with the goal of identifying aspects of clinical care that require improvement.




Healthcare quality indicators


The Institute of Medicine defines healthcare quality as ‘the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and care consistent with current professional knowledge’. Improving quality and safety of healthcare has generated considerable interest in recent years.


Quality can be improved without measurements, by implementing clinical guidelines. Moreover, quality can be assessed without using quantitative measures, such as rates of quality indicators, through peer review or patient interviews, for example. Measurement, however, plays an important part in improving quality of care and promoting beneficial changes. Therefore, over the past decade, much effort has gone into developing and using quality indicators.


One of the most widely accepted definitions of indicators is that of Marshall et al. They described indicators as ‘measurable elements of practice for which there is evidence or consensus that they reflect quality and hence help change the quality of care provided. Indicators are often based on routinely collected data, data from electronic medical records, and sometimes data from surveys’. Healthcare quality indicators are viewed as tools for decision-making and quality improvement. The effect of introducing indicator monitoring in healthcare facilities on the quality of health care has been assessed in several studies. Many government agencies and professional bodies have developed quality indicators for various fields, with the goal of improving healthcare quality by detecting suboptimal care based on the traditional Donabedian model, which assesses structures, processes, and outcomes ( Fig. 1 ). The Donabedian model is the most widely used, although other models for describing the process of quality assessment exist. In obstetrical care, it is relatively easy to apply, as its components can be readily defined.




Fig. 1


The Donabedian model of patient safety management. Source from “The Donabedian Model of Patient Safety: Medical Teamwork and Patient Safety: The Evidence-based Relation. July 2005. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/research/findings/final-reports/medteam/figure2.html ”.


Outcome indicators provide information on whether the goal of care was achieved. They include mortality, morbidity, health status, and patient satisfaction. Process indicators describe medical activities such as diagnosis, treatment, referral, and prescribing Finally, structural indicators reflect the organisation of care, particularly those relating to staffing, funding, and appointment availability. Structural indicators received limited attention, as healthcare facilities must therefore meet the structural requirements of accreditation bodies (e.g. the Haute Autorité de Santé in France, the Joint Commission on Accreditation of Healthcare Organizations in the USA, and the National Health Service in the UK).




Healthcare quality indicators


The Institute of Medicine defines healthcare quality as ‘the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and care consistent with current professional knowledge’. Improving quality and safety of healthcare has generated considerable interest in recent years.


Quality can be improved without measurements, by implementing clinical guidelines. Moreover, quality can be assessed without using quantitative measures, such as rates of quality indicators, through peer review or patient interviews, for example. Measurement, however, plays an important part in improving quality of care and promoting beneficial changes. Therefore, over the past decade, much effort has gone into developing and using quality indicators.


One of the most widely accepted definitions of indicators is that of Marshall et al. They described indicators as ‘measurable elements of practice for which there is evidence or consensus that they reflect quality and hence help change the quality of care provided. Indicators are often based on routinely collected data, data from electronic medical records, and sometimes data from surveys’. Healthcare quality indicators are viewed as tools for decision-making and quality improvement. The effect of introducing indicator monitoring in healthcare facilities on the quality of health care has been assessed in several studies. Many government agencies and professional bodies have developed quality indicators for various fields, with the goal of improving healthcare quality by detecting suboptimal care based on the traditional Donabedian model, which assesses structures, processes, and outcomes ( Fig. 1 ). The Donabedian model is the most widely used, although other models for describing the process of quality assessment exist. In obstetrical care, it is relatively easy to apply, as its components can be readily defined.




Fig. 1


The Donabedian model of patient safety management. Source from “The Donabedian Model of Patient Safety: Medical Teamwork and Patient Safety: The Evidence-based Relation. July 2005. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/research/findings/final-reports/medteam/figure2.html ”.


Outcome indicators provide information on whether the goal of care was achieved. They include mortality, morbidity, health status, and patient satisfaction. Process indicators describe medical activities such as diagnosis, treatment, referral, and prescribing Finally, structural indicators reflect the organisation of care, particularly those relating to staffing, funding, and appointment availability. Structural indicators received limited attention, as healthcare facilities must therefore meet the structural requirements of accreditation bodies (e.g. the Haute Autorité de Santé in France, the Joint Commission on Accreditation of Healthcare Organizations in the USA, and the National Health Service in the UK).




Quality indicators in obstetrics


In recent years, numerous quality measures have been proposed for obstetrical care. Some of them are listed in Table 1 . For example, in the ORYX project (National Hospital Quality Measures) of the Joint Commission on Accreditation of Healthcare Organizations, a technical advisory panel of perinatal care field selected a set of five indicators, known as the Perinatal Care measures, which includes the caesarean section rate and the use of antenatal steroids. The European Performance Assessment Tool for quality improvement in Hospitals includes the caesarean section rate among indicators used to measure performance in acute-care facilities.



Table 1

Examples of obstetrical quality indicators.
































































































































Institution or project Quality indicators
ORYX Project a Perinatal Care Core Measure Set
Elective delivery
Caesarean section
Antenatal steroids
Healthcare-associated bloodstream infections in neonates
Exclusive breast-milk feeding
EURO-PERISTAT Ten core quality indicators
Neonatal health
C1-Faetal mortality rate by gestational age, birth weight, plurality
C2-Neonatal mortality rate by gestational age, birth weight, plurality
C3-Infant mortality rate by gestational age, birth weight, plurality
C4-Birth weight distribution by vital status, gestational age, plurality
C5-Gestational age distribution by vital status, plurality
Maternal health
C6-Maternal mortality ratio by age, mode of delivery
Population characteristics or risk factors
C7-Multiple birth rate by number of foetuses
C8-Distribution of maternal age
Healthcare services
C9-Distribution of parity
C10-Distribution of births by mode of delivery by parity, plurality, fetal presentation, previous caesarean section
Nordic Obstetric and Gynaecological Association Perinatal mortality
Preterm birth (less than 34 weeks)
APGAR score less than 7
Small for gestational age
Large for gestational age
Induction of labour
Percentage of vaginal deliveries for breech presentation
Caesarean sections (all, planned, other) per 100 deliveries
Forceps or suction cup per 100 deliveries
Episiotomies per 100 vaginal deliveries
Sphincter tears (III + IV) per 100 vaginal deliveries
Epidural analgesia per 100 vaginal deliveries
From The Royal Australian and New Zealand College of Obstetricians and Gynaecologists, and the Australian Council on Healthcare Standards Indicator 1 : outcome of selected primipara
(1.1) spontaneous vaginal birth; (1.2) induction of labour; (1.3) operative vaginal birth (1.4); caesarean section
Indicator 2 : vaginal birth after caesarean section
Indicator 3 : Major perineal tears and surgical repair of the perineum in primipara
(3.1) intact perineum or unsutured perineal tear; (3.2) episiotomy and no perineal tear; (3.3) perineal tear and no episiotomy; (3.4) episiotomy and perineal tear; (3.5) third-degree tear (3.6); fourth-degree tear
Indicator 4 : General anaesthesia for caesarean section
Indicator 5 : Antibiotic prophylaxis at the time of caesarean section
Indicator 6 : Pharmacological thromboprophylaxis and caesarean section
Indicator 7 : Postpartum haemorrhage or blood transfusion
(7.1) women requiring blood transfusion after vaginal delivery; (7.2) women requiring blood transfusion after caesarean section
Indicator 8 : Intra-uterine growth restriction (birth weight less than 2750 g at 40 weeks or more
Indicator 9 : Apgar score less than 7.5 min after delivery in term babies
Indicator 10 : All admissions of a term baby to special care nursery or neonatal intensive care nursery
Indicator 11 : Peer review of serious adverse events
Mann et al. Adverse events used to develop the Adverse Outcome Index, Weighted Adverse Outcome Score, and Severity Index
Maternal death
Intrapartum or neonatal death greater than 2500 g
Uterine rupture
Maternal admission to intensive care unit
Birth trauma
Return to operating room or labour and delivery
Admission to neonatal intensive care unit if greater than 2500 g and for more than 24 h
Apgar score less than 7 at 5 min
Blood transfusion
Third- and fourth-degree perineal tear

a National Hospital Quality Measures of the Joint Commission Accreditation Healthcare Organizations.



The Health Care Quality Indicators project of the Organisation for Economic Co-operation and Development involves collecting data on obstetrical trauma (during caesarean section, operative vaginal delivery, and non-operative vaginal delivery) and on neonatal morbidity. The EURO-PERISTAT project, a European collaborative effort conducted as part of the European Commission’s Health Monitoring Programme, has developed perinatal health indicators for healthcare professionals, policy makers, researchers, and health service users who wish to monitor and evaluate perinatal health. The aim of this project, which included 13 countries, was to facilitate monitoring and comparison by harmonising indicator definitions and encouraging the collection of comparable data. A list of 10 core indicators and 20 recommended indicators was established. These indicators chiefly reflect maternal and neonatal morbidity. Of the 20 indicators, seven require further work to develop universally accepted definitions. In France, the COMPAQ-HPST project aims to develop healthcare quality indicators for widespread use in healthcare facilities, and to establish effective ways of using these indicators. The prevention and management of postpartum haemorrhage is among the topics of the COMPAQ-HPST project. Finally, professional bodies, such as the Norwegian Gynecological Society from the Nordic Federation of Societies of Obstetrics and Gynecology , the Royal Australian and New Zealand College of Obstetricians and Gynaecologists, and the Australian Council on Healthcare Standards have also listed candidate indicators for monitoring the quality of care in maternity units. Draycott et al. identified 290 maternity outcomes in 96 clinical categories published by four national organisations (Royal College of Obstetricians and Gynaecologists, American College of Obstetricians and Gynecologists, Royal Australian and New Zealand College of Obstetricians and Gynaecologists, and Society of Obstetricians and Gynaecologists of Canada).


Several studies have led to the development of new tools for quality measurement in obstetrics. For example, Mann et al. developed three obstetrical quality-improvement outcome tools: the Adverse Outcome Index, Weighted Adverse Outcome Score, and Severity Index. The Adverse Outcome Index is the per cent of deliveries with one or more of the adverse events listed in Table 1 , which include maternal death and third and fourth-degree tears. The Weighted Adverse Outcome Score is the adverse event score per delivery, computed as the sum of points assigned to deliveries with adverse outcomes divided by the total number of deliveries. The Severity Index is the sum of adverse outcome scores divided by the number of deliveries with identified adverse outcomes. Other measures have been suggested, such as the risk-adjusted primary caesarean rate. This rate is not affected by variations in patient populations across hospitals, but instead chiefly reflects variations in quality of care. All these measures, however, require validation and are, therefore, not suitable for use until further data become available.


Choosing the best indicators


Indicators that are widely used in practice include rates of maternal and neonatal mortality, preterm delivery, and low birth weight. In obstetrics, outcome indicators are generally used. Organisational factors and resource limitations are barriers to the monitoring of large numbers of indicators and, consequently, the indicators most relevant to the quality-monitoring objectives must be selected. Most pregnant women in industrialised countries are at low risk for adverse outcomes, as they are healthy and require relatively straightforward care. Continual improvements in management further decrease the risk. As a result, some outcomes are of limited value for detecting dips in the quality of obstetrical care. For example, in industrialised countries, maternal death is rare and often preventable by good healthcare, and maternal mortality therefore lacks sensitivity as a quality indicator; sentinel event analysis of maternal deaths, however, remains an essential component of local quality improvement efforts. In a UK study, severe obstetric morbidity (e.g. severe bleeding or pre-eclampsia, eclampsia, severe sepsis, and HELLP syndrome) occurred in only 1.2% of women in 19 maternity units.


Today, parents expect survival of the mother and neonate, and also maintenance of good health, optimal comfort for the mother and baby, and an overall positive experience. Quality indicators that reflect these expectations must be identified. Evaluations of obstetrical care now usually rely on the rates of events, such as caesarean section and nosocomial infection. These indicators reflect important elements of the process of care, and are widely used in national surveys and in benchmarking within and among healthcare institutions.


Continuous monitoring of obstetrical care faces several challenges. More specifically, the available data are often flawed and limited, and adverse outcomes are rare and ill suited to continuous monitoring. Consequently, developing a rational and standardised set of quality indicators for maternity units is urgently needed.


Standardised indicators for obstetrics


Differences in opinions across healthcare professionals complicate the development of a standardised set of quality indicators. Structured methods, however, can help. The information required to develop quality indicators can be obtained through systematic or non-systematic methods. Non-systematic methods, such as case studies, are based on data availability and real-time monitoring of critical incidents. Although they play a major role, they fail to exploit much of the available scientific evidence. In systematic approaches, in contrast, indicator selection relies directly on the available evidence, complemented when necessary with expert opinion. Experts examine the evidence and reach a consensus. Systematic methods enhance decision making, facilitate the development of quality indicators or review criteria for areas where the evidence alone is insufficient or controversial, and synthesise the body of expert opinion.


Delphi technique for selecting quality indicators


Among systematic methods, the Delphi technique has been widely used for quality-indicator development in healthcare. The Delphi technique is a structured process that uses a series of questionnaires or ‘rounds’ to gather information. Rounds are held until group consensus is reached. One of the main reasons for the popularity enjoyed by the Delphi technique is that a large number of individuals across diverse locations and areas of expertise can be included anonymously, thus avoiding domination of the consensus process by one or a few experts. Adler et al. defined the Delphi technique as an exercise in group communication that brings together and synthesises the knowledge of a group of geographically scattered participants who never meet.


The Delphi technique is among the methods used to develop prescribing indicators, indicators reflecting patient and general practitioner perspectives of chronic illness, performance indicators for emergency medicine, and indicators for cardiovascular disease.


Delphi technique in obstetrics


Boulkedid et al. used a modified Delphi technique to select 18 quality indicators designed to assess the overall quality of obstetrical care and to be monitored routinely in maternity units. The list resulted from a consensus among 35 multidisciplinary experts who varied widely in terms of years of experience and clinical practice. The selected indicators were relevant to various populations (i.e. all pregnant women, low-risk pregnant women, and all neonates). The indicators selected for assessing the management of all pregnant women are currently the most widely accepted indicators. An example is the caesarean section rate, which is clearly defined, easily collectible, and relevant to efforts aimed at decreasing maternal morbidity and healthcare costs. Other indicators reflecting severe morbidity related to pregnancy and labour were selected, such as uterine rupture, maternal intensive care unit transfer, admission, or both, and third and fourth-degree perineal tear. Process indicators were also selected, including epidural analgesia (for pain management), vaginal sampling in the ninth month to screen for streptococcus group B carriage (international recommendation to decrease sepsis), and a decision to breast feed at discharge. Two indicators are related to Down’s syndrome screening, namely, nuchal translucency on the sonogram and serum marker assays, both assessed during the first trimester. Three indicators assess neonatal outcomes. For example, birth 37 weeks or more with Apgar less than 7 at 5 min or neonatal intensive care unit admission of non-low-birth-weight neonates. The final set of 18 indicators is being used as a starting point for developing a quality improvement programme in French maternity units. The feasibility of these indicators, however, needs to be assessed by studies conducted under the conditions of everyday practice. Another Delphi survey led to the selection of 12 clinical quality indicators that provide a comprehensive coverage of labour and delivery outcomes, including induction of labour, intensive care unit admission of obstetrical patients, and caesarean section.


The first step towards measuring quality of care in obstetrical units is the selection of quality indicators. The above-mentioned studies demonstrate the usefulness of consensus methods for this step. The next step is identification of the best tools for judiciously implementing these indicators with the goal of continuously improving quality of care in maternity units.

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

Nov 8, 2017 | Posted by in OBSTETRICS | Comments Off on Quality indicator development and implementation in maternity units

Full access? Get Clinical Tree

Get Clinical Tree app for offline access