Variation in outcome reporting in endometriosis trials: a systematic review




Materials and Methods


Sources


A protocol with explicitly defined objectives, criteria for study selection, and approaches assessing outcome selection was developed. The systematic review was registered with the Core Outcome Measures in Effectiveness Trials Initiative Register and conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.


A comprehensive and systematic literature review was undertaken searching the Cochrane Central Register of Controlled Trials (CENTRAL), Embase, and Medline from database inception to November 2014 (see Appendix ). We searched the Cochrane Register of Systematic reviews to identify relevant Cochrane systematic reviews searching the bibliography for eligible trials.


Study selection


Two reviewers (M.H. and J.M.D.) independently screened titles and abstracts. They critically reviewed the full text of selected studies to assess eligibility. Any discrepancies between the reviewers were resolved by discussion with a third author (K.S.K.). We included randomized control trials assessing the effectiveness of any surgical intervention with or without an adjuvant medical therapy for the treatment of pain and subfertility associated with endometriosis. We excluded quasirandomized, nonrandomized, analytical, and diagnostic studies.


Two reviewers (M.H. and J.D.) extracted the data independently using a piloted data extraction sheet. The study characteristics were extracted from the trial report including the publishing journal, study design, setting, participants, interventions, sample size calculation, and the pharmaceutical funding. The impact factor in the year of publication was identified by reviewing data provided by Researchgate. We systematically reviewed primary and secondary outcomes and their definitions and instruments. The study characteristics and outcomes were summarized in tabular form and presented with descriptive statistics within summary tables and diagrams ( Table 1 ).



Table 1

Outcome reporting in endometriosis trials: study characteristics




























































































































































































































































































































































































































































Study IF Method quality Outcome quality Intervention group 1 Intervention group 2 Intervention group 3
Abbott et al, 2004 3.17 5 4 Diagnostic laparoscopy
plus delayed surgical treatment
Surgical treatment
plus repeat surgery
Abu Hashim et al, 2012 1.85 5 6 Surgical treatment
plus superovulation with letrozole
plus intrauterine insemination
Surgical treatment
plus superovulation with clomiphene citrate
plus intrauterine insemination
Acién et al, 2002 3.202 2 2 Surgical treatment
plus interferon α-2b
Surgical treatment
plus saline
Alborzi et al, 2004 3.17 2 5 Surgical treatment
plus ovarian fenestration and coagulation
Surgical treatment
plus ovarian cystectomy
Alborzi et al, 2007 3.168 2 2 Surgical treatment
plus ovarian fenestration and coagulation
Surgical treatment
plus ovarian cystectomy
Surgical treatment
plus ovarian fenestration and cystectomy
Alborzi et al, 2011 1.072 2 2 Surgical treatment
plus GnRHa
Surgical treatment
plus aromatase inhibitor
Surgical treatment
Alkatout et al, 2013 1.575 2 2 Surgical treatment HT Surgical treatment
plus hormone therapy
Audebert et al, 1998 0.745 2 2 Surgery treatment
plus GnRHa
GnRHa
plus surgical treatment
Ballester et al, 2011 3.468 2 4 Laparoscopy
plus colorectal resection
Laparotomy
plus colorectal resection
Beretta et al, 1998 3.344 2 2 Surgical treatment
plus ovarian cystectomy
Surgical treatment
plus ovarian fenestration and coagulation
Bianchi et al, 1999 3.643 3 2 Surgical treatment
plus danocrine
Surgical treatment
Busacca et al, 2001 2.751 3 2 Surgical treatment
plus GnRH agonist
Surgical treatment
Candiani et al, 1992 1.982 3 3 Surgical treatment
plus presacral neurectomy
Surgical treatment
Cobellis et al, 2011 1.974 5 3 Surgery treatment
plus fatty acid amide
Surgical treatment
plus selective COX2 NSAID
Surgical treatment
Cosson et al, 2002 3.202 3 4 Surgical treatment
plus progestin
Surgical treatment
plus GnRHa
Costello et al, 2010 3.122 5 6 Surgical treatment
plus multimodal intraoperative analgesia
Surgical treatment
plus placebo
Creus et al, 2008 2.537 5 0 Surgical treatment
plus xanthine derivative
Surgical treatment
plus placebo
Darai et al, 2010 7.474 3 5 Laparoscopy
plus colorectal resection
Laparotomy
plus colorectal resection
Darai et al, 2011 3.564 3 2 Laparoscopy
plus colorectal resection
Laparotomy
plus colorectal resection
diZerega et al, 2007 3.168 5 3 Surgical treatment
plus adhesion barrier gel
Surgical treatment
Healey et al, 2010 3.122 5 3 Surgical treatment
plus ablation
Surgical treatment
plus excision
Hoo et al, 2014 3.483 5 6 Surgical treatment
plus ovarian suspension
Surgical treatment
Jarrell et al, 2005 5 2 Surgical treatment Diagnostic laparoscopy
plus biopsy
Kamencic et al, 2008 3 2 Surgical treatment
plus xanthine derivative
Surgical treatment
Koninckx et al, 2013 2.03 5 6 Surgical treatment
plus humidified CO 2 pneumoperitoneum
Surgical treatment
plus peritoneal full conditioning and barrier gel
Lalchandani et al, 2005 2 3 Diagnostic laparoscopy
plus GnRHa plus HT
Surgical treatment
plus helium thermal coagulator
Loverro et al, 2008 1.565 5 2 Surgical treatment
plus GnRHa
Surgical treatment
plus placebo
Mais et al, 1995 2 5 Surgical treatment
plus adhesion barrier
Surgical treatment
Marcoux et al, 1997 27.766 5 6 Surgical treatment
plus ablation
Surgical treatment
plus excision
Matorras et al, 2002 3.202 2 2 Bilateral salpingo-oophrectomy
plus HT
Bilateral salpingo-oophrectomy
Moini et al, 2012 0.471 5 4 Surgical treatment Diagnostic Laparoscopy
Morgante et al, 1999 3.643 2 3 Surgical treatment
plus GnRHa plus danocrine
Surgical treatment
plus GnRHa
Nowroozi et al, 1987 3 1 Surgical treatment
plus ablation
Diagnostic laparoscopy
Parazzini et al, 1994 2.247 5 3 Surgical treatment
plus GnRHa
Surgical treatment
Parazzini et al, 1999 3.643 3 2 Surgical treatment
plus ablation
Surgical treatment
plus excision
Diagnostic laparoscopy
Seiler et al, 1986 3 0 Surgical treatment
plus ablation
Treatment with danocrine
Soysal et al, 2004 3.072 5 4 Surgical treatment
plus GnRHa
Surgical treatment
plus GnRHa plus aromatase inhibitor
Surrey et al, 1994 2 3 GIFT
plus surgical treatment
GIFT
Sutton et al, 1994 2.464 5 3 Surgical treatment
plus presacral neurectomy
Diagnostic laparoscopy
Sutton et al, 1997 2.612 4 2 Surgical treatment
plus presacral neurectomy
Diagnostic laparoscopy
Sutton et al, 2001 0.63 5 2 Surgical treatment
plus presacral neurectomy
Surgical treatment
Tanmahasamut et al, 2012 4.798 5 5 Surgical treatment
plus Mirena IUS
Surgical treatment
Telimaa et al, 1988 4 1 Surgical treatment
plus danocrine
Surgical treatment
plus progestin
Surgical treatment
plus placebo
Tsai et al, 2004 0.778 5 2 Surgical treatment
plus GnRHa
Surgical treatment
plus danocrine
Surgical treatment
Vercellini et al, 1999 2.657 3 4 Surgical treatment
plus GnRHa
Surgical treatment
Vercellini et al, 2002 3.202 3 4 Surgical treatment
plus progestin
Surgical treatment
plus COCP
Vercellini et al, 2003 3.483 5 5 Surgical treatment
plus presacral neurectomy
Surgical treatment
Vercellini et al, 2003 3.483 3 3 Surgical treatment
plus Mirena IUS
Surgical treatment
Wickström et al, 2012 4.542 5 3 Tubal pertubation
plus lidocaine
Tubal pertubation
plus placebo
Wright et al, 2005 3.114 4 2 Surgical treatment
plus ablation
Surgical treatment
plus excision
Zhao et al, 2013 1.401 1 2 Surgical treatment
plus Chinese medicine
Surgical treatment
plus GnRHa plus HT
Surgical treatment
plus progestin
Zhao et al, 2013 1.401 3 6 Surgical treatment
plus Chinese medicine
Surgical treatment
plus GnRHa plus HT
Surgical treatment
plus progestin
Zhu et al, 2014 1.877 3 2 Surgical treatment
plus COCP
Surgical treatment
plus COCP plus Chinese medicine
Surgical treatment
Zullo et al, 2003 2.518 5 4 Surgical treatment
plus presacral neurectomy
Surgical treatment

COCP , combined oral contraceptive pill; COX , cyclooxygenase; GIFT , gamete intrafallopian tube transfer; GnRHa , gonadotropin-releasing hormone agonist; HT , hormone therapy; IF , impact factor; IUI , intrauterine insemination; NSAID , nonsteroidal antiinflammatory drug.

Hirsch. Outcome reporting in endometriosis trials. Am J Obstet Gynecol 2016 .


Quality assessment


Two reviewers (M.H. and J.D.) independently assessed each study’s methodological quality using the JADAD criteria. The 5 point validated scoring system assesses the following: (1) was the trial described as randomized (1 point); (2) did the trial use an appropriate method of randomization (1 point); (3) was the trial blinded (1 point); (4) did the trial use an appropriate method of blinding? (1 point); and (5) did the trial account for all patients randomized (1 point)?


Two reviewers (M.H. and J.D.) independently assessed each study’s outcome reporting using the 6 point Management of Otitis Media with Effusion in Cleft Palate scoring system validated for the development of a core outcome set : (1) was a primary outcome stated (1 point); (2) was the primary outcome clearly defined for reproducible measures (1 point); (3) were the secondary outcomes clearly stated (1 point); (4) were the secondary outcomes clearly defined for reproducible measures (1 point); (5) do the authors explain the choice of outcome (1 point); and (6) are the methods used designed to enhance quality of measures appropriate (1 point)? There is no defined rating score; therefore, a previously used cutoff value of ≥ 4 was used to represent high-quality trials.


Analysis


Univariate association between continuous factors was assessed by nonparametric correlation coefficient (Spearman rho). The comparison of outcome reporting quality was assessed between groups according to type of journal (general vs specialist), funding source (commercial or other), year of publication, and impact factor in the year of publication. Journals specific to obstetrics and gynecology as listed by www.scimagojr.com were classified as specialist. Funding status was identified in the article text including commercial funding or the donation of equipment, which had facilitated the trial. These univariate analyses were performed using nonparametric Mann Whitney U tests.


To assess the multivariate relationship with quality of outcome reporting, we used a multivariate linear regression model including journal type, impact factor in the year of publication, year of publication, and methodological quality as independent variables and outcome reporting as the dependent variable. Only significant predictors were retained in the final model. We globally checked linear regression assumptions by exploring residuals vs predicted plot. All the analyses were performed using Stata program (StataCorp, 2013, Stata Statistical Software, release 13; StataCorp LP, College Station, TX).




Results


The search strategy identified 1570 titles and abstracts. We screened 1409 titles and abstracts following the exclusion of 161 duplicate records ( Figure 1 ). We included 54 RCTs ( Table 1 ). The included trials collected and reported 164 outcomes and 113 outcome measures ( Table 2 ). Unfortunately, the outcome measurement or definition was not described within the trial report for 110 outcomes.




Figure 1


Outcome reporting in endometriosis trials: flow of included studies

CENTRAL , Cochrane Central Register of Controlled Trials; RCT , randomized controlled trial.

Hirsch. Outcome reporting in endometriosis trials. Am J Obstet Gynecol 2016 .


Table 2

Outcome reporting in endometriosis trials: outcome and outcome measures reported


































Domain RCTs Outcomes Outcome measure
Pain 37 32 24
Subfertility 32 28 11
Quality of life 9 10 10
Surgical adverse events 14 34 5
Medical adverse events 8 22 0

RCT , randomized controlled trial.

Hirsch. Outcome reporting in endometriosis trials. Am J Obstet Gynecol 2016 .


The most common outcome domains were pain (29 of 54 trials [53%]), subfertility (22 of 54 trials [41%]), and quality of life (9 of 54 trials [17%]). When considering the pain domain, commonly reported pain outcomes were dysmenorrhea (23 RCTs, 10 outcome measures), dyspareunia (21 RCTs, 11 outcome measures), and pelvic pain (15 RCTs, 9 outcome measures). Three trials did not specify the outcome measure used to assess pain ( Tables 2–4 ).



Table 3

Outcome reporting in endometriosis trials: reported pain and fertility outcomes
































































































































































































Outcome domain Outcome Trials, n
Fertility outcomes Pregnancy 26
Miscarriage 7
Live birth 5
Estradiol 5
Ectopic pregnancy 4
Endometrial thickness 2
Number of follicles > 18 mm 3
Ampules of gonadotropin 1
Days of stimulation 1
Early fetal loss 1
Embryos per cycle 1
Follicular-stimulating hormone 1
Luteinizing hormone 1
Number of oocytes per cycle 1
Pregnancy interval 1
Pregnancy subsequent cycle 1
Reproductive outcome 1
Singleton delivery 1
Stillbirth 1
Term delivery 2
Twin delivery 1
Twin pregnancy 1
Vaginal delivery 1
Pain outcomes Dysmenorrhea 23
Dyspareunia 21
Pelvic pain 15
Nonmenstrual pelvic pain 6
Dyschezia 6
Overall pain 5
Postoperative pain 3
Abdominal pain 2
Back pain 2
Aggregate pain 1
Analgesia use 3
Analgesic requirement 2
Chest discomfort 1
General discomfort 1
General pain 1
Global intensity of pain 1
Lateral menstrual pain 1
Painless first stage of labor 1
Postoperative opioid analgesia 1
Rectal pain 1
Shoulder pain 1
Thigh pain 1
Voiding pain 1

Hirsch. Outcome reporting in endometriosis trials. Am J Obstet Gynecol 2016 .


Table 4

Outcome reporting in endometriosis trials: outcome measures for commonly reported outcomes

























































































Outcome Outcome measure n
Dysmenorrhea Visual analog scale (0–10) 8
Visual analog scale (0–100) 7
Visual analog scale (0–10 with description) 3
Visual analog scale (no description) 1
Ranked ordinal scale (1–5) 1
Likert scale (0–10) 3
Questionnaire (with description) 2
Questionnaire (ranked symptoms) 1
Questionnaire (no description) 1
Number of episodes 1
Not specified 2
Pregnancy Serum βHCG 4
Ultrasound (visualizing fetal heart) 4
Ultrasound (growth scan) 2
Not specified 20
Quality of life World Health Organization Quality of Life-BREF 1
EuroQol-5D 1
Short-Form Health Survey 12 1
Short-Form Health Survey 36 6
Hospital Anxiety and Depression Scale 2
Greene Climateric Scale 1
Blatt Kupperman Menopausal Index 1
Sabbatsberg Sexual Rating Scale 1
Revised Sabbatsberg Sexual Rating Scale 2
Sexual Activity Questionnaire 1

The n indicates the number of the randomized trials reporting on an individual outcome measure.

Hirsch. Outcome reporting in endometriosis trials. Am J Obstet Gynecol 2016 .


Dysmenorrhea was measured by 10 different outcome measures: a visual analog scale anchored between 0 and 10; a visual analog scale anchored between 0 and 100; a visual analog scale anchored between 0 (no pain) and 10 (severe pain); a visual analog scale with no specified parameters; a questionnaire including 3 domains of activities of daily living, coexistence of systemic symptoms, and analgesic requirement; a questionnaire with ranked symptoms; a questionnaire with no further description available; a ranked ordinal scale (1–5); number of episodes; and not specified.


The 3 most commonly reported fertility outcomes were pregnancy (26 RCTs, 5 outcome measures), miscarriage (7 RCTs, 2 outcome measures), and live birth (5 RCTs, 2 outcome measures). Pregnancy was measured with the following outcome measures: ultrasound scan visualizing fetal heart; ultrasound growth scan; serum beta HCG; pregnancy greater than 20 weeks’ gestation; not specified ( Tables 3 and 4 and Figure 2 ).


May 4, 2017 | Posted by in GYNECOLOGY | Comments Off on Variation in outcome reporting in endometriosis trials: a systematic review

Full access? Get Clinical Tree

Get Clinical Tree app for offline access