Effectiveness of blinding: sham suprapubic incisions in a randomized trial of retropubic midurethral sling in women undergoing vaginal prolapse surgery




Objective


This planned secondary analysis of the Outcomes Following Vaginal Prolapse Repairs and Midurethral Sling trial assessed whether treatment knowledge differed between randomized groups at 12 months and whether treatment success was affected by treatment perception.


Study Design


Sham suprapubic tension-free vaginal tape (TVT) incisions were made in the Outcomes Following Vaginal Prolapse Repairs and Midurethral Sling trial participants randomized to no-TVT. Primary surgical outcomes and maintenance of blinding was assessed at 12 months. Knowledge of treatment assignment was compared between groups, and the relationship with treatment success rates was assessed.


Results


Prior to the 12 month postoperative visit, only 4% of treated participants (13 of 336) formally reported unmasking. At 12 months, 94% of the randomized participants (315 of 336) provided treatment knowledge data. Sixteen TVT participants (10%) reported treatment knowledge; most (n = 15, 94%) were correct; 17 of the sham participants (11%) reported treatment knowledge; half (n = 8, 47%) were correct. Similar proportions of unmasked participants who reported no treatment knowledge correctly guessed/perceived treatment assignment (sham, 46 [33%] vs TVT, 44 [33%]). We did not detect significant differences in treatment success rates based on perception within and across received treatment groups (perceived sham vs TVT overall [ P = .76]). Of those receiving TVT, more participants perceiving TVT had treatment success compared with those who perceived sham (84% vs 74%; P = .29). Among sham participants, more participants perceiving sham had success compared with those who perceived receiving TVT (65% vs 56%; P = .42).


Conclusion


Sham surgical incisions effectively mask TVT randomization. These findings may help to inform future surgical trial designs.


Two critical principles for the proper conduct of a masked randomized trial include successful randomization and maintenance of the randomization assignment masking, also called blinding. Placebo controls have been introduced into clinical study design to enhance these basic tenets of scientifically sound human subject research and to minimize participant and evaluator knowledge of treatment.


Placebo controls have traditionally been useful in situations in which there is a potential for a significant placebo effect, as in the case of studies utilizing outcomes based on subjective measures and those involving patient perception. Surgical sham incisions are designed to allow the conduct of a study so that treatment arms are indistinguishable to both participant and evaluator and should be low risk.


Although many placebo-controlled trials in the study of pelvic floor disorders have focused on pharmacological or behavioral therapy, there are fewer placebo-controlled trials in the surgical literature. For example, Jarrell et al compared sham surgery (with sham skin incisions) with the excision of endometriosis in a randomized controlled trial assessing pain. They reported that active surgery (excision) was not associated with improvement in pain over sham incision, as measured by time to repeat surgery.


The Outcomes Following Vaginal Prolapse Repairs and Midurethral Sling (OPUS) trial provided an ideal environment to study the efficacy of sham incisions. The OPUS study evaluated the role of prophylactic tension-free vaginal tape (commonly known as TVT) to reduce the risk of de novo stress urinary incontinence. In the OPUS study, women undergoing vaginal prolapse repair were randomized to TVT vs no TVT with sham suprapubic incisions to mask the TVT assignment. We hypothesized that if sham incisions were effective and masking was maintained throughout the course of a trial, then the participants’ perception of treatment would not differ between study groups.


The objective of this planned secondary analysis of the OPUS trial was to determine whether the participant’s knowledge of treatment arm differed between randomized groups at 12 months and to assess whether treatment success was affected by the perception of receiving active treatment (TVT).


Materials and Methods


This is a planned secondary analysis of the OPUS trial. The design and primary outcome of this trial have been reported. Briefly, treatment success was defined at 3 months by the absence of a positive cough stress test and/or bothersome urinary incontinence or a need for urinary incontinence treatment.


All participating sites of the Pelvic Floor Disorders Network had institutional review board approval, and written informed consent was obtained on all patients. Briefly, participants were women considering apical and/or anterior vaginal wall vaginal prolapse repair for stage 2 or greater prolapse without subjective complaints of stress urinary incontinence.


At the time of their vaginal prolapse repair, they were randomized to a concomitant TVT or sham incisions. At the time of the vaginal prolapse surgery in the randomized participants, participants randomized to the control group underwent partial thickness suprapubic skin incisions with the use of a scalpel, located and sized to be identical to the 2 cm suprapubic TVT trocar exit incisions performed in women randomized to and receiving the TVT. The study protocol required all incisions, sham and real, to be covered by skin tape for 1 week unless there was a clinical reason for removal (ie, suspicion of a postoperative incision-related bleeding or infection).


This research effort also included a patient preference cohort, which was a systematic sample of women declining participation in the randomized trial but otherwise eligible for the study who agreed to participate in the patient preference cohort. Patient preference cohort participants were not randomized; instead, they decided whether they wanted to receive a TVT at the time of their vaginal prolapse surgery, and those not receiving a TVT did not have sham incisions placed.


Treatment knowledge (whether a participant believed they knew their group assignment: TVT vs no TVT) was assessed. When unmasking occurred at any point after study surgery and prior to the 12 month primary outcome surgical assessment, participants or evaluators completed a report detailing any unmasking circumstances.


At the time of the surgical outcome assessment at 12 months, treatment knowledge in both randomized and patient preference cohorts was also assessed by the participant responding to the query: “Have you found out or been told (by clinical personnel) whether you had the additional study procedure (TVT) at the time of your prolapse surgery?” (yes or no). Participants who reported yes to this question were considered unmasked. Additionally, participants were asked: “Did you have (do you think you had) the additional procedure?” (yes, no, or do not know).


We compared treatment knowledge in the randomized cohort, at 12 months. We also assessed whether treatment success was affected by the perception of receiving active treatment (TVT). In the patient preference cohort, only the assessment of treatment knowledge and treatment received were assessed. Treatment perception was compared between treatment groups, and the relationship with treatment success rates was assessed.


All analyses are presented based on treatment received. Participants who did not complete the treatment knowledge form were excluded from further analyses. Because all analyses are considered secondary, they are exploratory in nature, and the resulting P values are considered descriptive measures of relationship as opposed to formal tests of hypotheses, and therefore, no adjustments for multiple comparisons were made.


The percentage of participants reporting knowledge of treatment received and those correctly identifying treatment assignment among those reporting knowledge as well as those reporting no knowledge was compared by treatment groups using a 2-sided χ 2 test statistic. These analyses were completed for participants with primary outcome data.


We separately analyzed the randomized and patient preference cohorts. The relationship of treatment received and perception with treatment success was assessed via a logistic model, which included only randomized participants with no treatment knowledge and no unmasking event reported; the model incorporated the outcome of treatment success and explanatory variables of treatment received, treatment perceived, and their interaction.


Various comparisons of treatment success were assessed based on 2-sided Wald χ 2 tests resulting from this model including perceived sham vs sling (overall and by received treatment group), incorrectly perceiving sling vs incorrectly perceiving sham, treatment effect (by perception group), and incorrect perception of sling vs receiving sling.




Results


In this secondary analysis of 336 randomized and treated participants, 13 participants (4%) had unmasking forms completed during the 12 months after randomization, and 315 (94%) completed treatment knowledge forms at 12 months ( Figure ). In the randomized and treated cohort, only 16 in the sling (TVT) and 17 in the sham group (total = 33) reported knowing their treatment group at 12 months. The participant reported knowledge of treatment compared with the actual treatment received, excluding and then including participants who completed the unmasking form is shown in Table 1 .




Figure


Algorithm of subject status

Algorithm of study randomization, participant-reported unmasking, and treatment knowledge form completion.

Brubaker. Sham TVT incisions. Am J Obstet Gynecol 2014 .


Table 1

Participant-reported knowledge of treatment vs treatment received in the randomized cohort






























Data analysis group Participant reported knowledge Received sham (n = 173) Received sling (TVT) (n = 163) P value a
Excluding participants reporting unmasking (n = 302) Reported not knowing treatment 140 (92%) 135 (91%) .78
Reported knew treatment 13 (8%) 14 (9%)
Including participants reporting unmasking (n = 315) Reported not knowing treatment 142 (89%) 140 (90%) .90
Reported knew treatment 17 (11%) 16 (10%)

TVT , tension-free vaginal tape.

Brubaker. Sham TVT incisions. Am J Obstet Gynecol 2014 .

a P value was based on a 2-sided χ 2 test statistic of the 2 × 2 frequency table.



Approximately 90% of the participants who were not unmasked (140 of 153 [92%] in the sham and 135 of 149 [91%] in the sling groups) stated that they did not know their treatment assignment. Treatment group differences were not significant for either participants who remained masked or all participants ( P = .78 and P = .90, respectively).


Table 2 summarizes the participant-reported treatment perceptions vs treatment received. The vast majority of participants (275 of 302) without an unmasking incident reported no knowledge of their treatment group. One of these participants did not provide a response to the perception question. For the remaining participants, 121 of 274 of them (44%) reported no perception of their treatment, 77 of 274 (23%) perceived the incorrect treatment, and 76 of 274 (33%) perceived the correct treatment with no evidence that perception differed between treatment groups ( P = .00).



Table 2

Participant-perceived treatment vs treatment received in the randomized cohort




















































Data analysis group Participant-reported perception of treatment Received sham (n = 173) Received sling (TVT) (n = 163) P value a
Participants reporting no knowledge of treatment and excluding participants reporting unmasking (n = 274) Do not know 61 (44%) 60 (44%) .93
Perceived sham 46 (33%) 31 (23%)
Perceived sling 32 (23%) 44 (33%)
Participants reporting knowledge of treatment and excluding participants reporting unmasking (n = 27) Do not know 1 (8%) 0 (0%) .003
Perceived sham 5 (38%) 1 (7%)
Perceived sling 7 (54%) 13 (93%)
Participants reporting knowledge of treatment and including participants reporting unmasking (n = 33) Do not know 1 (6%) 0 (0%) .004
Perceived sham 8 (47%) 1 (6%)
Perceived sling 8 (47%) 15 (94%)

TVT , tension-free vaginal tape.

Brubaker. Sham TVT incisions. Am J Obstet Gynecol 2014 .

a P value was based on a 2-sided χ 2 test statistic of a 2 × 2 frequency table of whether participant-reported treatment correctly matched received treatment vs treatment received in which the responses of do not know were considered incorrect treatment assignment.



For participants reporting knowledge including those with a documented unmasking incidence, their perception was more likely to be correct if they perceived they received a sling (15 of 16 [94%]) than if they received a sham (8 of 17 [47%]) ( P = .004). Results were similar excluding or including participants who reported unmasking.


Table 3 summarizes treatment success rates by perceived treatment and treatment received in all randomized, treated participants who remained masked (excluding unmasked participants). There appears to be no evidence of a difference in success rates between those who perceived sham (53 of 77; 69%) versus those who perceived sling (55 of 76; 72%) ( Table 3 : C+D vs E+F, P = .76). In the sling group, those that perceived sling had the highest treatment success rate 37 of 44 (84%), but this did not significantly differ than those who perceived sham 23 of 31 (74%) ( Table 3 : D vs F, P = .29). Treatment success was no higher in the perceived sham group than in the perceived sling group.


May 10, 2017 | Posted by in GYNECOLOGY | Comments Off on Effectiveness of blinding: sham suprapubic incisions in a randomized trial of retropubic midurethral sling in women undergoing vaginal prolapse surgery

Full access? Get Clinical Tree

Get Clinical Tree app for offline access