Background
Simulation is an important adjunct to traditional surgical training, allowing for repetitive practice of new skills without compromising patient safety. Although several simulation models have been described and evaluated for gynecologic procedures, there is a lack of such models for laparoscopic myomectomy.
Objective
This study aimed to design a low-cost, low-fidelity laparoscopic myomectomy simulation model and to assess the model’s validity as a training tool.
Study Design
The model was constructed using a “cup turner” foam cylinder, felt, a 2-inch stress ball, self-adhesive bandage wrap, multipurpose sealing wrap, red marker, and hook-and-loop fastener. Participants were recruited at a quaternary care academic center and at the Society for Gynecologic Surgeons Annual Scientific Meeting. The simulation task involved the following 2 steps: fibroid enucleation and hysterotomy repair. Validity evidence was collected by comparing expert and novice simulation task performances. Video recordings were scored by 2 blinded reviewers using the Global Operative Assessment of Laparoscopic Skills scale (5–20 points) and a modified Global Operative Assessment of Laparoscopic Skills scale (5–35 points), incorporating 3 novel domains specific to laparoscopic myomectomy. The Mann–Whitney U test was used to compare the task completion times and performance scores. Interrater reliability of scoring was assessed using the interclass correlation coefficient. Validity was also assessed with a post-task survey regarding the model’s realism, utility, and educational effect.
Results
The total cost to construct each model was under $5. A 3:1 ratio was used to recruit 15 novices and 5 experts. The median time to task completion was shorter for experts than for novices (11.8 vs 20.1 minutes; P =.004). The experts scored higher than the novices on both the Global Operative Assessment of Laparoscopic Skills scale (median 19 [range 13–20] vs 10 [6–17.5]; P= .007) and the modified Global Operative Assessment of Laparoscopic Skills scale (31.5 [21.5–33.5] vs 18.5 [13.5–32]; P= .009). The interclass correlation coefficient was 0.95 for the Global Operative Assessment of Laparoscopic Skills scores and 0.96 for the modified Global Operative Assessment of Laparoscopic Skills scores. Most of the participants agreed that the model closely approximated the feel of fibroid enucleation (70% [14/20]) and suturing the uterus (80% [16/20]). All the participants agreed that the model was useful for learning or teaching laparoscopic myomectomy.
Conclusion
This study demonstrates evidence supporting the validity of a novel, low-cost laparoscopic myomectomy model and a novel assessment scale for laparoscopic myomectomy training. This simulation model provides a targeted training tool that allows learners to focus on the key aspects of laparoscopic myomectomy and may improve readiness for the operating room.
Why was this study conducted?
Low-fidelity surgical simulation models allow for repetitive practice of new skills in a risk-free environment with minimal preparation and cost. We aimed to design and assess the validity of a low-cost, low-fidelity model for laparoscopic myomectomy training.
Key findings
A novel laparoscopic myomectomy model was constructed using <$5 worth of materials. We provide evidence supporting the validity of this model as a tool for laparoscopic myomectomy training.
What does this add to what is known?
This study adds to the limited published data on laparoscopic myomectomy simulation models by describing and validating a novel low-fidelity model. In addition, we present a novel assessment tool to evaluate the unique skills required for laparoscopic myomectomy.
Introduction
There is growing concern that obstetrics and gynecology (OB/GYN) residents are underprepared to perform advanced gynecologic surgery upon graduation. The increased medical management of gynecologic conditions along with resident work hour restrictions has led to decreased surgical volume in residency. Furthermore, as the field of minimally invasive gynecologic surgery (MIGS) evolves with the advent of novel techniques and equipment, the learning curve for novice surgeons becomes steeper. In a national survey of third and fourth year OB/GYN residents, most respondents (71%) felt that their residency training adequately prepared them to perform MIGS in general, but only 50% felt prepared to perform a laparoscopic hysterectomy on a uterus of at least 12 weeks size, and only 17% felt comfortable performing a laparoscopic myomectomy.
Myomectomy is the second-most-common surgical procedure for the management of fibroids, and both myomectomy and endoscopy are required competencies for OB/GYN residency training, as delineated in the Accreditation Council for Graduate Medical Education (ACGME) milestones. Laparoscopic and robotic myomectomy often require further postresidency training, and many OB/GYN residency graduates seek additional training through fellowship to acquire these skills. The procedural skills for laparoscopic myomectomy include those related to uterine incision, enucleation of the fibroid, hysterotomy repair, and specimen extraction. Laparoscopic suturing is a complex task that has been suggested as a limiting factor in the widespread adoption of laparoscopic myomectomies.
Simulation has become an important tool to bridge gaps in surgical education, such as in laparoscopic myomectomy training. There is strong evidence that simulation-based education with deliberate practice improves surgical competency, including in the gynecologic surgery setting. Several low- and high-fidelity simulation models for gynecologic procedures have been developed and evaluated, particularly for tasks related to laparoscopic hysterectomy. However, there has been limited published data and evaluation of laparoscopic myomectomy simulation models.
This study aimed to design a low-cost, low-fidelity laparoscopic myomectomy simulation model for surgical training and to assess the model’s validity as a training tool.
Materials and Methods
This study was deemed exempt by the Cedars-Sinai Medical Center Institutional Review Board, as it met the definition of educational research. Informed consent was not required, and the study participants were instead provided with a detailed information sheet before voluntary participation. The study involved the following 2 components: (1) model development and (2) validity assessment.
Model development
The laparoscopic myomectomy model simulates a uterus with a 5 cm intramural fibroid, with its pseudocapsule already exposed. The design of the model serves to address the following 2 key components of laparoscopic myomectomy: fibroid enucleation and hysterotomy repair. The design and setup of the laparoscopic myomectomy model are shown in Figure 1 , and the construction of the model is demonstrated in Video 1 . The following materials were used to construct the model: a “cup turner” foam cylinder, pink felt, a 2-inch stress ball, 2-inch self-adhesive bandage wrap, multipurpose sealing wrap (Press ‘N Seal), red marker, and hook-and-loop fastener (Velcro). The model is reusable for multiple attempts and/or multiple learners.
The model was placed in a laparoscopic box trainer that allowed for ipsilateral, contralateral, or suprapubic port placement. The box trainer was connected to a monitor for viewing and recording ( Figure 1 ). The model was affixed to the trainer using a combination of hook-and-loop fastener and alligator clips.
Validity assessment
For the validation component of the study, we utilized the framework described by Messick. This contemporary framework describes validity as a process rather than an endpoint, involving the collection of evidence to support or refute a validity hypothesis. The potential sources of validity evidence include content, response process, internal structure, relationships with other variables, and consequences . Response process evidence and consequences evidence were not directly assessed in our study.
Validity evidence was primarily collected by evaluating expert and novice surgeons’ performances on the simulation model. The participants were recruited at a single quaternary care institution (Cedars-Sinai Medical Center) and at the Society of Gynecologic Surgeons 47th Annual Scientific Meeting. Eligible participants included OB/GYN residents (postgraduate year 2 and above), fellows, or attending surgeons who perform laparoscopic myomectomies as part of their training or routine practice. Participants who had performed greater than 20 laparoscopic myomectomies as the primary surgeon were categorized as experts, whereas those who had performed 20 or fewer were categorized as novices.
Upon enrollment, the participants were provided a randomly assigned, nonconsecutive study identification number generated on randomizer.org . They then completed a deidentified pre-task questionnaire that included demographic information and self-reported surgical and simulation experience. Next, the participants watched an instructional video outlining and demonstrating the simulation task ( Video 2 ). Part 1 of the task involved fibroid dissection and enucleation using laparoscopic instruments (scissors, grasper, and tenaculum) without the use of energy. Part 2 of the task involved two-layer closure of the hysterotomy using 12-inch, 0-caliber barbed suture on a GS-21 needle.
The participants were allowed to select their preferred trocar placement and could practice any component of the task for up to 10 minutes. While performing the task, they were allowed to ask the study coordinator to adjust the camera angle as needed. No technical guidance or assistance was otherwise provided. Each performance was recorded directly from the monitor without sound, and the recording was labeled with the participant’s study identification number. The time to completion of the task was also recorded. Part 1 began with the grasper contacting the model and ended when the fibroid was completely detached from its pseudocapsule, whereas Part 2 began with instrument entry into the camera view and ended with cutting of the suture.
Relationships with other variables evidence for the simulation model was collected by comparing expert and novice performances on the simulation task. The primary outcome of the study was to compare expert and novice performance scores for the task using the validated Global Operative Assessment of Laparoscopic Skills (GOALS) scale and a modified GOALS scale. The standard GOALS scale assesses technical performance in the following 5 domains deemed essential to laparoscopy: depth perception, bimanual dexterity, efficiency, tissue handling, and autonomy. The autonomy domain was omitted for this study, as the participants did not receive any guidance during the task. Each domain was graded on a 5-point Likert scale for a maximum composite score of 20 points. In addition, the following 3 novel metrics were created to assess the skills specific to minimally invasive myomectomy: fibroid dissection and enucleation, needle handling, and two-layer uterine closure ( Figure 2 ). These novel metrics were also graded on a 5-point Likert scale and added to create the modified GOALS score (maximum score of 35 points). Our novel metrics were modeled after the previously validated GOALS scale and customized for the laparoscopic simulation task with expert consensus. The needle handling metric was adapted from a similar modified GOALS scale developed by King et al.
Scoring of the deidentified videos was carried out by 2 blinded expert reviewers. For each of the domains, the 2 reviewer scores were averaged to calculate a single score for each participant. To avoid significant discrepancies in scoring using the assessment tool, the reviewers were first trained using 4 of the deidentified videos; the remaining videos were scored independently.
Content evidence was collected with a post-task questionnaire assessing the realism, utility, acceptability, and educational effect of the model on a 5-point Likert scale. This questionnaire was adapted from a previous gynecologic simulation study by Tunitsky-Bitton et al.
Statistical analysis
The Mann–Whitney U test was used to compare the task completion times and performance scores. The interrater reliability of scoring between the 2 reviewers (ie, internal structure evidence) was assessed using the interclass correlation coefficient. The sample size was calculated using the means and standard deviations of the GOALS scale using previously published studies evaluating similar simulation models as a reference. On the basis of these data, we powered our study to detect a difference of 3.0 points between the expert and novice groups on the GOALS scale, assuming a standard deviation of 1.5. , Given the limited number of expert-level surgeons compared with greater than 20 trainees eligible for participation, we planned for a 3:1 ratio of novices to experts. Assuming 90% power and a significance level of 0.05, a minimum of 4 experts and 12 novices was required.
Results
The total cost to construct each model was under $5 ( Table 1 ). Five experts and 15 novices were enrolled in the study. The results of the pre-task survey, including participant demographic characteristics and surgical experience, are displayed in Table 2 . The experts included fellowship-trained MIGS attendings, whereas the novices included a combination of OB/GYN residents and MIGS fellows. In the pre-task survey, only 20% (1/5) of experts and 27% (4/15) of novices agreed with the statement, “There is adequate training for myomectomy in residency.”
Material | Approximate cost per model ($) |
---|---|
“Cup turner” foam cylinder | 3.00 |
Felt | 0.15 |
2-inch stress ball | 0.50 |
2-inch self-adhesive bandage wrap | 0.10 |
Multipurpose sealing wrap | 0.10 |
Red marker | 0.05 |
Hook-and-loop fastener | 0.50 |
Total cost a | $4.40 |
a Does not include the cost of the box trainer, surgical instruments, or suture.
Characteristic | Expert surgeons (n=5) a | Novice surgeons (n=15) a |
---|---|---|
Age (y) | 42 (34–44) | 30.5 (26–37) |
Gender | ||
Male | 1 (20) | 3 (20) |
Female | 4 (80) | 12 (80) |
Surgeon PGY | ||
2 | N/A | 5 (33.3) |
3 | N/A | 3 (20) |
4 | N/A | 3 (20) |
5 | N/A | 3 (20) |
6 | N/A | 1 (6.7) |
Previous experience with minimally invasive myomectomy model | ||
None | 3 (60) | 14 (93.3) |
1–2 times | 0 | 1 (6.7) |
2–5 times | 2 (40) | 0 |
>5 times | 0 | 0 |
Comfort level with laparoscopic myomectomy (Likert scale, 1–5) | 5 (5–5) | 2 (1–4) |
Comfort level with laparoscopic suturing (Likert Scale, 1–5) | 5 (5–5) | 2 (1–5) |
Years of surgical experience beyond residency training (experts only) | 11 (6–13) | N/A |
Laparoscopic myomectomies performed as primary surgeon b | 375 (75–>500) | 0 (0–15) |
Total number of laparoscopic myomectomies participated in as primary or assistant surgeon (novices only) b | N/A | 3 (0–35) |
Robotic myomectomies performed as primary surgeon b | 75 (0–75) | 0 (0–35) |
Abdominal myomectomies performed as primary surgeon b | 175 (75–375) | 8 (0–35) |
Number of procedures involving laparoscopic suturing in career | >500 (>500– >500) | 3 (0–75) |
Laparoscopic myomectomies performed as primary surgeon in past year b | 75 (15–75) | 0 (0–8) |
Number of procedures involving laparoscopic suturing in past year | >100 (>100– >100) | 3 (0–75) |
Number of hysterotomies performed in laparoscopic myomectomy (novices only) | N/A | 3 (0–15) |
Number of times fibroid enucleation was performed in a laparoscopic myomectomy (novices only) | N/A | 3 (0–15) |
Number of times hysterotomy repair was performed in a laparoscopic myomectomy (novices only) | N/A | 3 (0–35) |
Laparoscopic procedures logged as primary surgeon (novices only) c | N/A | 75 (0–175) |
Hours spent practicing FLS (novices only) | N/A | 8 (<1–>20) |
Passed FLS (novices only) | N/A | 6 (40) |