Accuracy of self-reported survey data on assisted reproductive technology treatment parameters and reproductive history




Background


It is unknown whether data obtained from maternal self-report for assisted reproductive technology treatment parameters and reproductive history are accurate for use in research studies.


Objectives


We evaluated the accuracy of self-reported in assisted reproductive technology treatment and reproductive history from the Upstate KIDS study in comparison with clinical data reported to the Society for Assisted Reproductive Technology Clinic Outcome Reporting System.


Study Design


Upstate KIDS maternal questionnaire data from deliveries between 2008 and 2010 were linked to data reported to Society for Assisted Reproductive Technology Clinic Outcome Reporting System. The 617 index deliveries were compared as to treatment type (frozen embryo transfer and donor egg or sperm) and use of intracytoplasmic sperm injection and assisted hatching. Use of injectable medications, self-report for assisted reproductive technology, or frozen embryo transfer prior to the index deliveries were also compared. We report agreement in which both sources had yes or both no and sensitivity of maternal report using Society for Assisted Reproductive Technology Clinic Outcome Reporting System as the gold standard. Significance was determined using χ 2 at P < 0.05.


Results


Universal agreement was not reached on any parameter but was best for treatment type of frozen embryo transfer (agreement, 96%; sensitivity, 93%) and use of donor eggs (agreement, 97%; sensitivity, 82%) or sperm (agreement, 98%; sensitivity, 82%). Use of intracytoplasmic sperm injection (agreement, 78%: sensitivity, 78%) and assisted hatching (agreement, 57%; sensitivity, 38%) agreed less well with self-reported use ( P < .0001). In vitro fertilization (agreement, 82%) and frozen embryo transfer (agreement, 90%) prior to the index delivery were more consistently reported than was use of injectable medication (agreement, 76%) ( P < .0001).


Conclusion


Women accurately report in vitro fertilization treatment but are less accurate about procedures handled in the laboratory (intracytoplasmic sperm injection or assisted hatching). Clinics might better communicate with patients on the use of these procedures, and researchers should use caution when using self-reported treatment data.


More than 5 million babies have been born worldwide from assisted reproductive technology (ART), close to 3 million of these within the past 6 years. Numerous studies suggest that there is an increase in adverse outcomes in pregnancies resulting from ART. Not only is there a higher rate of multiple birth from these pregnancies, but increases in low birthweight, prematurity, small-for-gestational-age babies, and malformations are found in ART deliveries, even in singletons. Multiple authors have called for outcome studies evaluating the long-term health of these children and their mothers and have outlined the difficulties in getting these studies accomplished.


Research on infertility can be performed using clinical diagnostic and treatment data, vital records data, or self-reported survey data, and there are relative strengths and weaknesses to each of these data sources. With regard to self-reported data, we have previously evaluated the accuracy of report of in vitro fertilization (IVF) treatment in Upstate KIDS surveys and found it to be accurate. However, we have looked at treatment parameters in a very small group of 77 survey participants who underwent IVF treatment in Massachusetts and found mixed reporting accuracy.


To use maternal self-reported data for research purposes, we must have confidence that treatment information is recalled and reported accurately. This study compared self-reported parameters of ART treatment in the maternal survey of the Upstate KIDS study with clinical data in the Society for Assisted Reproductive Technology Clinic Outcome Reporting System (SART CORS) database. Accuracy of maternal self-report of treatment type and treatment parameters on the index pregnancy was assessed.


The secondary objective was to investigate whether time to survey, age of the mother, previous ART use, or presence of male factor infertility (as reported in SART CORS and known to be associated with increased use of intracytoplasmic sperm injection [ICSI]) affect reporting accuracy.


Materials and Methods


Data sources


Data were obtained from 2 sources, the Upstate KIDS maternal questionnaires and the SART CORS clinical ART data.


The Upstate KIDS Study used the New York State’s Perinatal Data System to identify all live births occurring to resident mothers of Upstate New York (57 New York counties excluding the 5 boroughs of New York City) between 2008 and 2010. Upstate KIDS was designed to obtain a population based cohort of infants conceived with and without infertility treatment including ART for the assessment of children’s growth and development.


All infants for whom the infertility treatment box was checked on their birth certificates as well as all infants of multiple births irrespective of treatment status were recruited. Women delivering singletons conceived without infertility treatment were recruited based on a paradigm including frequency matching at a 3:1 ratio to women delivering singletons conceived with treatment within the perinatal region of delivery.


The majority (93%) of Upstate KIDS mothers returned a self-administered questionnaire within 4-6 months of delivery. An incentive of $30 was provided to participants along with reminder calls and e-mails to achieve a high response rate. For this study we evaluated questions about ART treatment for the index delivery (question 23) as well as questions about the use of ART in previous pregnancies (question 25).


The Institutional Review Boards at New York State Department of Health and the University at Albany (State University of New York) approved the Study and served as the institutional review boards under a formal reliance agreement with the Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health. All participants provided written informed consent prior to data collection.


The SART CORS database is used by the Society for Assisted Reproductive Technology to collect national ART data under the Fertility Clinic Success Rate and Certification Act of 1992 (Public Law 102-493) and to report these data to the Centers for Disease Control and Prevention. SART CORS collects data from more than 90% of US ART clinics and includes greater than 95% of the US ART cycles.


The data collected include patient demographic information (age, race, height, and weight); reproductive history (prior cycles of ART and intrauterine insemination and female infertility diagnosis); cycle-specific treatment data (fresh vs frozen cycle, use of autologous or donor oocytes or embryos, use of ICSI, assisted hatching (AH) and other laboratory techniques; numbers of embryos transferred and quality of embryos transferred); and outcome data (cancellation, treatment outcome, pregnancy outcome, birthweight, gestational age).


Data are validated annually through a review by the Society for Assisted Reproductive Technology and the Centers for Disease Control and Prevention with yearly site visits to a random selection of clinics to check records for completeness and accuracy of data collection and data entry ( http://www.cdc.gov/art/ART2011/NationalSummary_appixa.htm ). SART CORS data for this study included fields related to the use of donor gametes, micromanipulation, and prior treatment.


Linkage


Upstate KIDS deliveries were linked to ART cycles containing a birth outcome reported to SART CORS as previously described. Briefly, deliveries were linked using identifiers for the mothers the infants and the delivery information. Approximately 89% of the women linking to SART CORS had been invited to participate. Overall participation into the study was 27%.


Statistical analysis


We analyzed how closely the 2 data sources agree and the rates of reports of each treatment type by each data source. For clinical treatment parameters, SART CORS was used as the gold standard; however, for prior treatment we used maternal self-report as the more accurate measure.


The process included the evaluation of the percentage agreement between the 2 data sources for each of the parameters: donor gametes (sperm or oocytes), use of ICSI (listed as some or all oocytes within SART CORS), AH (listed as some or all embryos in SART CORS), and the use of fresh or frozen embryos for ART transfer. We determined in which data source the reported use of each of these parameters was greater.


We also evaluated use of gamete intrafallopian transfer and zygote intrafallopian transfer and the use of a gestational carrier; however, for the index delivery, there was no SART CORS reporting of these procedures. In addition, we evaluated self-report of procedural treatments that are a part of ART treatment such as vaginal ultrasound and administration of medications. Because fresh and frozen ART treatment may make greater or lesser use of vaginal ultrasound, we evaluated this treatment in all cycles and separately in the cycles using fresh oocytes and embryos only.


Sensitivity was determined for each of these parameters treating SART CORS information from the index cycle as the gold standard. SART CORS is considered the gold standard for these items because these are clinical data and are validated as described in the previous text. Sensitivity was defined as the proportion of women with a certain ART parameter in SART CORS that were correctly reported in the maternal questionnaire, and 95% confidence intervals were calculated using the Agresti-Coull method.


Logistic regression was used to estimate unadjusted odds ratios (OR) and their 95% confidence levels to identify participant characteristics (ie, maternal age, time to report, male factor, previous ART) associated with sensitivity (on parameters that had less than perfect agreement). The analytical sample included all women who had the procedures according to the gold standard, allowing assessment of sensitivity. It did not, however, include all women who did not have ART, and thus, specificity was not estimated.


Also, specificity would most likely be very high (> 99%), given the relatively rare occurrence of ART compared with non-ART deliveries. In the sensitivity analysis, we also evaluated the effect that weighting the analyses by twins, whom are oversampled in this cohort, has on the results.


For comparing information on fertility treatment received to achieve a delivery prior to the index delivery, sensitivity estimates were based on maternal report as the preferred standard rather than SART CORS. This decision is based on previous observations by 2 of the authors (B.L. and J.E.S.) that the prior ART cycle fields do not agree with information on prior cycles recorded for these women in longitudinally linked cycles within SART CORS. For example, national linked data show that for the second and third treatment cycles (cycles 2 and 3), 18.1% and 14.3%, respectively, are reported as having no prior fresh cycles, and the number entered in that field may also have been reported as being much higher than 2 or 3 (up to 12).




Results


We analyzed 617 Upstate KIDS deliveries that were linked to ART cycles reported to SART CORS. Mothers completed questionnaires upon enrolling their infant in the Upstate KIDS study at approximately 4 months following delivery with a median time to report of 147 days. Demographics of the linked cycles as reported in the Upstate KIDS maternal exposure questionnaire are presented in Table 1 . The majority of mothers were aged 35 years or older at delivery, of white non-Hispanic race/ethnicity, with a college or higher education, and covered by private health insurance.



Table 1

Sociodemographic characteristics of linked mothers from the Upstate KIDS study linked with SART CORS






































































Characteristics n (%)
n 617
Age at delivery, y, %
< 35 256 (41)
35–37 138 (22)
38–40 121 (20)
> 40 102 (17)
Race, % a
White 546 (90)
Other 60 (10)
Education, % a
No bachelor’s degree 135 (22)
Bachelor’s or advanced degree 471 (78)
Insurance, % a
Private 586 (97)
Other 30 (3)
Gravidity, % a
0 prior 230 (38)
1 or more prior 378 (62)
Parity, % a
0 prior 331 (57)
1 or more prior 274 (43)

SART CORS , Society for Assisted Reproductive Technology Clinic Outcome Reporting System.

Stern et al. Accuracy of self-reported ART data. Am J Obstet Gynecol 2016 .

a Of 617 women, missing values were present for race (n = 11), education (n = 11), insurance (n = 11), gravidity (n = 9), and parity (n = 12).



Table 2 shows the results of comparisons of treatments used for the index delivery as reported to SART CORS compared with self-reported maternal treatment data. No parameter had 100% agreement. Strongest agreement (the sum of both sources indicating yes and both sources indicating no) was found for medication use (83%), use of donor gametes (97-99%), and use of frozen embryos (96%). The greatest differences between self-report and clinical data were found for laboratory-performed micromanipulation procedures of ICSI and AH. For calculations of sensitivity, the SART CORS was used as the gold standard.



Table 2

Comparison of maternal self-reported ART treatment parameters for index birth with ART cycle data from SART CORS




























































































































Parameters SART CORS
N (%)
Upstate KIDS
N (%)
Both Yes, N (%) d SART Yes
KIDS No, N, (%) d
SART No
KIDS Yes, N, (%) d
Both No, N, (%) d Sensitivity, % P value
All linked deliveries 617 (100) 617 (100)
Vaginal ultrasound 617 (100) 494 (80) 494 (80) 123 (20) 0 (0) 0 (0) 80 NS
Vaginal ultrasound (removing FET) a 492 (100) 392 (80) 392 (80) 100 (20) 0 (0) 0 (0) 80 NS
Medication any administration b 435 (71) 469 (76) 399 (65) 36 (6) 70 (11) 112 (18) 92 < .0001
IVF no ICSI 84 (17) 201 (40) 68 (14) 16 (3) 133 (26) 287 (57) 81 < .0001
IVF with ICSI c 420 (83) 349 (69) 328 (65) 92 (18) 21 (4) 63 (13) 78 < .0001
Donor egg 83 (13) 70 (11) 68 (11) 15 (2) 2 (0) 532 (86) 82 < .0001
Donor sperm 28 (5) 34 (6) 23 (4) 5 (1) 11 (2) 578 (94) 82 NS
Donor embryos 1 (0) 2 (0) 0 (0) 1 (0.2) 2 (0.3) 614 (99.5) 0 NS
Assisted hatching 359 (58) 178 (29) 136 (22) 223 (36) 42 (7) 216 (35) 38 < .0001
FET 113 (18) 124 (20) 105 (17) 8 (1) 19 (3) 485 (79) 93 < .0001

ART , assisted reproductive technology; FET , frozen embryo transfer; ICSI , intracytoplasmic sperm injection; IVF , in vitro fertilization; N , number of deliveries; SART CORS , Society for Assisted Reproductive Technology Clinic Outcome Reporting System.

Stern et al. Accuracy of self-reported ART data. Am J Obstet Gynecol 2016 .

a FET was measured by maternal questionnaire


b Includes self-report information from several medication administration fields in the Upstate KIDS survey


c Does not include 113 FET cycles


d per row.

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

May 2, 2017 | Posted by in GYNECOLOGY | Comments Off on Accuracy of self-reported survey data on assisted reproductive technology treatment parameters and reproductive history

Full access? Get Clinical Tree

Get Clinical Tree app for offline access