Development and validation of a spontaneous preterm delivery predictor in asymptomatic women




Materials and Methods


Subjects


The Proteomic Assessment of Preterm Risk (PAPR) study was conducted under a standardized protocol at 11 Institutional Review Board (IRB)-approved sites across the United States ( Clinicaltrials.gov identifier: NCT01371019 ). Subjects were enrolled between 17 0/7 and 28 6/7 weeks gestational age (GA). Dating was established using a predefined protocol of menstrual dating confirmed by early ultrasound biometry, or ultrasound alone, to provide the best clinically estimated GA. BMI was derived from height and prepregnancy self-reported weight. Pregnancies with multiple gestations or with known or suspected major fetal anomalies were excluded. Pertinent information regarding subject demographic characteristics, past medical and pregnancy history, current pregnancy history, and concurrent medications was collected and entered into an electronic case report form. Following delivery, data were collected for maternal and infant outcomes and complications. All deliveries were classified by the study sites as term (≥37 0/7 weeks GA), spontaneous preterm (including preterm premature rupture of membranes [PPROM]), or medically indicated preterm births. Classification of preterm deliveries was subsequently adjudicated by the chief medical officer (D.H.) at Sera Prognostics, Inc, who was blinded to results from laboratory analysis. As indicated, discrepancies were clarified with the principal investigator at the study site. The adjudication occurred prior to locking down the validation database and conducting laboratory and statistical analysis.


Sample collection


Maternal blood was collected and processed as follows: a 10-minute room temperature clotting period, followed by immediate refrigerated centrifugation or placement in an ice-water bath at 4–8 o C until centrifugation. Blood was centrifuged within 2.5 hours of collection and 0.5 mL serum aliquots were stored at −80 o C until analyzed. Details regarding sample accessioning can be found in Supplementary Materials and Methods .


Predictor development principles


Development of the insulin-like growth factor–binding protein 4 (IBP4)/sex hormone–binding globulin (SHBG) predictor included independent and sequential discovery, verification, and validation steps consistent with Institute of Medicine (IOM) guidelines for best practices in “omics” research. Analytical validation preceded clinical validation sample analysis and included assessment of inter- and intrabatch precision, carry-over, and limit of detection.


The validation nested case-control analysis was performed on specimens from 81 sPTD cases and controls independent of discovery and verification. Validation sPTD cases were the last to be enrolled in PAPR and included samples from 9 sites in total, with 2 sites being unique to validation. Validation cases and controls underwent 100% on-site source document verification with each subject’s medical record prior to mass spectrometry (MS) analysis. This process ensured that all subjects satisfied the inclusion and exclusion criteria, as well as confirmed medical/pregnancy complications and GA at birth assignments for all subjects at time of sample collection and delivery. Detailed analysis protocols, including the validation study design, analysis plan, and a blinding protocol, were preestablished. Personnel were blinded to subject case, control, and GA at birth data assignments, with the exception of the director of clinical operations (DCO) and clinical data manager. The data analysis plan included prespecified validation claims and a protocol for double independent external analyses. Predictor scores, calculated as described below, were determined for all subject samples by a blinded statistician and subsequently confirmed by 2 external blinded statisticians, 1 of whom was university based (E. Mazzola) and the other an industry consultant (P. Kearney). Case, control, and GA data, linked to the predictor scores by the DCO, were then provided to the 2 external statisticians for analysis. Area under the receiver operating characteristic curve (AUROC) and significance testing results were then transferred back to the DCO. Transfer of data incorporated the use of the SUMPRODUCT function to ensure data integrity. To provide an audit trail of data from each subject through to validation results, real-time digital time-stamping was applied to analytical data, plans, and reports.


Validation study design


In the primary analysis, cases were defined as subjects with deliveries due to PPROM or spontaneous onset of labor with delivery <37 0/7 weeks GA. Controls were subjects who delivered at ≥37 0/7 weeks GA. Prior discovery and verification analyses investigated 44 candidate biomarkers using serum samples collected across broad GA (17 0/7 through 25 6/7 weeks GA) ( Supplementary Materials and Methods ). Discovery and verification identified an optimal narrow GA at blood draw (GABD) interval (19 0/7 through 21 6/7 weeks) and 2 proteins, IBP4, up-regulated in sPTD cases, and SHBG, down-regulated in sPTD cases, used in a ratio (IBP4/SHBG) as the best predictor by AUROC for sPTD ( Supplementary Materials and Methods ). In discovery and verification, subjects without extreme BMI values had improved classification performance by IBP4/SHBG ( Supplementary Results , Appendix ). Following discovery and verification analyses, we proceeded to analytical and clinical validation.


Validation sPTD cases totaled 18 subjects collected between 19 0/7 and 21 6/7 weeks GABD from a total available of 81 subjects between 17 0/7 and 28 6/7 weeks GA. Sets of controls, comprising 2 controls per sPTD case matched by GABD, were randomly selected using the R statistical program (R 3.0.2) and compared to the term delivery distribution as outlined in the 2012 National Vital Statistics Report using a chi-square test. Randomly created control sets (in groups of 10) were examined for sets yielding a P value approaching 1.0.


Our primary objective was to validate the performance of the IBP4/SHBG ratio as a predictor for sPTD using AUROC. To control the overall multiple testing error rate (α = 0.05), the fixed sequence approach was applied to GABD increments within the optimal interval (19 0/7 through 21 6/7 weeks GA) identified in discovery and verification with and without the application of a BMI stratification ( Supplementary Materials and Methods ). Significance was assessed by the Wilcoxon-Mann-Whitney statistic that tests equivalence to AUROC = 0.5 (random chance). For determinations of classification performance at GA boundaries other than <37 0/7 vs ≥37 0/7 weeks GA (eg, <36 0/7 vs ≥36 0/7 , <35 0/7 vs ≥35 0/7 ), cases and controls were redefined as all subjects below and equal to/above the specific boundary, respectively.


Laboratory methods


A systems biology approach was employed to generate a highly multiplexed multiple reaction monitoring (MRM) MS assay ( Supplementary Materials and Methods and Supplementary Results ). The validation assay quantified proteotypic peptides specific to predictor proteins IBP4 and SHBG and other controls. Samples were processed in batches of 32, which were composed of clinical subjects (n = 24), pooled serum standards from healthy nonpregnant donors (HGS) (n = 3), pooled serum standards from healthy pregnant donors (pHGS) (n = 3), and phosphate-buffered saline that served as process controls (n = 2). For all analyses, serum samples were first depleted of high-abundance and nondiagnostic proteins using MARS-14 immunodepletion columns (Agilent Technologies, Santa Clara, CA), reduced with dithiothreitol, alkylated with iodoacetamide, and digested with trypsin. Heavy-labeled stable isotope standard (SIS) peptides (New England Peptide, Gardner, MA) were then added to samples, which were subsequently desalted and analyzed by reversed-phase liquid chromatography (LC)/MRM MS. SIS peptides were used for normalization by generating response ratios (RR), where the peak area of a peptide fragment ion (ie, transition) measured in serum was divided by that of the corresponding SIS transition spiked into the same serum sample.


The IBP4/SHBG predictor


The predictor score was defined as the natural log of the ratio of the IBP4 and SHBG peptide transition response ratios:


S=ln(RRIBP4RRSHBG),
S = l n ( R R IBP 4 R R SHBG ) ,
where RR are the measured response ratios of the respective peptides.




Results


Figure 1 summarizes the distribution of study subjects in PAPR. Between March 2011 and August 2013, 5501 subjects were enrolled. Clinical and demographic data of the enrolled subjects by site are included in Supplementary Materials and Methods . As predefined in the protocol, 410 subjects (6.7%) were excluded from analysis owing to receiving progestogen therapy after the first trimester of pregnancy. An additional 120 subjects (2.2%) were excluded owing to early discontinuation, and 146 (2.7%) were lost to follow-up. A total of 4825 subjects were available for analysis. There were 533 PTDs: 248 (4.7%) spontaneous and 285 (5.9%) medically indicated. Compared to those who delivered at term, subjects with an sPTD were more likely to have had 1 or more prior PTDs and to have experienced bleeding after 12 weeks of gestation in the study pregnancy ( Table 1 ). Characteristics of sPTD cases and term controls selected for the overall validation cohort were not significantly different from each other, with the exception that there were significantly more Hispanic controls (47.5% vs 33.3%, P = .035). Similarly, subjects selected for the validated window were largely representative of the study cohort as a whole ( Table 1 ).




Figure 1


Distribution of subjects in the PAPR database

A total of 5501 subjects were enrolled in the Proteomic Assessment of Preterm Risk (PAPR) study between 17 0/7 and 28 6/7 weeks gestational age (GA). A number of subjects (120) were discontinued, and another 146 subjects were lost to follow-up. Of the 5235 delivered subjects, 410 were excluded from these analyses owing to progestogen use. Of the 4825 subjects remaining, 4292 delivered at term, 248 experienced a spontaneous preterm delivery (sPTD), and 285 delivered preterm owing to medical indications. Following preanalytic exclusion of 31 subjects, 217 sPTDs were available for analysis and distributed among discovery, verification, and validation studies as shown.

Saade et al. Validation of a preterm delivery predictor. Am J Obstet Gynecol 2016 .


Table 1

Maternal characteristics and pregnancy outcomes stratified by timing of delivery (sPTD and term)









































































































































































































































































































































































































































































































































































































































































































































































Variables PAPR study Entire validation cohort (17 0/7 to 28 6/7 weeks) Validated window (19 1/7 to 20 6/7 weeks)
Cases n (%) (n = 217) Controls n (%) (n = 4292) P value Cases n (%) (n = 81) Controls n (%) (n = 162) P value Cases n (%) (n = 18) Controls n (%) (n = 36) P value
Maternal characteristics
Maternal age at enrollment, y .245 .239 .387
18–22 y 58 (26.7) 990 (23.1) 22 (27.2) 47 (29.0) 6 (33.3) 13 (36.1)
23–27 y 56 (25.8) 1222 (28.5) 17 (21.0) 41 (25.3) 6 (33.3) 9 (25.0)
28–32 y 54 (24.9) 1154 (26.9) 25 (30.9) 34 (21.0) 5 (27.8) 5 (13.9)
33–37 y 31 (14.3) 692 (16.1) 9 (11.1) 30 (18.5) 1 (5.6) 7 (19.4)
38 y or more 18 (8.3) 234 (5.5) 8 (9.9) 10 (6.2) 0 2 (5.6)
Mean 28 28 28 28 25 27
Median 27 27 28 27 25 25
Interquartile range 22–32 23–32 21–32 22–32 21–30 22–33
Body mass index, kg/m 2 .380 .802 .959
Less than 18.5 10 (4.7) 129 (3.1) 1 (1.3) 2 (1.3) 0 0
18.5–24.9 78 (36.8) 1789 (42.3) 25 (31.3) 55 (34.6) 8 (44.4) 16 (45.7)
25.0–29.9 54 (25.5) 1091 (25.8) 26 (32.5) 46 (28.9) 4 (22.2) 9 (25.7)
30.0–34.9 39 (18.4) 617 (15.6) 17 (21.3) 25 (15.7) 3 (16.7) 4 (11.4)
35.0–39.9 17 (8.0) 320 (7.6) 6 (7.5) 17 (10.7) 2 (11.1) 5 (14.3)
Greater than 40.0 14 (6.6) 286 (6.7) 5 (6.3) 14 (8.8) 1 (5.6) 1 (2.9)
Mean 27.8 27.5 28.4 29.1 28.2 27.4
Median 26.5 25.7 27.4 27.8 26.5 27
Interquartile range 22.7–31.8 22.3–31.1 23.6–32.0 23.4–32.4 23.8–33.7 22.3–30.6
Education level <.0002 .201 .263
Graduate degree 13 (6.0) 461 (10.9) 6 (7.7) 14 (8.7) 0 2 (5.7)
College diploma 34 (15.8) 701 (16.6) 10 (12.6) 22 (13.8) 2 (11.1) 5 (14.3)
Some college 51 (23.7) 936 (22.2) 19 (24.0) 23 (14.4) 1 (5.6) 5 (14.3)
High school diploma/equivalent 46 (21.4) 1032 (24.5) 16 (20.2) 50 (31.3) 5 (27.8) 14 (40.0)
Some high school 53 (24.6) 774 (18.4) 25 (31.6) 36 (22.5) 9 (50.0) 6 (17.1)
9th grade or less 12 (5.8) 292 (6.9) 3 (3.8) 14 (8.7) 1 (5.6) 3 (8.6)
Other 6 (2.8) 23 (0.6) 0 1 (0.6) 0 0
Ethnicity .157 .035 .844
Hispanic or Latino 89 (41.0) 1557 (36.3) 27 (33.3) 77 (47.5) 7 (38.9) 15 (41.7)
Non-Hispanic or Latino 128 (59.0) 2735 (63.7) 54 (66.7) 85 (52.5) 11 (61.1) 21 (58.3)
Race .887 .811 .319
American Indian/Alaskan Native 1 (0.5) 29 (0.7) 0 2 (1.2) 0 1 (2.8)
Asian 4 (1.8) 131 (3.1) 1 (1.2) 1 (0.6) 0 1 (2.8)
Black or African-American 45 (20.7) 838 (19.5) 19 (23.5) 37 (22.8) 2 (11.1) 11 (30.6)
Native Hawaiian or other Pacific Islander 0 12 (0.30) 0 2 (1.2) 0 1 (2.8)
White 156 (71.9) 3101 (72.3) 58 (71.6) 114 (70.4) 16 (88.9) 22 (61.1)
Other 11 (5.1) 193 (4.5) 3 (3.7) 6 (3.7) 0 0
Obstetrical characteristics
Primigravida 64 (29.5) 1212 (28.2) .689 27 (33.3) 39 (24.1) .126 5 (27.8) 8 (22.2) .652
Multigravida 153 (70.5) 3080 (71.8) 54 (66.7) 123 (75.9) 13 (72.2) 28 (77.8)
Number of prior full-term deliveries .007 .326 .790
1 or more 113 (73.8) 2538 (82.4) 40 (74.5) 102 (82.9) 10 (76.9) 22 (78.6)
None 40 (26.2) 542 (17.6) 13 (24.5) 21 (17.1) 3 (23.1) 6 (21.4)
Number of prior sPTDs <.0001 .221 .524
1 or more 35 (22.9) 339 (11.0) 9 (16.7) 11 (8.9) 1 (7.7) 6 (21.4)
None 118 (77.1) 2741 (89.0) 45 (83.3) 112 (91.1) 12 (92.3) 22 (78.6)
Lifestyle characteristics
Smoking .412 .719 1.000
Yes 34 (15.7) 588 (13.7) 15 (18.5) 27 (16.7) 3 (16.7) 6 (16.7)
No 183 (84.3) 3704 (86.3) 66 (81.5) 135 (83.3) 15 (83.3) 30 (83.3)
Illicit drugs .283 .628 .739
Yes 16 (7.4) 242 (5.6) 6 (7.4) 15 (9.3) 2 (11.1) 3 (8.3)
No 201 (92.6) 4050 (94.4) 75 (92.6) 147 (90.7) 16 (88.9) 33 (91.7)
Alcohol .096 .628 .278
Yes 20 (9.2) 273 (6.4) 6 (7.4) 15 (9.3) 4 (22.2) 4 (11.1)
No 197 (90.8) 4018 (93.6) 75 (92.6) 147 (90.7) 14 (77.8) 32 (88.9)
Alcohol use .108 .592 .278
Yes (amount unknown) 3 (1.4) 39 (0.9) 0 2 (1.2) 0 0
Social (occasional) 16 (7.4) 230 (5.4) 6 (7.4) 13 (8.0) 4 (22.2) 4 (11.1)
Heavy (daily) 1 (0.5) 4 (0.09) 0 0 0 0
No 197 (90.8) 4018 (93.6) 75 (92.6) 147 (90.7) 14 (77.8) 32 (88.9)
Medical characteristics
Bleeding during pregnancy after 12 wk .006 .360 .308
Yes 21 (9.7) 228 (5.3) 7 (8.6) 9 (5.6) 0 2 (5.6)
No 196 (90.3) 4064 (94.7) 74 (91.4) 153 (94.4) 18 (100.0) 34 (94.4)

Only gold members can continue reading. Log In or Register to continue

Stay updated, free articles. Join our Telegram channel

May 4, 2017 | Posted by in GYNECOLOGY | Comments Off on Development and validation of a spontaneous preterm delivery predictor in asymptomatic women

Full access? Get Clinical Tree

Get Clinical Tree app for offline access