Jianjun Ou1
Huixi Dong2
Si Dai1Yanting Hou1
Ying Wang2Xiaozi Lu3Guanglei Xun4
Kun Xia5
Jingping Zhao1
Yidong Shen1*- 1Department of Psychiatry, and National Clinical Research Center for Mental Disorders, The Second Xiangya Hospital of Central South University, Changsha, Hunan, China
- 2Mental Health Center of Xiangya Hospital, Central South University, Changsha, Hunan, China
- 3Qingdao Mental Health Center, Qingdao, Shandong, China
- 4Shandong Mental Health Center, Jinan, Shandong, China
- 5Center for Medical Genetics and School of Life Sciences, Central South University, Changsha, Hunan, China
Background: The use of pre- and perinatal risk factors as predictive factors may lower the age limit for reliable autism prediction. The objective of this study was to develop a clinical model based on these risk factors to predict autism.
Methods: A stepwise logistic regression analysis was conducted to explore the relationships between 28 candidate risk factors and autism risk among 615 Han Chinese children with autism and 615 unrelated typically developing children. The significant factors were subsequently used to create a clinical risk score model. A chi-square automatic interaction detector (CHAID) decision tree was used to validate the selected predictors included in the model. The predictive performance of the model was evaluated by an independent cohort.
Results: Five factors (pregnancy influenza-like illness, pregnancy stressors, maternal allergic/autoimmune disease, cesarean section, and hypoxia) were found to be significantly associated with autism risk. A receiver operating characteristic (ROC) curve indicated that the risk score model had good discrimination ability for autism, with an area under the curve (AUC) of 0.711 (95% CI=0.679-0.744); in the external validation cohort, the model showed slightly worse but overall similar predictive performance. Further subgroup analysis indicated that a higher risk score was associated with more behavioral problems. The risk score also exhibited robustness in a subgroup analysis of patients with mild autism.
Conclusion: This risk score model could lower the age limit for autism prediction with good discrimination performance, and it has unique advantages in clinical application.
1 Introduction
Autism spectrum disorder (ASD, also referred to as autism) is a neurodevelopmental disorder characterized by deficits in social interaction and communication skills and by stereotyped behaviors and restricted interests (1). According to the most recent epidemiological study (2), the prevalence of ASD in the United States is 2.76%, and the lifetime cost is approximately $1.4 to 2.4 million (3). Early detection and intervention could improve the outcomes of patients with autism (4). The American Academy of Pediatrics (AAP) recommends that routine developmental screening tests be administered after 9 months of age, which can lead to further evaluation, diagnosis and intervention (5). In practice, however, early behavioral abnormalities may sometimes be neglected, and diagnoses are often delayed until the age of 4 or 5 years (6). Previous research has revealed that autism is highly heritable (7), and some autism-specific markers are present before 12 months of age or even at birth (8–10). These findings suggest that autism identification may be possible during the neonatal period. One of the causes of diagnostic delay may be a lack of efficiency in screening or diagnostic tools for very young individuals. Current tools are mostly based on behavioral factors rather than etiological or pathological factors, and behavioral signs of autism are not reliable before 12 months of age (11).
In addition to genetic factors, pre- and perinatal risk factors also play important roles in the etiology of autism (12, 13). Evidence has indicated that environmental risk factors, such as viral infection or exposure to toxins, can activate neuroinflammatory processes, increase oxidative stress and/or disturb signaling pathways, which may directly or indirectly affect the neurodevelopmental process and result in abnormal behaviors (14). Kim and colleagues conducted an umbrella review to systematically appraise relevant meta-analyses to explore the strength and validity of more than 60 environmental risk factors for autism. Several factors were found to be strongly associated with autism risk (e.g., maternal age older than 35 years, gestational hypertension, maternal overweight, pre-eclampsia and maternal antidepressant use) or had a high level of evidence (e.g., maternal age older than 30 years, high paternal age, maternal autoimmune disease, and acetaminophen use during pregnancy) (13). Although the physiopathological mechanism is unclear, utilizing these risk factors, which may be closely related to the etiology of autism, could lower the age limit for the prediction of autism. In addition, from a practical point of view, information on the above risk factors is relatively easy to obtain from parental reports or medical records and may be more convenient to apply in community settings, especially in rural or undeveloped areas. Hence, we conducted this case–control study to develop a clinical risk score model based on pre- and perinatal factors for predicting autism. In addition to its ability to predict autism, theoretically, this model can also be used for autism screening.
2 Methods
2.1 Subjects
The Human Ethics Committee of the Second Xiangya Hospital of Central South University reviewed and approved this study. There were two groups of participants in the study. The first group of participants was recruited from 2008 to 2016 to establish the model, and then, an independent cohort was recruited from 2018 to 2023 for external validation.
For the first sample, the participants in the autism group were recruited from the outpatient departments of three different hospitals in Hunan, Jiangsu and Sichuan Provinces and from four autism training centers in Hunan, Shandong and Henan Provinces. The birthplaces of these children were distributed among 28 provinces in China, and they were diagnosed with autism before recruitment. Participants in the control group were recruited from four kindergartens and a primary school in Hunan, Shandong and Jiangsu Provinces. After we obtained written informed consent from the children’s parents, two independent psychiatric doctors confirmed the diagnoses of the children in the autism group per the Diagnostic and Statistical Manual of Mental Disorders, 4th edition, text revision (DSM-IV-TR) criteria for autism disorder. We designed a questionnaire to collect demographic information, medical history, and relevant information on risk factors during the prepregnancy, pregnancy, perinatal and postnatal periods from both groups. The parent-rated Social Responsiveness Scale (SRS) was used to evaluate children’s autistic traits. Parents of children above 4 years of age from both groups were also asked to complete the Achenbach Child Behavior Checklist (CBCL) to assess whether their children had any behavioral problems.
Children who presented with comorbid organic diseases of the nervous system were excluded from the study. Additionally, children in the control group were excluded if they had been previously diagnosed with psychiatric disorders or organic diseases of the nervous system or if their parents or teachers suspected a possible developmental disorder. Karyotype analysis performed at the Laboratory of Medical Genetics, Central South University, was used to identify participants in the autism group who had a chromosomal abnormality; these participants were also excluded from the study (n=12).
Ultimately, a total of 615 children with ASD and 615 children without ASD were recruited. All the recruited subjects were Han Chinese.
2.2 Candidate predictor selection and covariates
Data on candidate predictors were collected by adapting a parent-reported questionnaire. In total, 73 potential risk factors related to the prepregnancy, pregnancy, perinatal and postnatal periods were included in the questionnaire (Supplementary Table 1). The selection of these candidate predictors was based on two criteria. First, the percentage of missing data for each predictor had to be less than 10%; thus, the information was relatively reliable and could be effectively filled in. Second, the prevalence of the predictors had to be more than 1% in each group. For ease of interpretation and use, the continuous variables were categorized based on the medical reference range or previous literature. If the candidate variable had a U-shaped relationship with autism risk, the lowest risk was set as the reference. Candidate predictors that did not meet the prevalence criteria but showed an obvious increase in the incidence rate were merged into a new single variable for further analysis.
Ultimately, 28 candidate predictors (including 4 merged variables, shown in Supplementary Table 2) were selected for further analysis. Age at recruitment, sex, residential area and family annual income were included as covariates.
2.3 Statistical analysis
All the statistical analyses were conducted using IBM SPSS version 22.0. The chi-square test (Fisher’s exact test was used when necessary) was used to compare the selected variables between groups. Then, we filled in the missing values by adapting the expectation maximization (EM) algorithm. As all candidate predictors had missing data rates lower than 10%, the performance of the EM algorithm is similar to other filling methods such as multiple imputation (15).
After the missing values were filled and outliers were excluded, 80% of the participants were randomly selected into the training set, and the rest were included as the validation set. Then, a stepwise logistic regression analysis was conducted to explore the relationships between the selected predictors and autism risk in the training cohort (with recruitment age, residential area, and parental education levels included as covariates). The significance level of all the tests was set at p<0.05 (two-tailed). Nagelkerke R2 was used to assess the goodness of fit of the logistic model. The p values of multiple comparisons were corrected by Bonferroni correction.
We randomly split the data set into training and validation samples so that the performance of the model could be evaluated via cross-validation in the independent, unbiased validation sample. However, as data splitting may be less stable in smaller samples, we also conducted validation in our full sample using 1000 bootstrap replicates as a sensitivity analysis.
2.4 Risk score system development
To develop a practical scoring system, we assigned all the significant risk factors identified by the logistic model weights proportional to the β coefficient values (by dividing the β coefficients of each variable by the smallest coefficient in the model, multiplying by 2 and rounding to the nearest integer). The sum score for each participant in the training cohort was subsequently calculated. Student’s t test was used to compare the risk scores between the autism group and the control group. In addition, we constructed a linear regression model to analyze the association between the risk score and CBCL score.
A receiver operating characteristic (ROC) curve was generated to assess and compare the predictive accuracy of the risk score between different datasets. The maximal Youden index (sensitivity + specificity – 1) was used to determine the best cutoff point. The positive predictive value (PPV) and negative predictive value (NPV) were calculated based on the best cutoff point.
2.5 Model validation
2.5.1 Validation of selected predictors
We input the 28 candidate risk factors into a chi-square automatic interaction detector (CHAID) decision tree for the training cohort for comparison with the logistic model in terms of the identified risk factors and the area under the ROC curve (AUC) values.We chose CHAID as an additional selection method because it enables a visual understanding of the selection process.
2.5.2 Validation of the predictive performance
We adopted an established scoring system to calculate the risk score for the participants in the internal validation cohort. The AUC and the sensitivity, specificity, PPV and NPV of the internal validation cohort were compared with the results from the training cohort according to the same cutoff point.
2.5.3 External independent validation
The external validation set included data from an independent clinical database that was developed from May 2018 to March 2023. The recruited participants included typically developing (TD) and children with ASD as well as children with other neurodevelopmental disorders (ONDs). The pre- and perinatal information was partly obtained from parental reports via online questionnaires, and the rest of the information was obtained from a clinical interview at the time of recruitment. Because the questionnaires used in the two studies were different, we first matched the items carefully. The matched items are presented in Supplementary Table 3.
The completion rate of the online questionnaires was 84.5%. After excluding subjects and outliers from the dataset, we identified 614 children with ASD (513 males, 101 females), 115 TD children (68 males, 57 females), and 98 children with ONDs (75 males, 23 females). The mean recruitment age of the children with autism was 4.38 years (SD=1.53 years), the mean recruitment age of the TD children was 6.35 years (SD=2.62 years), and the mean recruitment age of the children with ONDs was 7.64 years (SD=2.71 years). Diagnoses were based on the DSM-5 criteria, and relevant developmental and medical history information was also checked. In addition, the Aberrant Behavior Checklist (ABC) (16) was used to assess the severity of behavioral symptoms in this sample. The same statistical methods used for internal validation of the model were applied for external validation.
2.6 Performance of the risk score model in the mild autism subgroup
We analyzed the performance of the risk score model in the subgroup of children with mild autism to test its robustness. In the present study, participants in the mild autism subgroup were defined as those whose SRS total raw score was less than 65. The SRS is widely used to measure autistic traits in the general population, and it performs extraordinarily well in autism screening (17). However, similar to other parent-report screening tools, the SRS is a subjective rating scale, and its performance in screening is reduced when the child’s social impairment is not prominent or when the rater lacks sufficient awareness of autistic symptoms. Our current predictive model based on prenatal and perinatal risk factors may be robust and more suitable for the above conditions. Therefore, we compared the performance of the risk score model and the SRS among the subgroup of children with mild autism. The analyses were subsequently used to calculate the theoretical sensitivity and specificity of the risk score model combined with the SRS to form a serial screening test or a parallel screening test, which can extend the usage of our risk score model to specific clinical subgroups or conditions.
3 Results
3.1 Characteristics and comparison of selected predictors and participants
As shown in Table 1, the mean age of the participants in the case group was 5.01 years (SD=1.25 years), ranging from 2.33 to 10.38 years. The mean age of the participants in the control group was 4.76 years (SD=1.32 years), ranging from 2.12 to 13.35 years. Significant differences were found in 8 of the 28 candidate predictors after Bonferroni correction for multiple comparisons (details shown in Supplementary Table 2).
Table 1 Characteristics and comparisons of recruited samples.
3.2 Potential risk factors for autism
As shown in Table 2, forward stepwise logistic regression identified five predictors associated with the risk of autism. In addition to the covariates, the logistic model included three predictors from the pregnancy period (influenza-like illness, stress and maternal allergic/autoimmune disease) and two predictors from the perinatal and neonatal periods (cesarean section and hypoxia). These five selected factors explained a fair amount of the variation in ASD risk (the Nagelkerke R2 of the final model was 0.450).
Table 2 Identified risk factors for autism.
3.3 Risk scores for autism prediction
The weighted scores of each identified risk factor are shown in Table 2. The minimum sum score of the scoring system was 0, and the maximum score was 20. In the training set, the sum score ranged from 0 to 20 in the autism group and from 0 to 16 in the control group. Student’s t test revealed a significant difference between the groups (mean ± SD: 5.08 ± 4.39 for the autism group vs. 2.15 ± 2.77 for the control group, t=12.53, p<0.001). The risk score system showed good discrimination for autism, with an AUC of 0.711 (95% CI=0.679-0.744) in the training cohort (Figure 1). The best estimated cutoff score was 3. With this cutoff score, the sensitivity was 0.600, the specificity was 0.732, the NPV was 0.646, and the PPV was 0.691.
Figure 1 ROC curve for clinical score of autism.
3.4 Model validation
We input the 28 candidate risk factors into a CHAID decision tree in the same training cohort for comparison with the logistic model. The logistic regression results revealed that four of the five selected factors (influenza-like illness during pregnancy, hypoxia, maternal allergic/autoimmune disease and stress during pregnancy) were also included in the decision tree model as key factors (Figure 2). The predictive AUC value of the decision tree was 0.670 (95% CI=0.636-0.703).
Figure 2 CHAID decision tree predicting autism diagnosis related factors in training samples. Factor 1= Pregnancy stressor; Factor 2= Pregnancy Influenza-like illness; Factor 3= Hypoxia; Factor 4= Maternal allergic/Auto-immune disease;.
The risk score for the validation cohort was calculated; the mean score of the ASD group was 4.98 ± 4.27, and that of the control group was 2.31 ± 2.84. A significant difference was detected between the groups (t=5.77, p<0.001). The AUC was 0.700 (95% CI: 0.635-0.765). This result was very similar to that of the training cohort. By adapting the same cutoff score, the sensitivity was 0.602, the specificity was 0.691, the NPV was 0.634, and the PPV was 0.661. Comparisons of the predictive performance among the samples are shown in Table 3. The similarity of the results indicates that the risk score system performed well in both the training and internal validation cohorts. Then, we combined the training and internal validation cohorts to calculate the predictive performance for all participants. The AUC was 0.709 (95% CI=0.681-0.738). With respect to the best cutoff score, the sensitivity was 0.600, the specificity was 0.724, the NPV was 0.644, and the PPV was 0.685. The 95% CI of AUC using 1000 bootstrap replicates from the full sample was 0.662-0.715.
Table 3 Comparisons of predictive performance of different samples.
In the independent validation cohort, the mean (SD) scores of the ASD group, TD group, and OND group were 4.55 (3.96), 1.89 (2.14) and 3.21 (2.84), respectively. Post hoc analysis revealed significant differences in the mean scores between the ASD group and the TD group (p<0.001) as well as between the OND group and the TD group (p=0.007). A significant difference was also found in the mean risk score between the ASD and OND groups (p=0.001). The predictive AUC of the independent validation cohort was 0.657 (95% CI=0.618-0.697). With the same cutoff point (3 points), the sensitivity was 0.570, and the specificity was 0.714. Thus, the risk score system did not perform as well as it did in the original training cohort, but its performance was still acceptable. A comparison of the ROC curves of the different cohorts is shown in Supplementary Figure 1.
The calibration plot of different sample set showed good calibration for the prediction model(see Supplementary Figures 2-4).
3.5 Robustness of the risk score model in the mild autism subgroup
Before comparing the diagnostic performance of the risk score model with that of the SRS in the mild subgroup, we first verified the ability of the SRS to distinguish ASD patients from TD children in the whole sample. The results showed that at its best cutoff point, the AUC for the SRS was 0.932 (95% CI: 0.917-0.946), the sensitivity was 0.852, and the specificity was 0.900, which was consistent with previous studies (18). When only children with autism with SRS total raw scores less than 65 were included in the analysis, the AUC, sensitivity and specificity decreased to 0.732, 0.662 and 0.743, respectively. The performance of the risk score model remained stable among the subgroups, and the AUC, sensitivity and specificity were 0.709, 0.574 and 0.731, respectively. The results revealed the robustness of the risk model in children with different clinical conditions. Moreover, theoretically, when the risk score model and the SRS are combined to form a serial screening test, the sensitivity for screening the mild autism subgroups may increase to 0.856; when combined as a parallel screening test, it may increase specificity to 0.928. Taken together, these findings indicate that the combination of the risk score model with the SRS (or other screening tools) may extend its usage and improve screening efficiency in mild autism subgroups.
3.6 Association between risk scores and behavioral problems in children
The parent-completed CBCL was used to assess the behavioral problems of children older than 4 years. We constructed a linear regression model to analyze the association between the risk score and CBCL score, as shown in Supplementary Table 4. The risk score was significantly positively associated with the CBCL total raw score in both groups after adjusting for recruitment age and sex (all p<0.05); thus, a higher risk score was associated with more behavioral problems.
4 Discussion
Using multivariable logistic regression, we found that several environmental risk factors during the pre- and perinatal periods are associated with autism risk. These risk factors include influenza-like illness during pregnancy, stress during pregnancy, maternal allergic/autoimmune disease, cesarean section, and hypoxia. Based on these identified factors, we developed a model for predicting autism risk. We used a CHAID tree as a second statistical tool and an external validation cohort and found that the developed risk score model exhibited satisfactory predictive performance. To our knowledge, this study has the largest sample size among similar studies in the Chinese population and is the first to develop a predictive model based on prenatal and perinatal risk factors.
Associations between the five identified risk factors and autism have been reported by several previous studies, including high-quality meta-analyses and large-sample studies (19–25). However, other studies failed to find significant associations between these factors (26–28). These inconsistencies may be caused by differences in methodology (including the study design, diagnostic criteria, sample size and data sources) rather than differences in pathophysiology mechanisms (29). For example, regarding influenza-like illness during pregnancy, a large population-based cohort study conducted in Denmark compared maternal-reported data and hospital data and revealed that the agreement between maternal-reported infection and hospital-registered infection was good for some specific infections (cystitis, 66%; vaginal yeast infection, 77%), but poor for respiratory infection and influenza (6% and 7%, respectively) (19). This finding suggested that data from medical records may be more precise but less sensitive to subclinical infection and illness for mothers who do not seek medical help (30). In the same study mentioned above, based on self-reported information, the results indicated that influenza-like infection during pregnancy was associated with a twofold increased risk of autism (adjusted hazard ratio [aHR]=2.3, 95% CI=1.0-5.3). In addition to selection bias, there is still no national medical registry system available in China (and thus a lack of complete medical records for all subjects); therefore, we collected data from parental reports only.
One of the barriers in translating environmental risk factors into a predictive model is that any single factor or event has only a limited contribution to the etiology and is unlikely to cause autism in isolation (31). Furthermore, in some of the previous studies, only univariate analyses were performed, and confounders were not properly assessed (29). Several researchers have suggested that many risk factors may be associated with a common pathway (32). We combined a broad, comprehensive survey with multivariable statistical methods, providing an advantage in the exploration of potential “biological interactions” among risk factors and the selection of the strongest factors when developing the prediction model. A subsequent concern may arise that there is overlap among the selected factors in all ONDs. However, we think that the contributions of these factors could vary according to the disorder; even though some factors seem common intuitively, statistical results reveal their specificity for a specific disorder. By combining these factors and considering different weights and their interactions, it was possible to construct a prediction model that met the specificity requirements.
The second strength of our study is that we used independent data (i.e., the external validation cohort) to validate the developed model. The predictive performance in the external validation cohort was slightly worse than that in the original sample, possibly because some items were not well matched. However, similar results were achieved in an independent cohort with a different design and a different source, indicating that the findings are robust and that the simple risk score is valid and has clinical utility. Moreover, the independent cohort included subjects with ONDs, and comparison revealed that the mean score of the ASD group was significantly greater than that of the OND group. Thus, to a certain extent, these results could help to answer some potential questions related to shared risk factors when this model is applied in clinical settings.
The sensitivity and specificity of our model were acceptable but not outstanding; therefore, we do not propose that the current model be used to provide a precise estimate of autism risk in clinical practice. Nevertheless, as there is currently no standardized screening or prediction tool appropriate for use in all children or in children of all ages (and as shown by our analysis), combining the current model with other tests may be a reasonable way to increase the efficiency of ASD screening or distinguish ASD from ONDs. On the other hand, as described in the recommendations for early screening of ASD (11), lack of time, unfamiliarity with screening instruments, or difficulty in scoring among providers are potential barriers to early screening of ASD. Our model uses prenatal and perinatal risk information, which is easy and convenient to collect and may be more suitable for use in economically underdeveloped regions. In addition, when combined with developmental trajectories, the risk score model may help nonspecialist pediatricians or primary care physicians identify the children most in need of routine developmental surveillance.
In addition to clinical applications, the present study and the risk score model may also stimulate research on environmental risk factors in clinical settings. The significant correlation between CBCL and the risk score, reflects more adverse events in prenatal or perinatal period may cause more behaviors problems in offspring (33). Meanwhile, the results also suggests that our risk score may closely align with the underlying physiopathological mechanism, even though it is not currently feasible to directly assess behavioral problems by using the risk score.
However, there are several limitations of our study. First, the sample size was relatively small, especially for some factors with a low incidence, which may have led to insufficient statistical power and relatively less stability by adopting data splitting for internal validation. Hence, a larger sample size is needed in future studies. Second, when collecting the risk factor data, both the testing and validation cohorts were recruited with a retrospective design, which may contribute to the possibility of recall bias (although several previous studies have indicated that parental reports are largely consistent with contemporaneous medical records for some pregnancy events in neurodevelopmental disorder research (34)). Therefore, a study with a prospective design or the use of medical records would help to confirm the findings. Third, we did not perform a detailed characterization of the children with autism. Most notably, we did not measure intelligence quotients; one may expect that pre- or perinatal risk factors are much more common in individuals with moderate to severe intellectual disability. However, this information was not available for the current sample of children with autism; thus, model extrapolation may be impacted. Finally, detailed information about exposure duration and intensity was not available in the study, and exposure duration and intensity may have affected the outcome (35). However, the effects of these variables are uncertain (36). We also think that an overly detailed model may have lower clinical utility.
As the proposed model is not a final model but rather a preliminary framework that can be modified, it can be improved by research with a larger sample size and broader and more detailed information combined with other screening measurements, biomarkers or genotyping data. In conclusion, we developed a clinical predictive model based on five identified prenatal and perinatal risk factors for autism that can effectively predict or screen for autism. The model was validated by the use of a second statistical method and an external independent cohort. This risk score model could lower the age limit for autism prediction and screening to the first month after birth.
Data availability statement
The raw data supporting the conclusions of this article will bemade available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by the Human Ethics Committee of the Second Xiangya Hospital of Central South University. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants’ legal guardians/next of kin.
Author contributions
JO: Formal Analysis, Data curation, Validation, Writing – original draft. HD: Data curation, Formal Analysis, Validation, Writing – original draft. SD: Data curation, Investigation, Writing – review & editing. YH: Data curation, Investigation, Writing – review & editing. YW: Data curation, Investigation, Writing – review & editing. XL: Data curation, Investigation, Writing – review & editing. GX: Data curation, Investigation, Writing – review & editing. KX: Supervision, Writing – review & editing. JZ: Supervision, Writing – review & editing. YS: Conceptualization, Formal Analysis, Methodology, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was supported by the National Natural Science Foundation of China (Grant nos. 81974217, 81901388, 82130043, and 81730036) and the Natural Science Foundation of Hunan Province, China (Grant nos. 2020JJ5830 and 2021SK1010).
Acknowledgments
We thank all the subjects who participated in this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2024.1291356/full#supplementary-material
SUPPLEMENTARY FIGURE 1 | Comparison of ROC curves from different sample sets.
Supplementary Figure 2 | The calibration plot of the training sample set.
Supplementary Figure 3 | The calibration plot of the internal validation sample set.
Supplementary Figure 4 | The calibration plot of the independent sample set.
References
1. Lai MC, Lombardo MV, Baron-Cohen S. Autism. Lancet. (2014) 383:896–910. doi: 10.1016/S0140-6736(13)61539-1
2. Shaw KA, Bilder DA, Mcarthur D, Williams AR, Amoakohene E, Bakian AV, et al. Early identification of autism spectrum disorder among children aged 4 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2020. MMWR Surveill Summ. (2023) 72:1–15. doi: 10.15585/mmwr.ss7201a1
3. Buescher AV, Cidav Z, Knapp M, Mandell DS. Costs of autism spectrum disorders in the United Kingdom and the United States. JAMA Pediatr. (2014) 168:721–8. doi: 10.1001/jamapediatrics.2014.210
4. Zwaigenbaum L, Bauman ML, Choueiri R, Kasari C, Carter A, Granpeesheh D, et al. Early intervention for children with autism spectrum disorder under 3 years of age: recommendations for practice and research. Pediatrics. (2015) 136 Suppl 1:S60–81. doi: 10.1542/peds.2014-3667E
5. Hyman SL, Levy SE, Myers SM. Identification, evaluation, and management of children with autism spectrum disorder. Pediatrics. (2020) 145. doi: 10.1542/peds.2019-3447
6. Zuckerman K, Lindly OJ, Chavez AE. Timeliness of autism spectrum disorder diagnosis and use of services among u.s. Elementary school-aged children. Psychiatr Serv. (2017) 68:33–40. doi: 10.1176/appi.ps.201500549
7. Tick B, Bolton P, Happe F, Rutter M, Rijsdijk F. Heritability of autism spectrum disorders: a meta-analysis of twin studies. J Child Psychol Psychiatry. (2016) 57:585–95. doi: 10.1111/jcpp.12499
8. Krakowiak P, Goines PE, Tancredi DJ, Ashwood P, Hansen RL, Hertz-Picciotto I, et al. Neonatal cytokine profiles associated with autism spectrum disorder. Biol Psychiatry. (2017) 81:442–51. doi: 10.1016/j.biopsych.2015.08.007
9. Shen MD, Nordahl CW, Young GS, Wootton-Gorges SL, Lee A, Liston SE, et al. Early brain enlargement and elevated extra-axial fluid in infants who develop autism spectrum disorder. Brain. (2013) 136:2825–35. doi: 10.1093/brain/awt166
10. Hazlett HC, Gu H, Munsell BC, Kim SH, Styner M, Wolff JJ, et al. Early brain development in infants at high risk for autism spectrum disorder. Nature. (2017) 542:348–51. doi: 10.1038/nature21369
11. Zwaigenbaum L, Bauman ML, Stone WL, Yirmiya N, Estes A, Hansen RL, et al. Early identification of autism spectrum disorder: recommendations for practice and research. Pediatrics. (2015) 136 Suppl 1:S10–40. doi: 10.1542/peds.2014-3667C
12. Pham C, Symeonides C, O’Hely M, Sly PD, Knibbs LD, Thomson S, et al. Early life environmental factors associated with autism spectrum disorder symptoms in children at age 2 years: a birth cohort study. Autism. (2022) 26:1864–81. doi: 10.1177/13623613211068223
13. Kim JY, Son MJ, Son CY, Radua J, Eisenhut M, Gressier F, et al. Environmental risk factors and biomarkers for autism spectrum disorder: an umbrella review of the evidence. Lancet Psychiatry. (2019) 6:590–600. doi: 10.1016/S2215-0366(19)30181-6
14. Modabbernia A, Velthorst E, Reichenberg A. Environmental risk factors for autism: an evidence-based review of systematic reviews and meta-analyses. Mol Autism. (2017) 8:13. doi: 10.1186/s13229-017-0121-4
15. Shrive FM, Stuart H, Quan H, Ghali WA. Dealing with missing data in a multi-question depression scale: a comparison of imputation methods. BMC Med Res Methodol. (2006) 6:57. doi: 10.1186/1471-2288-6-57
16. Kat S, Xu L, Guo Y, Ma J, Ma Z, Tang X, et al. Reliability and validity of the simplified chinese version of the aberrant behavior checklist in chinese autism population. Front Psychiatry. (2020) 11:545445. doi: 10.3389/fpsyt.2020.545445
17. Moody EJ, Reyes N, Ledbetter C, Wiggins L, Diguiseppi C, Alexander A, et al. Screening for autism with the srs and scq: variations across demographic, developmental and behavioral factors in preschool children. J Autism Dev Disord. (2017) 47:3550–61. doi: 10.1007/s10803-017-3255-5
18. Cen CQ, Liang YY, Chen QR, Chen KY, Deng HZ, Chen BY, et al. Investigating the validation of the chinese mandarin version of the social responsiveness scale in a mainland China child population. BMC Psychiatry. (2017) 17:51. doi: 10.1186/s12888-016-1185-y
19. Atladottir HO, Henriksen TB, Schendel DE, Parner ET. Autism after infection, febrile episodes, and antibiotic use during pregnancy: an exploratory study. Pediatrics. (2012) 130:e1447-54. doi: 10.1542/peds.2012-1107
20. Croen LA, Grether JK, Yoshida CK, Odouli R, Van de Water J. Maternal autoimmune diseases, asthma and allergies, and childhood autism spectrum disorders: a case-control study. Arch Pediatr Adolesc Med. (2005) 159:151–7. doi: 10.1001/archpedi.159.2.151
21. Keil A, Daniels JL, Forssen U, Hultman C, Cnattingius S, Soderberg KC, et al. Parental autoimmune diseases associated with autism spectrum disorders in offspring. Epidemiology. (2010) 21:805–8. doi: 10.1097/EDE.0b013e3181f26e3f
22. Duan G, Yao M, Ma Y, Zhang W. Perinatal and background risk factors for childhood autism in central China. Psychiatry Res. (2014) 220:410–7. doi: 10.1016/j.psychres.2014.05.057
23. Ronald A, Pennell CE, Whitehouse AJ. Prenatal maternal stress associated with adhd and autistic traits in early childhood. Front Psychol. (2010) 1:223. doi: 10.3389/fpsyg.2010.00223
24. Rai D, Lee BK, Dalman C, Golding J, Lewis G, Magnusson C. Parental depression, maternal antidepressant use during pregnancy, and risk of autism spectrum disorders: population based case-control study. BMJ. (2013) 346:f2059. doi: 10.1136/bmj.f2059
25. Curran EA, O’Neill SM, Cryan JF, Kenny LC, Dinan TG, Khashan AS, et al. Research review: birth by caesarean section and development of autism spectrum disorder and attention-deficit/hyperactivity disorder: a systematic review and meta-analysis. J Child Psychol Psychiatry. (2015) 56:500–8. doi: 10.1111/jcpp.12351
26. Sujan AC, Rickert ME, Oberg AS, Quinn PD, Hernandez-Diaz S, Almqvist C, et al. Associations of maternal antidepressant use during the first trimester of pregnancy with preterm birth, small for gestational age, autism spectrum disorder, and attention-deficit/hyperactivity disorder in offspring. JAMA. (2017) 317:1553–62. doi: 10.1001/jama.2017.3413
27. Zerbo O, Iosif AM, Walker C, Ozonoff S, Hansen RL, Hertz-Picciotto I. Is maternal influenza or fever during pregnancy associated with autism or developmental delays? Results from the charge (childhood autism risks from genetics and environment) study. J Autism Dev Disord. (2013) 43:25–33. doi: 10.1007/s10803-012-1540-x
28. Isaksson J, Pettersson E, Kostrzewa E, Diaz HR, Bolte S. Brief report: association between autism spectrum disorder, gastrointestinal problems and perinatal risk factors within sibling pairs. J Autism Dev Disord. (2017) 47:2621–7. doi: 10.1007/s10803-017-3169-2
29. Gardener H, Spiegelman D, Buka SL. Perinatal and neonatal risk factors for autism: a comprehensive meta-analysis. Pediatrics. (2011) 128:344–55. doi: 10.1542/peds.2010-1036
30. Zerbo O, Qian Y, Yoshida C, Fireman BH, Klein NP, Croen LA. Association between influenza infection and vaccination during pregnancy and risk of autism spectrum disorder. JAMA Pediatr. (2017) 171:e163609. doi: 10.1001/jamapediatrics.2016.3609
31. Glasson EJ, Bower C, Petterson B, de Klerk N, Chaney G, Hallmayer JF. Perinatal factors and the development of autism: a population study. Arch Gen Psychiatry. (2004) 61:618–27. doi: 10.1001/archpsyc.61.6.618
32. Grabrucker AM. Environmental factors in autism. Front Psychiatry. (2012) 3:118. doi: 10.3389/fpsyt.2012.00118
33. Roffman JL, Sipahi ED, Dowling KF, Hughes DE, Hopkinson CE, Lee H, et al. Association of adverse prenatal exposure burden with child psychopathology in the adolescent brain cognitive development (abcd) study. PloS One. (2021) 16:e250235. doi: 10.1371/journal.pone.0250235
34. Walshe M, Mcdonald C, Boydell J, Zhao JH, Kravariti E, Touloupoulou T, et al. Long-term maternal recall of obstetric complications in schizophrenia research. Psychiatry Res. (2011) 187:335–40. doi: 10.1016/j.psychres.2011.01.013
35. Atladottir HO, Thorsen P, Ostergaard L, Schendel DE, Lemcke S, Abdallah M, et al. Maternal infection requiring hospitalization during pregnancy and autism spectrum disorders. J Autism Dev Disord. (2010) 40:1423–30. doi: 10.1007/s10803-010-1006-y
Keywords: autism spectrum disorder, risk factor, prediction, clinical screening, maternal environment
Citation: Ou J, Dong H, Dai S, Hou Y, Wang Y, Lu X, Xun G, Xia K, Zhao J and Shen Y (2024) Development and validation of a risk score model for predicting autism based on pre- and perinatal factors. Front. Psychiatry 15:1291356. doi: 10.3389/fpsyt.2024.1291356
Received: 13 September 2023; Accepted: 30 January 2024;
Published: 16 February 2024.
Edited by:
Victorio Bambini-Junior, Lancaster University, United KingdomReviewed by:
Amy Shui, University of California, San Francisco, United StatesXuping Gao, Peking University Sixth Hospital, China
Copyright © 2024 Ou, Dong, Dai, Hou, Wang, Lu, Xun, Xia, Zhao and Shen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yidong Shen, shenyidong87@csu.edu.cn