Identification of Diagnostic Schizophrenia Biomarkers Based on the Assessment of Immune and Systemic Inflammation Parameters Using Machine Learning Modeling
Disorders of systemic immunity and immune processes in the brain have now been shown to play an essential role in the development and progression of schizophrenia. Nevertheless, only a few works were devoted to the study of some immune parameters to objectify the diagnosis by means of machine learning. At the same time, machine learning methods have not yet been applied to a set of data fully reflecting systemic characteristics of the immune status (parameters of adaptive immunity, the level of inflammatory markers, the content of major cytokines). Considering a complex nature of immune system disorders in schizophrenia, incorporation of a broad panel of immunological data into machine learning models is promising for improving classification accuracy and identifying the parameters reflecting the immune disorders typical for the majority of patients.
The aim of the study is to assess the possibility of using immunological parameters to objectify the diagnosis of schizophrenia applying machine learning models.
Materials and Methods. We have analyzed 17 immunological parameters in 63 schizophrenia patients and 36 healthy volunteers. The parameters of humoral immunity, systemic level of the key cytokines of adaptive immunity, anti-inflammatory and pro-inflammatory cytokines, and other inflammatory markers were determined by enzyme immunoassay. Applied methods of machine learning covered the main group of approaches to supervised learning such as linear models (logistic regression), quadratic discriminant analysis (QDA), support vector machine (linear SVM, RBF SVM), k-nearest neighbors algorithm, Gaussian processes, naive Bayes classifier, decision trees, and ensemble models (AdaBoost, random forest, XGBoost). The importance of features for prediction from the best fold has been analyzed for the machine learning methods, which demonstrated the best quality. The most significant features were selected using 70% quantile threshold.
Results. The AdaBoost ensemble model with ROC AUC of 0.71±0.15 and average accuracy (ACC) of 0.78±0.11 has demonstrated the best quality on a 10-fold cross validation test sample. Within the frameworks of the present investigation, the AdaBoost model has shown a good quality of classification between the patients with schizophrenia and healthy volunteers (ROC AUC over 0.70) at a high stability of the results (σ less than 0.2). The most important immunological parameters have been established for differentiation between the patients and healthy volunteers: the level of some systemic inflammatory markers, activation of humoral immunity, pro-inflammatory cytokines, immunoregulatory cytokines and proteins, Th1 and Th2 immunity cytokines. It was for the first time that the possibility of differentiating schizophrenia patients from healthy volunteers was shown with the accuracy of more than 70% with the help of machine learning using only immune parameters.
The results of this investigation confirm a high importance of the immune system in the pathogenesis of schizophrenia.
Introduction
Schizophrenia is a severe chronic psychiatric disease with cognitive function impairment, emotional and psychomotor disorders [1]. A high rate of disability and reduced life longevity is often observed in schizophrenia [2]. Early diagnosis and timely administered therapy are necessary to reduce the risk of unfavorable course of the disease. An important direction of researches aimed to improve schizophrenia diagnosing is the development of approaches to the objectification of the diagnosis using machine learning (ML) models based on the clinically significant biomarkers [3, 4]. In clinical practice, biomarkers are important for determining several factors: diagnosis clarification, verification of the disease stage, selection of the optimal treatment plan, long-term prognosis of the disease. However, the clinical significance (determined by sensitivity, specificity, prognostic value, etc.) has not been established at the relevant levels of evidence for the majority of the presently found schizophrenia biomarkers, and therefore, no provision is made for the application of biomarkers in the existing clinical recommendations [5].
A large volume, high dimensionality, and heterogeneity of multimodal laboratory data make it difficult to integrate all available modalities within the framework of a single study, therefore, interest is growing among the clinicians in the current approaches to the integration of heterogeneous data, ML and deep learning (DL) methods [6].
Presently, it has been proved that systemic immunity disorders and immune processes in the central nervous system (CNS) play an essential role in the development and progression of schizophrenia [7–9]. Nevertheless, there are a few works devoted to the study of some immunity parameters for objectifying the diagnosis of schizophrenia with ML methods [10]. Besides, the ML methods have not yet been applied to the datasets fully reflecting systemic characteristics of immune status (parameters of adaptive immunity, the level of inflammatory markers, content of major cytokines) [11–13]. Taking into consideration a complex character of immune system disorders in schizophrenia, inclusion into ML a broad panel of immunological data is a promising task for improving classification accuracy and selecting the variable parameters typical for the majority of patients. From the practical point of view, the results of data analysis by ML method may be used for the development of a new panel of markers having a diagnostic/prognostic value and become a basis for creating a prototype of a clinical decision support system using the selected features.
The aim of the study is to assess the possibility of using immunological parameters to objectify the diagnosis of schizophrenia applying machine learning models.
Materials and Methods
The clinical data presented in the given work are part of the research program “Molecular and neurophysiological markers of endogenous diseases” carried out at the N.A. Alekseyev Psychiatric Clinical Hospital No.1 of the Moscow Health Department (Russia) and approved by the Independent Interdisciplinary Committee on the ethical expertise of clinical researches (Protocol No.12 of July 14, 2017). Some results of this project have been published previously [14–16].
Patients. The study included 63 patients (36 men and 27 women, average age 29±3 years) hospitalized at the N.A. Alekseyev Psychiatric Clinical Hospital No.1 with the diagnosis of schizophrenia spectrum disorders (F20 and F25 according to ICD-10). All participants gave written informed consent after a full description of the investigation procedures in compliance with the Declaration of Helsinki.
Patients were selected according to the following inclusion criteria: patient’s state must meet the criteria of schizophrenia presented in ICD-10 and DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, fifth edition); insight into the ill condition; preserving the memory of psychotic symptoms; informed consent for participation in the study.
Exclusion criteria were as follows: schizoaffective and affective disorders; organic brain diseases; severe somatic and/or neurological conditions potentially affecting physiology or structure of the brain; signs of psychoactive substance abuse; acute chronic somatic and infectious inflammatory diseases or their exacerbation.
The control group consisted of 36 unrelated volunteers comparable in age and gender with the patients (21 men and 15 women, average age — 30±2 years). The volunteers and patients with schizophrenia were examined according to the same protocol.
Study design: cross-sectional, observational, case–control. Patients’ condition was diagnosed for two days. Before biomaterial collection, a clinical picture of psychosis was determined and objective information was clarified (from relatives or medical cards). The day prior to biomaterial collection, the condition was psychometrically assessed using the positive and negative syndrome scale for schizophrenia (PANSS) [17] (Table 1). Clinical investigation was performed by two experienced psychiatrists who collected all necessary data: questioning the relatives, analysis of medical cards, results of physical and laboratory tests, etc. The mental state at the time of scanning was characterized by criticism towards the previous psychosis and preserved memory with the ability to present subjective history of disease development (with a detailed content of delusion and assessment of affective condition in that period).
Table 1. Characteristics of patients with schizophrenia (n=63) |
Immunological investigations. Seventeen immunological indicators have been analyzed. They included parameters of humoral immunity (IgA, IgM, and IgG); systemic level of the key pro-inflammatory and anti-inflammatory cytokines, and other inflammatory markers (C-reactive protein (CRP), cortisol, circulating immune complexes (CIC)), brain-derived neurotrophic factor (BDNF) identified by enzyme immunoassay using reagent kits manufactured by CHEMA LLC (Russia), Cytokine LLC (Russia), R&D Systems (USA).
Statistical data processing. The results were statistically processed using Python 3.9.0 software (Python Software Foundation) in the form of NumPy, Pandas, SkLearn libraries, which are used in ML.
In the present study, quantitative continuous variables have been analyzed. The analysis of variables in dynamics was not performed since the study was cross-sectional. Two independent samples were examined: patients with schizophrenia and healthy volunteers.
As part of the initial data analysis, the distribution normality was determined using Shapiro–Wilk test. Clinical data were presented in the form of means with a standard deviation (M±σ), immunological parameters as medians and 25th and 75th percentiles (Me [25; 75]).
Such metrics as accuracy (ACC) and area under the ROC curve (ROC AUC) were used to evaluate the quality of classification. Accuracy measures the proportion of correctly predicted values in relation to the total number of responses, and it is higher for the models giving more correct prognoses. However, for the datasets with heterogeneous class representation, accuracy may be non-optimal metrics. ROC AUC measures an area under the ROC curve reflecting the ability of the model to discriminate objects belonging to two classes at different classification thresholds. ROC AUC values lie in the range from 1 to 0, the higher value indicating the better model performance. Since the number of patients with schizophrenia and healthy volunteers was different, ROC AUC was used as the main metric of model quality in the present study. A threshold level of ROC AUC was 0.70, which means a good classification quality.
To assess the stability of the obtained models for each of the ACC and ROC AUC metrics in all folds, a standard deviation (σ) was calculated. A lower value of σ denoted a more stable model work, with σ less than 0.2 being considered small, and from 0.2 to 0.5 moderate. Within the frameworks of this study, models having σ for ACC and ROC AUC less than 0.2 were considered stable.
Machine learning methods. The ML methods applied covered the main groups of approaches to a supervised learning such as linear models (logistic regression), quadratic discriminant analysis (QDA), support vector machine (linear SVM, RBF SVM), k-nearest neighbors algorithm, Gaussian processes, naive Bayes classifier, decision trees, and ensemble models (AdaBoost, random forest, XGBoost). These methods comprise a wide spectrum of approaches in ML, each having its strong points. Consideration of various approach groups allowed us to establish, which of them copes best with the given task. Speaking on the family of the ensemble approaches in more detail, it should be noted that they are based on the idea of combining several classifiers in a single strong one. For example, each weak classifier in AdaBoost (adaptive boosting) may be any learning algorithm (taking the values of negative and positive weights). At each learning iteration, AdaBoost increases the weights of the incorrectly classified samples in order to focus the next classifier on those samples where the previous classifiers have made mistakes. After training, all weak classifiers are integrated using weighted voting, where each classifier is assigned a weight based on its accuracy during classification, which makes it possible to obtain a strong classifier representing an ensemble of weak classifiers. When a final strong classifier is used for categorization of new samples, it takes into account the vote of all weak classifiers according to their weights, achieving thereby a more accurate and stable classification.
For each ML model, it is possible to evaluate relevance or contribution of various features in relation to prediction, i.e. to assess qualitatively the feature importance in the process of decision-making by the model. Feature importance may be computed by different methods such as replacement importance, Gini impurity importance, or importance coefficient value, which allows for determining the effect of each separate variable on the predicted variable and assessing its role in modeling. The result of calculating the importance coefficients may be presented as a table, enabling one to analyze the significance of each variable for modeling. Higher values indicate greater importance. Although feature importance may give knowledge on the relative contribution of each, this parameter should be interpreted with caution. It is not always implying cause-and-effect relations or direct relations between the features. Moreover, the interpretation of function importance depends on the specific model and context, and it should not be considered along with other assessment measures and knowledge in the subject area for comprehensive understanding. Thus, using the parameter of function importance, it is possible to evaluate function relevance in the ML model. This parameter provides interpretability, although it should be used as part of a wider analysis rather than a single basis for making conclusions.
The training process and model quality assessment were performed using a 10-fold StratifiedKFold cross-validation. As a result, 10 models for each ML method have been created, the quality of each model was determined on a test sample (20% of data). In this way, we obtained a sample of ten values for each quality metric for the selected set of hyperparameters. Next, a mean and standard deviation were found for each quality metric. For ML methods, which demonstrated the best quality, feature importance was analyzed for the prediction obtained from the best fold. The most significant features fitting the 70% quantile threshold were selected.
Results
During the experiments, it has been found that the best quality in the test sample on the 10 folds was demonstrated by the ensemble AdaBoost model with the area under the ROC curve of 0.71±0.15 and an average accuracy (ACC) of 0.78±0.11. Within the scope of this study, the AdaBoost model showed a good quality of classification between the patients with schizophrenia and healthy volunteers (ROC AUC more than 0.70) at a high stability of the results (σ less than 0.2) (Table 2).
Table 2. Results of objectifying the diagnosis of schizophrenia using machine learning models |
The results of the feature analysis are represented in Table 3 in order of importance for the quality of classification using the AdaBoost model.
Table 3. Feature importance ranking for the AdaBoost model with a 70% quantile threshold — 0.084 |
Table 4 shows feature importance ranking using XGBoost classifier, having the second values of ROC AUC and ACC, high or moderate stability of the classification results (ROC AUC — 0.68±0.21; ACC — 0.75±0.19).
Table 4. Feature importance ranking for the XGBoost classifier model with a 70% quantile threshold — 0.081 |
To make the obtained data more clear, we also presented feature importance ranking using logistic regression classification model, which is more simple and illustrative relative to the AdaBoost and XGBoost classifiers and has the third-largest value of ROC AUC with high or moderate stability of the results (ROC AUC — 0.62±0.21, ACC — 0.70±0.16) (see Table 2; Table 5).
Table 5. Feature importance ranking for the logistic regression model with 70% quantile threshold — 0.303 |
Thus, ranking by the importances of features relevant for the three models with the greatest predictive power allowed us to establish parameters which were most significant for discrimination between the patients with schizophrenia and healthy volunteers.
Discussion
As a result of our investigation, it was shown for the first time that it is possible to diagnose schizophrenia with the accuracy greater than 70% using machine learning models built only on a set of indicators of immune system condition. The given level of diagnostic accuracy was achieved despite the fact that at this stage we did not intend to include the results of clinical examination into the machine learning models, in contrast to the work [10], where both separate immunological data and the results of neuropsychological testing were used.
The study has revealed for the first time a complex of parameters of natural and adaptive immunity which are most important for classification of patients and individuals without psychiatric diseases: the level of some markers of systemic inflammation and activation of humoral immunity (CRP, cortisol, CIC), pro-inflammatory cytokines (IL-1β, IL-8, TNF-α), immunoregulatory proteins (IL-1RA), Th1 immunity cytokines (IFN-γ), Th2 cytokines (IL-4), and immunoregulatory cytokines (IL-10).
An important role of systemic inflammation parameters and the level of pro-inflammatory cytokines is worth mentioning. The literature and our data confirm the fact that patients with schizophrenia show the signs of systemic inflammation, which are most intensive in the first episode of the disease and in exacerbations. In disease exacerbation, the levels of pro-inflammatory cytokines IL-8, TNF-α, and CRP, an acute-phase protein, increase [18–20]. A high CRP level has been also shown to be associated with a more severe course of psychosis in schizophrenia and subsequent cognitive function decline [18, 21]. A definite level of immunoinflammatory activation, according to our data, remains also in the period of medically induced remission. However, application of ML methods has not yet been studied for verification of schizophrenia diagnosis by assessing the level of systemic inflammation markers [11, 12]. At the same time, there are several investigations, in which interconnections have been established between the level of some markers of systemic inflammation and clinical characteristics of schizophrenia including the intensity of cognitive function impairment (TNF-α, IL-2, IL-6, IL-8, cortisol), neurocognitive defect (IL-1β, sIL-1RA, TNF-α), acute or chronic course of the disease (TNF-α, IL-2, IL-6, IL-8, cortisol) [22, 23].
Cytokines of innate immunity, IL-1β, IL-8, TNF-α, play an important role in triggering and maintaining the systemic inflammatory response, pyrogenic reactions, and functions of adaptive immunity [24]. The elevation of their level in the CNS, which may be observed, for example, in neuroinfections, autoimmune diseases, mental diseases, causes a damaging effect on neurons and glial cells, facilitates neurodegeneration (see, for example, review [25]). According to the data of the meta-analysis [18], the level of IL-6, TNF-α cytokines, and the receptor antagonist IL-1RA is increased in acute schizophrenia. The levels of IL-1β and IL-6 are also elevated in chronic schizophrenia, as shown in the same meta-analysis. According to our data, the increased IL-8 level is noted in patients with schizophrenia irrespective of the intensity of clinical symptoms [26].
IFN-γ is an important cytokine activating functions of CD3+CD4+ T helpers type 1, CD3+CD8+ cytotoxic T cells, and CD3–CD16+CD56+ NK cells, which provide antiviral defense, and stimulating presentation of antigens to lymphocytes by the cells of the innate immunity. In inflammatory conditions, IFN-γ is actively produced by T lymphocytes and NK cells. Our results and the literature data show that its content increases in schizophrenia reflecting complex activation of mechanisms of adaptive and innate immunity in patients [26, 27]. In the frameworks of this study, IFN-γ has been shown to be one of the most significant indicators for confirming the diagnosis of schizophrenia with the help of machine learning models.
Immunological parameters reflecting activation of Th2 cytokines and immunoregulatory mechanisms such as the level of IL-4 cytokine, IL-1RA immunoregulatory protein, and CIC are also referred to the number of diagnostically significant markers identified in our investigation. According to the literature data, activation of the innate (natural) immunity response in patients with schizophrenia is followed by the activation of Th2 cells of adaptive immunity. The signs of activation of Th2 immune response in schizophrenia include the increase of the IL-4 and IL-10 levels in blood serum, decrease of Th1/Th2 cytokine level ratio (IFN-γ/IL-4, IFN-γ/IL-10, IL-2/IL-4, TNF-α/IL-4) [28]. De Campos-Carli et al. [29] have detected association between the intensity of cognitive disorders and elevated levels of Th2 cytokine IL-33 in the patients’ blood [29]. Activation of Th2 response in patients with schizophrenia may participate in the impairment of neurotransmitter exchange in the CNS involved in the pathogenesis of the negative symptoms in schizophrenia [30]. Previously, we have established for the first time that the immunological profile, which is characterized by the increase of IL-10 content and moderate signs of systemic inflammation, is associated with marked negative symptoms in patients with schizophrenia [26].
Thus, the revealed complex of immunological indicators (IL-8, CIC, IL-4, IFN-γ, TNF-α, cortisol) is significant for diagnosing schizophrenia. It should be noted that these parameters are associated with important clinical characteristics of the disease. The literature data indicate their participation in the schizophrenia pathogenesis.
Identification of these immunoinflammatory biomarkers suggests less time, economic, and organizational expenses than neuroimaging and spinal fluid examination. Our study has shown that the application of immunological parameters in clinical practice is a promising area for objectifying the diagnosis of schizophrenia.
Conclusion
The results of this study have shown for the first time that machine learning methods and the assessment of only the parameters of systemic inflammation, innate and adaptive immunity provide the possibility to validate the diagnosis of schizophrenia with the accuracy greater than 70%. Our results confirm the pathogenetic significance of immune system state and immunoinflammatory syndrome in schizophrenia.
At the next stage of the research, we are going to analyze a wide spectrum of immunological parameters as part of multimodal data using machine learning methods in order to create interpretable models which might be used to detect clinical and immunological variants of psychoses.
Study funding. The work was carried out within the state assignment of NRC “Kurchatov Institute” and partly supported by the grant of the Russian Science Foundation No.21-71-10136, https://rscf.ru/project/21-71-10136/.
Conflicts of interest. The authors have no conflicts of interest to declare.
References
- Jääskeläinen E., Juola P., Hirvonen N., McGrath J.J., Saha S., Isohanni M., Veijola J., Miettunen J. A systematic review and meta-analysis of recovery in schizophrenia. Schizophr Bull 2013; 39(6): 1296–1306, https://doi.org/10.1093/schbul/sbs130.
- Nordentoft M., Wahlbeck K., Hällgren J., Westman J., Osby U., Alinaghizadeh H., Gissler M., Laursen T.M. Excess mortality, causes of death and life expectancy in 270,770 patients with recent onset of mental disorders in Denmark, Finland and Sweden. PLoS One 2013; 8(1): e55176, https://doi.org/10.1371/journal.pone.0055176.
- Correll C.U., Galling B., Pawar A., Krivko A., Bonetto C., Ruggeri M., Craig T.J., Nordentoft M., Srihari V.H., Guloksuz S., Hui C.L.M., Chen E.Y.H., Valencia M., Juarez F., Robinson D.G., Schooler N.R., Brunette M.F., Mueser K.T., Rosenheck R.A., Marcy P., Addington J., Estroff S.E., Robinson J., Penn D., Severe J.B., Kane J.M. Comparison of early intervention services vs treatment as usual for early-phase psychosis: a systematic review, meta-analysis, and meta-regression. JAMA Psychiatry 2018; 75(6): 555–565, https://doi.org/10.1001/jamapsychiatry.2018.0623.
- Ferrara M., Guloksuz S., Mathis W.S., Li F., Lin I.H., Syed S., Gallagher K., Shah J., Kline E., Tek C., Keshavan M., Srihari V.H. First help-seeking attempt before and after psychosis onset: measures of delay and aversive pathways to care. Soc Psychiatry Psychiatr Epidemiol 2021; 56(8): 1359–1369, https://doi.org/10.1007/s00127-021-02090-0.
- Mirzakhanian H., Singh F., Cadenhead K.S. Biomarkers in psychosis: an approach to early identification and individualized treatment. Biomark Med 2014; 8(1): 51–57, https://doi.org/10.2217/bmm.13.134.
- Ellis J.K., Walker E.F., Goldsmith D.R. Selective review of neuroimaging findings in youth at clinical high risk for psychosis: on the path to biomarkers for conversion. Front Psychiatry 2020; 11: 567534, https://doi.org/10.3389/fpsyt.2020.567534.
- van Mierlo H.C., Schot A., Boks M.P.M., de Witte L.D. The association between schizophrenia and the immune system: review of the evidence from unbiased ‘omic-studies’. Schizophr Res 2020; 217: 114–123, https://doi.org/10.1016/j.schres.2019.05.028.
- Birnbaum R., Weinberger D.R. A genetics perspective on the role of the (neuro)immune system in schizophrenia. Schizophr Res 2020; 217: 105–113, https://doi.org/10.1016/j.schres.2019.02.005.
- Sun H.L., Bai W., Li X.H., Huang H., Cui X.L., Cheung T., Su Z.H., Yuan Z., Ng C.H., Xiang Y.T. Schizophrenia and inflammation research: a bibliometric analysis. Front Immunol 2022; 13: 907851, https://doi.org/10.3389/fimmu.2022.907851.
- Fernandes B.S., Karmakar C., Tamouza R., Tran T., Yearwood J., Hamdani N., Laouamri H., Richard J.R., Yolken R., Berk M., Venkatesh S., Leboyer M. Precision psychiatry with immunological and cognitive biomarkers: a multi-domain prediction for the diagnosis of bipolar disorder or schizophrenia using machine learning. Transl Psychiatry 2020; 10(1): 162, https://doi.org/10.1038/s41398-020-0836-4.
- Ferrara M., Franchini G., Funaro M., Cutroni M., Valier B., Toffanin T., Palagini L., Zerbinati L., Folesani F., Murri M.B., Caruso R., Grassi L. Machine learning and non-affective psychosis: identification, differential diagnosis, and treatment. Curr Psychiatry Rep 2022; 24(12): 925–936, https://doi.org/10.1007/s11920-022-01399-0.
- Sharaev M.G., Malashenkova I.K., Maslennikova A.V., Zakharova N.V., Bernstein A.V., Burnaev E.V., Mamedova G.S., Krynskiy S.A., Ogurtsov D.P., Kondrateva E.A., Druzhinina P.V., Zubrikhina M.O., Arkhipov A.Yu., Strelets V.B., Ushakov V.L. Diagnosis of schizophrenia based on the data of various modalities: biomarkers and machine learning techniques (review). Sovremennye tehnologii v medicine 2022; 14(5): 53, https://doi.org/10.17691/stm2022.14.5.06.
- Malashenkova I.K., Krynskiy S.A., Ogurtsov D.P., Mamoshina M.V., Zakharova N.V., Ushakov V.L., Velichkovsky B.M., Didkovsky N.A. A role of the immune system in the pathogenesis of schizophrenia. Zhurnal nevrologii i psihiatrii im. S.S. Korsakova 2018; 118(12): 72–80, https://doi.org/10.17116/jnevro201811812172.
- Corponi F., Zorkina Y., Stahl D., Murru A., Vieta E., Serretti A., Morozova A., Reznik A., Kostyuk G., Chekhonin V.P. Frontal lobes dysfunction across clinical clusters of acute schizophrenia. Rev Psiquiatr Salud Ment 2021, https://doi.org/10.1016/j.rpsm.2021.12.002.
- Morozova A., Zorkina Y., Abramova O., Pavlova O., Pavlov K., Soloveva K., Volkova M., Alekseeva P., Andryshchenko A., Kostyuk G., Gurina O., Chekhonin V. Neurobiological highlights of cognitive impairment in psychiatric disorders. Int J Mol Sci 2022; 23(3): 1217, https://doi.org/10.3390/ijms23031217.
- Kartashov S.I., Vartanov A.V., Zakharova N.V., Arkhipov A.Yu., Strelets V.B., Maslennikova A.V., Ushakov V.L. Tractographic studies in the human brain at the norm and the paranoid schizophrenia. Procedia Comput Sci 2021; 190: 434–438, https://doi.org/10.1016/j.procs.2021.06.051.
- Kay S.R., Fiszbein A., Opler L.A. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13(2): 261–276, https://doi.org/10.1093/schbul/13.2.261.
- Goldsmith D.R., Rapaport M.H., Miller B.J. A meta-analysis of blood cytokine network alterations in psychiatric patients: comparisons between schizophrenia, bipolar disorder and depression. Mol Psychiatry 2016; 21(12): 1696–1709, https://doi.org/10.1038/mp.2016.3.
- Malashenkova I.K., Krynskiy S.A., Ogurtsov D.P., Hailov N.A., Zakharova N.V., Bravve L.V., Kaydan M.A., Chekulaeva E.I., Andreyuk D.S., Ushakov V.L., Didkovsky N.A., Kostyuk G.P. Immunoinflammatory profile in patients with episodic and continuous paranoid schizophrenia. Consortium Psychiatricum 2021; 2(1): 19–31, https://doi.org/10.17816/cp66.
- Ushakov V.L., Malashenkova I.K., Kostyuk G.P., Zakharova N.V., Krynskiy S.A., Kartashov S.I., Ogurtsov D.P., Bravve L.V., Kaydan M.A., Hailov N.A., Chekulaeva E.I., Didkovsky N.A. The relationship between inflammation, cognitive impairments, and neuroimaging data in schizophrenia. Neurosci Behav Physiol 2021; 51(7): 873–881.
- Johnsen E., Fathian F., Kroken R.A., Steen V.M., Jørgensen H.A., Gjestad R., Løberg E.M. The serum level of C-reactive protein (CRP) is associated with cognitive performance in acute phase psychosis. BMC Psychiatry 2016; 16: 60, https://doi.org/10.1186/s12888-016-0769-x.
- Zhang Q., He H., Cao B., Gao R., Jiang L., Zhang X., Dai J. Analysis of cognitive impairment in schizophrenia based on machine learning: Interaction between psychological stress and immune system. Neurosci Lett 2021; 760: 136084, https://doi.org/10.1016/j.neulet.2021.136084.
- Al-Hakeim H.K., Almulla A.F., Al-Dujaili A.H., Maes M. Construction of a neuro-immune-cognitive pathway-phenotype underpinning the phenome of deficit schizophrenia. Curr Top Med Chem 2020; 20(9): 747–758, https://doi.org/10.2174/1568026620666200128143948.
- Tanaka T., Narazaki M., Kishimoto T. IL-6 in inflammation, immunity, and disease. Cold Spring Harb Perspect Biol 2014; 6(10): a016295, https://doi.org/10.1101/cshperspect.a016295.
- Malashenkova I.K., Krynskiy S.A., Khailov N.A., Kazanova G.V., Velichkovsky B.B., Didkovsky N.A. The role of cytokines in memory consolidation. Uspekhi sovremennoi biologii 2015; 135(5): 419–436.
- Malashenkova I.K., Ushakov V.L., Zakharova N.V., Krynskiy S.A., Ogurtsov D.P., Hailov N.A., Chekulaeva E.I., Ratushnyy A.Y., Kartashov S.I., Kostyuk G.P., Didkovsky N.A. Neuro-immune aspects of schizophrenia with severe negative symptoms: new diagnostic markers of disease phenotype. Sovremennye tehnologii v medicine 2021; 13(6): 24, https://doi.org/10.17691/stm2021.13.6.03.
- Momtazmanesh S., Zare-Shahabadi A., Rezaei N. Cytokine alterations in schizophrenia: an updated review. Front Psychiatry 2019; 10: 892, https://doi.org/10.3389/fpsyt.2019.00892.
- Chiang S.S.W., Riedel M., Schwarz M., Mueller N. Is T-helper type 2 shift schizophrenia-specific? Primary results from a comparison of related psychiatric disorders and healthy controls. Psychiatry Clin Neurosci 2013; 67(4): 228–236, https://doi.org/10.1111/pcn.12040.
- de Campos-Carli S.M., Miranda A.S., Dias I.C., de Oliveira A., Cruz B.F., Vieira É.L., Rocha N.P., Barbosa I.G., Salgado J.V., Teixeira A.L. Serum levels of interleukin-33 and its soluble form receptor (sST2) are associated with cognitive performance in patients with schizophrenia. Compr Psychiatry 2017; 74: 96–101, https://doi.org/10.1016/j.comppsych.2017.01.008.
- Musso T., Gusella G.L., Brooks A., Longo D.L., Varesio L. Interleukin-4 inhibits indoleamine 2,3-dioxygenase expression in human monocytes. Blood 1994; 83(5): 1408–1411, https://doi.org/10.1182/blood.V83.5.1408.1408.