Preprint
Article

Reliability and Validity of the Polish Version of the Schema Mode Inventory (SMI)

Altmetrics

Downloads

134

Views

29

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

24 July 2023

Posted:

26 July 2023

You are already at the latest version

Alerts
Abstract
(1) Background: The study presents an assessment of the psychometric properties of the Polish version the Short Schema Mode Inventory (SMI) adaptation. (2) Methods: First, the original version of the scale was translated. Subsequently, a validity and reliability study was conducted on a sample of 240 patients and 400 non-patients. In particular: the factor structure of the inventory was checked, internal reliability and intercorrelations between subscales were tested, differences between the clinical and non-clinical groups in terms of the severity of each factor were examined, and construct validity was assessed by comparing the association of results with external variables. (3) Results: The results did not conclusively confirm the 14-factor structure postulated in the original scale. Nevertheless, relatively the best fit indices were obtained for such a model. Internal reliability for the 14 subscales was in the acceptable to excellent range. Correlations between subscales took moderate to high values. The existence of differences between the clinical and non-clinical groups and the construct validity were confirmed. (4) Conclusions: The psychometric evaluation performed is mostly similar to the results obtained for other adaptations, and the results entitle the inventory to be used for research and clinical purposes with the knowledge of its limitations.
Keywords: 
Subject: Medicine and Pharmacology  -   Psychiatry and Mental Health

1. Introduction

The concept of schema therapy by Jeffrey E. Young (1) has been developing at a very fast pace over the past 30 years. There is an increasing amount of data on the effectiveness of interventions in different groups of patients - no longer only with borderline and narcissistic personality disorder, for which this therapy was dedicated at the beginning (2), but also with other types of personality disorders (3) and different kinds of psychopathology such as: depressive disorders, bipolar disorder, anxiety disorders, post-traumatic stress disorder, obsessive-compulsive disorder, eating disorder, schizophrenia, alcohol- and cocaine-dependence (4–8). The interventions are effective in both individual and group work formats i.e., (9,10).
In the early stages of the development of schema therapy, a major role was attached to so-called early maladaptive schemas (EMSs), which arise in response to unmet early childhood needs. Young defined EMS as: "a broad, pervasive theme or pattern, comprised of memories, emotions, cognitions, and bodily sensations, regarding oneself and one's relationships with others, developed during childhood or adolescence, elaborated throughout one's lifetime and dysfunctional to a significant degree.” (2)
Over time, the second core construct of schema therapy, the so-called schema modes, began to receive more attention. Schema mode refers to “the dominant emotional state, coping patterns and reactions that are active for a person at a particular time.” (11) So while EMSs are percived as features, schema modes have been assigned properties of states. In all likelihood, the concentration on modes was motivated by their greater accessibility and clarity for clients, as well as the more intuitive possibilities of using them in experimental work, for example.
Young distinguished 4 groups of schema modes (2). The first concerns the modes of the inner child, which are characterized by certain types of emotions experienced (sadness, feelings of helplessness, loneliness or shame, fear, anger or rage that is difficult to control). These modes are revived when an individual finds himself in a situation where his emotional needs are not being met. The second group are parental modes, associated with a critical, blaming or overly demanding voice, arising as a result of negative experiences in contact with significant others. The third group includes so-called coping modes, reflecting the overuse of three key belief coping strategies, namely compensation, avoidance and confirmation. And the last category is the healthy modes, i.e., the Healthy Adult and Happy Child modes, through which an individual can lead a valuable, responsible, and at the same time joyful life. A more detailed description of the modes can be found in Appendix A (descriptions on Lobbesteal et al. ((12). The objective of any therapeutic process is to take care of the inner child's needs by removing parental modes, weakening coping modes and strengthening healthy modes.
Also on the Polish ground, there is a noticeable focus on schema modes within the framework of conducted seminars, or in therapeutic work with patients. Unfortunately, there is a lack of a measure with tested psychometric properties to evaluate the intensity of individual schema modes. This would support both the field of practice and allow for the conduct of research on modes in the Polish population. To date, several questionnaires have been developed to assess schema modes. The first was a questionnaire created by Young et al. (13), consisting of 270 items, which lacks an assessment of psychometric properties. Considering the large number of statements, Lobbesteal et al. (13) thought it would be a good solution to create a shortened version of it, which in its final form consisted of 118 statements. Adequate fit of the data to the 14-factor model, acceptable internal reliability of the tool, medium to high intercorrelations between subscales, and reasonable construct validity (in convergent and divergent aspects) were confirmed. Several adaptations of the aforementioned questionnaire have been developed so far, i.e., the German (14), Urdu (15), Greek (16), Danish (17) and Turkish versions (18). Most have satisfactory psychometric properties for their use for both clinical and research purposes.
The purpose of this paper is to present the results of the Polish adaptation. It was based on a shortened version of the SMI by Lobbesteal et al. (12). An attempt was made to verify the reliability and validity of the measure, and therefore, in particular, the following were examined: factor structure, intercorrelations between the distinguished subscales, differences between the clinical and non-clinical groups and their strength, and validity in terms of convergent and divergent aspects.

2. Materials and Methods

2.1. Participants

The study included individuals between the ages of 18 and 70, without a diagnosis of intellectual disability or dementia syndromes, and who spoke Polish as a native speaker. A mixed sample was collected (N = 640), consisting of subjects from the clinical and general populations. 36,1% of the respondents (N = 231) declared that they had been given at least one of the following diagnoses in the course of their lives: depression, anxiety disorder, bipolar disorder, schizophrenia or alcohol dependence. The part of this group (i.e., 21,6%) declared a comorbid diagnosis of personality disorder. 9,2% of all respondents (N = 59) declared having a personality disorder diagnosis over the course of their lives. 7,2% of respondents had at least one psychiatric hospitalization in their experience. 17.2% received outpatient psychiatric care, 15.2% took psychiatric medications on a long-term basis, 44.1% had the experience of participating in psychotherapy. Due to lack of access to medical records, it was not possible to determine the exact characteristics of the study group in terms of current psychiatric diagnoses. One-quarter of the respondents (25.8%) declared that they suffered from some somatic disease.
Participants in the study were recruited over a period of about 15 months (from January 2020 to March 2021) within the departments of the Central Clinical Hospital in Lodz, the Mental Health Outpatient Clinic and private practice run by doctors and psychotherapists. Participation in the study did not influence the design of the psychiatric care and pharmacological treatment undertaken. The healthy control group was selected among Medical University students and their surroundings by sending out an announcement to their email addresses.
Due to the large number of statements for evaluation in connection with the construct validity examination, the sample group consisted of the two subgroups: Subgroup I (N = 311) and Subgroup II (N = 329). The demographic characteristics of the participants divided into groups show the Table 1.
Table 1. Characteristics of the sample in study.
Table 1. Characteristics of the sample in study.
Demographic characteristics Whole sample Subgroup I Subgroup II Missing data
N 640 311 329
Gender, N (%): N = 8
   Female 545 (85,2%) 261 (84,7%) 284 (87,7%)
   Male 87 (13,6%) 47 (15,3%) 40 (12,3%)
Age; mean (SD) 34,04 (10,62) 34,76 (10,73) 33,35 (10,45)
Education; N (%) N = 2
   higher 347 (54,2%) 185 (59,9%) 162 (49,2%)
   secondary 269 (42,0%) 110 (35,6%) 159 (48,3%)
   basic vocational 14 (2,2%) 9 (2,9%) 5 (1,5%)
   elementary 8 (1,3%) 5 (1,6%) 3 (0,9%)
Place of residence N = 1
   village 123 (19,2%) 53 (17,0%) 70 (21,3%)
   city under 100 000 inhabitants 177 (27,7%) 76 (24,4%) 101 (30,8%)
   city over 100 000 inhabitants 339 (53,0%) 182 (58,8%) 157 (47,9%)
Marital status N = 5
   married 186 (29,1%) 96 (31,3%) 90 (27,4%)
   in an informal relationship 200 (31,3%) 95 (30,9%) 105 (32,0%)
   single 249 (38,9%) 116 (37,8%) 133 (40,5%)
Employment N = 2
   employed/student 557 (87%) 273 (88,1%) 284 (86,6%)
   retired 13 (2,0%) 6 (1,9%) 7 (2,1%)
   unemployed 68 (10,6%) 31 (10,0%) 37 11,3%)

2.2. Materials

Schema Mode Inventory (SMI)
The study involved an adaptation of the Dutch version of the Short Schema Mode Inventory (12), which was based on the Schema Mode Inventory, long version constructed by Young et al. (19). The Short SMI is a scale composed of 118 items assigned to 14 factors (described in more detail in Appendix A). Each factor contains from 4 to 10 items. The questionnaire is preceded by instructions asking respondents to rate each statement in terms of how often they believe or feel the way described. The individual items are rated on a 6-point Likert scale, where 1 is “never or almost never” and 6 “all of the time”. The results are obtained by calculating the arithmetic mean for each subscale. There is no cut-off point. The higher the average score obtained in the subscale, the greater the severity of the tested factor.
The results of the confirmatory factor analysis proved that the original version of the Short Schema Mode Inventory is characterized by good levels of the goodness-of-fit indices of the model to the data using the 14-factor solution. The following results were obtained: Comparative Fix Index (CFI) = 0,98, Non-Normed Fit Index (NNFI) = 0,98, Standardized Root Mean Square (SRMR) = 0,66, Root Mean Square Error of Approximation (RMSEA) = 0,053 and chi-square test (χ2) (degrees of freedom, df) = 18374,70 (6694). Mean item loadings per subscale varied between 0,53 and 0,85. The internal consistency of the subscales was acceptable (Cronbach’s α ranged from 0.79 to 0.96). Positive correlations were noted between all maladaptive modes and between the two adaptive modes. The maladaptive modes correlated negatively with the adaptive ones (12).
The procedure for adaptation of the inventory described above was preceded by obtaining written permission from the authors of the original short version. The adaptation was made by the method of translation, that is, by means of a fairly faithful translation, in which minor modifications are allowed in places where a literal translation would not be possible (20).
As a first step, in accordance with the adopted standards, the original version of the Short SMI was translated into Polish by two independent psychologists fluent in English with theoretical and practical knowledge of schema therapy. A comparison of the translation results revealed that the discrepancies found in 8 items (i.e., 1, 18, 50, 52, 70, 79, 116, 118) were mainly due to the use of synonymous words or due to the difficulty in maintaining translation accuracy and simultaneous semantic equivalence of statements. Through a group discussion on the selection of the most optimal versions, the wording of most items was established. A native Polish speaker with a background in psychology, who has lived in the United States for years, was then asked to perform a blinded back-translation. Any additional translation discrepancies that arose were resolved through discussion among the initial translators.
Finally, a pilot study was performed with the participation of 24 students, who were able to make comments on the design of the questionnaire and their understanding of the various statements. The result was a change in the wording of two items. The average time to complete the questionnaire was 25 minutes. This validated the official Polish language version of the questionnaire, which was then subjected to psychometric evaluation.
The characteristics of the other measures used in the assessment of construct validity are presented below.
Temperament and Character Inventory (TCI by Cloninger at al. (21))
The TCI is a questionnaire based on the psychobiological model by Cloninger (21). It contains scales to measure various dimensions of temperament and character. It is composed of 240 statements, to which the respondent refers by choosing one of two options: true or false. The study used the Polish version of this scale adapted by Hornowska (22), which has psychometric properties that entitle it to be used for research purposes. The scales applied have a reliability (measured by the Kuder-Richardson reliability coefficients, KR20) ranging from 0,42 to 0,87, with a mean of 0,67. In the current group, internal consistency for the compared subscales (Cronbach's α calculated for dichotomous data) ranged from 0,46 to 0,84 with a mean of 0,68.
The inventory distinguishes seven scales, within which 25 subscales are identified. Sixteen of them were used to test construct validity in this study. Positive correlations are assumed to occur between: the TCI fear of uncertainty scale and the Vulnerable Child mode; TCI impulsiveness scale and the Impulsive Child mode; TCI persistence scale and the Undisciplined Child mode; TCI dependence mode and the Compliant Surrender mode; TCI persistence scale and the Demanding Parent mode; TCI all the self-directedness subscales and all the cooperativeness subscales and the Healthy Adult mode. Negative correlations were expected between: TCI responsibility scale and the Impulsive Child mode; TCI purposeful scale and the Undiscipline Child mode; TCI resourcefulness and the Vulnerable Child and Compliant Surrender modes; TCI enlightened second nature scale and the Detached Self-Soother, Undiscipline Child and Impulsive Child modes; TCI all the cooperativeness subscales and the Angry Child mode; TCI compassion scale and the Enraged Child and Self-Aggrandizer modes; TCI all the self-directedness subscales, TCI attachment scale and the Detached Protector mode; TCI compassion scale, and the Bully and Attack mode.
Coping Inventory for Stressful Situations (CISS by Endler and Parker (23))
The CISS is a questionnaire developed based on the interactional theoretical model. It measures stress coping styles, understood as conscious coping actions that an individual takes when faced with a specific stressful situation. These actions are the result of the interaction that occurs between the characteristics of the situation and the individual's characteristic style. The scale allows the assessment of three dimensions: task-oriented style, emotion-oriented style and avoidance-oriented style, where there are two subscales: distraction and social diversion (24).
The questionnaire is composed of 48 statements, describing various behaviors undertaken in a stressful situation. Respondents rate each statement on a 5-point Likert scale, indicating the frequency with which they engage in a given action, where 1 means "never" and 5 means "very often." The current study used a Polish adaptation of the questionnaire by Szczepaniak et al. (25). This scale is characterized by adequate psychometric properties, i.e., internal consistency with Cronbach α ranged from 0.6 to 0.88 (with a mean of 0,77) and satisfactory construct validity. In the current study, reliability indices were in the range of 0,74 to 0,90 (with a mean 0,82). Positive correlations are predicted between CISS task-oriented style and the Healthy Adult mode; CISS emotional-oriented scale and the Vulnerable Child mode; CISS distraction scale and the Detached Self-soother mode, and negative correlations between CISS social diversion and the Detached Protector mode.
Rosenberg Self-Esteem Scale (SES (26))
The SES is a tool that measures self-esteem, that is positive or negative attitudes toward the Self (26). The scale consists of 10 statements that respondents address on a 4-point scale from "strongly agree" to "strongly disagree." The current study used a Polish adaptation of the measure by Dzwonkowska et al. (27). The adapted questionnaire's internal consistency ranged between 0,81 and 0,83 for (Cronbach's α) for the whole scale, depending on the study sample. In the original version, the single-factor structure of the measure was proven. The Polish version assumes the existence of two factors (one composed of positive statements, the other of negative ones). Cronbach's α in the current sample was at the level of 0,90. A positive relationship is expected between the SES score and the Healthy Adult mode, a negative one between the SES score and the Punitive Parent mode.
State-Trait Anger Expression Inventory-2 (STAXI-2 (28))
The STAXI-2 is a revised version of the STAXI questionnaire by Spielberger et al. (28) that measures anger in various aspects. The scale contains 57 statements, which respondents rate on a 4-point Likert scale from "definitely no" to "definitely yes." The questionnaire is divided into three parts: one measuring anger as a state, one measuring anger as a trait, and one dealing with expressing and controlling anger. This study used the scale in an adaptation by Bąk (29). Internal consistency coefficients (Cronbach's α) for the Polish adaptation range from 0,74 to 0,95 for each of the subscales. The validity of the measure and its relative stability in terms of anger as a trait were also confirmed. The current sample obtained good to excellent reliability indices: for the anger-as-state scale 0,95, for the anger-as-trait scale 0,86, for the other subscales: 0,73 – 0,93.
Referring to the perception of schema modes in the category of states (11), positive correlations are predicted to occur between the subscales of the STAXI-2 considering anger as a state and the Angry Child and Enraged Child modes; between the STAXI-2 anger expression-out scale and the Angry Child, Enraged Child and Bully and Attack modes; the STAXI-2 anger expression-in scale and the Vulnerable Child and Compliant Surrender modes; and between the STAXI-2 anger control-out and anger control-in scales and the Healthy Adult mode. Negative correlations are expected between anger control-out scale and the Angry Child, Enraged Child and Impulsive Child modes and anger control-in scale and the same three child modes.

2.3. Procedure

The study was approved by the Bioethics Committee of the Medical University of Lodz. The data used in the study were obtained partly by face-to-face contact (paper-and-pencil method) and partly by an online survey. The decision to include an online survey group was made in the face of the COVID-19 pandemic, which resulted in a problem with access to volunteers for the study.
Each participant was tested individually. The randomly selected subgroups were given batteries composed of various questionnaires. Subgroup I completed a questionnaire that was the Polish translation of the Short Schema Mode Inventory (SMI, Version 1) and the Temperament and Character Inventory (TCI). The Subgroup II, on the other hand, filled out a battery that also consisted of a Polish translation of the Short SMI and three other questionnaires, i.e., Coping Inventory for Stressful Situations (CISS), Rosenberg Self-Esteem Scale (SES) and State-Trait Anger Expression Inventory-2 (STAXI-2). This procedure significantly reduced the time of filling out the battery (average filling time about 45 minutes) in order to keep the subjects engaged and reduce the impact on results of the fatigue factor.
Participants were informed in the instructions preceding the set of questionnaires about the identity of the researcher and the purpose of the study, and its procedure. They were also assured of the scientific nature of the study, their voluntary participation, and the complete anonymity of the data provided in the questionnaires. To increase the motivation to respond honestly to the evaluated items, willing participants could receive a brief psychological characterization based on the results achieved.

2.4. Statistical analyses

To perform the analyses, the following statistical techniques were used: Confirmatory Factor Analyses (CFA) for assessing the factor structure of the adapted questionnaire, Cronbach’s α coefficient for estimating internal consistency of the subscales, independent sample t-test to determine differences between the means and Pearson’s correlation analysis to establish intercorrelation between SMI subscales and correlations of the SMI subscales and other analyzed variables. For the statistical calculations the statistical package PS IMAGO PRO 8.0 and the AMOS 8.0 were used.

3. Results

3.1. Factor structure of the Polish version of the Short SMI

The present study tried to reflect the factor structure of the original version of the scale, so it was verified using CFA. A maximum likelihood estimator was applied, resistant to not fulfilling the assumption of normality of the distribution of the variable under study. According to the standard (30), several measures of the model's fit to the data were used: corrected chi-square (χ2), chi-square divided by the number of degrees of freedom (χ2/df), comparative fix index (CFI), non-normed fit index (NNFI), standardized root mean square residual (SRMR) and root mean square error of approximation (RMSEA). The following threshold values were adopted: p-value for the model > 0,05, χ2/df < 3, CFI ≥ 0,90, NNFI ≥ 0,95, SRMR < 0,08 and RMSEA < 0,08 (31).
A 14-factor structure was compared with an 8-factor and 4-factor model (all based on theoretical assumptions). Subsequent models were created taking into account correlations between latent variables. Given the differences found in the frequency of distributions of the items, Tabachnick and Fidell (32) suggest that a loading value of 0,32 can be used as a cut-off point. Accordingly, six items were removed (two from the Bully and Attack factor, two from the Happy Child factor, and one each from Healthy Adult and Self-Aggrandizer mode). In the next step covariances were added between error terms within the same factor, where Modification Indices ≥ 20 (33). Table 1 presents the goodness-of-fit indices for the proposed models.
Table 2. Goodness-of-fit indices of various tested models (N = 640).
Table 2. Goodness-of-fit indices of various tested models (N = 640).
Model χ2(df) Normed χ2 CFI NNFI SRMR RMSEA
14-correlated factors (118 items) 19426,263 (6694) *** 2,902 0,715 0,624 0,122 0,055
14-correlated factors
with covariances (118 items)
16798,122 (6640) *** 2,530 0,773 0,674 0,118 0,049
14-correlated factors
with covariances (112 items)
15064,511 (5960) *** 2,528 0,790 0,697 0,112 0,049
8-correlated factors (118 items) 22626,77 (6757) *** 3,349 0,645 0,561 0,137 0,061
8-correlated factors
with covariances (118 items)
17024,863 (6618) *** 2,573 0,767 0,670 0,128 0,050
4-correlated factors (118 items) 28516,757 (6779) *** 4,207 0,514 0,447 0,142 0,071
Note: χ2 = chi-square; df = degrees of freedom; CFI = Comparative Fix Index; NNFI = Non-Normed Fit Index; SRMR = Standardized Root Mean Square Residual; RMSEA = Root Mean Square Error of Approximation; ***p < 0,001.
Not one of the models presents good enough fit indices. For all the proposals the p-value was lower than 0,001, which implies a rejection of the null hypothesis of a good fitness. The reason for this result is probably the sensitivity of the chi-square exact fit test to the sample size. With a sample size of over 400 subjects, most models are rejected (34). The relative best was the results obtained for the 14-factor model, consisting of 112 items. This is supported by a good score of the normed χ2 (independent of sample size) with a value of 2,528, a very good RMSEA = 0,049, and the nearest to norms of other indicators. Unquestionably, the issue of the factor structure of the Polish version of the questionnaire requires further analysis.

3.2. Internal consistency, item loadings and correlations between subscales of the short SMI

The reliability analysis revealed that the internal consistency values for the specific subscales of the Polish version of the Short SMI (see Table 3) ranged from acceptable (lowest α = 0,74, for Bully and Attack mode) to excellent (α = 0,94 for Vulnerable Child mode) with a mean of α = 0,84 (referring to the generally accepted cut-off point of 0,7 (35)), which is similar to the result obtained in the original version (12) and other adaptations (14,16–18). It is noteworthy that in most analyses one of the less reliable scales appears to be the Bully and Attack mode (14,15,17,18).
According to the criterion adopted following Tabachnick and Fidell (32), all factor loadings for items have assumed adequate values (see Table 4). The mean factor loadings for each subscale for the 14-factor solution ranged from 0,54 to 0,79, with an overall mean of 0,64 (see Table 3).
Table 3. Internal reliability of the Polish version of the Short SMI (N = 640).
Table 3. Internal reliability of the Polish version of the Short SMI (N = 640).
SMI subscales Number of items Mean inter-item correlation Cronbach's α Mean item loading
Vulnerable Child 10 0,63 0,94 0,79
Angry Child 10 0,34 0,83 0,57
Enraged Child 9 0,43 0,87 0,63
Impulsive Child 8 0,44 0,87 0,65
Undisciplined Child 5 0,46 0,81 0,67
Happy Child 8 0,58 0,92 0,75
Compliant Surrender 7 0,39 0,81 0,63
Detached Protector 9 0,46 0,89 0,67
Detached Self-Soother 4 0,47 0,78 0,69
Self-Aggrandizer 9 0,31 0,80 0,54
Bully and Attack 7 0,31 0,74 0,55
Punitive Parent 10 0,48 0,90 0,69
Demanding Parent 7 0,34 0,78 0,57
Healthy Adult 9 0,35 0,83 0,59
Mean 8 0,43 0,84 0,64
Table 4. Item loadings of the Polish version of the Short SMI for 14-factor model (N = 640).
Table 4. Item loadings of the Polish version of the Short SMI for 14-factor model (N = 640).
SMI item Scale Item loading
1. I feel loved and accepted. HC 0,75
2. I deny myself pleasure because I don’t deserve it. PP 0,66
3. I feel fundamentally inadequate, flawed, or defective. VC 0,78
4. I have impulses to punish myself by hurting myself (e.g., cutting myself). PP 0,59
5. I feel lost. VC 0,79
6. I’m hard on myself. DP 0,66
7. I try very hard to please other people in order to avoid conflict, confrontation, or rejection. CS 0,68
8. I can’t forgive myself. PP 0,74
9. I do things to make myself the center of attention. SA 0,48
10. I get irritated when people don’t do what I ask them to do. SA 0,59
11. I have trouble controlling my impulses. IC 0,79
12. If I can’t reach a goal, I become easily frustrated and give up. UC 0,69
13. I have rage outbursts. EC 0,77
14. I act impulsively or express emotions that get me into trouble or hurt other people. IC 0,81
15. It’s my fault when something bad happens. PP 0,66
16. I feel content and at ease. HC 0,85
17. I change myself depending on the people I’m with, so they’ll like me or approve of me. CS 0,47
18. I feel connected to other people. HC 0,52
19. I don’t discipline myself to complete routine or boring tasks. UC 0,71
20. If I don’t fight, I will be abused or ignored. AC 0,57
21. If you let other people mock or bully you, you’re a loser. BA 0,42
22. I physically attack people when I’m angry at them. EC 0,41
23. Once I start to feel angry, I often don’t control it and lose my temper. EC 0,84
24. It’s important for me to be Number One (e.g., the most popular, most successful, most wealthy, most powerful). SA 0,65
25. I feel indifferent about most things. DPT 0,56
26. I can solve problems rationally without letting my emotions overwhelm me. HA 0,65
27. I won’t settle for second best. SA 0,51
28. Attacking is the best defense. BA 0,54
29. I feel cold and heartless toward other people. DPT 0,51
30. I feel detached (no contact with myself, my emotions or other people). DPT 0,75
31. I blindly follow my emotions. IC 0,62
32. I feel desperate. VC 0,81
33. I allow other people to criticize me or put me down. CS 0,72
34. In relationships, I let the other person have the upper hand. CS 0,68
35. I feel distant from other people. DPT 0,79
36. I don’t think about what I say, and it gets me into trouble or hurts other people. IC 0,65
37. I work or play sports intensively so that I don’t have to think about upsetting things. DSS 0,53
38. I’m angry that people are trying to take away my freedom or independence. AC 0,40
39. I feel nothing. DPT 0,75
40. I do what I want to do, regardless of other people’s needs and feelings. SA 0,37
41. I don’t let myself relax or have fun until I’ve finished everything I’m supposed to do. DP 0,38
42. I throw things around when I’m angry. EC 0,55
43. I feel enraged toward other people. AC 0,69
44. I feel that I fit in with other people. HC 0,61
45. I have a lot of anger built up inside of me that I need to let out. AC 0,68
46. I feel lonely. VC 0,78
47. I like doing something exciting or soothing to avoid my feelings (e.g., working, gambling, eating, shopping, sexual activities, watching TV). DSS 0,72
48. Equality doesn’t exist, so it’s better to be superior to other people. BA 0,63
49. When I’m angry, I often lose control and threaten other people. EC 0,54
50. I let other people get their own way instead of expressing my own needs. CS 0,82
51. If someone is not with me, he or she is against me. AC 0,61
52. In order to be bothered less by my annoying thoughts or feelings, I make sure that I’m always busy. DSS 0,80
53. I’m a bad person if I get angry at other people. PP 0,57
54. I don’t want to get involved with people. DPT 0,53
55. I feel that I have plenty of stability and security in my life. HC 0,76
56. I know when to express my emotions and when not to. HA 0,56
57. I’m angry with someone for leaving me alone or abandoning me. AC 0,51
58. I don’t feel connected to other people. DPT 0,66
59. I can’t bring myself to do things that I find unpleasant, even if I know it’s for my own good. UC 0,68
60. I break rules and regret it later. IC 0,43
61. I feel humiliated. VC 0,70
62. I act first and think later. IC 0,55
63. I get bored easily and lose interest in things. UC 0,66
64. Even if there are people around me, I feel lonely. VC 0,80
65. I don’t allow myself to do pleasurable things that other people do because I’m bad. PP 0,72
66. I assert what I need without going overboard. HA 0,41
67. I feel special and better than most other people. SA 0,52
68. I don’t care about anything; nothing matters to me. DPT 0,73
69. It makes me angry when someone tells me how I should feel or behave. AC 0,43
70. If you don’t dominate other people, they will dominate you. BA 0,62
71. I say what I feel, or do things impulsively, without thinking of the consequences. IC 0,66
72. I feel like telling people off for the way they have treated me. AC 0,70
73. I’m capable of taking care of myself. HA 0,68
74. I’m quite critical of other people. SA 0,61
75. I’m under constant pressure to achieve and get things done. DP 0,66
76. I’m trying not to make mistakes; otherwise, I’ll get down on myself. DP 0,75
77. I deserve to be punished. PP 0,81
78. I can learn, grow, and change. HA 0,67
79. I want to distract myself from upsetting thoughts and feelings. DSS 0,72
80. I’m angry at myself. PP 0,80
81. I feel flat. DPT 0,77
82. I have to be the best in whatever I do. SA 0,54
83. I sacrifice pleasure, health, or happiness to meet my own standards. DP 0,65
84. I’m demanding of other people. SA 0,57
85. If I get angry, I can get so out of control that I injure other people. EC 0,77
86. I’m a bad person. PP 0,73
87. I feel safe. HC 0,84
88. I feel listened to, understood, and validated. HC 0,85
89. It is impossible for me to control my impulses. IC 0,71
90. I destroy things when I’m angry. EC 0,54
91. By dominating other people, nothing can happen to you. BA 0,59
92. I act in a passive way, even when I don’t like the way things are. CS 0,61
93. My anger gets out of control. EC 0,82
94. I mock or bully other people. BA 0,48
95. I feel like lashing out or hurting someone for what he/she did to me. AC 0,56
96. I know that there is a “right” and a “wrong” way to do things; I try hard to do things the right way, or else I start criticizing myself. DP 0,54
97. I often feel alone in the world. VC 0,85
98. I feel weak and helpless. VC 0,85
99. I’m lazy. UC 0,64
100. I can put up with anything from people who are important to me. CS 0,40
101. I’ve been cheated or treated unfairly. AC 0,55
102. I feel left out or excluded. VC 0,77
103. I be little others. BA 0,55
104. I feel optimistic. HC 0,83
105. I’m pushing myself to be more responsible than most other people. DP 0,34
106. I can stand up for myself when I feel unfairly criticized, abused, or taken advantage of. HA 0,58
107. I don’t deserve sympathy when something bad happens to me. PP 0,59
108. I feel that nobody loves me. VC 0,77
109. I feel that I’m basically a good person. HA 0,64
110. When necessary, I complete boring and routine tasks in order to accomplish things I value. HA 0,41
111. I feel spontaneous and playful. HC 0,40
112. I can become so angry that I feel capable of killing someone. EC 0,74
Note. VC = Vulnerable Child; AC = Angry Child; EC = Enraged Child; IC = Impulsive Child; UC = Undisciplined Child; HC = Happy Child; CS = Compliant Surrender; DPT = Detached Protector; DSS = Detached Self-soother; SA = Self-Aggrandizer; BA = Bully and Attack; PP = Punitive Parent; DP = Demanding Parent; HA = Healthy Adult.
The mean item-correlations within each factor ranged between 0,31 and 0,63 (with a mean correlation of 0,43; see Table 3). The factor inter-correlations between subscales are summarized in Table 5. Positive correlations were proven between both the maladaptive modes and the two adaptive modes. The adaptive modes correlated negatively with the maladaptive modes. The only exception was 4 correlation values, which proved to be non-significant. The mean correlation between all maladaptive child modes (VC, AC, EC, IC, and UC) was 0,50, the mean correlation between coping modes (CS, DPT, DSS, SA, and BA) was 0,31 (including correlation between compensation modes i.e., SA and BA, at 0,59, and between avoidance-based modes i.e., DPT and DSS, at 0,40), parent modes (PP and DP) correlate 0,52 with each other and healthy modes (HA and HC) correlate 0,71 with each other. In some cases, high correlations were obtained, but despite this, none of the confidence intervals (±2*SE, (36)) around the estimated correlations between the two subscales included 1.0 This suggests that the subscales of the adapted version are distinct constructs.
Table 5. Factor inter-correlations between the Polish version of the Short SMI subscales (N = 640).
Table 5. Factor inter-correlations between the Polish version of the Short SMI subscales (N = 640).
VC AC EC IC UC HC CS DPT DSS SA BA PP DP
VC
AC ,60**
EC ,39** ,59**
IC ,44** ,59** ,67**
UC ,47** ,41** ,32** ,48**
HC -,84** -,50** -,35** -,36** -,37**
CS ,61** ,35** ,18** ,29** ,37** -,48**
DPT ,72** ,46** ,24** ,30** ,42** -,70** ,47**
DSS ,50** ,50** ,20** ,35** ,21** -,46** ,37** ,40**
SA ,12** ,52** ,37** ,35** ,22** -,07 ,05 ,17** ,22**
BA ,31** ,63** ,43** ,44** ,32** -,28** ,21** ,35** ,26** ,59**
PP ,71** ,48** ,38** ,41** ,35** -,62** ,55** ,57** ,48** ,15** ,28**
DP ,39** ,41** ,18** ,15** ,02 -,35** ,35** ,31** ,53** ,40** ,29** ,52**
HA -,70** -,35** -,37** -,45** -,51** ,71** -,51** -,54** -,31** ,03 -,20** -,64** -,14**
Note. **p < 0,01; VC = Vulnerable Child; AC = Angry Child; EC = Enraged Child; IC = Impulsive Child; UC = Undisciplined Child; HC = Happy Child; CS = Compliant Surrender; DPT = Detached Protector; DSS = Detached Self-soother; SA = Self-Aggrandizer; BA = Bully and Attack; PP = Punitive Parent; DP = Demanding Parent; HA = Healthy Adult.

3.3. Differences and effect size between subgroups

As part of the assessment of the construct validity of the scale, it was checked whether there were differences between the mean of the subscales for the clinical (n = 240) and non-clinical group (n = 400). The clinical group consisted of people who had experienced a psychiatric diagnosis that included disorders such as: depression, anxiety disorder, bipolar disorder, schizophrenia or alcohol dependence at least once in their lives, and people with a diagnosis of personality disorder (including those where both categories of disorders co-occurred). This solution was decided because nine people were identified in the study group, with a diagnosis of personality disorder only, which presented too small group for comparison.
The results show that there are significant differences between the clinical and non-clinical groups, with the exception of the Bully and Attack and Self-Aggrandizer modes (at p-value ≤ 0,05; see Table 6). Within the adaptive modes, significantly higher scores were obtained in the clinical group compared to the non-clinical group. Under adaptive modes, the result was the opposite, i.e., the scores in the clinical group were significantly lower compared to the scores in the non-clinical group. The most significant differences between the groups were observed between the intensity of the Happy Child mode (Cohen’s δ = -0,57), while the lowest were characterized by the Demanding Parent mode (Cohen’s δ = 0,16).
Table 6. Means, standard deviations, differences between the means of the Polish version of the Short SMI subscales and effect size in two subgroups (N=640).
Table 6. Means, standard deviations, differences between the means of the Polish version of the Short SMI subscales and effect size in two subgroups (N=640).
SMI subscales Clinical group
(N=240)
Non-clinical group
(N=400)
δ t(df) p
m SD m SD
Vulnerable Child 3,30 1,06 2,78 1,05 0,50 6,07(638) <0,001
Angry Child 3,20 0,83 2,94 0,77 0,33 4,09(638) <0,001
Enraged Child 1,81 0,69 1,68 0,63 0,21 2,54(638) 0,011
Impulsive Child 2,64 0,86 2,36 0,76 0,35 4,34(638) <0,001
Undisciplined Child 3,43 0,97 3,17 0,93 0,28 3,38(638) <0,001
Happy Child 2,98 0,95 3,53 0,98 -0,57 -6,97(638) <0,001
Compliant Surrender 3,05 0,87 2,78 0,81 0,32 3,92(638) <0,001
Detached Protector 2,80 0,98 2,46 0,83 0,38 4,48(439,38)* <0,001
Detached Self-Soother 3,28 1,05 2,98 1,05 0,29 3,59(638) <0,001
Self-Aggrandizer 2,80 0,75 2,81 0,79 -0,01 -0,14(638) 0,891
Bully and Attack 2,07 0,72 2,06 0,67 0,01 0,08(638) 0,934
Punitive Parent 2,49 0,98 2,11 0,75 0,46 5,22(405,57)* <0,001
Demanding Parent 3,58 0,91 3,43 0,87 0,16 1,98(638) 0,048
Healthy Adult 3,81 0,85 4,15 0,78 -0,42 -5,17(638) <0,001
Note. m = mean, SD = standard deviations; δ = Cohen’s δ clinical group versus non-clinical group; * the value of the t-statistic with the unequal variance correction applied.

3.4. Construct validity

Tables 7 and 8 show the correlation coefficients of assumed and not assumed relationships between subscales the Polish version of the Short SMI and theoretically related external constructs. All hypothesized correlations turned out to be significant. Most of them took moderate to strong values (Pearson value of 0,3 – 0,5 and 0,5 – 0,7, respectively), with the exception of the correlations between the Healthy Adult mode and TCI all the cooperativeness subscales. In addition to the assumed relationships, a number of unanticipated correlations were also revealed, but mostly of lower strength. Moreover, 145 of 311 (46,6%) correlations took a value below 0,3, indicating good discriminant validity.
Analyzing the associations of schema modes with measures of temperament and character, it is observed that there are positive correlations with adaptive modes (i.e., the Healthy Adult and Happy Child modes) and negative correlations with non-adaptive modes. The exception is the TCI impulsivity scale positively correlated with the child maladaptive scales. Noteworthy are the reasonably high negative correlations with coping modes (i.e., the Compliant Surrender, Detached Protector, Self-Aggrandizer and Bully and Attack modes), which indicate good discriminant validity.
The predicted correlations obtained with the CISS subscales, proved to be among the highest, although several unpredicted ones also took high values. A number of correlations with strengths above 0,5 were found with the CISS emotion-oriented scale (positive with the Angry Child, Compliant Surrender, Detached Self-Soother, Punitive Parent and Demanding Parent modes and negative with the Happy Child and Healthy Adult modes). The CISS avoidant-oriented style scale showed weak associations, and only its subscales (i.e., distraction and social diversion) allowed for stronger correlations with the schema modes.
In addition to the predicted correlations, unanticipated relationships of high strength were also reported between SES score and schema modes. With the exception of the Self-Aggrandizer mode, all others significantly correlated with the self-esteem dimension. The strongest negative correlations (r > 0,5) were obtained between SES score and the Vulnerable Child, Compliant Surrender, Detached Protector and Punitive Parent modes. Very strong positive relationships (r > 0,7) were achieved between the SES score and the Healthy Adult and Happy Child modes.
Also noteworthy are the correlations obtained between STAXI-2 subscales and schema modes by SMI. It turned out to be, contrary to predictions, that the schema modes associated with anger regulation difficulties (i.e., the Angry Child and Enraged Child modes) correlate more strongly with STAXI-2 subscales treating anger as a trait rather than a state. High correlations of this scale were also obtained with compensatory coping modes (i.e., the Self-Aggrandizer and Bully and Attack modes). Fairly high discriminant value was presented by the scales of anger expression-out and -in and the scales of anger control-out and -in relative to child modes associated with anger (i.e., the Angry Child and Enraged Child modes). Not entirely as expected, the scale of anger control-out and -in showed only moderate strength of association with the Healthy Adult mode.
In conclusion, 20 out of 49 predicted correlations had a value of at least 0,5 in the current sample. Additionally, several other significant correlations were found, which are theoretically convergent with the SMI subscales. For most of the subscales (with the exception of the Demanding Parents mode), correlations at the level of at least a strong relationship were obtained. In addition, the moderate discriminatory validity of the adapted inventory was confirmed.
Table 7. Correlation (Pearson’s coefficients) between the Polish version of the Short SMI subscales and the Temperament and Character Inventory subscales (N = 311).
Table 7. Correlation (Pearson’s coefficients) between the Polish version of the Short SMI subscales and the Temperament and Character Inventory subscales (N = 311).
VC AC EC IC UC HC CS DPT DSS SA BA PP DP HA
TCI
Exploratory excitability -,31 -,11 -,08 -,01 -,22 ,28 -,35 -,33 -,04 ,18 ,01 -,16 -,09 ,25
Impulsiveness ,05 ,16 ,15 ,31 ,21 -,06 -,01 ,03 ,09 ,04 ,07 ,05 -,14 -,16
Fear of uncertainty ,33 ,13 ,10 ,05 ,22 -,28 ,29 ,14 ,10 -,19 -,06 ,18 ,06 -,30
Attachment -,40 -,23 -,12 -,11 -,25 ,45 -,23 -,60 -,17 -,03 -,17 -,35 -,11 ,38
Dependence ,20 -,06 -,04 -,04 ,10 -,14 ,39 -,04 ,11 -,18 -,09 ,21 ,16 -,28
Persistence -,08 ,01 -,09 -,18 -,41 ,05 -,06 -,08 ,14 ,25 ,01 ,04 ,43 ,21
Responsibility -,55 -,44 -,36 -,42 -,38 ,52 -,53 -,47 -,37 -,05 -,21 -,49 -,23 ,54
Purposeful -,63 -,33 -,28 -,36 -,55 ,59 -,52 -,54 -,33 ,04 -,13 -,48 -,10 ,66
Resourcefulness -,54 -,23 -,24 -,30 -,53 ,48 -,55 -,39 -,23 ,07 -,08 -,40 -,03 ,62
Self-acceptance -,29 -,48 -,31 -,33 -,37 ,30 -,17 -,32 -,28 -,48 -,41 -,28 -,26 ,25
Enlightened second nature -,58 -,40 -,31 -,44 -,66 ,54 -,50 -,48 -,32 -,06 -,21 -,49 -,11 ,63
Social acceptance -,23 -,43 -,39 -,37 -,27 ,24 -,15 -,32 -,17 -,39 -,39 -,12 -,15 ,21
Empathy -,34 -,32 -,30 -,31 -,34 ,35 -,20 -,45 -,22 -,23 -,26 -,24 -,08 ,34
Helpfulness -,26 -,38 -,32 -,25 -,25 ,30 -,09 -,39 -,17 -,26 -,32 -,14 -,04 ,21
Compassion -,14 -,48 -,40 -,33 -,29 ,18 ,02 -,25 -,08 -,38 -,47 -,15 -,07 ,17
Pure-hearted conscience -,13 -,28 -,21 -,24 -,22 ,16 -,02 -,31 -,06 -,29 -,35 -,09 ,04 ,13
Note. TCI = Temperament and Character Inventory; VC = Vulnerable Child; AC = Angry Child; EC = Enraged Child; IC = Impulsive Child; UC = Undisciplined Child; HC = Happy Child; CS = Compliant Surrender; DPT = Detached Protector; DSS = Detached Self-soother; SA = Self-Aggrandizer; BA = Bully and Attack; PP = Punitive Parent; DP = Demanding Parent; HA = Healthy Adult; bold figures are significant at p < 0,05; underlined figures reflect predicted associations.
Table 8. Correlation (Pearson’s coefficients) between the Polish version of the Short SMI subscales and other theoretically linked constructs (N = 329).
Table 8. Correlation (Pearson’s coefficients) between the Polish version of the Short SMI subscales and other theoretically linked constructs (N = 329).
VC AC EC IC UC HC CS DPT DSS SA BA PP DP HA
CISS
Task-oriented style -,40 -,10 -,19 -,27 -,41 ,38 -,29 -,27 -,06 ,17 ,01 -,36 ,14 ,65
Emotion-oriented style ,73 ,53 ,38 ,45 ,46 -,58 ,54 ,47 ,55 ,25 ,30 ,65 ,57 -,58
Avoidance-oriented style -,01 ,16 ,12 ,22 ,29 ,11 ,02 -,15 ,17 ,16 ,15 -,03 -,01 -,02
distraction ,27 ,31 ,25 ,35 ,45 -,21 ,21 ,16 ,33 ,20 ,25 ,20 ,06 -,32
social diversion -,40 -,15 -,10 -,06 -,08 ,47 -,29 -,53 -,16 -,01 -,11 -,35 -,13 ,36
SES -,80 -,44 -,30 -,39 -,42 ,74 -,55 -,52 -,48 -,05 -,22 -,75 -,45 ,74
STAXI-2
Anger-as-state ,33 ,34 ,41 ,35 ,15 -,36 ,18 ,25 ,18 ,21 ,29 ,25 ,10 -,30
Anger-as-trait ,37 ,72 ,67 ,67 ,40 -,30 ,17 ,20 ,35 ,57 ,51 ,29 ,29 -,26
Anger expression-out scale ,26 ,53 ,65 ,53 ,28 -,16 -,01 ,08 ,16 ,40 ,36 ,25 ,17 -,16
Anger expression-in scale ,42 ,31 -,04 ,11 ,34 -,34 ,49 ,53 ,44 ,24 ,26 ,36 ,41 -,27
Anger control-out scale -,20 -,42 -,64 -,55 -,19 ,20 ,03 ,03 -,11 -,20 -,24 -,21 -,07 ,31
Anger control-in scale -,25 -,41 -,53 -,49 -,22 ,25 -,05 -,07 -,06 -,28 -,30 -,25 -,08 ,35
Note. CISS = Coping Inventory for Stressful Situations; SES = Rosenberg Self-Esteem Scale; STAXI-2 = State-Trait Anger Expression Inventory-2; VC = Vulnerable Child; AC = Angry Child; EC = Enraged Child; IC = Impulsive Child; UC = Undisciplined Child; HC = Happy Child; CS = Compliant Surrender; DPT = Detached Protector; DSS = Detached Self-soother; SA = Self-Aggrandizer; BA = Bully and Attack; PP = Punitive Parent; DP = Demanding Parent; HA = Healthy Adult; bold figures are significant at p < 0,05; underlined figures reflect predicted associations.

4. Discussion

The study describes the procedure for adaptation of the Short Schema Mode Inventory (SMI) to Polish conditions and verifies the psychometric properties of the obtained version. The need to adapt the questionnaire was based on the growing popularity of the application of schema modes in schema therapy, both in the area of scientific research and in the everyday clinical practice of psychotherapists. Evidence of the efficacy of using schema modes in treatment of mental disorders is increasing, which implies the need for their reliability evaluation, also on the Polish ground.
The results of the analyses obtained are mostly similar in strengths and weaknesses to both the psychometric properties of the original Dutch version of the SMI (12) and other language versions (14–18). The study proved that the most promising direction of consideration is the 14-factor solution. Acceptable reliability of the measure's individual subscales, moderate to high correlations between subscales, and satisfactory results within the context of construct validity were confirmed, testing intergroup differences and the convergent as well as divergent aspect of validity.
Examining the conducted factor analysis in more detail, it should be emphasized that the results obtained are not unambiguous. Admittedly, the best values of fit indices were obtained with a 14-factor model, consisting of 112 items, taking into account correlations between factors and covariances between error terms, but even with this model, only some of them indicated a good fit (i.e., the normed χ2 and RMSEA). Similar results were obtained in a Danish study (17). The authors of this study pointed out that confirmatory factor analysis is too restrictive, resulting in an overestimation of the correlations between latent variables. As a solution, they proposed using exploratory structural equation modeling (ESEM), which more adequately estimates these correlations. However, this would contradict the methodology of original questionnaire adaptation, where using CFA yielded appropriate fit indices. In all likelihood, therefore, the cause lies somewhere else.
Apart from the possibility of mistakes made at the translation level, another explanation could be cultural differences between the populations of the countries where the questionnaire was adapted. It would be valuable to compare the distributions of results in various populations. The weakest subscales in the Polish version turned out to be those related to the expression of anger (i.e., the Bully and Attack and Self-Aggrandizer modes). Much has been said about the suppression of anger in the generation of today's Polish 30-40 year olds, who consider it a cause for shame or a sign of weakness. This hypothesis opens up many directions for research on Polish anger. An interesting place to start would be to study modes in conjunction with assessing sensitivity to social approval.
Also noteworthy is the proportion of people surveyed. In the original study, the clinical population accounted for about 53,8 % of the subjects, of which about two-thirds were patients with a diagnosis of personality disorder, better differentiating the distribution in terms of mode severity. In the group analyzed in this study, the clinical population comprised 37,5%, and the group of subjects with a diagnosis of personality disorder was so small and heterogeneous that it was not singled for separate analysis. It certainly needs to be supplemented.
Perhaps the result was influenced by the fact that the method used (i.e., maximal likelihood) was not robust enough against the violation of the normality assumption. In such situations, the use of the asymptotically distribution free (ADF) method is postulated (37), which significantly increases the need for the number of observations tested (in this study to about 7,000). Due to the insufficient number of observed variables, this method could not be tested. Further limitations may have resulted from the high sensitivity of the χ2 statistic to the size of the study group and to the complexity of the model (34), which with 118 items is unavoidable. Therefore, we relied on the normalized value of the statistic χ2. Similar properties characterize the CFI and NNFI indices, which, while quite robust to sample size, show strong sensitivity regarding high model complexity (37). In light of the above, it would be valuable to conduct a factor analysis using data optimized for this purpose (perhaps on a more homogeneous group), possibly using a different evaluation method.
The question of applying factor analysis itself to data that were intended to represent states also requires consideration. Nezlek argues that while trait structure can be modeled using a factor approach based on single-level data, modeling state variability requires multiple measurements, for which a multilevel analysis is appropriate (38). It would therefore be extremely valuable to design a study that would include multiple measurements of schema modes, in situations that differ, for example, in the level of emotional arousal.
Taking the above issues into consideration, it is postulated that for now we should stay with the original factor structure of the questionnaire under study. This is due to the fact that – regardless of questionable fit indices – the internal consistency of the particular subscales was at least acceptable to excellent. An additional argument is the facade validity of the measure, which is justified by the use of factor division in clinical practice. Reducing the number of dimensions would result in a loss of shades of meaning, determining the patient's presentation of a particular mode.
To highlight the factor structure, the mean factor loadings for the subscales were checked, which also take acceptable to high scores. Following Tabachnick and Fidell's criterion (32) fairly attenuated cut-off point, i.e., 0,32, for individual items was adopted. This procedure was guided by an attempt to adapt the measure as closely as possible to the original. A more restrictive cut-off point for factor loadings would have required the removal of more items, which would have affected a structure of the tool, making comparisons more difficult in perspective.
Subsequent analyses examined construct validity. Mostly moderate correlations were obtained between subscales: positive between adaptive, positive between maladaptive and negative between the two groups. These results indicate the co-occurrence of adaptive modes and the co-occurrence of maladaptive modes. At the same time, the moderate values of the correlation coefficients show that we are referring to distinct constructs.
The study also proved the existence of significant differences between the scores obtained in the clinical group compared to the non-clinical group. Individuals in the clinical group scored significantly higher on maladaptive modes and lower on adaptive modes compared to the non-clinical group. The results collected are consistent with Young's et al. theoretical assumptions (19) and the data in the adaptations of the questionnaire that have been developed so far (12,14,16–18).
Only the Bully and Attack and Self-Aggrandizer modes did not differentiate between the group with psychiatric diagnoses and the healthy group. Perhaps this is a consequence of the fact that these are the scales with the lowest mean factor loadings. A second explanation may be related to the hypothesis that these are modes that differentiate more between individuals with a personality disorder diagnosis while not suffering from other types of mental disorders. These suppositions require further verification.
It is noteworthy that the greatest strength of the effect of comparisons between groups characterized the Happy Child and Vulnerable Child modes. It is observed that in clinical practice a very large role is attached to working with the Vulnerable Child mode, so that the patient is able to meet his needs. At the same time, it is only recently that attention has begun to be paid to the Happy Child mode, which, according to the data obtained, is an extremely important predictor of mental health.
The further comparison was made using a mixed clinical group consisting of subjects suffering from different types of mental disorders (such as depression, anxiety disorder, bipolar disorder, schizophrenia or alcohol dependence) and personality disorders. The severity of the disorders at the time of the study was not controlled. It certainly would be valuable to see whether the Polish version of the questionnaire also differentiates the group of patients with so-called Axis I versus those with personality disorders (Axis II, as, for example, in the study by Lobbesteal et al. (12)). It also would be recommended to control for the severity of the disorder at the time of the testing.
The final step in testing construct validity was to examine the associations of schema modes with external constructs (i.e., measures of temperament and character, coping styles, self-esteem, and anger in terms of trait and state). All predicted correlations proved significant. Most of them took at least a moderate value. There were also many unpredicted significant correlations that showed lower values compared to the hypotheses. It can be concluded that the obtained data indicate satisfactory theoretical validity in both convergent and divergent aspects.
An interesting result, contrary to prediction, was the higher correlations obtained between anger in the sense of a trait rather than a state. It opens the field for expanding the analysis to include the induction of affect and its importance in "triggering" modes.
In addition to the indicated modifications and new research directions, the literature and clinical practice acknowledge the need to distinguish new modes. Already in the original version of the questionnaire, the Over Controller or the Lonely Child and Abandoned and Abuse Child modes were distinguished (19). The recent literature abounds with newer modes (including for example: the Helpless Surrender, Pollyanna or Paranoid Controller modes; see (39)). It is possible that the inclusion of more scales will be a further direction in the development of the adapted tool, though certainly this should be done with consideration of their discriminative value and the utility of the measure for research and clinical purposes.
In conclusion, we can recommend using the Polish version of the Short SMI for both clinical and research purposes with the understanding of its limitations. The scale can be a great support, next to a professional clinical diagnosis, in psychotherapeutic work, indicating to the schema modes most often used by the respondent (both in the diagnostic layer and in the context of assessing effectiveness of treatment). In the area of research, the adapted inventory will allow to compare the results obtained in Poland with results from other countries and facilitate the development of schema therapy in accordance with the principles of evidence-based medicine.

Author Contributions

Conceptualization, A.G.; methodology, A.G., K.K., K.S. and D.S.; validation, A.G., K.K., K.S. and D.S.; formal analysis, A.G., K.K. and D.S.; investigation, A.G., K.K., K.S. and D.S.; data curation, A.G. and D.S.; writing—original draft preparation, A.G. and D.S.; writing—review and editing, A.G. and D.S.; visualization, A.G. and D.S.; supervision, K.K., K.S. and D.S.; project administration, A.G. and D.S.; funding acquisition, D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Young JE. Cognitive therapy for personality disorders: A schema-focused approach. Sarasota: Professional Resource Exchange; 1990.
  2. Young JE, Klosko JS, Weishaar ME. Schema Therapy: A Practitioner’s Guide. New York: Guilford Press; 2006.
  3. Zhang K, Hu X, Ma L, Xie Q, Wang Z, Fan C, et al. The efficacy of schema therapy for personality disorders: a systematic review and meta-analysis. Nord J Psychiatry. 2023 Jul 4;1–10. [CrossRef]
  4. Taylor CDJ, Bee P, Haddock G. Does schema therapy change schemas and symptoms? A systematic review across mental health disorders. Psychology and Psychotherapy: Theory, Research and Practice. 2017 Sep;90(3):456–79. [CrossRef]
  5. Masley SA, Gillanders DT, Simpson SG, Taylor MA. A Systematic Review of the Evidence Base for Schema Therapy. Cogn Behav Ther. 2012 Sep;41(3):185–202. [CrossRef]
  6. Bortolon C, Capdevielle D, Boulenger JP, Gely-Nargeot MC, Raffard S. Early maladaptive schemas predict positive symptomatology in schizophrenia: A cross-sectional study. Psychiatry Res. 2013 Oct;209(3):361–6. [CrossRef]
  7. Nilsson KK. Early maladaptive schemas and functional impairment in remitted bipolar disorder patients. J Behav Ther Exp Psychiatry. 2012 Dec;43(4):1104–8. [CrossRef]
  8. Boog M, van Hest KM, Drescher T, Verschuur MJ, Franken IHA. Schema Modes and Personality Disorder Symptoms in Alcohol-Dependent and Cocaine-Dependent Patients. Eur Addict Res. 2018;24(5):226–33. [CrossRef]
  9. Arntz A, Jacob GA, Lee CW, Brand-de Wilde OM, Fassbinder E, Harper RP, et al. Effectiveness of Predominantly Group Schema Therapy and Combined Individual and Group Schema Therapy for Borderline Personality Disorder. JAMA Psychiatry. 2022 Apr 1;79(4):287. [CrossRef]
  10. Koppers D, Van HL, Peen J, Dekker JJM. Exploring the effect of group schema therapy and comorbidity on the treatment course of personality disorders. Curr Opin Psychiatry. 2023 Jan;36(1):80–5. [CrossRef]
  11. Rafaeli E, Bernstein DP, Young J. Schema Therapy [Internet]. New York; 2011. Available from: www.routledgementalhealth.com/cbt-distinctive-features.
  12. Lobbestael J, Van Vreeswijk M, Spinhoven P, Schouten E, Arntz A. Reliability and validity of the short schema mode inventory (SMI). Behavioural and Cognitive Psychotherapy. 2010 Jul;38(4):437–58. [CrossRef]
  13. Lobbestael J, Van Vreeswijk M, Spinhoven P, Schouten E, Arntz A. Reliability and validity of the short schema mode inventory (SMI). Behavioural and Cognitive Psychotherapy. 2010 Jul;38(4):437–58. [CrossRef]
  14. Reiss N, Dominiak P, Harris D, Knörnschild C, Schouten E, Jacob GA. Reliability and validity of the German version of the schema mode inventory. European Journal of Psychological Assessment. 2012;28(4):297–304. [CrossRef]
  15. Nazir Riaz M, Khalily T, Kalsoom U e. Translation, Adaptation, and Cross Language Validation of Short Schema Mode Inventory (SMI). Pakistan Journal of Psychological Research. 2013;28(1):51–64.
  16. Lyrakos DG. The Validity of Young Schema Questionnaire 3rd Version and the Schema Mode Inventory 2nd Version on the Greek Population. Psychology. 2014;05(05):461–77. [CrossRef]
  17. Reiss N, Krampen D, Christoffersen P. Reliability and Validity of the Danish Version of the Schema Mode Inventory (SMI). Psychol Assess. 2016;28(3):e19–26. [CrossRef]
  18. Aytaç M, Köse Karaca B, Karaosmanoğlu A. Turkish adaptation of the Short Schema Mode Inventory. Clin Psychol Psychother. 2020 May 1;27(3):346–63. [CrossRef]
  19. Young JE, Arntz A, Atkinson T, Lobbesteal J, Weishaar ME, van Vreeswijk MF, et al. The Schema Mode Inventory. New York: Schema Therapy Institute; 2007.
  20. Drwal RŁ. Adaptacja kwestionariuszy osobowości. Warszawa: Wydawnictwo Naukowe PWN; 1995. 15 p.
  21. Cloninger C, Przybeck T, Svrakic D, Wetzel R. The Temperament and Character Inventory (TCI): a guide to its development and use. St. Louis, Missouri: Washington University, Center for Psychobiology of Personality; 1994.
  22. Hornowska E. Temperamentalne uwarunkowania zachowania. Poznań: Bogucki Wydawnictwo Naukowe; 2003. 50–66 p.
  23. Endler NS, Parker JDA. Coping inventory for stressful situations (CISS): manual. Toronto: Multi-Health System; 1990.
  24. Endler NS, Parker JDA. Assessment of multidimensional coping: Task, emotion, and avoidance strategies. Psychol Assess. 1994 Mar;6(1):50–60. [CrossRef]
  25. Szczepaniak P, Strelau J, Wrześniewski K. Diagnoza stylów radzenia sobie ze stresem za pomocą polskiej wersji kwestionariusza CISS Endlera i Parkera. Przegląd Psychologiczny. 1996;39(1):187–210.
  26. Rosenberg M. Society and the Adolescent Self-Image. New York: Princeton University Press; 1965. 30–31 p.
  27. Dzwonkowska I, Lachowicz-Tabaczek K, Łaguna Mariola. SES: polska adaptacja skali SES M. Rosenberga. Warszawa: Pracownia Testów Psychologicznych; 2008.
  28. Spielberger CD. STAXI-2 State-Trait Anger Expression Inventory, Research Edition. Professional Manual. Odessa: FL: PAR; 1999.
  29. Bąk W. Pomiar stanu, cechy, ekspresji i kontroli złości. Polska adaptacja kwestionariusza STAXI-2. Polskie Forum Psychologiczne. 2016;21(1):93–122.
  30. Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting Practices in Confirmatory Factor Analysis: An Overview and Some Recommendations. Psychol Methods. 2009 Mar;14(1):6–23. [CrossRef]
  31. Kline RB. Principles and Practice of Structural Equation Modeling. 4th Edition. New York: Guilford Press; 2016.
  32. Tabachnich BG, Fidell LS. Using multivariate statistics. Fifth Edition. Pearson Education Inc; 2007.
  33. Harrington D. Assessing Confirmatory Factor Analysis. In: Confirmatory Factor Analysis. Oxford University Press; 2008. p. 50–77. [CrossRef]
  34. Stone BM. The Ethical Use of Fit Indices in Structural Equation Modeling: Recommendations for Psychologists. Front Psychol. 2021 Nov 23;12. [CrossRef]
  35. Nunnally JC, Bernstein IC. Psychometric theory. Third Edition. New York: McGraw-Hill; 1994. 248–292 p.
  36. Anderson JC, Gerbing DW. Structural Equation Modeling in Practice: A Review and Recommended Two-Step Approach. Psychol Bull. 1988;103(3):411–23. [CrossRef]
  37. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods of Psychological Research Online. 2003;8(2):23–74.
  38. Nezlek JB. A multilevel framework for understanding relationships among traits, states, situations and behaviours. Eur J Pers. 2007 Oct;21(6):789–810. [CrossRef]
  39. Edwards DJA. Using Schema Modes for Case Conceptualization in Schema Therapy: An Applied Clinical Approach. Front Psychol. 2022 Jan 20;12. [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated