Did Cognitive–Attentional Syndrome Symptoms Predict Stress and Trauma-Related Symptoms in the Initial Phase of COVID-19 Pandemic? Results from a Two-Wave Study on a Sample of Polish Internet Users

1. Introduction

The Cognitive–Attentional Syndrome (CAS) is a core concept in the theoretical model of metacognitive therapy for psychological disorders [1]. The Self-regulatory Executive Function model (S-REF) [2,3] considers inflexible and recurrent patterns of thinking in response to negative thoughts, feelings, and beliefs as the proximal cause of such disorders. The CAS is a set of symptoms associated with this maladaptive style of processing and is considered a transdiagnostic feature of psychopathology. It consists of perseverative and negative thinking (worry or rumination), threat monitoring, and unhelpful, paradoxically inefficient coping strategies used to deal with the first two aspects, such as thought suppression or avoidance.

CAS is hypothesized to develop due to underlying maladaptive metacognitions, which include positive and negative beliefs about thinking (i.e., metacognitive beliefs) [1,4,5]. For example, holding the belief that worrying keeps one safe (positive metacognitive belief) predisposes a person to worrying in response to a negative thought about potential danger. Furthermore, holding the belief that worrying will ruin one’s health (negative metacognitive belief) leads to a persistence of worrying because the person uses unhelpful strategies such as thought suppression to interrupt the process. The S-REF model posits that in all situations in which there is a discrepancy between self-relevant goals (outer circumstances and mental states) and perceived goals, Self-regulatory Executive Function becomes activated. This process might be accompanied by CAS activation and, therefore, negative emotions, self-appraisal, and sense of threat. While, in most people, periods of CAS activation are brief or non-existent, some will experience a vicious circle of prolonged CAS activation. For example, a person with health-related anxiety during the COVID-19 pandemic engages in negative repetitive thoughts about health-related issues due to positive metacognitive beliefs (e.g., “thinking about it will help me prepare”). Consequently, this person may find that they are devoting excessive amounts of time to worry. This observation may trigger worrying about worrying due to negative metacognitive beliefs about uncontrollability and negative consequences of worrying (e.g., “I cannot stop these thoughts and I will lose my mind”). Strategies such as attempting to suppress thoughts will probably lead to greater preoccupation with these thoughts, meaning that CAS is likely to continue to occur.

This process is understood in the S-REF model as the cause of emotional and other psychiatric disorders and their core, common component. Numerous studies confirm that maladaptive metacognitive beliefs and symptoms of CAS are positively associated with a wide range of psychological and behavioral problems, including emotional disorders such as depression, anxiety, and stress, as well as trauma-related disorders such as adjustment disorder (AjD) and posttraumatic stress disorder (PTSD) [6,7,8,9].

The aim of this study was to examine the association between symptoms of CAS and stress- and trauma-related psychopathology in the context of the COVID-19 pandemic, which is perceived as a highly stressful situation by most people [10]. To date, there have been many publications on the prevalence of emotional disorders obtained in studies conducted during the current pandemic. For example, in a web-based survey conducted by Rossi et al. [11], rates of different mental health outcomes were assessed in the Italian general population three to four weeks into lockdown measures after the outbreak of the pandemic. Almost a quarter (23%) of respondents reported symptoms of adjustment disorder, 37% reported posttraumatic stress symptoms, 22% high perceived stress, 21% anxiety, and 17% depression. In many other studies conducted in the first and subsequent months of the pandemic, increased rates of anxiety, depressive symptoms, and stress-related symptoms were found as well [12,13,14,15]. These symptoms seemed to persist throughout the pandemic. Given the wide range of mental health symptoms observed as outcomes of the pandemic, we decided to test whether CAS – a transdiagnostic factor and the main mechanism behind the persistence of psychopathology according to metacognitive theory – predicted symptoms of various emotional disorders in the first months of the pandemic or three months later. In particular, we focused on symptoms of adjustment disorder and traumatic stress, but additionally on other symptoms frequently included in studies on mental health during the pandemic (i.e., generalized anxiety and depression).

2. Materials and Methods

2.1. Participants

The total sample for this study consisted of 1,792 participants who were recruited online via social media (Facebook). They participated voluntarily and no financial or material reward was offered. Ethical approval for the study was granted by the Ethics Committee of the Faculty of Psychology at the [blinded for peer review]. The study was conducted via the internet using the Qualtrics platform. Participants had to be aged 18 years or older at the time of the survey; a total of 50 people were excluded from the study due to being under 18 years and 51 were excluded due to partial completion of the questionnaires, so the analysis ultimately included 1,693 participants. No other exclusion criteria were applied. The majority of respondents (78%) were female (21% men, and 1% intergender or non-binary) and the mean age of the sample was 31.23 years (SD=9.60, range 18–78 years).

The data was collected at two time points. The first wave took place from March 25th to April 30th 2020, three weeks after identification of the first coronavirus-infected patient in Poland, at the time when the state of epidemic had just been announced and the lockdown restrictions were introduced. It was therefore the time of the greatest restrictions, consisting of, for example, the closure of educational institutions, the closure of borders to air and rail traffic, prohibition of travel without due need, etc. After consenting, participants completed the online survey, which lasted about 25 minutes; if they agreed to participate in the second measurement, they were asked to provide an email address.

The second time point of the study was three months after the first wave; the data was collected from 3th July to 11th August 2020. In total, 418 people responded in the second wave, but only 362 answered questions. As in the first wave, most participants (78%) were female (20% men, and 1% intergender or non-binary) and the mean age of the sample was 30.40 years (SD=8.39, range 18–66 years). At the beginning of June, the rate of new infections was 300 people a day. In July, however, there was a sharp increase in new infections, with the rate doubling to about 650 infections per day. The rapid increase was related to the ongoing parliamentary elections and increased holiday tourism, during which, among other things, little attention was paid to maintaining social distancing and wearing masks.

2.2. Measures

The first part of the online survey included the measurement of sociodemographic variables (gender, age, relationship status, employment status, years of education, possibility of remote work). Then, respondents provided answers on self-report questionnaires:

Cognitive–Attentional Syndrome: The Cognitive–Attentional Syndrome Questionnaire (CAS-1) [1,4] questionnaire consists of 16 items. The first two are questions concerning the frequency of rumination and worry as well as concentration on threats. A further six items concern maladaptive behaviors used to cope with negative emotions and/or thoughts, such as thought and situation avoidance, drinking or substance abuse, and attempts to control thoughts or emotions. The last eight items concern positive and negative metacognitive beliefs core to Cognitive–Attentional Syndrome (e.g., “worrying too much could harm me” or “worrying helps me cope”). The results of the questionnaire were calculated as in previous papers [4,16]. The total results can range from 0 to 128, where a higher result indicates a greater level of Cognitive–Attentional Syndrome. The Polish version has good psychometric properties; in the current study Cronbach’s alpha was .83.

Impaired Functioning: The Work and Social Adjustment Scale (WSAS) [17] is a short questionnaire used to measure impaired functioning. It consists of five items with a nine-point scale (0 indicates no impairment at all and 8 indicates severe impairment). Possible scores range from 0 to 45. Based on the results [17], it is possible to distinguish three levels of functioning: 1–10 points: mild functional impairment; 11–20: moderately severe functional impairment; 21+: severe functional impairment. The original English version of the WSAS was translated into Polish with the use of the back translation procedure. The Polish version of the scale exhibited satisfactory internal consistency of scores in the current sample (α=.80).

Symptoms of Adjustment Disorder: The Adjustment Disorder – New Module 20 (ADNM-20) [18,19] is a questionnaire that measures symptoms of adjustment disorder. The ADNM-20 consists of two parts: a list of stressors and an item symptom list. The list of stressful events comprises a wide range of experiences (19 potential stressors; e.g., financial problems, divorce, serious illness), and requires reference to the event that was the most aggravating in the last six months. For the purpose of the study, the COVID-19 pandemic was also added to this list. The symptom list section measures the symptoms in response to the most distressing event(s) the respondent has experienced. The ADNM-20 was developed to more closely align with the ICD-11 guidelines for AjD and this is reflected in its focus on the two core symptom clusters of Preoccupation (four items) and Failure to Adapt (four items) [20]. However, it also includes the four associated symptom clusters of Avoidance (four items), Depression (three items), Anxiety (two items), and Impulsivity (three items). All items are answered on a four-point Likert scale with possible scores ranging from 20 to 80. The questionnaire consists of six subscales: Preoccupation, Failure to Adapt, Avoidance, Depressive Mood, Anxiety, and Impulsivity. Preoccupation and Failure to Adapt are the core symptoms of AjD and can be considered together as one subscale (AjD-C). Avoidance, Depressive Mood, Anxiety, and Impulsivity are accessory symptoms and can also be considered together as one subscale (AjD-AS). The Polish version of the ADNM-20 has excellent internal consistency, with α=.91 [10].

Traumatic Stress: The International Trauma Questionnaire (ITQ) [21] is a self-report measure of ICD-11 PTSD symptoms. Respondents complete the ITQ in relation to the most traumatic event they have experienced before answering questions about symptoms. In the current study, they were also given the option of referring to their experience of the COVID-19 pandemic. The PTSD items in the ITQ are completed with reference to how much the respondent has been bothered by each symptom in the past month and are accompanied by three items measuring functional impairment caused by these symptoms. All items are answered on a five-point Likert scale, with possible scores ranging from 0 to 24. A symptom is considered present where a score of ≥ 2 (moderately) is achieved. PTSD diagnosis requires traumatic exposure, at least one symptom present from each symptom cluster (Re-experiencing, Avoidance, and Sense of Threat), and endorsement of at least one indicator of functional impairment. The psychometric properties of the ITQ have been examined in both clinical and general population samples [22]. The measure is available in many language versions, including Polish (www.traumameasuresglobal.com/itq). The internal consistency of the PTSD item scores in the current sample was very good (α=.90).

Depression: Additionally, nine symptoms of depression were measured using the Patient Health Questionnaire-9 (PHQ-9) [23,24], available from the MAPI Research Institute, (www.phqscreeners.com). Respondents indicate how often they have been bothered by each symptom over the last two weeks using a four-point Likert scale. Possible scores range from 0 to 27, with higher scores indicating higher levels of depression. A cut-off score of 15 was used to identify participants likely to meet the criteria for depressive disorder, in accordance with the results of the meta-analysis of Manea et al. [25]. PHQ-9 scores have very good psychometric properties, showing excellent internal consistency in the current sample (α=.93).

Generalized Anxiety: Symptoms of generalized anxiety were measured using the Generalized Anxiety Disorder 7-item Scale (GAD-7) [26]. Like the PHQ-9, respondents indicate how often they have been bothered by each symptom over the last two weeks on a four-point Likert scale. Possible scores range from 0 to 21, with higher scores indicating higher levels of anxiety. The cut-off point for the scale is ≥10 points [27]. The GAD-7 has been shown to be a reliable and valid measure in multiple studies; the Polish translation of the scale is available from the MAPI Research Institute (www.phqscreeners.com). The internal consistency of the scores for the current sample was excellent (α=.92).

2.3. Statistical Analyses

In the first step, descriptive statistics and a series of paired-samples t-tests with Hedges’ g [28] were performed using IBM’s SPSS 28. Following the guidelines for managing missing data in longitudinal studies [29], attrition analysis was performed. Student’s t-test was used to investigate differences in the severities of measured symptoms of disorders between the two waves of study. For further investigation, structural equation modeling (SEM) was conducted in Mplus 8.5 [30] in order to determine relations between stressors, Cognitive–Attentional Syndrome, impaired functioning, and symptoms of: depression, generalized anxiety, AjD, and PTSD. The recommendations of Hu and Bentler [31] were used to determine the goodness of fit of the data to the model. The following parameters were taken into account, in accordance with the most commonly-used standards: RMSEA<.08 means acceptable fit and <.05 means good fit; CFI>.90 and TLI>.90 means acceptable fit, and CFI and TLI>.95 means good fit; SRMR should be<.08.

3. Results

3.1. Descriptive Statistics and Attrition Analysis

Descriptive statistics and the prevalence of disorders are shown in Table 1. Attrition analysis was performed using Little’s MCAR test on variables associated with psychopathology. The percentage of missing data ranged from 78.6% to 88.2%; due to high levels, no data imputation technique was introduced and partial responses were used for t-test analyses. Little’s MCAR test was insignificant, χ²(27)=24.60, p=.579, and we therefore concluded that missing data were randomly distributed.

3.2. Changes in the Severity of Symptoms

One of the purposes of this study was to examine changes in the severities of symptoms over time. A series of paired-samples t-tests were conducted to compare the number of stressors, symptoms of PTSD and adjustment disorder, depression, generalized anxiety, CAS, and impaired functioning between the two time points. There were significant differences in PTSD scores: Re-experiencing (M^T1=2.93, SD^T1=2.55, M^T2=4.86, SD^T2=2.48, t(286)=-12.86, p=<.001, Hedges’ g=-.76, 95% CI [-.90,-.63]), Avoidance (M^T1=3.77, SD^T1=2.62, M^T2=5.53, SD^T2=2.62, t(286)=-11.91, p=< .001, g=-.67, 95% CI[-.80,-.63]), and Sense of Threat (M^T1=3.70, SD^T1=2.72, M^T2=5.37, SD^T2=2.77, t(286)=-11.52, p=<.001, g=-.61, 95% CI[-.72,-.49]), core symptoms of AjD (M^T1=21.65, SD^T1=6.43, M^T2=20.11, SD^T2=6.67, t(329)=4.91, p=<.001, g=.23, 95% CI[.14,.33]), accessory symptoms of AjD (M^T1=31.95, SD^T1=8.98, M^T2=29.98, SD^T2=9.68, t(329)=4.45, p=<.001, g=.21, 95% CI [.12,.30]), Depression (M^T1=11.43, SD^T1=6.73, M^T2=10.05, SD^T2=6.55, t(278)=4.78, p=<.001, g=.21, 95% CI [.12,.30]), Generalized Anxiety (M^T1=9.55, SD^T1=6.10, M^T2=7.71, SD^T2=65.71, t(365)=4.46, p=<.001, g=.31, 95% CI [.21,.41]), and Impaired Functioning (M^T1=20.97, SD^T1=9.12, M^T2=18.23, SD^T2=10.54, t(361)=5.73, p=<.001, g=.28, 95% CI [.18,.37]). The following were statistically insignificant: changes in numbers of stressors (M^T1=5.49, SD^T1=2.42, M^T2=5.42, SD^T2=2.50, t(359)=.64, p=.522) and level of Cognitive–Attentional Syndrome (M^T1=75.65, SD^T1=20.33, M^T2=73.96, SD^T2=21.23, t(278)=1.73, p=.085). The results of this study indicate that there was a statistically significant difference between severity of symptoms AjD, depression, generalized anxiety and impaired functioning between the two time points: their intensities decreased over time. In contrast, PTSD symptoms worsened between measurements.

3.3. Structural Equation Modeling

The multiple-mediator SEM model was checked with a maximum likelihood estimator (ML) with 1,000 bootstrap re-samples. The proposed model of the relationship between the variables at first measurement (see Figure 1) showed good model fit indicators: χ²(28)=186.155, p=<.001; CFI = .984; TLI = .969; RMSEA = .058 (90% CI [.050, .066]; p = .049); SRMR = .020. In addition, indirect effects were analyzed between traumatic events and PTSD included other variables. The results are shown in Table 2. Cognitive–Attentional Syndrome and AjD were responsible for partial mediation in the relationship between stressors and other studied symptoms.

Figure 1. Structural equation model for T1. All paths except marked have p<.001.

Figure 1. Structural equation model for T1. All paths except marked have p<.001.

Notes: CAS – Cognitive–Attentional Syndrome, AjD – adjustment disorder, AjD-C – core symptoms of AjD, AjD-AS – accessory symptoms of AjD, GAD – symptoms of generalized anxiety, RE – re-experiencing, AV – avoidance, ST – sense of threat, IF – impaired functioning, FI – PTSD functional impairment, *p<.05, **p<.01, ns–non significant.

The T1 model was also used for the second measurement. Model fit indicators remained at an acceptable level: χ²(28)=81.748, p=<.001; CFI=.976; TLI=.952; RMSEA=.073 (90% CI [.055,.092]; p=.020); SRMR=.029. However, not all paths in the model were statistically significant. After removing them (see Figure 2), the model’s fit indicators improved slightly: χ²(39)=98.023, p=<.001; CFI=.973; TLI=.962; RMSEA=.065 (90% CI [.049,.081]; p=.061); SRMR=.033. According to simulations performed on the fit indicators, a value of ∆CFI smaller than or equal to -.01 indicates that the null hypothesis of invariance should not be rejected [32]. This confirms that the proposed models differ from each other.

Figure 2. Structural equation model for T2. All paths except those marked have p<.001.

Figure 2. Structural equation model for T2. All paths except those marked have p<.001.

Notes: CAS – Cognitive–Attentional Syndrome, AjD – Adjustment Disorder, AjD-C – core symptoms of AjD, AjD-AS – accessory symptoms of AjD, GAD – symptoms of Generalized Anxiety, RE – Re-experiencing, AV – Avoidance, ST – Sense of Threat, IF – Impaired Functioning, FI – PTSD functional impairment, **p<.01.

Table 2. Indirect effects.

Effects	T1 Estimate		T2 Estimate
	90% CI	p	90% CI		p
Stressors –> CAS –> PTSD	.028 .006–.050	.038	.070 -.012–.152	.162
Stressors –> AjD –> PTSD	.112 .085–.139	<.001	.145 .071–.219	.001
Stressors –> CAS –> AjD –> PTSD	.153 .128–.178	<.001	.211 .137–.284	<.001
Stressors –> AjD –> IF	.104 .080–.128	<.001	.124 .061–.186	.001
Stressors –> CAS –> AjD –> IF	.142 .123–.161	< 001	.180 .129–.231	<.001
Stressors –> AjD –> Depression Symptoms	.110 .083–.137	<.001	.174 .076–.272	.003
Stressors –> CAS –> Depression Symptoms	.042 .020–.065	.002	.025 -.076–.127	.681
Stressors –> CAS –> AjD –> Depression Symptoms	.150 .124–.150	<.001	.254 .149–.359	<.001
Stressors –> CAS –> GAD	.041 .021–.061	.001	.016 -.059–.091	.730
Stressors –> AjD –> GAD	.120 .091–.149	<.001	.168 .079–.257	.002
Stressors –> CAS –> AjD –> GAD	.164 .139–.189	<.001	.244 .158–.330	<.001

Notes: CAS – Cognitive–Attentional Syndrome, AjD – Adjustment Disorder, GAD – Symptoms of Generalized Anxiety, IF – Impaired Functioning. .

Table 2. Indirect effects.

Effects	T1 Estimate		T2 Estimate
	90% CI	p	90% CI		p
Stressors –> CAS –> PTSD	.028 .006–.050	.038	.070 -.012–.152	.162
Stressors –> AjD –> PTSD	.112 .085–.139	<.001	.145 .071–.219	.001
Stressors –> CAS –> AjD –> PTSD	.153 .128–.178	<.001	.211 .137–.284	<.001
Stressors –> AjD –> IF	.104 .080–.128	<.001	.124 .061–.186	.001
Stressors –> CAS –> AjD –> IF	.142 .123–.161	< 001	.180 .129–.231	<.001
Stressors –> AjD –> Depression Symptoms	.110 .083–.137	<.001	.174 .076–.272	.003
Stressors –> CAS –> Depression Symptoms	.042 .020–.065	.002	.025 -.076–.127	.681
Stressors –> CAS –> AjD –> Depression Symptoms	.150 .124–.150	<.001	.254 .149–.359	<.001
Stressors –> CAS –> GAD	.041 .021–.061	.001	.016 -.059–.091	.730
Stressors –> AjD –> GAD	.120 .091–.149	<.001	.168 .079–.257	.002
Stressors –> CAS –> AjD –> GAD	.164 .139–.189	<.001	.244 .158–.330	<.001

Notes: CAS – Cognitive–Attentional Syndrome, AjD – Adjustment Disorder, GAD – Symptoms of Generalized Anxiety, IF – Impaired Functioning. .

4. Discussion

According to the metacognitive theory of psychopathology, Cognitive–Attentional Syndrome (CAS) is the main factor in the development and maintenance of symptoms, including those that appear as the result of exposure to stress and trauma [10]. This assumption has been confirmed in many previous studies. The main aspect of CAS is extended negative thinking, in the forms of worry or rumination. In our study, we aimed to answer the question of whether CAS predicted symptoms of stress and trauma related disorders in the course of the COVID-19 pandemic, which was perceived as a highly stressful situation by the majority of respondents [10]. This study had a longitudinal design with two time points: at the beginning of the pandemic and three months later. Therefore, we analyzed the hypothesized model with reference to these two measurement points that assumed that CAS played a key role in predicting symptoms of psychopathology.

The first measurement included a large sample of adult Poles recruited through the internet in the first phase of COVID-19 pandemic (i.e., in the middle of March and April 2020). The tested model revealed that the CAS was predictive of all included symptomatology – adjustment disorder, posttraumatic stress disorder, depression, and generalized anxiety. However, it was not predictive of symptoms of impaired functioning measured by the Work and Social Adjustment Scale. Stressors included in the Adjustment Disorder – New Module 20 scale were predictive for CAS, which was a mediator between these events and AjD, PTSD, as well as impaired functioning and depressive symptoms. Cognitive–Attentional Syndrome in the first wave was also a direct predictor of all disorders included in the study. In other words, the symptoms of CAS intensified the symptoms of these disorders. This result may be treated as a confirmation of other findings revealing that life stressors are important risk factors for psychopathology in general, but also that AjD is a disorder specifically related to stress, because the more stressors, the more intense the internal cognitive-emotional processing in the form of worrying/rumination – the core symptom of AjD.

It is worth considering the context of the pandemic at the time the measurements took place. The government of Poland announced the first restrictions on the 11th of March 2020 (closure of all municipal institutions, schools, and childcare facilities, and the banning of all mass events or even going to the woods), and on March 20th the state of epidemic was officially announced. Mandatory government measures followed soon after, with the temporary closure of all non-essential services and additional physical distancing measures, etc. Our study started on the 25th of March – immediately after the introduction of these strict restrictions. Thus, the findings of the study at the first time point can be interpreted in the context of the pandemic as the result of an ongoing process of adaptation to the early phase of this unknown situation, which was somewhat naturally associated with an increased state of stress and anxiety, resulting in an increase of all symptoms of psychopathology.

The pandemic situation was somewhat different at the time of the second measurement: around this time, there was an increase in new infections due to the loosening of the restrictions (July 2020). However, this was also the holiday season, and this significant increase might be also explained by fatigue with the previous strict restrictions that had finally been lifted. The data from that time confirms that CAS mediated between reported stressors and symptoms of adjustment disorder. However, in this model it was AjD that mediated the relationship between both stressors and CAS with co-occurring symptoms of other disorders (PTSD, depression, and generalized anxiety). A significant increase of AjD symptoms predicted the severity of other symptoms, which indicates that intense stress and disturbances in adjustment were a dominant feature in the picture of psychopathology at that time. This means that extended negative thinking, which is the core aspect of CAS and also one of the main symptoms of AjD, was not only significantly increased, but also a leading cause of general symptom aggravation. Despite the decrease in the intensity of AjD symptoms between waves, it became a significant predictor of other psychopathology symptoms at both time points, except for traumatic stress. The reduced intensity of symptoms may be related to getting used to the unique situation and gradually becoming better at coping with it. However, symptoms of PTSD might be specific against other symptoms that co-occur in reaction to prolonged stressful situations or increased between two time points as a result of cumulative (traumatic) stress.

The main limitation of the study is, of course, the significant reduction in the number of participants at the second time point, which restricted the possible statistical analyses. Moreover, recruitment in our study relied on voluntary participation through social networks. For this reason, there may be an important selection bias against people who do not use social networks, as well as self selection, resulting in the highly unbalanced gender ratio (the much higher proportion of women) and predominance of young adults. An additional factor related to the respondents was a significant representation of people working from home offices. Furthermore, the survey was based on self-report assessments, not interview-based measures. Therefore, the rates of mental health outcomes obtained in this study should be interpreted with caution.

5. Conclusions

The results of this study confirm the mediating role of Cognitive–Attentional Syndrome between reported stressors and symptoms of emotional disorders (adjustment disorder, traumatic stress, generalized anxiety, and depression) in the context of the initial phase of the COVID-19 pandemic. It confirms also that this situation was highly stressful for many people, as indicated by the symptoms of stress and trauma-related disorders; however, even in the initial phase, including the first months after the outbreak of the pandemic, changes in symptoms were observed: symptoms decreased with time and in specific contexts, such as the loosening of restrictions and the onset of the holiday season.