Back to Journals » Psychology Research and Behavior Management » Volume 17

Assessing Emotion Regulation Difficulties Across Negative and Positive Emotions: Psychometric Properties and Clinical Applications of the Perth Emotion Regulation Competency Inventory in the Chinese Context

Authors Zhu L , Zhang Q, Ni K, Yang XJ, Jin K, Wei W, Preece DA, Li BM, Cai XL

Received 15 May 2024

Accepted for publication 17 September 2024

Published 24 September 2024 Volume 2024:17 Pages 3299—3311

DOI https://doi.org/10.2147/PRBM.S478246

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 4

Editor who approved publication: Dr Bao-Liang Zhong



Lin Zhu,1 Qian Zhang,1 Ke Ni,2 Xue-Jun Yang,1 Kai Jin,3 Wei Wei,4– 6 David A Preece,7,8 Bao-Ming Li,1,9 Xin-Lu Cai1,9

1Institute of Brain Science and Jing Hengyi School of Education, Hangzhou Normal University, Hangzhou, People’s Republic of China; 2Qiqihar Mental Health Center, Qiqihar, People’s Republic of China; 3The Fifth People’s Hospital of Lin’an District, Hangzhou, Zhejiang, People’s Republic of China; 4Department of Neurobiology, Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, Zhejiang University School of Medicine, Hangzhou, People’s Republic of China; 5Liangzhu Laboratory, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, State Key Laboratory of Brain-Machine Intelligence, Zhejiang University, Hangzhou, People’s Republic of China; 6NHC and CAMS Key Laboratory of Medical Neurobiology, Zhejiang University, Hangzhou, People’s Republic of China; 7School of Population Health and Curtin enAble Institute, Curtin University, Perth, WA, Australia; 8School of Psychological Science, The University of Western Australia, Perth, WA, Australia; 9Zhejiang Philosophy and Social Science Laboratory for Research in Early Development and Childcare, Hangzhou Normal University, Hangzhou, People’s Republic of China

Correspondence: Xin-Lu Cai, Institute of Brain Science and Jing Hengyi School of Education, Hangzhou Normal University, Hangzhou, 311121, People’s Republic of China, Tel +86 571-28864320, Email [email protected]

Background: Abnormalities of regulating positive and negative emotion have been documented in patients with mental disorders. Valid and reliable psychological instruments for measuring emotion regulation across different valences are needed. The Perth Emotion Regulation Competency Inventory (PERCI) is a 32-item self-report measure recently developed to compressively assess emotion regulation ability across both positive and negative valences.
Purpose: This study aimed to validate the Chinese PERCI in a large non-clinical sample and examine the clinical utility in patients with major depressive disorder (MDD).
Methods: The Chinese PERCI was administered to 1090 Chinese participants (mean age = 20.64 years, 773 females). The factor structure, internal consistency, test-retest reliability, convergent validity, concurrent validity, and predictive validity were examined. Moreover, a MDD group (n = 50) and a matched healthy control group (n = 50) were recruited. Group comparisons and the linear discriminant analysis were conducted to assess the clinical relevance of the PERCI.
Results: Confirmatory factor analysis supported the intended eight-factor structure of the PERCI in the Chinese population. The PERCI showed high internal consistency, test-retest reliability, as well as good convergent and concurrent validity. The MDD group had significantly higher PERCI scores than the healthy control group. Linear discriminant function comprised of the eight factors successfully distinguish patients with MDD from their matched controls.
Conclusion: The Chinese version of the PERCI is a valid and reliable instrument to compressively measure emotion regulation across positive and negative valences in the general Chinese population and patients with depression.

Plain Language Summary: The Perth Emotion Regulation Competency Inventory was designed to comprehensively assess emotion regulation ability across both positive and negative valences. This study provided the first translation and psychometric evaluation of the PERCI in the Chinese context. The findings support that the Chinese version of the PERCI is a reliable and valid measurement for assessing emotion regulation across positive and negative valences in research and clinical practice.

Keywords: emotion regulation, reliability, validity, factor structure, depression

Introduction

Emotions are subjective responses to internal and external events across experiential, behavioral, and physiological channels of the emotion system.1 Emotion regulation refers to the processes by which individuals modify the intensity, duration, or frequency of emotional experiences,2,3 which plays an important role in adapting to the environment4 and maintaining mental health.5,6 Difficulties in emotion regulation have been observed in various mental disorders7–10 and have been found as a key risk factor for the development and persistence of psychopathology,11,12 including major depressive disorder,13 anxiety disorder,14 and autistic spectrum disorder.15 Previous studies in Chinese population have found that emotion dysregulation is closely related with suicidal behaviors16 and negative affect.17 In addition, emotional intelligence has been suggested to have four components, including emotional expression, emotional regulation, intrinsic emotional satisfaction, and extrinsic emotional satisfaction.18 Importantly, as the ultimate objective of emotional intelligence, the intrinsic and extrinsic emotional satisfaction has been found to be achieved through the process of emotional expression and emotional regulation.18 Moreover, deficits in emotion regulation have been found to be closely related with worse well beings of both community population19 and patients with mental disorders.20 Therefore, it is crucial to develop reliable and suitable measures for emotion regulation ability.

Numerous tools have been developed to measure emotion regulation. For example, the Emotion Regulation Questionnaire (ERQ)21 and the Cognitive Emotion Regulation Questionnaire (CERQ)22 are widely used to assess individual differences in the habitual use of emotion regulation strategies. However, emotion regulation is a multifaceted construct, with emotion regulation strategies representing only one aspect of its broader framework. On the other hand, the Difficulties of Emotion Regulation Scale (DERS)23 and the DERS-Positive24 have been developed to evaluate emotion regulation difficulties, which provide an overall index of emotion regulation competency. Albeit the former taps into the regulation difficulties of negative emotions and the latter only assesses positive emotions. Furthermore, the DERS and the DERS-Positive have different number of items and factor structure. Therefore, it is difficult to combine the scores from both scales to provide an overall score of emotion regulation ability across negative and positive valences.25 In addition, abnormal levels of both negative and positive emotions, including increased levels of negative emotions (eg, sadness and anxiety) and decreased levels of positive emotions (eg, anhedonia), are core symptoms of many mental disorders (such as mood disorder and psychotic disorders).12,26,27

In order to assess emotion regulation ability across both positive and negative valences in a single tool, Preece et al developed the Perth Emotion Regulation Competency Inventory (PERCI).25 The PERCI is a multidimensional scale with 32 items, which assesses one’s ability to alter emotions experientially, behaviorally, and cognitively across both positive and negative emotions.25 It has four subscales in each valence: controlling experience, inhibiting behaviors, activating behaviors, and tolerating emotions. The ability to alter one’s emotion in changing experiential feelings is assessed through a set of subscales named as Positive-Controlling experience (P-Sub; 4 items, eg, I do not know what to do to create pleasant feelings in myself) and Negative-Controlling experience (N-Sub; 4 items, eg, when I am feeling bad, I have no control over the strength and duration of that feeling). The ability to determine whether and when it is appropriate to implement emotion regulation through experiential channel in the first place, is measured by another set of subscales (Positive-Tolerating emotions, P-Tol; 4 items, eg, when I am feeling good, I must try to eliminate those feelings; Negative-Tolerating emotions, N-Tol; 4 items, eg, when I am feeling bad, I must try to totally eliminate those feelings). Behavioral responses are measured in the other two sets of subscales. They assess the ability to inhibit inappropriate response tendencies (Positive-Inhibiting behaviors, P-Inh; 4 items, eg, when I am feeling good, my behavior becomes out of control; Negative-Inhibiting behaviors, N-Inh; 4 items, eg, when I am feeling bad, my behavior becomes out of control) and activate desired behaviors when experiencing positive and negative emotions (Positive-Activating behaviors, P-Act; 4 items, eg, when I am feeling good, I have trouble getting anything done; and Negative-Activating behaviors, 4 items, N-Act; eg, when I am feeling bad, I have trouble of getting anything done). Moreover, the PERCI Positive-Emotion regulation composite and the PERCI Negative-Emotion regulation composite can be derived, which measures the ability to regulate positive and negative emotions separately. Finally, the total score of all items is a marker for the overall ability of emotion regulation ability.25

Preece et al25 have demonstrated an eight-factor structure of the PERCI, which was consistent with contemporary emotion regulation theory.3 Moreover, the PERCI has been found to have good reliability and validity in Australian, United States, Iranian, and Turkish samples.25,28–31 As for the clinical application, McKay et al32 utilized the PERCI in children with attention-deficit/hyperactivity disorder (ADHD) and found that the impairments in positive emotion regulation significantly predicted the social difficulties. To the best of our knowledge, the psychometric properties of the PERCI has not been examined in the Chinese context. Difficulties in emotion regulation have been found in patients with major depressive disorder (MDD)8 and have been proposed to be a risk factor for the onset of depression.33 Thus, we further examined the clinical utility of the Chinese PERCI in patients with MDD.

The purpose of the present study was to investigate the psychometric properties and clinical utility of the Chinese PERCI. First, the factor structure, internal and test-retest reliability, convergent and concurrent validity, as well as predictive validity of the PERCI were examined in a large non-clinical sample. Then, the clinical utility of the Chinese PERCI was examined in patients with MDD. Given that the eight-factor structure of the PERCI has been reported in previous studies across cultures,25,28,30,31 We hypothesized that the Chinese version of the PERCI would retain the original eight-factor structure. Second, we hypothesized that the PERCI would have good psychometric properties. Finally, we expected that the PERCI scores would be able to distinguish patients with MDD from healthy controls successfully.

Methods

Participants

For the non-clinical sample, a total of 1717 participants were recruited through online and offline advertisement in Hangzhou, Beijing, and Qiqihar from June to October, 2022. Participants completed a battery of self-reported questionnaires through an online platform named Wenjuanxing (https://www.wjx.cn/). The online assessment took around 70 minutes. All participants received 25 RMB as compensation for their time. As all question items were preset as “mandatory” in the online platform, there was no missing value in our data. Ten pairs of lie or inattention detection items were incorporated in the set of questionnaires to detect non-valid response patterns.34,35 An example pair is (a) I want to know others; and (b) I do not want to know others at all. Ten pairs of items could be found in Supplementary Table S1. The exclusion criteria for the non-clinical sample were as follows: (1) presence of current or past mental disorders, (2) having a family history of mental disorders, (3) having a history of neurological disorders or significant head injuries, (4) having substance abuse or alcohol dependence, and (5) providing conflicting responses for more than 3 lie/inattention-detection item pairs.36,37 A total of 1090 participants (Mage = 20.64 years, SDage = 2.96 years; Medu = 14.12 years, SDedu = 1.87 years, 317 males; see Table 1) were included for further analyses. Most participants identified themselves as Han Chinese (95.23%) and few participants (4.77%) are ethnic minorities. Ethnicity and other diversity issues were not further explored in current study. Furthermore, all participants were contacted through text to completed the PERCI again after a four-week interval to assess the test-retest reliability. A total of 340 responses were collected.

Table 1 Descriptive Statistics and Reliability of the Administered Measures

For the clinical utility, the required minimum number of participants was 42 for each group, with effect size of 0.15, a of 0.05, power of 0.95 calculated using G*Power.38 A total of 50 patients with MDD were recruited from a Mental Health Center. They were diagnosed using the Diagnostic and Statistical Manual of Mental Disorder-IV (DSM-IV) Axis I disorders.39 The exclusion criteria for the clinical sample were: (1) having a history of head trauma or neurological disorders, (2) having a history of substance or alcohol dependence, (3) having mental retardation, (4) having a history of transcranial magnetic stimulation or electroconvulsive therapy in past 12 weeks. The 17-item Hamilton Rating Scale (HAMD) was used by qualified psychiatrists to assess the depressive symptoms of patients. All patients were medicated with an average fluoxetine equivalent of 29.96 (± 15.89) mg/day. The mean illness duration was 4.18 (± 6.17) years. Moreover, 50 healthy controls were recruited from the local communities. The exclusion criteria for healthy controls were the same as those in the large non-clinical sample. The procedure of participants’ recruitment is presented in Figure 1.

Figure 1 Flow chart of participants recruitment.

All participants provided informed consent. The study was approved by the Ethics Committee of the University (protocol number: 20221206) and was conducted in accordance with the Declaration of Helsinki.

Measures

The Chinese Version of the Perth Emotion Regulation Competency Inventory (PERCI)

The PERCI is a 32-item self-report measure designed to assess one’s ability to regulate positive and negative emotions.25 The PERCI has eight subscales (controlling emotions, inhibiting behaviors, activating behaviors, and tolerating emotions for both negative and positive emotions). All items are answered on a 7-point Likert scale (from 1 as for “strongly disagree” to 7 as for “strongly agree”), with higher scores indicating higher levels of difficulties in emotion regulation.

With permission to translate and validate the PERCI from the authors,25 a bilingual expert in psychology and a postgraduate student majoring in psychology translated the English version of the PERCI into Chinese independently. After comparing the two draft versions, discrepancies were identified and reconciled through discussions and consensus. Then, another bilingual psychology expert who had no previous knowledge of the original version of the PERCI back-translated the revised Chinese version. Further modifications were made to achieve highest possible interchangeability between the original version and the Chinese version of the PERCI. The Chinese translation of the PERCI can be found in the Supplementary Table S2.

The Beck Depression Inventory (BDI)

The BDI is a 21-item self-reported questionnaire for measuring the severity of depressive symptoms.40,41 Each item is rated on a 4-point Likert scale ranging from 0 (symptom absent) to 3 (severe symptom), with higher scores indicating higher levels of depression. The Chinese version of the BDI has been validated to have good psychometric properties.41 The Cronbach’s alpha coefficient for the BDI was 0.94 in the large non-clinical sample.

The Emotion Regulation Questionnaire (ERQ)

The ERQ is a 10-item self-report questionnaire to assess the individual difference in two emotion regulation strategies (Cognitive Reappraisal and Expressive Suppression).21,42 Each item is rated on a 7-point Likert scale ranging from 1 (completely disagree) to 7 (completely agree), with higher scores indicating higher frequency of using the certain regulation strategy. The Chinese version of the ERQ has showed good psychometric properties.42 The Cronbach’s alpha for the Cognitive Reappraisal subscale and the Expressive Suppression subscale were 0.86 and 0.79 in the large non-clinical sample, respectively.

The Depression Anxiety and Stress Scale (DASS-21)

The DASS-21 is a 21-item self-reported measure of depression, anxiety, and stress.36,43 Each item is rated on a 4-point Likert scale ranging from 0 (did not apply to me at all) to 3 (applied to me very much or most of the time), with higher scores indicating greater severity of the symptoms. The Chinese version of the DASS has been validated to have good reliability and validity.36 The Cronbach’s alphas for the DASS-21 subscales and the total score in our large non-clinical sample were 0.84 (for the Anxiety subscale), 0.88 (for the Depression subscale), 0.87 (for the Stress subscale), and 0.95 (for the total score).

The Difficulties in Emotion Regulation Scale (DERS)

The DERS is a 36-item self-report scale assessing difficulties in emotion regulation.23,44 The DERS has 6 subscales, including difficulty accepting emotional responses, lack of emotional awareness, limited access to emotion regulation strategies, difficulties engaging in goal-directed behaviors when emotionally aroused, impulse control difficulties, and lack of emotional clarity. Items are rated on a 5-point Likert scale ranging from 1 (almost never) to 5 (almost always), with higher scores indicating higher levels of difficulties in emotion regulation. The Chinese version of the DERS has been shown to have consistent factor structure, as well as adequate reliability and validity.44 The Cronbach’s alphas for the DERS subscales and the total score in our large non-clinical sample were 0.89, 0.79, 0.89, 0.84, 0.87, 0.74, and 0.93, respectively.

Data Analyses

Data analyses were conducted using SPSS version 22 and AMOS 21.0 (IBM, released 2013; IBM SPSS Statistics for Windows, Version 22.0). Eight factor structure of the PERCI (one-factor model, two-factor model, four-factor model, bifactor model, and four eight-factor models with a first-order latent variable, two second-order variables, and a third-order latent variable; see Supplementary Figure S1) were assessed via confirmatory factor analyses (CFA, maximum likelihood estimation based on a Pearson covariance matrix) in AMOS 26. The goodness-of-fit indices of the CFA models included the comparative fit index (CFI), Tucker Lewis index (TLI), Akaike information criterion (AIC), root mean square error of approximation (RMSEA), and standardized root mean residual (SRMR). A smaller AIC value indicated a better fit of the model.45 When CFI ≥ 0.90,46 TLI ≥ 0.90,47 RMSEA ≥ 0.0848 and SRMR ≥ 0.08,47 the model would be considered as a good fit to the data.46,47,49 To improve the robustness of the findings, all models were tested using the package lavaan version 0.6–1850 in R to for confirmatory factor analysis with robust maximum likelihood estimation (MLR).

Internal consistency reliability of the PERCI subscales, composite, as well as total scale was evaluated using the Cronbach’s α coefficients (with accepted value ≥ 0.70, good ≥ 0.80, excellent ≥ 0.90). Test-retest reliability was assessed with the intraclass correlation coefficients (ICC, ICC ≥ 0.50 is considered moderate, ≥0.75 as good, and ≥0.90 as excellent).51 Convergent validity was assessed by conducting correlations between the PERCI scores and the ERQ as well as the DERS scores. To evaluate concurrent validity, correlations between the PERCI scores and the DASS subscales scores were calculated. In order to investigate whether the PERCI scores could predict depressive levels in the non-clinical sample, predictive validity of the PERCI was examined by conducting a stepwise multiple regression analysis, with the BDI scores as the dependent variable and the PERCI scores as well as the demographic factors as the predictor variables. Incremental validity was checked through another stepwise multiple regression analysis testing to what extent the PERCI adding predictability of BDI to the ERQ (set as step 1) and DERS (set as step 2).52

To explore the clinical utility of the PERCI, variance analysis was applied to compare the PERCI total score between patients with MDD and healthy controls. Multivariate analyses of variance (MANOVA) were used to compare the scores of PERCI subscales and composites between the two groups. A Bonferroni correction (0.05/ 8= 0.00625) was applied for multiple testing. As healthy controls have significantly longer years of education than that of patients with MDD, multivariate analyses of covariance were conducted with gender, age, and years of education as covariances. Finally, a linear discriminant analysis was conducted to examine the extent to which the PERCI could be used to differentiate the two groups.

Results

Factor Structure

As shown in Table 2, the eight-factor model with a first-order latent variable fitted to the data best. All items loaded above 0.50 on each factor and all the eight factors were significantly and positively correlated in the first-order eight-factor model (see Figure 2). The one-factor model, two-factor model, and four-factor model worked worse than the eight-factor models, further supporting the necessity of separating factors based on different channels and different valences of emotion regulation. Results of CFA using MLR also found the eight-factor structure the best fitting model (see Supplementary Table S3).

Table 2 Goodness-of-Fit Index Values from Confirmatory Factor Analyses of the PERCI

Figure 2 Graphical representations of the eight-factor model with factor loadings.

Abbreviations: PERCI, Perth Emotion Regulation Competency Inventory; N-Sub, Negative-Controlling experience; N-Inh, Negative-Inhibiting behavior; N-Act, Negative-Activating behavior; N-Tol, Negative-Tolerating emotions; P-Sub, Positive-Controlling experience; P-Inh, Positive-Inhibiting behavior; P-Act, Positive-Activating behavior; P-Tol, Positive-Tolerating emotions.

Reliability

The Cronbach’s alpha coefficient for the PERCI total score was 0.95 in the non-clinical sample (see Table 1), indicating excellent internal consistency reliability. The Cronbach’s alpha coefficients of the PERCI subscales and composite scores ranged from 0.79 to 0.95, demonstrating good to excellent internal consistency reliability. For patients with MDD and healthy controls, the Cronbach’s alpha coefficients were both above 0.70, showing good internal consistency in general (see Table 1). In terms of test-retest reliability, the ICC for the PERCI subscales, composites, and total scale scores ranged from 0.70 to 0.86, indicating good to excellent test-retest reliability.

Validity

Convergent and Concurrent Validity

Pearson correlation coefficients among the PERCI, the DERS, ERQ, and DASS are presented in Figure 3a. In general, higher PERCI scores were significantly correlated with more difficulties in emotion regulations (as measured by the DERS), lower frequency of using the adaptive emotion regulation strategy, and higher frequency of using the maladaptive strategy (as measured by the ERQ), suggesting that the PERCI had good convergent validity. In addition, the PERCI subscales and composite scores, as well as total score were significantly and positively correlated with the DASS subscales scores, indicating good concurrent validity of the PERCI.

Figure 3 (a) Correlation coefficient matrix diagram of the PERCI, DERS, ERQ, DASS, and BDI. (b) Violin plots of the PERCI subscales, composite, and total scale scores in patients with MDD and healthy controls.

Abbreviations: Total, total score of the Perth Emotion Regulation Competency Inventory; N-Com, composite score of negative emotion regulation subscales; P-Com, composite score of positive emotion regulation subscales; N-Sub, Negative-Controlling experience; N-Inh, Negative-Inhibiting behavior; N-Act, Negative-Activating behavior; N-Tol, Negative-Tolerating emotions; P-Sub, Positive-Controlling experience; P-Inh, Positive-Inhibiting behavior; P-Act, Positive-Activating behavior; P-Tol, Positive-Tolerating emotions; ERQ_Cog, Cognitive reappraisal in the Emotion Regulation Questionnaire; ERQ_Sup, Suppression in the Emotion Regulation Questionnaire; DASS_Total, total score of the Depression Anxiety Stress Scale; DERS_Total, total score of the Difficulties in Emotion Regulation Scale; Non-Acceptance, difficulty accepting emotional responses; Awareness, lack of emotional awareness; Strategies, limited access to emotion regulation strategies; Engagement, difficulties engaging in goal-directed behavior when emotionally aroused; Impulsiveness, impulse control difficulties; Clarity, lack of emotional clarity; BDI, Beck Depression Inventory; MDD, patients with major depressive disorder; HC, healthy controls. **p < 0.01.

Notes: Significant correlations (p < 0.05) were represented in bold.

Predictive and Incremental Validity

For predictive validity, results of stepwise regression analyses are presented in Table 3. After controlling for gender, age, and years of education (R2 = 0.028, adjusted R2 = 0.026, F (3, 985) = 10.572, p < 0.001; function coefficient for three factors were −1.802, 0.467, −0.434, respectively, for the constant was 6.794), the BDI scores could be significantly predicted by the four subscales of the PERCI (Negative-Controlling experience, Negative-Inhibiting behaviors, Positive-Controlling experience, and Positive-Tolerating emotions, R2 = 0.313, adjusted R2 = 0.309, F (7, 981) = 70.509, p < 0.001; function coefficient for the subscales were 0.442, 0.241, 0.288, and 0.219, respectively, for the constant was −10.852). For the incremental validity, the regression analysis showed that the PERCI significantly increase the predictability of the BDI (R2 = 0.405, adjusted R2 = 0.397, R2 changed = 0.028, p < 0.05; Supplementary Table S4).

Table 3 Stepwise Multiple Regression of the BDI Score on Demographic Factors and Each Subscale of the PERCI

Clinical Utility

As shown in Table 1, patients with MDD had significantly higher PERCI total scores than healthy controls (F (1, 98) = 20.49, p < 0.001, η² = 0.17). As for the PERCI subscales scores, results from MANOVA showed significant differences between patients with MDD and healthy controls (see Table 1). Follow-up ANOVAs showed significant between-group differences in the negative subscales and negative composite scores of the PERCI, while non-significant differences were found in the positive subscales and positive composite scores (see Figure 3b). The results from MANCOVA showed consistent results with the MANOVA (see Supplementary Table S5). Furthermore, the scores of the HAMD were positively and significantly correlated with the total, subscale, and composite scores of the PERCI (see Supplementary Table S6).

Finally, results of the linear discriminant analysis showed that the discriminant function (discriminant score = 1.012 × Negative-Controlling experience +0.228 × Negative-Inhibiting behavior – 0.182 × Negative-Activating behavior +0.057 × Negative-Tolerating emotions – 0.510 × Positive-Controlling experience – 0.459 × Positive-Inhibiting behavior – 0.122 × Positive-Activating behavior +0.555 × Positive-Tolerating emotions) significantly distinguished patients with MDD from healthy controls (λ = 0.56, χ2(8) = 54.77, p < 0.001). The discriminant function was able to correctly classify 82.00% of the originally grouped participants (74.00% for patients with MDD, 90.00% for healthy controls).

Discussion

In the present study, we examined the psychometric properties of the Chinese version of the PERCI in a large non-clinical sample and explored the clinical utility of the PERCI in patients with MDD. The Chinese version of the PERCI appeared to show a reliable eight-factor structure. The PERCI demonstrated good to excellent internal and test-retest reliability, as well as high convergent and concurrent validity. Moreover, the Chinese version of the PERCI significantly distinguished patients with MDD from healthy controls.

The results of the CFA strongly supported the intended eight-factor structure, which is consistent with the original PERCI study (in Australian adults).25 Furthermore, previous studies also reported that the PERCI had a robust eight-factor structure in individuals from different cultural background, such as American adults, Iranian adults, and Iranian adolescents.28,31 These findings provide robust evidence for the multidimensional emotion construct of emotion regulation ability across Eastern and Western cultures. Moreover, the eight-factor models have better fit to the data than the simpler models, highlighting the significance of distinguishing different valence as well as different channels of emotion regulation.21 Positive emotions play a crucial role in various settings, including education53 and work.54 Moreover, emotion regulation has been found to be influenced by cultural contexts.55 Asian values, such as interdependence and harmony in relationships, may contribute to emotional suppression.56,57 Assessing positive emotions through the four channels suggested by the extended process model will enhance our understanding of positive emotion regulation.

The reliability of the Chinese PERCI was comparable to those in the original version,25 which evidenced a successful cross-cultural adaptation of the PERCI. We further extended the test-retest reliability of the PERCI over a 4-week interval, with ICCs generally higher than those reported by Mazidi et al.31 Significant correlations between the PERCI and the DERS, the ERQ, as well as the DASS and the BDI suggest a robust convergent and concurrent validity. Interestingly, our findings further showed that the depressive symptoms in general population was significantly predicted by both negative and positive subscales of the PERCI, highlighting the importance to distinguish negative and positive valences of emotion regulation ability. Accumulating evidence have documented a robust association between difficulties in emotion regulation and worse well-being in general population.58–61 Furthermore, dysregulation of positive emotion has been found in a wide range of mental disorders.27,62 Therefore, future research utilizing the PERCI might provide valuable insights into our understanding of regulating both positive and negative emotions.

As expected, we observed that patients with MDD had significantly higher total scores of the PERCI than healthy controls, indicating defected emotion regulation ability in patients with depression. Notably, a large body of literature has pointed out that dysregulation of emotion being a hallmark of depression.33,63,64 Further, we found worse emotion regulation ability for negative emotion in patients with MDD, which is consistent with previous studies.33,63,65 Depression severity was found to be positively correlated with the PERCI.66 However, patients with MDD were not significantly different in emotion regulation ability for positive emotion as compared with healthy controls. Medication might be a confounding factor which contributed to the non-significant results. In our study, patients with MDD were medicated using fluoxetine or other antidepressant medicine. Medication-naïve patients with MDD were found to have impairments in regulating both positive and negative emotions than healthy controls.67 A pharmacological study in healthy volunteers has demonstrated that even a single dose of fluoxetine consumption would influence emotional processing.68 In addition, patients with MDD were found to exhibit increased hedonic capacity after 8 weeks of treatment with antidepressant medications.69 Therefore, different stages of MDD patients (such as medication-naïve patients, medicated patients, and remitted patients) should be recruited in the future to explore the clinical utility of the PERCI.

This study has several limitations. First, the non-clinical sample and healthy controls were not screened using clinical interviews, such as Mini-International Neuropsychiatric Interview.70 Second, most of the data used in this study was cross-sectional and obtained through convenience sampling. Although we collected follow-up data for the PERCI with a 4-week interval, additional longitudinal data would be necessary to assess the invariance of emotion regulation over time. Third, the PERCI was designed to be used in a wide range of populations. Our study only recruited adults and patients with MDD, which limited the generalization of the findings. Future studies are encouraged to apply the PERCI in samples across different age (ie, adolescents) and with other mental disorders. Fourthly, the PERCI is a self-report assessment and all measures used to validate convergent validity were also based on self-report. Future effort is needed to combine the PERCI with behavioral paradigms for emotion regulation to further validate the scale. Next, the gender composition of our sample was uneven and the gender invariance of the PERCI remained unknown in current sample. However, as previous study found gender invariance in American and Iranian samples,31 we would speculate that the PERCI would also exhibit gender invariance in a Chinese context. Future studies should recruit samples with balanced gender ratios to explore the question of gender invariance. Lastly, as suggested by Preece et al, existing measures on emotion regulation could be broadly classified into two categories, including process (or strategy used, such as the ERQ) and competence (or ability/difficulties to regulate emotions, such as the DERS). The PERCI only measures emotion regulation difficulties. Future assessment tools are recommended to provide a more comprehensive evaluation of emotion regulation.

Conclusion

In conclusion, our findings suggest that the Chinese version of the PERCI is a reliable and valid instruct to measure emotion regulation ability across positive and negative valences. Furthermore, the Chinese PERCI could successfully differentiate patients with MDD from their matched controls. Therefore, application of the PERCI in the future might help advance our understanding of emotion regulation among the Chinese population and might contribute to develop novel therapies for depression.

Data Sharing Statement

Data for this study are available upon reasonable request by contacting the corresponding author.

Ethical Approval

The study was approved by the Ethics Committee of the school of Basic Medical Sciences, Hangzhou Normal University, China. The study complies with the Declaration of Helsinki.

Acknowledgments

We would like to thank all the participants who took part in the studies. We would like to thank Dr. Han-xue Yang from Beijing Language and Culture University for her work on the back-translation of the Chinese PERCI.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by a grant from the National Natural Science Foundation of China (32200906; to XLC), the STI 2030-Major Projects (2021ZD0201705; to BML), Major Project of Philosophy and Social Science Research of the Ministry of Education of China (22JZD044; to XLC and BML), the Research Project of Shanghai Science and Technology Commission (20dz2260300; to XLC), the Fundamental Research Funds for the Central Universities, and the Starting Research Fund from Hangzhou Normal University (to XLC).

Disclosure

The authors report there are no competing interests to declare in this work.

References

1. Mauss IB, Levenson RW, McCarter L, Wilhelm FH, Gross JJ. The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion. 2005;5(2):175. doi:10.1037/1528-3542.5.2.175

2. Gross JJ. Antecedent-and response-focused emotion regulation: divergent consequences for experience, expression, and physiology. J Personality Soc Psychol. 1998;74(1):224. doi:10.1037//0022-3514.74.1.224

3. Gross JJ. The extended process model of emotion regulation: elaborations, applications, and future directions. Psychol Inq. 2015;26(1):130–137.

4. Rozin P. Preadaptation and the puzzles and properties of pleasure. Well-Being: Foundations Hedonic Psychol. 1999;109:133.

5. Hu T, Zhang D, Wang J, Mistry R, Ran G, Wang X. Relation between emotion regulation and mental health: a meta-analysis review. Psychol Rep. 2014;114(2):341–362.

6. Sheppes G, Suri G, Gross JJ. Emotion regulation and psychopathology. Ann Rev Clin Psychol. 2015;11(1):379–405. doi:10.1146/annurev-clinpsy-032814-112739

7. Seligowski AV, Lee DJ, Bardeen JR, Orcutt HK. Emotion regulation and posttraumatic stress symptoms: a meta-analysis. Cog Behav Ther. 2015;44(2):87–102. doi:10.1080/16506073.2014.980753

8. Visted E, Vøllestad J, Nielsen MB, Schanche E. Emotion regulation in current and remitted depression: a systematic review and meta-analysis. Frontiers Psychol. 2018;9:756. doi:10.3389/fpsyg.2018.00756

9. Daros AR, Williams GE. A meta-analysis and systematic review of emotion-regulation strategies in borderline personality disorder. Harvard Rev Psychiatry. 2019;27(4):217–232. doi:10.1097/HRP.0000000000000212

10. Ludwig L, Werner D, Lincoln TM. The relevance of cognitive emotion regulation to psychotic symptoms–a systematic review and meta-analysis. Clin Psychol Rev. 2019;72:101746. doi:10.1016/j.cpr.2019.101746

11. Masters MR, Zimmer-Gembeck MJ, Farrell LJ. Transactional associations between adolescents’ emotion dysregulation and symptoms of social anxiety and depression: a longitudinal study. J Early Adolescence. 2019;39(8):1085–1109.

12. Lincoln TM, Schulze L, Renneberg B. The role of emotion regulation in the characterization, development and treatment of psychopathology. Nat Rev Psychol. 2022;1(5):272–286.

13. Moccia L, Janiri D, Giuseppin G, et al. Reduced hedonic tone and emotion dysregulation predict depressive symptoms severity during the COVID-19 outbreak: an observational study on the Italian general population. Int J Environ Res Public Health. 2021;18(1):255.

14. Amstadter A. Emotion regulation and anxiety disorders. J Anxiety Disord. 2008;22(2):211–221. doi:10.1016/j.janxdis.2007.02.004

15. Mazefsky CA, Herrington J, Siegel M, et al. The role of emotion regulation in autism spectrum disorder. J Am Acad Child Adolesc Psychiatry. 2013;52(7):679–688.

16. Jiang L, Shi X, Wang Z, Wang S, Li Z, Wang A. Sleep problems and emotional dysregulation mediate the relationship between childhood emotional abuse and suicidal behaviors: a three-wave longitudinal study. J Affective Disord. 2021;295:981–988. doi:10.1016/j.jad.2021.09.003

17. Gong J, He Y, Wang S, Liu J. Emotion regulation and depressive symptoms mediate the association between schizotypal personality traits and suicidality in Chinese college students. Arch Suicide Res. 2022;26(2):614–625. doi:10.1080/13811118.2020.1818655

18. Husain W, Inam A, Wasif S, Zaman S. Emotional intelligence: emotional expression and emotional regulation for intrinsic and extrinsic emotional satisfaction. Psychol Res Behav Manag. 2022;15:3901–3913. doi:10.2147/PRBM.S396469

19. Berking M, Wupperman P. Emotion regulation and mental health: recent findings, current challenges, and future directions. Curr Opin Psychiatry. 2012;25(2):128–134.

20. Kraiss JT, Ten Klooster PM, Moskowitz JT, Bohlmeijer ET. The relationship between emotion regulation and well-being in patients with mental disorders: a meta-analysis. Comprehensive Psychiatry. 2020;102:152189. doi:10.1016/j.comppsych.2020.152189

21. Gross JJ, John OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Personality Soc Psychol. 2003;85(2):348. doi:10.1037/0022-3514.85.2.348

22. Garnefski N, Kraaij V, Spinhoven P. Negative life events, cognitive emotion regulation and emotional problems. Pers Individ Dif. 2001;30(8):1311–1327.

23. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Asses. 2004;26:41–54.

24. Weiss NH, Gratz KL, Lavender JM. Factor structure and initial validation of a multidimensional measure of difficulties in the regulation of positive emotions: the DERS-Positive. Behav Modification. 2015;39(3):431–453. doi:10.1177/0145445514566504

25. Preece DA, Becerra R, Robinson K, Dandy J, Allan A. Measuring emotion regulation ability across negative and positive emotions: the Perth Emotion Regulation Competency Inventory (PERCI). Pers Individ Dif. 2018;135:229–241. doi:10.1016/j.paid.2018.07.025

26. Krkovic K, Clamor A, Schlier B, Lincoln TM. Emotions and persecutory ideation in daily life: on the trail of the “chicken and egg” problem. J Abnormal Psychol. 2020;129(2):215. doi:10.1037/abn0000495

27. Vanderlind WM, Millgram Y, Baskin-Sommers AR, Clark MS, Joormann J. Understanding positive emotion deficits in depression: from emotion preferences to emotion regulation. Clin Psychol Rev. 2020;76:101826. doi:10.1016/j.cpr.2020.101826

28. Preece DA, Becerra R, Sauer-Zavala S, et al. Assessing emotion regulation ability for negative and positive emotions: psychometrics of the Perth emotion regulation competency inventory in United States adults. J Affect Disord. 2021;294:558–567. doi:10.1016/j.jad.2021.07.055

29. Foroughi AA, Parvizifard A, Sadeghi K, Parsa Moghadam A. Psychometric properties of the Persian version of the emotion regulation questionnaire. Trends Psychiatry Psychother. 2021;43(2):101–107. doi:10.47626/2237-6089-2018-0106

30. Derya A, Yasemin K. Regulation of positive and negative emotions: the Turkish adaptation study of the Perth emotion regulation competency inventory (PERCI). Stud Psychol. 2022;42(3):699–736.

31. Mazidi M, Zarei M, Preece D, Gross JJ, Azizi A, Becerra R. Evaluating emotion regulation ability across negative and positive emotions: psychometric properties of the Perth Emotion Regulation Competency Inventory (PERCI) in American adults and Iranian adults and adolescents. Aust Psychologist. 2023;58(5):321–335. doi:10.1080/00050067.2022.2157239

32. McKay E, Cornish K, Kirk H. Impairments in emotion recognition and positive emotion regulation predict social difficulties in adolescent with ADHD. Clin Child Psychol Psychiatry. 2023;28(3):895–908. doi:10.1177/13591045221141770

33. Joormann J, Stanton CH. Examining emotion regulation in depression: a review and future directions. Behav Res Ther. 2016;86:35–49.

34. Wang K, Yu XY, Yu CR, et al. Validation of the Chinese version of the body image concern inventory. Eval Health Prof. 2022;45(2):204–214. doi:10.1177/0163278720979651

35. Yan Y-J, Hu H-X, Wang L-L, et al. Negative schizotypal traits predict the reduction of reward motivation in effort–reward imbalance. European Arch Psychiatry Clin Neurosci. 2023;273(2):439–445. doi:10.1007/s00406-022-01419-3

36. Wang K, Shi H-S, Geng F-L, et al. Cross-cultural validation of the depression anxiety stress scale–21 in China. Psychol Asses. 2016;28(5):e88–e100. doi:10.1037/pas0000207

37. Cai XL, Ye Q, Ni K, et al. Chinese version of the Perth alexithymia questionnaire: psychometric properties and clinical applications. Gen Psychiatr. 2024;37(2):e101281. doi:10.1136/gpsych-2023-101281

38. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–191.

39. Bell CC. DSM-IV: diagnostic and statistical manual of mental disorders. JAMA. 1994;272(10):828–829.

40. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4(6):561–571. doi:10.1001/archpsyc.1961.01710120031004

41. Shek DT. Reliability and factorial structure of the Chinese version of the beck depression inventory. J Clin Psychol. 1990;46(1):35–43. doi:10.1002/1097-4679(199001)46:1<35::aid-jclp2270460106>3.0.co;2-w

42. Wang L, Liu H, Li Z, Du W. Reliability and validity of emotion regulation questionnaire Chinese revised version. China J Health Psychol. 2007;15(6):503–505.

43. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the beck depression and anxiety inventories. Behav Res Ther. 1995;33(3):335–343. doi:10.1016/0005-7967(94)00075-u

44. Li J, Han ZR, Gao MM, Sun X, Ahemaitijiang N. Psychometric properties of the Chinese version of the Difficulties in Emotion Regulation Scale (DERS): factor structure, reliability, and validity. Psychol Asses. 2018;30(5):e1. doi:10.1037/pas0000582

45. Cavanaugh J, Neath A. The Akaike information criterion: background, derivation, properties, application, interpretation, and refinements. WIREs Comput Stat. 2019;11(3):e1460.

46. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88(3):588.

47. Brown TA. Confirmatory Factor Analysis for Applied Research. Guilford publications; 2015.

48. Hancock GR. Power analysis in covariance structure modeling. Struct Eqn Model. 2006;69–115.

49. Browne MW, Cudeck R. Alternative ways of assessing model fit. Soc Methods Res. 1992;21(2):230–258.

50. Rosseel Y. lavaan: an R package for structural equation modeling. J Statis Softw. 2012;48:1–36.

51. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420.

52. Hunsley J, Meyer GJ. The incremental validity of psychological testing and assessment: conceptual, methodological, and statistical issues. Psychol Assess. 2003;15(4):446–455. doi:10.1037/1040-3590.15.4.446

53. Pekrun R, Goetz T, Titz W, Perry RP. Positive emotions in education. 2002.

54. Diener E, Thapa S, Tay L. Positive emotions at work. Ann Rev Org Psychol Org Behav. 2020;7(1):451–477.

55. Mesquita B, Albert D. The cultural regulation of emotions. Handbook Emotion Regulat. 2007;2:284–301.

56. Sutton RE, Harper E. Teachers’ emotion regulation. In: International Handbook of Research on Teachers and Teaching. Springer; 2009:389–401.

57. Yin H. Knife-like mouth and tofu-like heart: emotion regulation by Chinese teachers in classroom teaching. Soc Psychol Educ. 2016;19:1–22.

58. Quoidbach J, Wood AM, Hansenne M. Back to the future: the effect of daily practice of mental time travel into the future on happiness and anxiety. J Positive Psychol. 2009;4(5):349–355.

59. Erisman SM, Roemer L. A preliminary investigation of the effects of experimentally induced mindfulness on emotional responding to film clips. Emotion. 2010;10(1):72. doi:10.1037/a0017162

60. Nelis S, Luyckx K, Feldman G, Bastin M, Raes F, Bijttebier P. Assessing response styles to positive affect: one or two dimensions of positive rumination in the responses to positive affect questionnaire? Pers Individ Dif. 2016;89:40–46.

61. Kelley NJ, Glazer JE, Pornpattananangkul N, Nusslock R. Reappraisal and suppression emotion-regulation tendencies differentially predict reward-responsivity and psychological well-being. Bio Psychol. 2019;140:35–47. doi:10.1016/j.biopsycho.2018.11.005

62. Gruber J. Can feeling too good be bad? Positive emotion persistence (PEP) in bipolar disorder. Curr Directions Psychol Sci. 2011;20(4):217–221.

63. Joormann J, Vanderlind WM. Emotion regulation in depression: the role of biased cognition and reduced cognitive control. Clin Psychol Sci. 2014;2(4):402–421.

64. Gross JJ, Jazaieri H. Emotion, emotion regulation, and psychopathology: an affective science perspective. Clin Psychol Sci. 2014;2(4):387–401.

65. Liu DY, Thompson RJ. Selection and implementation of emotion regulation strategies in major depressive disorder: an integrative review. Clin Psychol Rev. 2017;57:183–194. doi:10.1016/j.cpr.2017.07.004

66. He Z, Lu F, Sheng W, et al. Functional dysconnectivity within the emotion-regulating system is associated with affective symptoms in major depressive disorder: a resting-state fMRI study. Aust N Z J Psychiatry. 2019;53(6):528–539.

67. Greening SG, Osuch EA, Williamson PC, Mitchell DG. The neural correlates of regulating positive and negative emotions in medication-free major depression. Soc Cognit Affective Neurosci. 2014;9(5):628–637. doi:10.1093/scan/nst027

68. Capitão L, Murphy S, Browning M, Cowen P, Harmer C. Acute fluoxetine modulates emotional processing in young adult volunteers. Psychol Med. 2015;45(11):2295–2308. doi:10.1017/S0033291715000240

69. Light SN, Heller AS, Johnstone T, et al. Reduced right ventrolateral prefrontal cortex activity while inhibiting positive affect is associated with improvement in hedonic capacity after 8 weeks of antidepressant treatment in major depressive disorder. Biol Psychiatry. 2011;70(10):962–968. doi:10.1016/j.biopsych.2011.06.031

70. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(20):22–33.

Creative Commons License © 2024 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, 3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.