The Difficulties in Emotion Regulation Scale – Short Form (DERS-SF): psychometric properties and invariance between genders

Patrícia Gouveia Catarina Ramos José Brito Telma C. Almeida Jorge Cardoso About the authors

Abstract

Background:

The understanding of how individuals manage their emotional experiences has flourished dramatically over the last decades, including assessing of emotion (dys) regulation. The Difficulties in Emotion Regulation Scale (DERS) is a well-validated and extensively used self-report instrument for emotion regulation problems. Despite the wide use of DERS in both clinical and research settings, its length potentially increases fatigue and frustration in respondents and limits its inclusion in brief research protocols. Consequently, a short-form version of the DERS (DERSSF) was developed, which requires cross-cultural adaptations and the study of its reliability and validity.

Objectives:

In order to address this issue, this study aimed to analyze the factorial structure and psychometric properties of the Portuguese version of DERS-SF and examine the DERS-SF factor structure invariance between men and women.

Methods:

The sample comprised 646 participants aged between 18 and 66 years (M = 29.93, SD = 11.71).

Results:

The correlated six-factor structure of the original version has an acceptable fit, good reliability, and convergent validity. Our results also suggested the invariance of the factor structure of the DERS-SF across genders.

Conclusion:

The DERS-SF has good psychometric properties, and it may be useful for future research and clinical work to use this six-factor brief version and improve emotion regulation assessment.

Keywords:
Emotion regulation; Assessment; DERS-SF; Psychometrics; Invariance

Introduction

Historically, the concepts of emotion and emotional regulation have been widely debated, as well as what characterizes the difficulties in emotional regulation, also known as emotional dysregulation. Emotions can be defined as transient changes in an individual's subjective experiences, behaviors, and physiological responses, resulting from motivationally relevant internal or external stimuli (Gross, 2015Gross, J. J. (2015). Emotion regulation; current status and future prospects. Psychological Inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781.
https://doi.org/10.1080/1047840X.2014.94...
; Lang, 1995Lang, P. J. (1995). The emotion probe: Studies of motivation and attention. American. Psychologist, 50(5), 372–385. https://doi.org/10.1037/0003-066X.50.5.372.
https://doi.org/10.1037/0003-066X.50.5.3...
). According to the functional perspective, emotions have an adaptive purpose, that is, they are promoters of survival (Kehoe & Havighurst, 2020Kehoe, C., & Havighurst, S. (2020). Treating emotion dysregulation in internalizing disorders. In T. P. Beauchine, & S. E. Crowell (Eds.), The Oxford handbook of emotion dysregulation, (pp. 443–462). Oxford University Press.).

The ability to manage emotions and express them appropriately requires skills in identifying, understanding, and regulating emotions in both intra- and interpersonal situations (Halberstadt et al., 2001Halberstadt, A. G., Denham, S. A., & Dunsmore, J. C. (2001). Affective social competence. Social Development, 10(1), 79–119. https://doi.org/10.1111/1467-9507.00150.
https://doi.org/10.1111/1467-9507.00150...
). Emotion regulation involves monitoring, evaluating, and modifying emotional reactions (Thompson, 1994Thompson, R. A. (1994). Emotion regulation: A theme in search of definition. Monographs of the Society for Research in Child Development, 59(2-3), 25–52. https://doi.org/10.2307/1166137.
https://doi.org/10.2307/1166137...
). It can be defined as a process that aims to intensify, decrease, or maintain the behavioral, cognitive, experiential, or physiological valences of emotion, depending on the subject's objectives (Gross & Thompson, 2007Gross, J. J., & Thompson, R. A. (2007). Emotion regulation: Conceptual foundations. In J. J. Gross (Ed.), Handbook of emotion regulation, (pp. 3–24). Guilford Press.). The effectiveness of emotion regulation implies the selection of appropriate strategies and flexibility in their use, which in itself means psychological adjustment (Campbell-Sills & Barlow, 2006Campbell-Sills, L., & Barlow, D. H. (2006). Incorporating emotion regulation into conceptualization and treatment of anxiety and mood disorders. In J. J. Gross (Ed.), Handbook of emotion regulation, (pp. 542–560). Guilford Press.). Deficits in emotion regulation are associated with psychopathology symptoms, other emotion-related constructs, and therapy progress (Victor & Klonsky, 2016Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the Difficulties in Emotion Regulation Scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/s10862-016-9547-9.
https://doi.org/10.1007/s10862-016-9547-...
).

Recognizing the importance of the functional role of emotions, Gratz and Roemer (2004)Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
proposed a multifactorial conceptualization of emotion regulation, formed by the following dimensions: consistency and understanding of emotions; acceptance of emotions; ability, in the face of negative emotions, to control impulsive behaviors and act in line with the desired goals; and ability to use flexible and appropriate emotion regulation strategies, modulating emotional responses to achieve individual goals and deal with the demands of the situation. The relative absence of any or all these capacities may indicate the presence of difficulties in emotion regulation or emotion dysregulation. Usually, emotion regulation skills increase with age (Orgeta, 2009Orgeta, V. (2009). Specificity of age differences in emotion regulation. Aging and Mental Health, 13(6), 818–826. https://doi.org/10.1080/13607860902989661.
https://doi.org/10.1080/1360786090298966...
). However, difficulties in regulating emotions can occur throughout the life cycle (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
).

Two different approaches to the concept of emotion regulation supported the development of self-report instruments: (1) emotion dysregulation responses in the form of emotional sensitivity, reactivity, and/or intensity and (2) maladaptive responses to emotions, regardless of the characteristics of the emotions (Gratz et al., 2020Gratz, K. L., Forbes, C. N., Wheeless, L. E., Richmond, J. R., & Tull, M. T. (2020). Self-report assessment of emotion dysregulation. In T. P. Beauchine, & S. E. Crowell (Eds.), The Oxford handbook of emotion dysregulation, (pp. 395–409). Oxford University Press.). The Difficulties in Emotion Regulation Scale (DERS) developed by Gratz and Roemer (2004)Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
is based on the second perspective, which emphasizes the functional nature of emotions. There are other measures to evaluate this construct (e.g., Catanzaro and Mearns Generalized Expectancy for Negative Mood Regulation Scale; Trait Meta-Mood Scale; Emotional Regulation Questionnaire), but they all assess how individuals’ internal experiences impact their affective response and only reflect a single aspect or subset of emotions (Mekawi et al., 2021Mekawi, Y., Watson-Singleton, N. N., Dixon, H. D., Fani, N., Michopoulos, V., & Powers, A. (2021). Validation of the difficulties with emotion regulation scale in a sample of trauma-exposed Black women. Journal of Clinical Psychology, 77(3), 587–606. https://doi.org/10.1002/jclp.23036.
https://doi.org/10.1002/jclp.23036...
). Conversely, the DERS was designed to assess trait-level perceived emotion regulation ability in a multidimensional and comprehensive regulation perspective (Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
).

The DERS (Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
) is an extensively used instrument in different populations worldwide, covering adults and adolescents and presenting comprehensive empirical support (Charak et al., 2019Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010.
https://doi.org/10.1016/j.psychres.2019....
). This self-response scale aims to assess clinically significant emotion regulation difficulties through 36 items that fall into 6 domains: non-acceptance of negative emotions (Non-Acceptance), inability to engage in goal-oriented behaviors when experiencing negative emotions (Goals), difficulties in controlling impulsive behaviors when experiencing negative emotions (Impulses), restricted access to emotion regulation strategies perceived as effective (Strategies), lack of emotional awareness (Awareness), and lack of emotional clarity (Clarity).

Numerous studies have confirmed this six-factor structure (Fowler et al., 2014Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the Difficulties in Emotion Regulation Scale among adults with severe mental illness. Journal of psychiatric research, 58, 175–180. https://doi.org/10.1016/j.jpsychires.2014.07.029.
https://doi.org/10.1016/j.jpsychires.201...
; Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
; Neumann et al., 2010Neumann, A., van Lier, P. A., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17(1), 138–149. https://doi.org/10.1177/1073191109349579.
https://doi.org/10.1177/1073191109349579...
), although more recently, it has been suggested that items of the Awareness factor could be removed due to their lower validity and consistency (Hallion et al., 2018Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539.
https://doi.org/10.3389/fpsyg.2018.00539...
; Miguel et al., 2017Miguel, F. K., Giromini, L., Colombarolli, M. S., Zuanazzi, A. C., & Zennaro, A. (2017). A Brazilian investigation of the 36- and 16-item difficulties in emotion regulation scales. Journal of Clinical Psychology, 73(9), 1146–1159. https://doi.org/10.1002/jclp.22404.
https://doi.org/10.1002/jclp.22404...
; Osborne et al., 2017Osborne, T. L., Michonski, J., Sayrs, J., Welch, S. S., & Anderson, L. K. (2017). Factor structure of the Difficulties in Emotion Regulation Scale (DERS) in adult outpatients receiving dialectical behavior therapy (DBT). Journal of Psychopathology and Behavioral Assessment, 39(2), 355–371. https://doi.org/10.1007/s10862-017-958.
https://doi.org/10.1007/s10862-017-958...
).

Contributing to the strength of the convergent validity, it was found that the emotional difficulties measured by this scale are significantly associated with a multiplicity of behaviors, such as self-mutilation, domestic violence, binge eating, substance abuse, and risky behaviors; psychopathological conditions, including borderline personality disorder, post-traumatic stress disorder, anorexia nervosa, social anxiety disorder, and behavioral disorder; and with countless other constructs in the scope of mental functioning, namely negative affect, the severity of depressive and anxious symptoms, tolerance to distress, experiential avoidance, and self-compassion (for a review see Gratz et al., 2020Gratz, K. L., Forbes, C. N., Wheeless, L. E., Richmond, J. R., & Tull, M. T. (2020). Self-report assessment of emotion dysregulation. In T. P. Beauchine, & S. E. Crowell (Eds.), The Oxford handbook of emotion dysregulation, (pp. 395–409). Oxford University Press.).

Given its relevance, DERS was translated and validated for several countries, originating multiple versions, including a Portuguese-European version (Coutinho et al., 2010Coutinho, J., Ribeiro, E., Ferreirinha, R., & Dias, P. (2010). Versão Portuguesa da Escala de Dificuldades de Regulação Emocional e sua relação com sintomas psicopatológicos. Revista de Psiquiatria Clínica, 37(4), 145–151. https://doi.org/10.1590/S0101-60832010000400001.
https://doi.org/10.1590/S0101-6083201000...
) and a Portuguese-Brazilian version (Miguel et al., 2017Miguel, F. K., Giromini, L., Colombarolli, M. S., Zuanazzi, A. C., & Zennaro, A. (2017). A Brazilian investigation of the 36- and 16-item difficulties in emotion regulation scales. Journal of Clinical Psychology, 73(9), 1146–1159. https://doi.org/10.1002/jclp.22404.
https://doi.org/10.1002/jclp.22404...
), both with good psychometric qualities. Despite the wide use of DERS in both clinical and research contexts, its length represents an important limitation, given the expected burden effects on respondents and the difficulties associated with time constraints, particularly in assessments with close intervals and in large epidemio-logical studies (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
; Shahabi et al., 2020Shahabi, M., Hasani, J., & Bjureberg, J. (2020). Psychometric properties of the brief Persian version of the Difficulties in Emotion Regulation Scale (the DERS-16). Assessment for Effective Intervention, 45(2), 135–143. https://doi.org/10.1177/1534508418800210.
https://doi.org/10.1177/1534508418800210...
). In addition, due to the similarity of some items, these tend to be perceived as repetitive, increasing fatigue and frustration, which advises the use of short instruments that can be equally effective in evaluating the same construct (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
).

Considering these factors, three short versions of the DERS were developed: the Difficulties in Emotion Regulation Scale – Short Form (DERS-SF) (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
), the DERS-18 (Victor & Klonsky, 2016Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the Difficulties in Emotion Regulation Scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/s10862-016-9547-9.
https://doi.org/10.1007/s10862-016-9547-...
), and the DERS-16 (Bjureberg et al., 2016Bjureberg, J., Ljotsson, B., Tull, M. T., Hedman, E., Sahlin, H., Lundh, L. G., et al. (2016). Development and validation of a brief version of the difficulties in emotion regulation scale: The DERS-16. Journal of Psychopathology and Behavioral Assessment, 38(2), 284–296. https://doi.org/10.1007/s10862-015-9514-x.
https://doi.org/10.1007/s10862-015-9514-...
). When comparing the DERS short forms (DERS-SF, DERS-18, DERS-16), all the three scales showed strong concordance with the original extended version, internal consistency fair-to-good, and reliability above 0.80 for all subscales except Awareness (Hallion et al., 2018Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539.
https://doi.org/10.3389/fpsyg.2018.00539...
). The authors of this comparative study reported no evidence that any of the short forms were psychometrically superior to the others. However, short versions that retained subscale scores (i.e., DERSSF and DERS-18) have shown strong concurrent validity, given their capacity to predict current symptoms of anxiety and depression (Skutch et al., 2019Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
). Considering that the short forms generally performed similarly to the original DERS, despite a slight loss of predictive utility (1-3% of the variance) to explain clinical severity, it was suggested that its use is acceptable in most clinical and research situations, with the long form of DERS being indicated for when a comprehensive assessment is required (Hallion et al., 2018Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539.
https://doi.org/10.3389/fpsyg.2018.00539...
; Shahabi et al., 2020Shahabi, M., Hasani, J., & Bjureberg, J. (2020). Psychometric properties of the brief Persian version of the Difficulties in Emotion Regulation Scale (the DERS-16). Assessment for Effective Intervention, 45(2), 135–143. https://doi.org/10.1177/1534508418800210.
https://doi.org/10.1177/1534508418800210...
). The DERS-SF has been the most used (Skutch et al., 2019Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
) and the most recommended version intended to investigate emotion dysregulation throughout the life cycle, as it is the only scale that presents invariance among adolescents and adults (Charak et al., 2019Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010.
https://doi.org/10.1016/j.psychres.2019....
). The DERS-SF is composed of half of the items in the original version and was developed using two adult and three adolescent samples, verifying the maintenance of the six-factor structure and the excellent psychometric properties of the original instrument, regardless of the age variation.

As with DERS, these short instruments also need to be subject to cross-cultural adaptations and the respective study of their psychometric properties. Recently, a study carried out in Portugal by Moreira et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
, with an adolescent and adult community women sample and aiming to contribute to clarifying the adequacy of the DERS-SF, suggested a bifactorial model without the Awareness subscale.

Pointing out inconsistencies in the literature about the multidimensionality of DERS and its short forms (e.g., Hallion et al., 2018Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539.
https://doi.org/10.3389/fpsyg.2018.00539...
; Osborne et al., 2017Osborne, T. L., Michonski, J., Sayrs, J., Welch, S. S., & Anderson, L. K. (2017). Factor structure of the Difficulties in Emotion Regulation Scale (DERS) in adult outpatients receiving dialectical behavior therapy (DBT). Journal of Psychopathology and Behavioral Assessment, 39(2), 355–371. https://doi.org/10.1007/s10862-017-958.
https://doi.org/10.1007/s10862-017-958...
), Moreira et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
tested several models for the scale structure. Between the first group of models tested, a correlated six-factor model and a bifactorial model exhibited a good fit to the data. Nevertheless, the former presented high correlations between all factors except for the correlations between Awareness and all the other factors, and the second had some problems with some items that had non-significant loading or weak factor loading. Considering the results of the first models, they tested a second set of models but removed the Awareness subscale. The correlated six-factor model without Awareness had a good fit to the data, but the bifactorial model without Awareness had a very good and better internal consistency of the subscales. Moreira et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
suggested that the items on the Awareness subscale should not be included in calculating the total value of the DERS-SF. The authors suggested that the Awareness subscale may be interpreted as a unique measure that evaluates difficulties in processing emotions, and not in the regulation of emotional responses.

Research is moderately extensive but far from conclusive concerning the differences between men and women in terms of emotion regulation and their difficulties. Nolen-Hoeksema and Aldao (2011)Nolen-Hoeksema, S., & Aldao, A. (2011). Gender and age differences in emotion regulation strategies and their relationship to depressive symptoms. Personality and Individual Differences, 51(6), 704–708. https://doi.org/10.1016/J.Paid.2011.06.012.
https://doi.org/10.1016/J.Paid.2011.06.0...
found that compared to men, women reported a wider range of emotion regulation strategies, including acceptance, social support, problem-solving reassessment, and rumination, being more likely to resort to more adaptive strategies at older ages. Furthermore, Gratz and Roemer (2004)Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
during the validation of DERS found that men had greater difficulties in becoming emotionally aware. There were differences in the Clarity domain in the DERS validation studies for the Portuguese population, with men showing more difficulties recognizing their emotions (Veloso et al., 2011Veloso, M., Pinto, J. P., & Dinis, A. (2011). Estudos de validação com a versão portuguesa da Escala de Dificuldades na Regulação Emocional (EDRE). Psychologica, 54, 87–110. https://doi.org/10.14195/1647-8606_54_4.
https://doi.org/10.14195/1647-8606_54_4...
). However, this finding was not corroborated by a recent study, which found a greater lack of emotional clarity in female participants (Shahabi et al., 2020Shahabi, M., Hasani, J., & Bjureberg, J. (2020). Psychometric properties of the brief Persian version of the Difficulties in Emotion Regulation Scale (the DERS-16). Assessment for Effective Intervention, 45(2), 135–143. https://doi.org/10.1177/1534508418800210.
https://doi.org/10.1177/1534508418800210...
). In summary, gender differences have been documented in some DERS subscales, albeit sometimes inconsistently. It should be noted that these differences are often not found in the instrument's overall score (Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
; Tull et al., 2012Tull, M. T., Weiss, N. H., Adams, C. E., & Gratz, K. L. (2012). The contribution of emotion regulation difficulties to risky sexual behavior within a sample of patients in residential substance abuse treatment. Addictive Behaviors, 37(10), 1084–1092. https://doi.org/10.1016/j.addbeh.2012.05.001.
https://doi.org/10.1016/j.addbeh.2012.05...
). However, this analysis has not yet been carried out using the DERS-SF. At the same time, considering the articulation between gender differences and factorial invariance, and considering that this has never been investigated, it is pertinent to explore gender invariance.

Based on a sample of adults from the general population, the present study aims to (a) analyze the factorial structure and psychometric properties of the Portuguese version of DERS-SF (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
) and (b) analyze the DERS-SF factor structure invariance between men and women.

Method

Participants

The sample was composed of 646 subjects, 400 (61.9%) women, and 246 (38.1%) men of Portuguese nationality, aged between 18 and 66 years (M = 29.93, SD = 11.71). Most participants were single (n = 446, 69.0%), employed (n = 338, 52.3%), and had completed secondary education (n = 291, 45.0%) and higher education (n = 321, 49.7%).

Instruments

Sociodemographic questionnaire

A brief questionnaire was developed to assess the following sociodemographic variables: gender, age, marital status, occupational status, and educational level.

Difficulties in Emotion Regulation Scale – Short Form (DERS-SF)

The Difficulties in Emotion Regulation Scale – Short Form (DERS-SF; Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
) is a scale used to assess the difficulties in emotion regulation. This instrument is based on the Difficulties in Emotion Regulation Scale (Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
), which is a well-validated and frequently used instrument in assessing this construct. The original scale is composed of 36 items (Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
), whereas the short version comprises18 items, divided into six subscales, each composed of three items: Strategies, Non-Acceptance, Impulse, Goals, Awareness, and Clarity. The answers are assessed using a 5-point Likert scale, from 1 (almost never) to 5 (almost always). It is possible to obtain the score of each subscale, and the total score of the DERS-SF, with higher values indicating greater difficulties in emotion regulation. The original DERS-SF validation with two adults samples revealed excellent psychometric properties, with the following Cronbach's alphas: Clarity (0.78), Awareness (0.78), Strategies (0.82), Non-Acceptance (0.85), Impulse (0.89), Goals (0.91), and 0.89 for the total scale (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
).

Procedure

For the present study, the items of the DERS-SF were translated from the original version (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
) to Portuguese by fluent researchers in both languages and then back-translated from Portuguese to English. The translated version was applied to a small, randomly selected sample of men and women to discuss in detail the understanding of the items and to obtain the final translation of the Portuguese version of the DERS-SF.

Subsequently, the instrument was applied to the general population through an online questionnaire platform (i.e., Google Forms). Participants’ recruitment was carried out by disseminating the study through personal contact networks and social networks. All study participants were clarified about the objectives and procedures of the study and confidentiality and anonymity of the data and gave their informed consent before completing the questionnaire. The study was previously approved by the University Ethics Committee.

Data analysis

The original sample (n = 646) was randomly divided into subsamples S1 (n = 327) and S2 (n = 319). Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed in subsamples S1 and S2, respectively.

Exploratory factor analysis (EFA) was performed for simplification of the 18 interrelated measures of the DERS scale, to uncover patterns in that set of variables. Factor extraction was conducted using the principal axis factoring (PAF), and suitable orthogonal (VARIMAX) and oblique (Direct oblimin and Promax) factor rotation techniques were explored. The number of factors to retain was decided upon the results of a parallel analysis (PA) performed using the JASP Computer Software (ASP Team (2021). JASP (version 0.16) [computer software]).

For the following analyses, data were treated using the SPSS statistics software (IBM SPSS Statistics®, v.27.0, IBM® Corp, Armonk, NY) and AMOS® (v.27.0, SPSS Inc., Chicago, IL) for a significance level of α ≤ 0.05. Confirmatory factor analyses (CFA), with maximum likelihood as the estimation method, were performed in order to compare the factor structure resulting from the EFA, which was equal to the six-factor structure obtained in the original article (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
), with the bifactorial model of a recent Portuguese version of DERS Short Form (Moreira et al., 2020Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
). The model fit was assessed based on the following indexes: chi-square (χ2/df < 2), goodness-of-fit index (GFI > 0.90), comparative fit index (CFI > 0.90), and the root mean square of approximation (RMSEA < 0.05) (Marôco, 2014Marôco, J. (2014). Análise de Equações Estruturais - Fundamentos teóricos, software & aplicações (2ª ed rev). Report Number, Lda.).

For the assessment of the psychometric properties, within the scope of the internal structure of the selected factor structure, reliability was assessed according to Cronbach's alpha (> 0.70) (Pestana & Gageiro, 2008Pestana, M. H., & Gageiro, J. N. (2008). edição revista e corrigida. In Análise de Dados para Ciências Sociais. A complementaridade do SPSS, (5ª ed., pp. 527–528). Edições Sílabo.), and according to the composite reliability (> 0.70), for the subscales. Convergent validity was assessed through average variance extracted (AVE ≥ 0.50), and discriminant validity was calculated by comparing the AVE with the square of the correlations between the factors (AVEi and AVEj ≥ ρij) (Marôco, 2014Marôco, J. (2014). Análise de Equações Estruturais - Fundamentos teóricos, software & aplicações (2ª ed rev). Report Number, Lda.).

We proceeded with the multi-group analysis using the stepwise procedure to assess the factor invariance of the DERS-SF across genders, with S2. Four models that differed from each other according to the following sets of parameters were used to answer questions related to multi-group equivalence: model 2a—unconstrained; model 2b—factor loadings; model 2c—structural covariances; and model 2d—measurement residuals (Byrne, 2010Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts applications, and programming, (2nd ed.,). Routledge.; Marôco, 2014Marôco, J. (2014). Análise de Equações Estruturais - Fundamentos teóricos, software & aplicações (2ª ed rev). Report Number, Lda.). Invariance was calculated by comparing the difference of the CFI (ΔCFI) regarding the baseline model (i.e., unconstrained; model 2a) and resulting models (fixed factor loadings, structural covariances, and measurement residuals; models 2b-2d). Thus, gender invariance was verified when the values of ΔCFI were less than 0.01 (Byrne, 2010Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts applications, and programming, (2nd ed.,). Routledge.). According to Cheung & Rensvold (2002) cit in Byrne (2010)Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts applications, and programming, (2nd ed.,). Routledge., “it may be more reasonable to base invariance decisions on a difference in CFI (ΔCFI) rather than on χ2 values” (p. 221).

Finally, descriptive analysis of the DERS-SF was calculated for the subsamples of men and women, in parallel with the comparison of means between these groups, using one-way analysis of variance (ANOVA). The oneway ANOVA's assumptions were previously verified.

Results

Evidence of validity based on the internal structure

Factor analysis

To begin, according to PA, 6 factors must be retained in this analysis, based on the comparison of the actual eigenvalues and the 95th percentile of the eigenvalues derived from the random data matrices with the actual size (327 cases, 18 variables).

Moreover, EFA using Varimax rotation has resulted in a factor transformation matrix which off-diagonal elements deviate markedly from a near symmetry (data not shown) suggesting that the DERS factors may be correlated, and thus, oblique rotation may support a more realistic theoretically explanation.

In these conditions, the Direct oblimin and Promax rotation techniques were applied which produced pattern matrices that differ only slightly in the saturation of one item (item 10) in different factors. Thus, EFA suggested one model which was further explored in CFA. This model had the same factorial structure as the model in the original article by Kaufman et al. (2016)Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
(Table 1). Moreover, the resulting correlation matrix between factors shown in Table 2 for EFA with Oblimin rotation presents several correlations in excess of 0.32, which is indicative of variance overlapping between factors, thus warranting the applied oblique rotation.

Table 1
Pattern matrix: factor loadings < 0.35 suppressed
Table 2
Correlation matrix for the 6 factors in the EFA with direct Oblimin rotation for the DERS data

A confirmatory factor analysis was conducted to assess which factorial structure had a better model fit among the following models: model 1 bifactor model excluding the Awareness subscale (Moreira et al., 2020Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
) and model 2—correlated six-factor model resulting from EFA and original article (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
). Table 3 displays the model fit indexes of the different factor structures (models 1-2). The correlated six-factor structure as stated in the EFA and the original validation article (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
) presents a good model fit for the present sample (χ2 (120) = 245,309; p ≤ 0.001; GFI = 0.921; CFI = 0.965; RMSEA = 0.057 [0.047; 0.068]). Comparing models 1 and 2, despite the first has a higher CFI and GFI than model 1, we select model 2, since in our sample the Awareness subscale did not show any limitations that would justify its exclusion, namely in terms of factor loadings or significance (Fig. 1, Tables 3 and 4).

Fig. 1
Correlated six-factor structure of the DERS-SF
Table 3
Model fit indexes of two factor structures of DERS-SFa and factorial invariance for gender (n = 319)
Table 4
Factor loadings of correlated six-factor structure

Reliability, convergent, and discriminant evidence The analysis of reliability was performed by assessing Cronbach's alpha, whose value should be higher than 0.70 (Pestana & Gageiro, 2008Pestana, M. H., & Gageiro, J. N. (2008). edição revista e corrigida. In Análise de Dados para Ciências Sociais. A complementaridade do SPSS, (5ª ed., pp. 527–528). Edições Sílabo.). The values found in the Portuguese version of the DERS-SF presented a Cronbach's alpha of the following: Awareness: α = 0.70; Clarity: α = 0.77; Non-Acceptance: α = 0.78; Strategies: α = 0.86; Impulse: α = 0.88; and Goals: α = 0.91 and α = 0.90 for the total scale. Since the factor structure of the DERSSF has 6 factors, composite reliability (CR) was also performed, and all subscales had scores ranging between 0.67 (Awareness) and 0.91 (Goals). As regards convergent validity, all subscales were confirmed to have an average variance extracted (AVE) higher than 0.50, except for the subscale Awareness (AVE = 0.44). The remaining sub-scales have AVE values between 0.57 (Non-Acceptance) and 0.78 (Goals). Regarding discriminant validity, we confirmed its existence between all subscales since the AVE of each subscale is higher than the square of the correlation between each pair of subscales. The subscales Strategies and Non-Acceptance showed problems concerning discriminant validity, since the square of the correlation 0.92 is higher than the AVE of the subscale Strategies (AVE = 0.70) and Non-Acceptance (AVE = 0.57).

Invariance of the factor structure Considering the statistically significant differences between genders, we conducted the multi-group CFA analysis to assess the factor invariance between genders by comparing the four models (model 2a to model 2d—Table 3). The factor invariance analyses between unconstrained model (i.e., model 2a) and resulting models (fixed factor loadings, structural covariances, and measurement residuals; models 2b-2d) revealed a ΔCFI < 0.01, which indicate the invariance of the factor structure of the DERS-SF across genders for the factor loadings, covariances, and residuals.

Descriptive analysis and gender differences

The descriptive analysis of the DERS-SF for the total sample can be seen in Table 5 and for the genders can be seen in Table 6. The mean (standard deviation) for the total DERS-SF sample was 38.39 (12.49). The mean for the total DERS-SF was 37.72 (12.13) in men and 39.13 (12.69) in women. Statistically significant differences were identified only between these two groups for the Strategies subscale (F(1, 644) = 4.70, p = 0.031).

Table 5
Descriptive analysis for total sample (N = 646)
Table 6
Descriptive analysis and gender differences of DERS-SF

Discussion

In this study, psychometric properties, factor structure, and gender invariance of the DERS-SF were analyzed in a sample of the Portuguese population.

Inconsistencies remain in the literature regarding the most appropriate structure of DERS (Victor & Klonsky, 2016Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the Difficulties in Emotion Regulation Scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/s10862-016-9547-9.
https://doi.org/10.1007/s10862-016-9547-...
) and which versions of DERS are best suited to different contexts (e.g., clinical, research). To clarify the factorial structure of the short form of DERS, other studies compared the different versions of the scale (i.e., DERS-16, DERS-SF, and DERS-18), in a sample of undergraduate students (Skutch et al., 2019Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
); among adults and adolescents with severe mental illness (Charak et al., 2019Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010.
https://doi.org/10.1016/j.psychres.2019....
); and with adults with one or more emotional disorders according to the DSM-5 (Hallion et al., 2018Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539.
https://doi.org/10.3389/fpsyg.2018.00539...
). The results of Skutch et al. (2019)Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
revealed that the reliability and validity of the three structures are identical, but despite that, the authors recommended using the DERS-SF or DERS-18 version, as they allow the addition of sums for the subscales. In our study, we ascertained the relevance of DERS-SF, but only with a normative sample.

In order to confirm the factor structure of DERS-SF, two different factorial structures of the DERS-SF were compared: (a) bifactorial model excluding the Awareness subscale recently studied in a Portuguese sample (Moreira et al., 2020Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
); and (b) correlated six-factor structure resulting from exploratory factor analysis with study sample, equal to factor structure of correlated six factors resulting from the original DERS-SF (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
), and (b) bifactorial model excluding the Awareness subscale recently studied in a Portuguese sample (Moreira et al., 2020Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
). The results obtained demonstrated that the factor structure of the correlated six factors resulting from the EFA, equal to the original version with a sample of adolescents and university students (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
), is the one that presents a better model fit to the sample (including all the subscales) of the present study, which is following other studies (Charak et al., 2019Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010.
https://doi.org/10.1016/j.psychres.2019....
; Skutch et al., 2019Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
). The mean age in our sample represents young adults, which may justify that the same factor structure also demonstrated a good adjustment in our study. Moreira et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
used a sample of female adults and adolescents from the Portuguese normative population. Additionally, the 18 items used in this study were extracted from the Portuguese version of 36 items (Coutinho et al., 2010Coutinho, J., Ribeiro, E., Ferreirinha, R., & Dias, P. (2010). Versão Portuguesa da Escala de Dificuldades de Regulação Emocional e sua relação com sintomas psicopatológicos. Revista de Psiquiatria Clínica, 37(4), 145–151. https://doi.org/10.1590/S0101-60832010000400001.
https://doi.org/10.1590/S0101-6083201000...
) and were not the result of the translation process of the original version of the DERS-SF (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
), as in our study. In this sense, differences in the characteristics of our and Moreira's et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
sample, and the sentence content of the items, may justify the disparity in the results. Unlike Moreira et al. (2020)Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
study, in our correlated six-factor model, the Awareness subscale did not present factor loadings, reliability, or correlations with the total scale or subscales that justified its exclusion. We consider that validation studies of DERS-SF with a representative sample of the Portuguese population are still recommended.

In this sample of the Portuguese population, DERSSF has good psychometric properties, in particular, high factorial validity, similar to the results of other studies (Charak et al., 2019Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010.
https://doi.org/10.1016/j.psychres.2019....
; Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
). Reliability is also close to the results found in the original study (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
) as well in the study conducted by Skutch et al. (2019)Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
, although in this one, the subscales Clarity, Non-Acceptance, and Awareness have higher values of reliability when compared to our study's results. Regarding discriminant validity, the Awareness subscale showed good correlations with the remaining subscales, contrary to what was found in other studies of the DERS-SF version (Moreira et al., 2020Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5.
https://doi.org/10.1007/s12144-019-00602...
) or of the DERS-18 version (Victor & Klonsky, 2016Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the Difficulties in Emotion Regulation Scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/s10862-016-9547-9.
https://doi.org/10.1007/s10862-016-9547-...
). However, in the present study, the Awareness subscale was not problematic in terms of conceptual discrimination with the remaining subscales, and problems with discriminant validity were found only between the Strategies and Non-Acceptance subscales.

Concerning gender invariance, the differences in the difficulties in namely in Strategies subscale, between men and women were found in our sample, and other studies (e.g., Gratz & Roemer, 2004Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.
https://doi.org/10.1023/B:JOBA.000000745...
; Nolen-Hoeksema & Aldao, 2011Nolen-Hoeksema, S., & Aldao, A. (2011). Gender and age differences in emotion regulation strategies and their relationship to depressive symptoms. Personality and Individual Differences, 51(6), 704–708. https://doi.org/10.1016/J.Paid.2011.06.012.
https://doi.org/10.1016/J.Paid.2011.06.0...
; Veloso et al., 2011Veloso, M., Pinto, J. P., & Dinis, A. (2011). Estudos de validação com a versão portuguesa da Escala de Dificuldades na Regulação Emocional (EDRE). Psychologica, 54, 87–110. https://doi.org/10.14195/1647-8606_54_4.
https://doi.org/10.14195/1647-8606_54_4...
) supported the analysis of the DERS-SF factorial invariance between genders. The DERS-SF factor structure invariance between genders was verified, for factor loadings, covariance, and residuals. This result suggests that assessing the difficulties in emotion regulation can be carried out using the same factorial structure of DERS-SF for men and women since both groups have the same understanding of the constituent items of latent scale dimensions.

The results of the present study must be interpreted by taking into account the following limitations. First, the non-probabilistic and convenience sampling, the higher percentage of women, and the low average age of the participants prevent generalizing the results to the Portuguese population. Future studies are recommended with greater representativeness in terms of age and gender. Second, the participants are from the non-clinical population, and variables related to maladaptive circumstances, including psychological distress or mental disorder, were not controlled. Third, the non-performance of test-retest and the concurrent validity of DERS-SF, compared to DERS-36 (Kaufman et al., 2016Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3.
https://doi.org/10.1007/s10862-015-9529-...
; Skutch et al., 2019Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z.
https://doi.org/10.1007/s10862-019-09736...
), is also an important limitation. Finally, the factorial invariance was tested for gender only, and therefore, no other conclusions can be drawn regarding invariance between the groups defined according to other socio-demographic or clinical characteristics.

Despite the limitations mentioned above, the present study contributes to the cross-cultural dissemination of this instrument, namely, among Portuguese speakers.

  • Availability of data and materials
    The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
  • Declarations
    Ethics approval and consent to participate
    All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study. This article does not contain any studies with animals performed by any of the authors. Permission was requested from the original creators of the instrument for its use/adaptation in the study.
  • Publisher's Note
    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Abbreviations

  • DERS-SF  Difficulties in Emotion Regulation Scale – Short Form
  • EFA  Exploratory factor analysis
  • PAF  Principal axis factoring
  • PA  Parallel analysis
  • KMO  Kaiser-Meyer-Olkin indicator
  • χ 2  Chi-square
  • df  Degrees of freedom
  • CFA  Confirmatory factor analysis
  • GFI  Goodness-of-fit index
  • CFI  Comparative fit index
  • RMSEA  Root mean square error of approximation
  • AVE  Average variance extracted
  • CR  Composite reliability
  • ANOVA  Analysis of variance
  • M  Mean
  • SD  Standard deviation
  • Sk  Skewness
  • Ku  Kurtosis.

Acknowledgements

We would like to thank the participants who participated in and cooperated with our project. We are also grateful to the research assistants for contributing to the data collection process.

References

  • Bjureberg, J., Ljotsson, B., Tull, M. T., Hedman, E., Sahlin, H., Lundh, L. G., et al. (2016). Development and validation of a brief version of the difficulties in emotion regulation scale: The DERS-16. Journal of Psychopathology and Behavioral Assessment, 38(2), 284–296. https://doi.org/10.1007/s10862-015-9514-x
    » https://doi.org/10.1007/s10862-015-9514-x
  • Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts applications, and programming, (2nd ed.,). Routledge.
  • Campbell-Sills, L., & Barlow, D. H. (2006). Incorporating emotion regulation into conceptualization and treatment of anxiety and mood disorders. In J. J. Gross (Ed.), Handbook of emotion regulation, (pp. 542–560). Guilford Press.
  • Charak, R., Byllesby, B. M., Fowler, J. C., Sharp, C., Elhai, J. D., & Frueh, B. C. (2019). Assessment of the revised Difficulties in Emotion Regulation Scales among adolescents and adults with severe mental illness. Psychiatry research, 279, 278–283. https://doi.org/10.1016/j.psychres.2019.04.010
    » https://doi.org/10.1016/j.psychres.2019.04.010
  • Coutinho, J., Ribeiro, E., Ferreirinha, R., & Dias, P. (2010). Versão Portuguesa da Escala de Dificuldades de Regulação Emocional e sua relação com sintomas psicopatológicos. Revista de Psiquiatria Clínica, 37(4), 145–151. https://doi.org/10.1590/S0101-60832010000400001
    » https://doi.org/10.1590/S0101-60832010000400001
  • Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the Difficulties in Emotion Regulation Scale among adults with severe mental illness. Journal of psychiatric research, 58, 175–180. https://doi.org/10.1016/j.jpsychires.2014.07.029
    » https://doi.org/10.1016/j.jpsychires.2014.07.029
  • Gratz, K. L., Forbes, C. N., Wheeless, L. E., Richmond, J. R., & Tull, M. T. (2020). Self-report assessment of emotion dysregulation. In T. P. Beauchine, & S. E. Crowell (Eds.), The Oxford handbook of emotion dysregulation, (pp. 395–409). Oxford University Press.
  • Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and BehavioralAssessment, 26(1), 4154. https://doi.org/10.1023/B:JOBA.0000007455.08539.94
    » https://doi.org/10.1023/B:JOBA.0000007455.08539.94
  • Gross, J. J. (2015). Emotion regulation; current status and future prospects. Psychological Inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781
    » https://doi.org/10.1080/1047840X.2014.940781
  • Gross, J. J., & Thompson, R. A. (2007). Emotion regulation: Conceptual foundations. In J. J. Gross (Ed.), Handbook of emotion regulation, (pp. 3–24). Guilford Press.
  • Halberstadt, A. G., Denham, S. A., & Dunsmore, J. C. (2001). Affective social competence. Social Development, 10(1), 79–119. https://doi.org/10.1111/1467-9507.00150
    » https://doi.org/10.1111/1467-9507.00150
  • Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the Difficulties in Emotion Regulation Scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, Article 539. https://doi.org/10.3389/fpsyg.2018.00539
    » https://doi.org/10.3389/fpsyg.2018.00539
  • Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The Difficulties in Emotion Regulation Scale Short Form (DERS-SF): Validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38(3), 443–455. https://doi.org/10.1007/s10862-015-9529-3
    » https://doi.org/10.1007/s10862-015-9529-3
  • Kehoe, C., & Havighurst, S. (2020). Treating emotion dysregulation in internalizing disorders. In T. P. Beauchine, & S. E. Crowell (Eds.), The Oxford handbook of emotion dysregulation, (pp. 443–462). Oxford University Press.
  • Lang, P. J. (1995). The emotion probe: Studies of motivation and attention. American. Psychologist, 50(5), 372–385. https://doi.org/10.1037/0003-066X.50.5.372
    » https://doi.org/10.1037/0003-066X.50.5.372
  • Marôco, J. (2014). Análise de Equações Estruturais - Fundamentos teóricos, software & aplicações (2ª ed rev) Report Number, Lda.
  • Mekawi, Y., Watson-Singleton, N. N., Dixon, H. D., Fani, N., Michopoulos, V., & Powers, A. (2021). Validation of the difficulties with emotion regulation scale in a sample of trauma-exposed Black women. Journal of Clinical Psychology, 77(3), 587–606. https://doi.org/10.1002/jclp.23036
    » https://doi.org/10.1002/jclp.23036
  • Miguel, F. K., Giromini, L., Colombarolli, M. S., Zuanazzi, A. C., & Zennaro, A. (2017). A Brazilian investigation of the 36- and 16-item difficulties in emotion regulation scales. Journal of Clinical Psychology, 73(9), 1146–1159. https://doi.org/10.1002/jclp.22404
    » https://doi.org/10.1002/jclp.22404
  • Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF) in a sample of adolescents and adults. Current Psychology.https://doi.org/10.1007/s12144-019-00602-5
    » https://doi.org/10.1007/s12144-019-00602-5
  • Neumann, A., van Lier, P. A., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17(1), 138–149. https://doi.org/10.1177/1073191109349579
    » https://doi.org/10.1177/1073191109349579
  • Nolen-Hoeksema, S., & Aldao, A. (2011). Gender and age differences in emotion regulation strategies and their relationship to depressive symptoms. Personality and Individual Differences, 51(6), 704–708. https://doi.org/10.1016/J.Paid.2011.06.012
    » https://doi.org/10.1016/J.Paid.2011.06.012
  • Orgeta, V. (2009). Specificity of age differences in emotion regulation. Aging and Mental Health, 13(6), 818–826. https://doi.org/10.1080/13607860902989661
    » https://doi.org/10.1080/13607860902989661
  • Osborne, T. L., Michonski, J., Sayrs, J., Welch, S. S., & Anderson, L. K. (2017). Factor structure of the Difficulties in Emotion Regulation Scale (DERS) in adult outpatients receiving dialectical behavior therapy (DBT). Journal of Psychopathology and Behavioral Assessment, 39(2), 355–371. https://doi.org/10.1007/s10862-017-958
    » https://doi.org/10.1007/s10862-017-958
  • Pestana, M. H., & Gageiro, J. N. (2008). edição revista e corrigida In Análise de Dados para Ciências Sociais. A complementaridade do SPSS, (5ª ed., pp. 527–528). Edições Sílabo.
  • Shahabi, M., Hasani, J., & Bjureberg, J. (2020). Psychometric properties of the brief Persian version of the Difficulties in Emotion Regulation Scale (the DERS-16). Assessment for Effective Intervention, 45(2), 135–143. https://doi.org/10.1177/1534508418800210
    » https://doi.org/10.1177/1534508418800210
  • Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the Difficulties in Emotion Regulation Scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/s10862-019-09736-z
    » https://doi.org/10.1007/s10862-019-09736-z
  • Thompson, R. A. (1994). Emotion regulation: A theme in search of definition. Monographs of the Society for Research in Child Development, 59(2-3), 25–52. https://doi.org/10.2307/1166137
    » https://doi.org/10.2307/1166137
  • Tull, M. T., Weiss, N. H., Adams, C. E., & Gratz, K. L. (2012). The contribution of emotion regulation difficulties to risky sexual behavior within a sample of patients in residential substance abuse treatment. Addictive Behaviors, 37(10), 1084–1092. https://doi.org/10.1016/j.addbeh.2012.05.001
    » https://doi.org/10.1016/j.addbeh.2012.05.001
  • Veloso, M., Pinto, J. P., & Dinis, A. (2011). Estudos de validação com a versão portuguesa da Escala de Dificuldades na Regulação Emocional (EDRE). Psychologica, 54, 87–110. https://doi.org/10.14195/1647-8606_54_4
    » https://doi.org/10.14195/1647-8606_54_4
  • Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the Difficulties in Emotion Regulation Scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/s10862-016-9547-9
    » https://doi.org/10.1007/s10862-016-9547-9

Publication Dates

  • Publication in this collection
    13 June 2022
  • Date of issue
    2022

History

  • Received
    20 July 2021
  • Accepted
    19 Apr 2022
  • Published
    06 May 2022
Curso de Pós-Graduação em Psicologia da Universidade Federal do Rio Grande do Sul Rua Ramiro Barcelos, 2600 - sala 110, 90035-003 Porto Alegre RS - Brazil, Tel.: +55 51 3308-5691 - Porto Alegre - RS - Brazil
E-mail: prc@springeropen.com