Open-access Evidence of the validity of the Multidimensional Scale of Perceived Social Support (MSPSS) in university students

Abstract

Social support refers to the social resources that a person perceives to be available and has been strongly associated with physical and mental health outcomes. The present study aimed to evaluate the internal consistency, construct validity, and test-retest reliability of the Perceived Social Support Multidimensional Scale (PSSMS) in university students in the Midwest of Brazil. Exploratory and confirmatory factor analyses were performed with two independent random samples, both consisting of 1,147 students. The test-retest study was carried out with a sample of 347 medical students. Data were collected in two separate moments with a 14-day interval. The solution with the best fit was the three-factor model: family, friends, and significant others. The factor loadings of the scale items ranged between 0.767 and 0.950 and each factor showed high internal consistency (Cronbach’s alpha=0.96, 0.97, and 0.97, respectively). The model also attained adequate fit: χ2(d.f.)=380 (49), p<0.0001; SRMR=0.023; RMSEA=0.077; CFI=0.993; TLI=0.990. Test-retest reliability was moderate (weighted kappa ranging from 0.36 to 0.52). The results suggest that the PSSMS has acceptable psychometric properties for use with university students.

Key words:
Social support; Multidimensional Scale of Perceived Social Support; University students

Resumo

O apoio social se refere aos recursos sociais percebidos como disponíveis à pessoa e tem sido fortemente associado a desfechos em saúde física e mental. O estudo atual objetivou avaliar a consistência interna, a validação de construto e a confiabilidade teste-reteste da Escala Multidimensional de Suporte Social Percebido (EMSSP) em universitários do Centro Oeste brasileiro. As análises fatoriais exploratória e confirmatória foram realizadas com duas amostras aleatórias e independentes, ambas de 1.147 universitários da área da saúde. O estudo teste-reteste foi realizado com uma amostra de 347 estudantes de medicina e duas coletas com intervalo de 14 dias entre elas. A melhor solução foi com três fatores: família, amigos, e outros significativos, os quais apreesentaram cargas fatoriais variando entre 0,767 a 0,950 e consistência interna elevada (alfa de Cronbach de 0,96, 0,97 e 0,97, respectivamente). O ajustamento para essa solução foi adequado (χ2(g.l.)=380 (49), p<0,001; SRMR: 0,023; RMSEA: 0,077; CFI: 0,993; TLI: 0,990). A confiabilidade teste-reteste foi moderada (Kappa ponderado variando de 0,36 a 0,52). Os resultados sugerem que a EMSSP possui propriedades psicométricas aceitáveis para seu uso com universitários.

Palavras-chave:
Apoio social; Escala Multidimensional de Suporte Social Percebido; Universitários

Introduction

Social support can be understood as the perception that social resources are available or actual support provided by family, friends, or peers1,2. It means having someone to turn to in times of need3. Types of social support may be classified as emotional (empathy, love, trust, and generosity)3, instrumental (tangible aid in performing activities)1, informational (advice, information)4, social interaction (personal networks)3, appraisal (information that is useful for self-evaluation)4, and cognitive (the influence of learning on individual behavior, help with memory loss and reasoning)3,5.

Social support has been associated with better physical and mental health6. High levels of social support act as a protective factor against a range of morbidities, thus contributing to better health outcomes6. Having someone you can count on to provide emotional and material support in times of need has been associated with lower levels of anxiety, depression, and somatic disorders and helps people to adapt better to the effects of stressful life events6,7.

Several instruments have been developed to assess social support and its various dimensions8,9, including the Multidimensional Scale of Perceived Social Support (MSPSS). The MSPSS was originally developed with a sample of 275 US university students10 and later tested on a wider sample including 265 pregnant women, 74 adolescents, and 55 pediatric residents11. The studies confirmed the theoretical formulation of the scale items and the existence of three moderately correlated factors. The MSPSS evaluates emotional support and social interaction from three sources: family, friends, and significant others10. Other commonly used scales assess other facets of social support such as informational and instrumental support, but without specifying the sources, meaning that the MSPSS is differentiated from other measures. The instrument is also used widely around the world because it is easy to use and has a relatively small number of items (12), making it the ideal measure when time is limited.

Recently, a systematic review of 70 studies with approximately 30,909 participants evaluating the MSPSS translated in 22 languages reported that most studies attained a Cronbach’s alpha of at least 0.70 and test-retest correlation ranging between 0.72 and 0.859. The MSPSS has demonstrated internal consistency, test-retest stability, and stable factor structure9,11, which is relatively consistent across the various countries where the scale has been translated and adapted9. However, the large majority of the 70 studies only performed exploratory analysis, with only nine performing confirmatory factor analysis9. The scale’s psychometric properties have been studied in various groups, including adolescents12,13, adults with chronic diseases14,15, psychiatric patients16, cancer patients17, older persons18, and family caregivers of people with dementia19.

The MSPSS has been adapted for use in Brazil and evidence of validity was reported by Garbado-Martins et al.20 in a study with 831 male and female workers from 25 states, most of whom had post-graduate degrees. Factor analysis confirmed factor structure and resulted in acceptable estimates of internal consistency (Cronbach’s alfa: friends, 0.93; family, 0.91; and significant others, 0.90)20. In addition, confirmatory factor analysis showed that the three-factor solution presented good goodness-of-fit indices20.

There is no doubt about the importance of social support for the health and well-being of young university students, a group with high prevalence of stress and psychological distress21. When evaluating social support in specific populations, it is important to consider the intrinsic variability of social networks and cultural standards2,6. Studies investigating the validity of the MSPSS are therefore important to ensure the accurate evaluation of specific population groups. Evidence of the validity of the MSPSS in university students can help researchers and practitioners choose the best social support measures for this group. Furthermore, there is currently no evidence for test-retest reliability of the Brazilian version of the instrument. The aim of this study was therefore to obtain evidence of validity based on the structure (exploratory and confirmatory factor analysis), internal consistency (Cronbach’s alpha), and test-retest reliability of the MSPSS among university students in the Midwest region of Brazil.

Methods

The study population was taken from a cross-sectional study with 2,295 health students at a university in the Midwest region of Brazil. In 2018 a survey was conducted with all health students studying at the university using a pre-tested standardized questionnaire containing the MSPSS and questions devised to collect information about sociodemographic characteristics, behaviors, nutrition, and health. The present study was divided into two stages. The first stage assessed the construct validity and internal consistency of the MSPSS in the respondents of the above survey. The second stage explored MSPSS test-retest reliability in a sample of 347 medical students from the original study population. The data for the second stage were collected in November 2019 in two separate moments with a 14-day interval. The sample sizes used in both stages exceeded the minimum size per instrument question recommended in the literature by at least 10 people22. In both stages, the students were approached in the classroom and completed a self-administered questionnaire read out by a researcher in order to minimize missing answers. After completion, the questionnaire was placed in a sealed box.

As mentioned above, the MSPSS assesses emotional support and social interaction from three sources: friends, family, and significant others. The family support items (3, 4, 8 and 11) assess emotional support, availability of support, and help dealing with problems and making decisions, such as item 3: “My family really tries to help me”. The support from friends items (6, 7, 9 and 12) investigate help dealing with adverse situations, sharing joys and sorrows, and talking about problems, as illustrated by item 7: “I can count on my friends when things go wrong”. The significant others items (1, 2, 5 and 10) look at the presence of a special person in time of need as a source of comfort, to share joys and sorrows, and care about feelings, as shown by item 1: “There is a special person who is around when I am in need”. The questions are answered on a 7-point Likert scale, as follows: very strongly disagree (1); strongly disagree (2); mildly disagree (3); neutral (4); mildly agree (5); strongly agree (6); very strongly agree (7).

The data were double entered using EpiData version 3.1 and checked for typing errors. The analyses were performed using Mplus version 8.423. The sample was described using absolute and relative frequencies, means, and standard deviations. Internal consistency was measured using Cronbach’s alpha, where values equal to or greater than 0.7 indicate a factor structure with good internal consistency24.

Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed with two random independent samples of 1,147 individuals (excluding one student who did not answer the scale). EFA was performed using the factor extraction method weighted least squares mean and variance adjusted (WLSMV), inputting the variables as categorical variables (PROBIT link) and using Geomin oblique factor rotation, which allows the factors to be correlated among themselves23,24.

Factor structure was confirmed using CFA adopting the same estimation method. The analysis tested solutions with one to four factors to determine which model had the best fit24,25. We opted for an open solution with up to four factors. The fit of the factor structure was measured considering the factor loading of the items, number of items per factor, the model’s fit indices25, and the results of the analysis of internal consistency24.

The following fit indicators were used in the EFA and CFA: RV (residual variance)24, chi-squared (χ²), standardized root mean square residual (SRMR), root mean square error of approximation (RMSEA), comparative fit index (CFI), and the Tucker-Lewis index (TLI)24,25. RV represents the variance not explained by the latent factor, where a value of less than 0.75 is deemed adequate22.

Chi-squared tests difference between the empirical matrix and matrix of the theoretical model. For an acceptable fit, the χ² value should accept the null hypothesis (nonsignificant p-value>0.05)24. RMSEA24 values close to or less than 0.06 indicate good fit. SRMR24 values of close to or less than 0.08 are recommended, where the closer to zero the better the fit of the model. CFI24 and TLI24 values range between 0 and 1, where values greater than 0.90 and 0.95 are deemed acceptable and adequate respectively. Improvement in fit with the inclusion of covariances was determined using the Theta modification index24, added to the CFA only when theoretical plausibility was detected.

The test-retest stability (TR) of each scale item was tested using crude and weighted total percentage agreement and kappa coefficients (κ), using the following kappa reference values: 0, no agreement; 0.1 to 0.20, minimal agreement; 0.21 to 0.40, reasonable agreement; 0.41 to 0.60, moderate agreement; 0.61 to 0.80, substantial agreement; and 0.81 to 1.0, perfect or almost perfect agreement24-26.

All participants signed an informed consent form. The study was conducted in accordance with the ethical, legal, and regulatory norms and standards for research involving human subjects set out in National Health Council resolutions 466/2012 and 510/2016. The study protocol was approved by the Universidade do Vale do Rio dos Sinos’s and Universidade de Rio Verde’s research ethics committees (certificate No. 97545818.2.0000.5344/reference No. 2.892.764 and certificate No. 97545818.2.3001.5077/reference No. 2.905.704, respectively, and reference numbers 3.649.203 and 3.688.985, respectively for the test-retest study).

Results

The EFA and CFA samples were both made up of 1,147 students (total=2,294). The test-retest study was conducted with a sample of 347 medical students. The students were predominantly white single females aged between 21 and 22 years. Economic class A accounted for 45.2%, 44.1%, and 23.9%, respectively, of the EFA, CFA, and test-retest samples (Table 1).

Table 1
Demographic and socioeconomic characteristics of the university students.

As expected, the solution with the best fit in the exploratory analysis was the four-factor model. However, this solution was immediately discarded and is not presented here because the fourth factor had only one item (I have a special person who is a real source of comfort to me). The two-factor solution loaded friends and significant others on factor 1 and maintained the original family factor in factor 2. The best solution was therefore deemed to be the three-factor model, which reproduced the factor structure suggested by the literature: significant others (factor 1), family (factor 2), and friends (factor 3). These factors obtained the following Cronbach’s alpha values: 0.96, 0.97, and 0.97, respectively.

The factor loadings of the three-factor model ranged between 0.636 and 0.972 and the following fit indices were obtained: χ²(d.f.) 660.425(33), p<0.0001; SRMR=0.025; RMSEA=0.130; CFI=0.987, and TLI=0.973 (Table 2). The Theta modification index indicated the inclusion of two correlations that made theoretical sense: item 1 (There is a special person who is around when I am in need) with item 2 (There is a special person with whom I can share my joys and sorrows) and item 5 (I have a special person who is a real source of comfort to me) with item 10 (There is a special person in my life who cares about my feelings). These correlations were therefore added to the CFA, resulting in a better fit to the data.

Table 2
Results of the exploratory factor analysis using Geomin rotation for a solution with one, two, and three factors and scale fit indices in Brazilian university students (n=1,130).

In the confirmatory factor analysis (CFA), the factor loadings of the items of the three-factor solution ranged between 0.76 and 0.95 and the model obtained the following fit indices: χ²(d.f.)=380.006 (49), p<0.0001; SRMR=0.023; RMSEA=0.077; CFI=0.993; TLI=0.990 (Figure 1).

Figure 1
Confirmatory factor analysis of the three-factor solution for the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students (n=1,143).

With regard to test-retest stability, the crude and weighted kappa coefficient values ranged between 0.26 and 0.39 and 0.36 and 0.52, respectively, while crude and weighted percentage agreement ranged between 48.7% and 62.5% and 83.5 and 89.7%, respectively (Table 3).

Table 3
Crude and weighted kappa coefficient values and percentage agreement of the test-retest of the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students (n=347).

Discussion

The aim of this study was to assess the internal consistency, construct validity, and test-retest reliability of the Multidimensional Scale of Perceived Social Support (MSPSS) in Brazilian university students. Our findings confirm the three-factor structure (family, friends, and significant others) of the original version of the MSPSS10,11. These results are consistent with the literature on this population27-33. The findings also demonstrate that the MSPSS and factors have high internal consistency and that the factor solution provides a good fit for study population, obtaining higher values than those reported for the original version of the scale11 and a previous study with 237 medical students33.

The CFA results, except for the significant χ² value, which is strongly influenced by sample size, suggest that the model has good fit. The other indicators demonstrated adequate values for the three-factor model in comparison to the one- and two-factor models and considering the values obtained by the study that evaluated the original version of the scale14 and other studies with university students27-29,33,34. The RMSEA was acceptable despite being slightly higher than the desired value. A previous study with 549 university students reported similar results, supporting the three-factor model and showing that the MSPSS had high internal consistency and acceptable RMSEA30.

In addition, factor loadings in the CFA were high (above 0.78) and the factors reproduced the results of the original version of the scale11, which is consistent with previous studies9,28. In our study, we found correlations with lower factor loadings in items 1, 2, 5, 10, which belong to the “significant others” factor. This may be explained by the fact that university students may perceive family and friends to be a more acceptable source of support than significant others, which has been shown by other studies32,34. Based on the results of the theoretical plausibility test, we therefore introduced correlations between items 1 and 2 and items 5 and 10, improving the fit of the confirmatory model.

With regard to test-retest reliability, the MSPSS showed reasonable stability over time for a 14-day interval and moderate agreement for scale items with their respective factors, as reported by Portugal31 for the friends factor. In addition, the results of a study assessing the validity of a Russian version of the MSPSS with 1,018 adults35 indicated acceptable test-retest reliability. It is possible that changes in perceived social support occurred during the time interval given that this construct is strongly mediated by other psychosocial aspects6, which may explain the insubstantial Kappa values found in the present study. In addition, it is important to consider measure errors that are intrinsic to the construct assessed by the scale in consecutive applications.

Finally, it can be concluded that the MSPSS has acceptable psychometric properties, adequate internal consistency and construct validity, and moderated test-retest reliability, suggesting that the instrument has good fit for use with university students. As proposed by Zimmet, the three-factor solution showed the best fit. The availability of MSPSS and evidence for validity can help in investigating mechanisms and causal relationships between social support and physical and mental health among university students6,12.

Although our findings support the use of the Brazilian version of the scale, certain limitations need to be considered. The study sample comprised health students and is therefore not representative of students doing other courses or young people in general. Studies evaluating evidence for the validity of the MSPSS with clinical samples have yet to be conducted and would be an interesting direction for future research. Future studies with other population groups, using robust methods to assess measurement invariance of the MSPSS in minority groups for example, could help make the measure more accurate and enable comparison between results obtained with different populations.

References

  • 1 Cassel J. Psychosocial processes and "stress": theoretical formulation. Int J of Health Serv 1974; 4(3):471-482.
  • 2 Gottlieb BH, Bergen AE. Social support concepts and measures. J Psychosom Res 2010; 69(5):511-520.
  • 3 Kaplan BH, Cassel JC, Gore S. Social support and health. Med Care 1977; 15(5):47-58.
  • 4 Cassel J. The contribution of the social environment to host resistance: the fourth wade hampton frost lecture. Am J Epidemiol 1976; 104(2):107-123.
  • 5 Kelly ME, Duff H, Kelly S, Power JEM, Brennan S, Lawlor BA, Loughrey DG. The impact of social activities, social networks, social support and social relationships on the cognitive functioning of healthy older adults: a systematic review. Syst Rev J 2017; 6(259):5-18.
  • 6 Thoits PA. Mechanisms linking social ties and support physical and mental health. J Health Soc Behav 2011; 52(2):145-161.
  • 7 Aragão EIS, Portugal FB, Campos MR, Lopes CS, Fortes SLCL. Distintos padrões de apoio social percebido e sua associação com doenças físicas (hipertensão, diabetes) ou mentais no contexto da atenção primária. Cien Saude Colet 2017; 22(7):2367-2374.
  • 8 Rock DL, Green KE, Wise BK, Rock RD. Social support scales and social networks: a psychometric review. Res Nurs Health 1984; 7(4):325-332.
  • 9 Dambi JM, Corten L, Chiwaridzo M, Jack H, Mlambo T, Jelsma J. A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health Qual Life Outcomes 2018; 16(80):1-19.
  • 10 Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Soc Psychol 1988; 52(1):30-41.
  • 11 Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the multidimensional scale of perceived social support. J Pers Soc Psychol 1990; 55(3-4):610-617.
  • 12 Canty-Mitchell J, Zimet GD. Psychometric properties of the multidimensional scale of perceived social support in urban adolescents. Am J Community Psychol 2000; 28(3):391-400.
  • 13 Merino-Soto C, Boluarte Carbajal A, Toledano-Toledano F, Nabors LA, Núñez-Benítez MÁ. A New Story on the Multidimensionality of the MSPSS: Validity of the Internal Structure through Bifactor ESEM. Int J Environ Res Public Health 2022; 19(2):935.
  • 14 De Maria M, Vellone E, Durante A, Biagioli V, Matarese M. Psychometric evaluation of the multidimensional scale of perceived social support (MSPSS) in people with chronic diseases. Ann Ist Super Sanita 2018; 54(4):308-315.
  • 15 Micozkadioglu H, Micozkadioglu I, Zumrutdal A, Erdem A, Ozdemir FN, Sezer S, Haberal M. Relationship between depressive affect and malnutrition-inflammation complex syndrome in haemodialysis patients. Nephrology 2006; 11(6):502-505.
  • 16 Vaingankar JA, Abdin E, Chong SA. Exploratory and confirmatory factor analyses of the Multidimensional Scale of Perceived Social Support in patients with schizophrenia. Compr Psychiatry 2012; 53(3):286-291.
  • 17 Calderón C, Ferrando PJ, Lorenzo-Seva U, Gómez-Sánchez D, Fernández-Montes A, Palacín-Lois M, Antoñanzas-Basa M, Rogado J, Manzano-Fernández A, Ferreira E, Asensio-Martínez E, Jiménez-Fonseca P. Multidimensional Scale of Perceived Social Support (MSPSS) in cancer patients: psychometric properties and measurement invariance. Psicothema 2021; 33(1):131-138.
  • 18 Pérez-Villalobos C, Briede-Westermeyer JC, Schilling-Norman MJ, Contreras-Espinoza S. Multidimensional scale of perceived social support: evidence of validity and reliability in a Chilean adaptation for older adults. BMC Geriatr 2021; 21(1):461.
  • 19 Cartwright AV, Pione RD, Stoner CR, Spector A. Validation of the multidimensional scale of perceived social support (MSPSS) for family caregivers of people with dementia. Aging Ment Health 2022; 26(2):286-293.
  • 20 Gabardo-Martins LMD, Ferreira MC, Valentini F. Propriedades psicométricas da escala multidimensional de suporte social percebido. Temas Psicol 2017; 25(4):1873-1883.
  • 21 Granieri A, Franzoi IG, Chung MC. Editorial: Psychological Distress Among University Students. Front Psychol 2021; 12:647940.
  • 22 Hair Junior JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7ª ed. New Jersey: Pearson Prentice Hall; 2009.
  • 23 Muthén LK, Muthén BO. Mplus user's guide. 7ª ed. Los Angeles: Muthén & Muthén; 2012.
  • 24 Hu LT, Bentler PM. Cut-off criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Model 1999; 6(1):1-55.
  • 25 Brown TA. Confirmatory factor analysis for applied research. New York: The Guilford Press; 2006.
  • 26 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1):159-174.
  • 27 Duru E. Re-examination of the psychometric characteristics of the Multidimensional Scale of Perceived Social Support among Turkish university students. Soc Behav Pers 2007; 35(4):443-452.
  • 28 Guan NC, Seng LH, Ann AYH, Hui KO. Factorial validity and reliability of the malaysian simplified Chinese version of Multidimensional Scale of Perceived Social Support (MSPSS-SCV) among a group of university students. Asia Pac J Public Health 2015; 27(2):225-231.
  • 29 Basol G. Validity and reliability of the multidimensional scale of perceived social support-revised, with a turkish sample. Soc Behav Personality 2008; 36(10):1303-1314.
  • 30 Clara IP, Cox BJ, Enns MW, Murray LT, Torgrudc LJ. Confirmatory factor analysis of the multidimensional scale of perceived social support in clinically distressed and student samples. J Pers Soc Psychol 2003; 81(3):265-270.
  • 31 Carvalho S, Pinto-Gouveia J, Pimentel P, Maia D, Mota-Pereira J. Características psicométricas da versão portuguesa da Escala Multidimensional de Suporte Social Percebido (Multidimensional Scale of Perceived Social Support - MSPSS). Psychol 2011; 54:331-357.
  • 32 Eker D, Arkar H, Yaldiz H. Generality of support sources and psychometric properties of a scale of perceived social support in Turkey. Soc Psychiatry Psychiatr Epidemiol 2000; 35:228-233.
  • 33 Ng CG, Amer Siddiq AN, Aida SA, Zainal NZ, Koh OH. Validation of the Malay version of the Multidimensional Scale of Perceived Social Support (MSPSS-M) among a group of medical students in faculty of medicine, University of Malaya. Asian J Psychiatr 2010; 3(1):3-6.
  • 34 Ekbäck M, Benzein E, Lindberg M, Årestedt K. The Swedish version of the multidimensional scale of perceived social support (MSPSS) - a psychometric evaluation study in women with hirsutism and nursing students. Health Qual Life Outcomes 2013; 11:168.
  • 35 Pushkarev GS, Zimet GD, Kuznetsov VA, Yaroslavskaya EI. The Multidimensional Scale of Perceived Social Support (MSPSS): reliability and validity of Russian version. Clin Gerontol 2018; 43(3):331-339.

Edited by

  • Chief editors:
    Romeu Gomes, Antônio Augusto Moura da Silva

Publication Dates

  • Publication in this collection
    17 Oct 2022
  • Date of issue
    Nov 2022

History

  • Received
    31 Jan 2022
  • Accepted
    15 June 2022
  • Published
    17 June 2022
location_on
ABRASCO - Associação Brasileira de Saúde Coletiva Av. Brasil, 4036 - sala 700 Manguinhos, 21040-361 Rio de Janeiro RJ - Brazil, Tel.: +55 21 3882-9153 / 3882-9151 - Rio de Janeiro - RJ - Brazil
E-mail: cienciasaudecoletiva@fiocruz.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Ir para o topo Reportar erro