Test-Retest Reliability of the Swedish Demand-Control-Support Questionnaire among Industrial Restaurant Workers in the State of Rio de Janeiro

Abstracts

OBJETIVO: Este estudo tem o objetivo de verificar a confiabilidade teste-reteste da versão em Português da escala sueca "Demand-Control-Support Questionnaire (DCSQ)" em uma população de trabalhadores com baixa escolaridade. MÉTODO: O questionário foi aplicado em dois momentos para 52 trabalhadores de três restaurantes industriais de uma empresa concessionária do Rio de Janeiro, com intervalos de 7 a 15 dias. Como indicadores de estabilidade foram utilizados o Coeficiente de Correlação Intraclasse (CCIC), a estatística Kappa Ponderado e o gráfico de Bland & Altman. Para avaliação da consistência interna utilizou-se o Coeficiente Alpha de Cronbach. RESULTADOS: O CCIC para as dimensões: demanda psicológica, controle do trabalho e apoio social no trabalho foi de 0,70, 0,68 e 0,80, respectivamente. O Alpha de Cronbach apresentou, no reteste, os seguintes resultados: 0,75, 0,50 e 0,82, para as dimensões anteriormente citadas, na mesma sequência. CONCLUSÕES: Ainda que o resultado da escala controle do trabalho tenha sido considerado baixo para o Alpha de Cronbach, os outros indicadores de confiabilidade apontam para uma boa estabilidade do instrumento, possibilitando sua utilização em estudos de associação entre estresse no trabalho e desfechos relacionados à saúde.

Reprodutibilidade dos resultados; Saúde ocupacional; Estresse psicológico

ORIGINAL ARTICLES

^IDepartamento de Nutrição Aplicada do Instituto de Nutrição da Universidade do Estado do Rio de Janeiro - UERJ

^IIDepartamento de Epidemiologia da Escola Nacional de Saúde Pública da Fundação Oswaldo Cruz - FIOCRUZ, Rio de Janeiro, RJ

Correspondência

ABSTRACT

OBJECTIVE: This study aims to verify the test-retest reliability of the Portuguese version of the Swedish "Demand-Control-Support Questionnaire (DCSQ)" scale in a population of workers with low education.

METHOD: The questionnaire was administered to 52 employees of three restaurants in industrial companies in Rio de Janeiro twice, with intervals from 7 to 15 days. As indicators of stability, the Intraclass Correlation Coefficient (ICC), weighted Kappa statistics and Bland and Altman's plot were used; for internal consistency evaluation, Cronbach's alpha coefficient was used.

RESULTS: The ICCs for the "psychological demand", "decision latitude" and "social support in the workplace" dimensions were 0.70, 0.68 and 0.80, respectively. Cronbach's alpha showed the following results in the retest for the previously mentioned dimensions: 0.75, 0.50 and 0.82, respectively.

CONCLUSIONS: Although the outcome of the Demand-Control scale has been considered low for Cronbach's alpha, other reliability indicators point to good stability of the instrument, allowing its use in studies on the association between job stress and health-related outcomes.

Keywords: Reproducibility of Results; Occupational Health; Psychological stress.

Introduction

Considering the context of restructuring of the world economy, linked to the redefinitions of work processes, efforts have been required to develop objective scales, which can assess work-related stress with outcomes in the sphere of health¹. In the 1970s², studies on stress emphasizing workers' individual characteristics began, whereas the evaluation of psychosocial aspects of work, such as psychological demand, decision latitude and social support, has largely dominated the investigations since the 1980s³.

Recently, the use of instruments that evaluate psychosocial aspects of work has increased considerably in the literature⁴. The questionnaire that has been frequently used in the United States, Canada, Europe and Japan is the Job Content Questionnaire (JCQ), which combines two psychosocial aspects of work: psychological demand and decision latitude^1,2. Psychological demand is defined as the individual's perception of the intensity with which he is required or requested to perform their tasks and of the existing conflicts in the work relationship. The level of decision latitude would be the individual's capacity to decide about their work program or how to perform it, expressed by the authority to make decisions and develop abilities^4,5. Subsequently, Johnson et al. added the dimension of social support in the workplace to the model, which results from the interaction occurring among workers and between workers and supervisors in the work environment ⁶.

The original "Job Strain Model" predicts that highly stressful jobs are those that combine high psychological demand originated from work and low control of such work, classified as high-demand. In addition, the model also predicts that the combination of high psychological demand and high decision latitude leads to high-strain jobs, where the challenges resulting from this work develop one's abilities, trust, competence and well-being². However, the combination of low psychological demand and low decision latitude point to a reduction in the capacity to provide solutions for the difficulties associated with work activities, defined as passive jobs. The combination of low psychological demand and high decision latitude indicates low demand in the workplace and, probably, an "ideal" work process situation⁷.Social support in the workplace has been seen as a buffer in the effects of high-demand work, enabling social interaction, existing in the work environment among coworkers and between these and the managers, to be observed. To understand how the work environment affects the well-being of workers has been of great interest to researchers in the area of health and work^4,6. Investigations on the association between stress in the workplace and different outcomes, such as psychiatric disorders³, interruption of routine activities⁸ and, especially, cardiovascular problems, have been described in the literature^2,9,10.

The JCQ comprises 49 questions and deals with the following dimensions: psychological demand (nine questions), physical demand (five questions), decision latitude - including two components, use of abilities (six questions) and authority to make decisions (11 questions) - and social support in the workplace from management (five questions) and coworkers (six questions), and insecurity in the workplace (six questions). There is one question about the level of qualification required for the work performed (corresponding to the level of education required in the position occupied)^2,4.

The short modified JCQ version was introduced by Theorell, in 1988, the Swedish "Demand-Control-Support Questionnaire - DCSQ", including three dimensions proposed in the JCQ: psychological demand, decision latitude and social support⁷. This version is comprised of 17 questions: five to evaluate psychological demand, six to evaluate decision latitude, and six to evaluate social support in the workplace. In the questions about psychological demand, four refer to quantitative aspects of work, such as time, requirement and speed to perform tasks, and one refers to conflict among different demands. In the items related to decision latitude, four refer to use and development of abilities and two, to the autonomy to make decisions about the work process. The "social support in the workplace" dimension includes six questions about relationships between coworkers and managers⁷. Both scales were adapted to Portuguese and used in epidemiological studies in Brazil. The JCQ was applied to nurses and oil refinery workers^3,9 and the DCSQ, to a cohort of civil servants of a university in the state of Rio de Janeiro, in the Pró-Saúde (Pro-Health) Study^10,11.

In studies on reliability of scales in use in Brazil, both from the JCQ and the DCSQ, study populations predominantly showed a high level of education, without the presence of results of workers with a low level of education.

To obtain a reliable measure has become a challenge to researchers in the areas of medical clinic and epidemiology, due to the difficulty and impossibility to control all possible sources of variability of the measure¹². To test the reliability of studies has become an essential step to guarantee adequacy of the information gathered in the ongoing investigation and its reproducibility, which represents the extension in which the results obtained by a specific instrument or test can be reproducible in other populations^13,14.

The present study aimed to observe the test-retest reliability (intra-observer) of the Portuguese version of the Swedish "Demand-Control-Support Questionnaire (DCSQ)" scale in a population of workers with low level of education.

Methods

A test-retest study with an interval from seven to 15 days between applications was performed to enable the analysis of reliability of the Swedish "Demand-Control-Support Questionnaire (DCSQ)". All workers from the three restaurants, selected for convenience from a meal delivery company established in the city of Rio de Janeiro, were interviewed. Interviews occurred in the company's cafeteria during the period when no meals were distributed.

Criteria for exclusion from the study were as follows: night-shift workers, worker on a sick or maternity leave, length of stay in the job of less than 30 days or workers with no direct participation in the meal production process were also excluded.

Of all 56 eligible workers in these three restaurants, four did not participate: one was dismissed in the week following test application, two were on vacation in this period and one refused to participate. Thus, the population that performed the test-retest totaled 52 workers (92.8%) and none refused to repeat the interview. Questionnaires were applied face-to-face by only one interviewer, during their work time, after reading and signing an Informed Consent Form.

Workers interviewed in this study on test-retest showed characteristics, such as sex, age, level of education and work process, that were similar to those of the population that would be investigated in a different study entitled, "Pressão no trabalho: impedimento das atividades laborais e ambiente de trabalho entre trabalhadores dos Restaurantes Populares do Rio de Janeiro" ("Pressure in the workplace: an obstacle to work activities and environment among workers of Budget Restaurants in Rio de Janeiro"), in nine budget restaurants operating in 2007¹⁵.

The following variables were included: professional qualification, employment situation and socio-demographic characteristics. The DCSQ scale used had been translated and adapted to Portuguese by the Pró-Saúde study⁷.

The present study was approved by the Comitê de Ética em Pesquisa do Instituto de Medicina Social da Universidade do Estado do Rio de Janeiro (CEP-IMS - Rio de Janeiro State University Institute of Social Medicine Research Ethics Committee), under register number 15/5006 of November 22^nd, 2006.

Data Analysis

Standardized score calculation of each of the three dimensions was performed to analyze data, attributing points to each response selected. The "psychological demand" and "decision latitude" dimensions could be given the following values: (4) frequently, (3) sometimes, (2) rarely, and (1) never or almost never for these dimensions. The "social support in the workplace" dimension could be given the following values: (4) I totally agree, (3) I agree more than disagree, (2) I disagree more than agree, and (1) I totally disagree.

A score was created for the psychological demand scale, based on the sum of values obtained from the five questions about demand and varying between five and 20. The question, "Do you have enough time to perform all the tasks of your job?", has a reverse direction. Thus, a score 1 was attributed to "frequently"; a score 2 to "sometimes"; a score 3 to "rarely", and a score 4 to "never" or "almost never". The reason is that the more frequent the time to perform work, the lower the weight of demand.

A score based on the sum of values, obtained from the six questions about control and varying between six and 24, was created for the "decision latitude" scale. In this dimension, the question, "In your job, do you have to repeat the same tasks many times?", also had a reverse direction. As a result, the less frequent the repetition of tasks, the more control over work one had.

The third and last dimension, social support in the workplace, was also created from the sum of values of scores of the six questions about this support, varying between six and 24 points. None of the questions of this dimension had a reverse scoring.

Reliability of the Questionnaire Score

Reliability of the "psychological demand", "decision latitude" and "social support in the workplace" dimensions, resulting from the sum of scores, was evaluated using the intraclass correlation coefficient (ICC) with a 95% confidence interval (CI) and Bland & Altman plot^14,16.

The ICC has been considered appropriate to evaluate the consistency and conformity of studies, as it is capable of estimating the proportion of total variation due to the variability among independent units of analyses. The ICC is equivalent to quadratic weighted kappa statistics for continuous variables and it has the same amplitude of possible values (from zero to +1.0, in the case of perfect agreement). The limitation to this method is in the dependence on the level of variability in and among the observations, affecting the ICC results². To analyze these results, calculation was performed using analysis of variance (ANOVA), one-way model with fixed effects¹⁷.

Bland & Altman plot enables the evaluation of the pattern of agreement or disagreement among repeated measurements, or among a given measurement and the gold standard, in addition to its incorporating certain limits of tolerance. In this plot, the magnitude of disagreement (including systematic differences) and strange values (outliers) can be seen and trends can be verified^,14,16.

Reliability of Questionnaire Questions

Reliability of items of the three dimensions was evaluated by weighted kappa, once these items have the form of ordinal variables. Next, agreement was evaluated, considering the perfect level of agreement (main diagonal in the contingency table), and so was the magnitude of disagreement, by attributing different weights, according to the greater or lower proximity among variable categories¹⁴. Criteria proposed by Byrt (1996) were adopted to interpret the level of agreement of kappa statistics: no agreement, below zero; very poor, from 0 to 0.20; poor, from 0.21 to 0.40; fair, from 0.41 to 0.60; good, from 0.61 to 0.80; very good, from 0.81 to 0.92; and excellent, from 0.93 to 1.00¹⁴.

Reliability of Internal Consistency of the Questionnaire

Cronbach's alpha coefficient was used in the analysis of internal consistency of scores of DCSQ dimensions. This index identifies the homogeneity of questions (item) that aims to measure the same construct¹³, considering the variance attributable to individuals and the variance attributable to the interaction between individuals and items. In addition, this estimate is affected by the number of items, intercorrelations among items and instrument dimensionalities¹⁸. Bland & Altman (1997) recommend alpha values between 0.7 and 0.8 as satisfactory to compare groups. When alpha is applied to a construct aimed at clinical evaluation, a minimum of 0.9 could be considered¹⁹.

RESULTS

All the 52 workers who participated in the test-retest were 38.4 years of age on average, with a standard deviation (SD) of 10.5, corresponding to a number of males equal to 75% of the total. Among interviewees, 32.7% had not completed elementary school, 15.4% had only completed elementary school; 25.0% had not completed high-school, and 19.2% had completed high-school. Only nutritionists had a higher education (7.7%). Mean length of work in the kitchens was 5.2 (SD=5.6).

As regards the results obtained in the reliability study, Table 1 shows that the ICC for psychological demand, decision latitude and social support in the workplace was 0.70 (95% CI: 0.56-0.83), 0.68 (95% CI: 0.53-0.82) and 0.80 (95% CI:0.71-0.90) respectively, indicating that agreements were good in the three dimensions, according to cut-off points attributed by Byrt.

Cronbach's alpha showed the following results for the "psychological demand", "decision latitude" and "social support in the workplace" dimensions: in the test, 0.59, 0.33 and 0.66; and, in the retest, 0.75, 0.50 and 0.82, respectively. Variations in the estimates of internal consistency were not observed, according to sex or age group (data not shown).

In the analysis of "psychological demand" and "decision latitude" scales by the Bland-Altman method, in Figures 1 and 2 respectively, the means of scores between test and retest are found in the x-axis. The y-axis shows the difference between scores of the first (test) and second interviews (retest). Figure 1 shows the mean of differences, 0.31, and 95% of the "psychological demand" values are found in the limits of agreement, between the mean of differences plus two standard deviations (5.1 psychological demand) and minus two standard deviations (-4.4 psychological demand). The information about psychological demand in the workplace revealed a positive difference between test and retest, indicating a higher concentration in the upper limit of the plot, suggesting a trend of underestimation in the retest, when compared to the test.

In terms of decision latitude, Figure 2 shows that the mean of 0.36 differences and 95% of values of decision latitude are found between the mean of differences plus two standard deviations (4.4 decision latitude) and minus two standard deviations (-3.7 decision latitude), with the configuration of points indicating a smaller distance between the point and the horizontal line. The concentration of positive values indicates an underestimation of informed perception of decision latitude in the retest. Bland-Altman plot for social support in the workplace (data not shown) showed a concentration of negative values, thus indicating an overestimation of informed values in the retest. In the calculation of weighted kappa values, values varying from 0.48 (fair) in item 5 to 0.63 (good) in item 2 were obtained for "psychological demand", for each of the 17 items of the DCSQ questionnaire (Table 2).

In the "decision latitude" dimension, values varied between 0.37 (poor) in item 2 and 0.70 (good) in item 4. Item 3 showed a fair level of agreement, while the level of the other items was good.

In the case of "social support in the workplace", variation was between 0.28 (poor) in item 1, which showed the lowest level of agreement between test and retest responses, and 0.86 (very good) in item 5. Moreover, item 2 showed a fair level of agreement; item 3, good; and items 4 and 6, very good.

DISCUSSION

Findings from this investigation show that, although the result of internal consistency of the scale for decision latitude was considered low, other reliability indicators point to good stability of the instrument.

Agreement between the information assessed in the test and that in the retest in industrial restaurant workers, seeking to observe the consistency and conformity of the study, was considered good. This indicates greater stability in the "psychological demand" and "social support in the workplace" dimensions and lower stability in "decision latitude". These results differ from the Pró-Saúde study (Alves, 2004), where the stability of responses assessed by the Intraclass Correlation Coefficient showed higher values, ICC= 0.88 for psychological demand, ICC=0.87 for decision latitude and ICC=0.86 for social support in the workplace. These differences may be attributed to the level of education, once the interpretation of the scale presupposes an understanding of the responses, in view of its not being direct.

Cronbach's alpha showed differences between the test and retest, as it was low in the first interview and closer to being adequate in the second application of the scale, with the exception of decision latitude. This can be partly explained by the fact that, in the test, the DCSQ scale was applied concomitantly with the other variables included in the questionnaire (socio-demographic variables and professional qualification, for example), whereas only the DCSQ scale was applied in the retest. Individual results for the questions about decision latitude were much worse than those for "psychological demand" or "social support in the workplace". Items 2, "Does you work require much ability or specialized knowledge?", and 4, "In your job, do you have to repeat the same tasks many times?", were those showing the best correlations. With few exceptions, correlations between each question of each item and the final score of each item improved from the test to the retest.

In the process of adaptation of the scale to Portuguese, in the Pró-Saúde study, the following results were found for the internal consistency of the "psychological demand", "decision latitude" and "social support in the workplace" dimensions: alpha of 0.72, 0.63 and 0.86, respectively⁷.

Josephson et al. (1997), using the short version of Karasek's questionnaire in a population of nurses from Northern Sweden, found a Cronbach's alpha of 0.69 for "psychological demand" and 0.51 for "decision latitude", in addition to low internal consistency for decision latitude²¹. Even in studies where the level of education was considered high, the internal consistency of the "decision latitude" dimension did not show adequate results. The results found both in Brazil and Sweden were similar to the low internal consistency for "decision latitude" observed in the retest of the present study.

In the sectional study with the Job Content Questionnaire (JCQ), performed by Araújo and Karasek (2008), authors found low internal consistency for "psychological demand" (alpha=0.55) and decision latitude (alpha=0.62) among informal market workers²². According to authors, "psychological demand" can have different meanings in distinct groups of the working population, in their cultural, social and occupational contexts. However, in the study by Sanne et al. (2005), Cronbach's alpha was adequate for "psychological demand" (0.73), "decision latitude" (0.74) and "social support" (0.83)²³. Moreover, studies performed in Brazil that evaluated the "social support in the workplace" dimension have found the internal consistency to be very good^{7, 22}.

Cortina (1993) warns that the internal consistency must be interpreted with caution, given the fact that the same refers to the level of interrelationship among items, rather than the homogeneity and the fact that its use will be more appropriate in a set of data of a normal distribution. In addition, Cronbach's alpha can change its result due to the number of items, intercorrelation among items and dimensionality¹⁸.Bland-Altman plot has also been considered as a good measure of magnitude of validity, once it analyzes the pattern of disagreement between repeated measures, or between a given measure and the gold standard^14,16. This graphic form has been used in different studies of reliability with continuous discrete variables to observe the hypothesis of normality of differences, according to the limits of agreement^24,25. However, it was not possible to compare the results observed to evaluate the Demand-Control scale, because there were no articles that used this method in the literature.

In the evaluation of weighted kappa for DCSQ scale questions, the lowest value attributed to item 5 of "psychological demand" can be due to the workers' difficulty in interpreting "contradictory or discordant requirements". As regards the low agreement of weighted kappa in item 2 of "decision latitude", one possible explanation would be the industrial restaurant workers' difficulty in considering the fact that their activities require "ability" or "specialized knowledge", once no previous professional experience in the area is required in the majority of cases of industrial restaurant personnel hired. The "social support" scale showed the greatest level of difficulty in understanding the options of responses by workers, due to its structure, which included items such as "agree more than disagree" or "disagree more than agree". In item 1, "calm and pleasant environment", weighted kappa showed the lowest value of scale, perhaps due to the difficulty in attributing a perception of pleasantness and serenity to an industrial restaurant environment, which the question seeks to obtain, or due to a change of pattern of response in the scale.

Another possible explanation for the disagreements found can be associated with the time interval between the applications of both tests. Even considering the interval from seven to 15 days between both measurements, the items that comprise the dimensions can be subject to the understanding in the first contact with the scale and the interviewee's mood. Moreover, the relationship between workers and work overload can affect the perception of psychosocial aspects in the work environment.

Among the study limitations, the impossibility of extrapolating results to the general population should be emphasized, because this investigation only included workers, most of whom had a low level of education and were formally employed. However, the results found can be generalized to populations of workers with a profile similar to those of industrial restaurants, or to those with a low level of education.

The DCSQ scale, which aims to assess work-related stress, is considered relatively short and simple, enabling its inclusion into a multidimensional questionnaire. Nonetheless, in the analysis of results of empirical research on work-related stress, issues related to the world of work in different countries where they are applied should be considered, such as: questions about work organization, conditions of the work environment, level of technology, organization of labor movements, improvement of the legislation and worker's socioeconomic conditions should be taken into consideration in health outcomes⁷.

Conclusion

Based on the findings of the present study, it could be concluded that, despite the low result of internal consistency of the "decision latitude" scale, other indicators of reliability point to good stability of the instrument. The use of the DCSQ scale in the population of workers in the private sector, who have a low level of education, can be reproduced in other populations, with similar characteristics and a broader sample. Thus, the fragility of certain items, which have been shown in the literature in populations with higher levels of education, can be confirmed.

References

• 1. Landsbergis P, Theorell T. Measurement of psychosocial workplace exposure variables. Occup Med 2000; 15(1): 163-88.
• 2. Karasek R, Baker D, Marxer F, Ahlbom A, Theorell T. Job decision latitude, job demands, and cardiovascular disease: a prospective study of Swedish men. AJPH 1981, 71(7): 694-705.
• 3. Araújo TM, Aquino E, Menezes G, Oliveira OS, Aguiar L. Aspectos psicossociais do trabalho e distúrbios psíquicos entre trabalhadoras de enfermagem. Rev Saúde Pública 2003; 37(4): 424-33.
• 4. Araújo TM, Graça CC, Araújo E. Estresse ocupacional e saúde: contribuições do modelo demanda-controle. Ciência & Saúde Coletiva 2003; 8(4): 991-1003.
• 5. Karasek R, Theorell T. Healthy work: stress, productivity, and the reconstruction of working life. New York: Basic Books Publishers; 1990.
• 6. Kristensen TG. Job stress and cardiovascular disease: a theoretic critical review. J Occup Health Psychol, 1996, 1(3): 246-60.
• 7. Alves MGM, Chor D, Faerstein E, Lopes CS, Werneck GL. Versão resumida da "job stress scale": adaptação para o português. Rev Saúde Pública 2004; 38(2): 164-71.
• 8. Macedo LET, Chor D, Andreazzi V, Faerstein E, Werneck GL, Lopes C. Estresse no trabalho e interrupção de atividades habituais, por problemas de saúde, no estudo pró-saúde. Cad Saúde Pública 2007; 23(10): 2327-36.
• 9. Dantas J, Mendes R, Araújo TM. Hipertensão arterial e fatores psicossociais no trabalho em uma refinaria de petróleo. Rev Bras Med Trab 2004, 2(1): 55-68.
• 10. Alves, MGM. Pressão no trabalho: estresse no trabalho e hipertensão arterial em mulheres do estudo pró-saúde [tese de doutorado]. Rio de Janeiro: Escola Nacional de Saúde Pública da FIOCRUZ; 2004.
• 11. Brito, AS. Estresse e acidentes no trabalho: estudo pró-saúde [tese de doutorado]. Rio de Janeiro: Instituto de Medicina Social da UERJ; 2007.
• 12. Streiner DL, Norman GR. Health Measurements Scales 2^nd ed. New York: Oxford University Press; 1998. p. 4-13.
• 13. Luiz RR, Costa AJL, Kale PL, Werneck GL. Assessment of agreement of a quantitative variable: a new graphical approach. J Clin Epidemiol 2003; 56: 963-7.
• 14. Szklo M, Nieto FJ. Epidemiology: beyond the basics. 2^nd ed. USA: Jones and Bartlett Publishers; 2007. p. 313-45.
• 15. Aguiar, OB. Aspectos psicossociais do impedimento laboral por motives de saúde em trabalhadores de cozinhas industriais [tese de doutorado]. Rio de Janeiro: Instituto de Medicina Social da UERJ; 2009.
• 16. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1(307): 10
• 17. Shrout PE, Fleiss JL. Intraclass Correlations: Uses in assessing rater reliability. Psychol Bull 1979; 86(2): 420-8.
• 18. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol 1993; 78(1): 98-104.
• 19. Bland JM, Altman DG. Statistics notes: Cronbach's alpha. BMJ 1997; 314: 572.
• 20. Faerstein E, Chor D, Lopes CS, Werneck GL. Estudo pró-saúde: características gerais e aspectos metodológicos. Rev Bras Epidemiol 2005; 8(4): 454-66.
• 21. Josephson M, Lagerström M, Hagberg M, Hjelm EW. Musculoskeletal symptoms and job strain among nursing personnel: a study over a three year period. Occup Envirom Med 1997; 54: 681-5.
• 22. Araújo TM, Karasek R. Validity and reliability of the job content questionnaire in formal and informal jobs in Brazil. SJWEH 2008; 6(S): 52-9.
• 23. Sanne B, Torp S, Mykletum A, Dahl A. The Swedish demand-control-support questionnaire (DCSQ): factor structure, item analyses, and internal consistency in a large population. Scand J Public Health 2005; 33: 166-74.
• 24. Vilete LMP, Coutinho ESF, Figueira ILV. Confiabilidade da versão em Português do inventário de fobia social (SPIN) entre adolescentes estudantes do município do Rio de Janeiro. Cad Saude Pública 2004; 20(1): 89-99.
• 25. Fonseca MJM, Faerstein E, Chor D, Lopes CS. Validade de peso e estatura informados e índice de massa corporal: estudo pró-saúde. Rev Saúde Pública 2004; 38(3): 392-8.

Reliability (test-retest) of the Swedish "Demand-Control-Support Questionnaire" scale among industrial restaurants workers, state of Rio de Janeiro, Brazil

Odaleia Barbosa de Aguiar^I; Maria de Jesus Mendes da Fonseca^II; Joaquim Gonçalves Valente^II

Publication Dates

• Publication in this collection
  01 July 2010
• Date of issue
  June 2010

History

• Received
  19 June 2009
• Reviewed
  15 Mar 2010
• Accepted
  03 Apr 2010