Application of mood states validation instruments in the detection of the overtraining syndrome

Abstracts

As pressões provocadas pelas exigências do esporte competitivo levam muitos atletas a excederem os limites de sua capacidade física e psicológica, acarretando a manifestação da síndrome do excesso de treinamento (overtraining). O intuito deste artigo de revisão é, a partir do material original, discutir o processo de validação do Perfil dos Estados de Humor-Adolescentes (POMS-A) para uso em adultos(1). Esse instrumento foi desenvolvido para permitir uma rápida mensuração dos estados de humor entre populações de adolescentes e adultos, já tendo sido demonstrada, em recentes pesquisas, sua eficácia no diagnóstico desses estados alterados pelo treinamento intensivo. O POMS-A foi administrado a atletas adultos de competição, atletas estudantes adultos, atletas adolescentes de competição e estudantes adolescentes. Um subgrupo de atletas estudantes adultos foi utilizado para testar a validade do critério do POMS-A. A análise do fator confirmatório deu suporte para a validade fatorial do modelo de 24 itens e seis fatores, usando ambas as análises: independente e amostras múltiplas. Relações entre os escores do POMS-A e medidas validadas previamente, que eram coerentes com fundamentações teóricas, sustentaram a validade do critério de medida. Evidências foram encontradas dando suporte à integridade psicométrica do POMS-A quando se estendeu de adolescentes para populações de adultos. Tais evidências sugerem que o POMS-A é um instrumento apropriado para avaliação de perfis do humor, além do que a brevidade do teste facilita a coleta de dados em ambientes de pesquisa. Pretende-se, em estudos posteriores, validar e aplicar o instrumento BRUMS (nome atual do POMS-A) na detecção da síndrome do excesso de treinamento em atletas brasileiros, para o que já existe autorização dos autores Terry, Lane e Fogarty(1).

Mensuração; Exercício físico; Emoção; Desempenho desportivo; Escalas

REVIEW ARTICLE

Application of mood states validation instruments in the detection of the overtraining syndrome

Aplicación de instrumentos de evaluación de los estados de humor en la detección del síndrome de exceso de entrenamiento

Izabel Cristina Provenza de Miranda Rohlfs; Tales de Carvalho; Tatiana Marcela Rotta; Ruy Jornada Krebs

Santa Catarina State University – Physical Education, Physiotherapy and Sports Center – Florianópolis, SC, Brazil

^{Correspondence}

ABSTRACT

The pressures tempted by the exigencies from the competitive sport lead many athletes to exceed the limits of their physical and psychological capacity, causing the manifestation of overtraining syndrome. The purpose of this review article is to discuss, through the original material, the validation process of the Profile of Mood States-Adolescents (POMS-A) for use with adults⁽¹⁾. This instrument was developed to serve as a brief measure of mood states among adolescents and adult populations, and had already demonstrated, in recent researches, effectiveness in the diagnosis of these altered states by intensive training. The POMS-A was administered to adult athletes prior to competition, adult student athletes, adolescent athletes prior to competition, and adolescent students. A subset of adult student athletes was used to test the criterion validity of the POMS-A. Confirmatory factor analysis provided support for the factorial validity of 24-item, six-factor model using both independent and multi-sample analyses. Relationships between POMS-A scores and previously validated measures, that were consistent with theoretical predictions, supported the criterion validity. Evidences were found in support of the psychometric integrity of the POMS-A when extended from adolescent to adult populations. It is suggested that the POMS-A is an appropriate tool with which mood profiles will be tested, besides the brevity of the test facilitates data collection in research environments. Subsequent studies aim the validation and applicability of the instrument BRUMS (current name of the POMS-A) in detection of overtraining syndrome in Brazilian athletes, for what already exists authorization by the authors Terry, Lane and Fogarty⁽¹⁾.

Key words: Measurement. Physical exercise. Emotion. Physical performance. Scales.

RESUMEN

Las presiones provocadas por las exigencias del deporte competitivo llevan muchos atletas a exceder los límites de su capacidades físicas y sicológicas acarreando la manifestación del síndrome de exceso de entrenamiento (overtraining). El cometido de este artículo de revisión, a partir del material original, es discutir el proceso de la validación del Perfil de los Estados de Humor Adolescentes (POMS – A) para el uso en adultos⁽¹⁾. Este instrumento fué desarrollado para permitir una rápida medida de los estados de humor entre poblaciones de adolescentes y de adultos, ya teniendo demostrado en recientes pesquisas su eficacia en el diagnóstico de estados alterados por el entrenamiento intensivo. El POMS-A fué administrado a atletas adultos de competición, atletas estudiantes adultos, atletas adolescentes de competición y estudiantes adolescentes. Un subgrupo de atletas estudiantes adultos fué utilizado para comprobar la validez del criterio de POMS-A. El análisis del factor confirmatorio dio suporte para la validez factorial del modelo de 24 items y seis factores, usando ambas análisis: independiente y a muestras múltiples. Relaciones entre los escores del POMS-A y las medidas validadas previamente, que eran coherentes con fundamentaciones teóricas, sustentaron la validez del criterio de la medida. Evidencias fueron encontradas dando soporte a la integridad psicométrica del POMS-A cuando se extendió de adolescentes a poblaciones de adultos. Tales evidencias sugieren que el POMS-A es un instrumento apropiado para evaluación de perfiles del humor, además que la brevedad del test facilita la colecta de datos en ambientes de pesquisa. Se ha pretendido en estudios posteriores validar y aplicar el instrumento BRUMS (nombre actual del estudio POMS-A) en la detección del síndrome de exceso de entrenamiento (SEE) en atletas brasileños, para lo que ya existe autorización de los autores Terry, Lane y Fogarty⁽¹⁾.

Palabras-clave: Mensura. Ejercicio físico. Emoción. Desempeño deportivo. Escalas.

INTRODUCTION

Harmful consequences have been found in high-level athletes as result of pressures tempted by the current context of the high exigency sportive practice. It is quite usual athletes to exceed the limits of their physical and psychological capacity before the challenge of excessive training quantities, anxiety, and competitions accumulation, in addition to the recovery insufficient intervals.

The clinical manifestation as result of such excesses is observed through a set of signs and symptoms known as overtraining syndrome. The overtraining syndrome is defined as a neuroendocrine disturbance (hypothalamo-hypophyseal), which results in an unbalance between the exercise demand and the functional capacity, worsened by an inadequate recovery, leads to a decrease on the performance, persistent muscular pain, immunological and neuroendocrine alterations, mood state alterations, constant fatigue, etc. All performance levels athletes run the risk of developing this syndrome, and despite the large list of symptoms and signs, there are no well-established diagnostic criterions usually used^(2-4).

Sportive psychology measurements and methods are parameters identified and considered not only to compare normative values, but also to identify difficulties and to indicate latent characteristics, in combined works with the sportive sciences⁽⁵⁾. De Rose Jr.⁽⁶⁾ elucidates that the association between emotion and the sportive performance emerged when a group of researchers was interested by the performance-dependent variables (motor area), while another group focused on the independent variables that influence the performance (sociocultural aspects). The motor and motor control apprenticeship area approached to the psychological studies with regard to the cognitive and neuropsychological processes involved in the movement^(6,7).

One of the psychological instruments quite useful for the study of several sportive sciences is the POMS. In 1980, William Morgan, an American sports psychologist, began using the POMS test (Profile of Mood States) in the physical activity and sports area in order to evaluate the mood states of American athletes. This test was initially developed for the observation of different mood states in psychiatric patients by McNair et al.⁽⁸⁾. The 65-item instrument measures six mood factors: tension, depression, anger, vigor, fatigue and mental disturbance. The mood transitory factors that the test evaluates are set in an individual graphic, where a type of curve that differs from the non-athletes' may be observed. In this curve, the vigor factor remains above the percentile 50, while the other factors remain below, forming an ideal graphic, called as "iceberg" type⁽⁹⁾.

Through the studies, it was observed that the elevated fatigue factor compared to the elevated depression factor, presented in the POMS individual graphic, seems to be the result of the overtraining and that the test may detect the psychological alterations prior to the syndrome, inverting the "iceberg" profile in the graphic. Starting from a qualitative epistemological analysis, in other words, from the athletes' perception with regard to the psychical (mood alterations, repression, anxiety) and physical (fatigue, exhaustion) signs, this measure has been, since then, quite effective and sensible in quantifying the distress associated to the overtraining in researches with athletes.

Gould⁽¹⁰⁾ defines the stress, in a psychological perspective, as an individual who perceives an unbalance between the physical or psychological demands and his resources to face it, in an activity considered important such as the sportive action, for the athlete. According to Seyle⁽¹¹⁾, the distress is a type of stress that represents a hazardous situation for the organism, being acute when intense, which is short-term installed, or chronic when it is long-term and progressively installed.

Brandão and colleagues studied the POMS among Brazilian populations of athletes in the year of 1993, as for the 300 athletes from the Brazilian teams in 1996⁽¹²⁾, enabling the POMS adaptation for high-performance adult athletes. The POMS application in a study with athletes from the State of Santa Catarina showed that this acceptance threshold of the six factors is different from the observed in international studies, especially with regard to the vigor, whose value was shown below the validated average⁽¹³⁾. Thus, further studies will be necessary with the objective of establishing an average threshold for athletes from different sportive contexts in the Brazilian population.

However, the brevity required by the psychometric tests in some field researches has generated several condensed POMS^(14-17) versions. One of them, the POMS-Adolescents (POMS-A⁽¹⁷⁾) was submitted to a validation rigorous process, and in the year of 2003, it was also validated for use with adults⁽¹⁾, being called BRUMS – Brunel Mood Scale⁽¹⁾, since then. This 24-item instrument was developed in order to allow a quick measuring of the six mood states among adolescent and adult populations, and through recent researches, it has demonstrated efficiency on the diagnosis of these altered states due to overtraining.

Since it perceived the need of developing one more possibility of measuring the psychological evaluation of adolescent and adult athletes in order to contribute for the development of the Brazilian sports, this review article aims, through the original material, to discuss the validation process of the Profile of Mood States-Adolescents (POMS-A) for use with adults⁽¹⁾. Subsequent studies aim the validation and applicability of the BRUMS instrument (current name of the POMS-A) in the detection of the overtraining syndrome in Brazilian athletes, for what already exists authorization by the authors Terry, Lane and Fogarty⁽¹⁾.

POMS-A VALIDATION PROCESS

The POMS-A validation process by Terry et al.⁽¹⁾, passed by three stages. The stage 1 established a satisfactory validity when a council of specialists evaluated a set of initial items elaborated for the comprehension of adolescents and a sample of adolescents identified those items that better described each mood dimension. On stage 2, with 24 items, a six-factor structure was tested using the confirmative factor analysis (CFA) in adolescents in classroom environment and in adolescent athletes prior to competition. The hypothetical model was supported in both groups independently and simultaneously. On stage 3, relationships between POMS-A scores and previously validated measures were consistent with theoretical predictions, supporting the criterion validity of the test measure.

The establishment of the factorial validity is a pre-requirement necessary for the use of any scale in a second population and, therefore, the use of a psychometric perspective; this was important to guide the question of whether the measurement model for the POMS-A, which was supported among adolescent and adult samples, could also be confirmed among adults⁽¹⁷⁾. This question has determined the core of the POMS-A validation study for the use in adults.

According to Terry et al.⁽¹⁾, an important step to establish the validity of a questionnaire is to show that it actually measures the construct that it intends to measure. Criterion validity tests aid to clarify the meaning of the construct measured, evaluating relationships with other measures against theoretical prognostics. Although Terry et al.⁽¹⁷⁾ have tested the POMS-A against three related scales, it was important to test the new scale in criterion measures, especially because the measure was being applied in a different population. Therefore, the second objective of this study was to evaluate the POMS-A validity criterion among adult participants.

Terry et al.⁽¹⁾ described the six POMS-A factors from studies of other authors. Spielberger⁽¹⁸⁾ defines the anger factor as an emotional state that ranges from slight irritation feelings until rage associated to stimuli from the autonomous nervous system; Beck and Clark⁽¹⁹⁾ define mental disturbance as an uncertainness feeling, instability for the attention and emotions control, and the depression as the depreciation or negative self-image. For the fatigue factor, Terry et al.⁽¹⁾ elucidate the meaning of physical and mental exhaustion; for the tension factor, as feelings experienced of apprehension and anxiety; and for the vigor factor, as being characterized by feelings of excitement, disposition and physical energy.

Based on findings of Terry et al.⁽¹⁷⁾, it was established that, in this study, depression would show positive moderate relation with anger, disturbance, fatigue and tension and a weak inverse relation with vigor, while vigor would show a moderate inverse relation with fatigue, but no relation with anger, disturbance and tension whatsoever. These authors divided the entire work development for the validation of the psychological measure into four procedures: (a) method used on the model test, (b) method used on the validity of the criterion test, (c) results of the instrument validation and (d) discussion on the POMS-A validation study for use with adults.

METHOD USED ON THE MODEL TEST

For the validation, the strategy of evaluating the structure constancy of the POMS-A factor between different samples and of testing the relationships with simultaneous measures was used. The POMS-A was administrated to 2,549 participants from four samples: adult athletes (n = 621), recruited from cycling, distance running, kick-boxing, rowing and swimming, with the aim of reflecting a wide range of age, experience and abilities; Sports Sciences graduation adults students (n = 656); adolescent athletes (n = 676) who participated on the London Youth Games at the following modalities: bow and arrow, hockey, judo, netball, soccer, table tennis, walking, springboard, triathlon and volleyball; and adolescent students (n = 596) from West London high schools.

Due to the wide reach of potential use in which only one mood measure may be applied, it is desirable that the validity tests be conducted to more than one situation. Therefore it was decided that the mood would be evaluated in competitions and non-competition situations.

Participants from Sample 1 (adult athletes) and from Sample 3 (adolescent athletes) accomplished POMS-A approximately one hour prior to competition. Participants from Sample 2 (adult students) and from Sample 4 (adolescent students) accomplished POMS-A at the beginning and at the end of one class. All participants answered the following question: "How do you feel now?" with regard to the 24 mood descriptions. The POMS-A has a 5-point response scale, from 0 (absolutely not) to 4 (extremely). The participants were instructed to respond to all items and a list of alternative words was available to the participants as a reference, in case the mood descriptions could not be comprehended.

Following the recommendations of Byrne, the 24 hypothetical items of the six-factor mood model were firstly tested in each sample independently before being conducted to multi-sample analyses in which the hypothetical model was tested to all four samples simultaneously. The confirmatory factor analysis (CFA) using EQS V5 from Bentler and Wu authorship in 1995 was used to test the model⁽¹⁾.

According to the theoretical base and with the previous empirical support, it was possible to correlate the following latent factors: anger, disturbance, depression, fatigue and tension⁽¹⁾. The vigor factor was only correlated to depression and fatigue and the relationships between vigor and anger, disturbance and tension did not differ significantly from zero, as it had been supposed.

The authors selected the four indexes strategy to evaluate the model adjustment. The first index used was the c² ratio to the degrees of freedom. Two additional indexes were used: the comparative fitting index (CFI) from Bentler in 1990 and the Tucker-Lewis index (TLI) from Tucker and Lewis in the year of 1973. The fourth index used was the root mean squared error approximation (RMSEA) from Steiger in the year of 1990, that indicated the average discrepancy between the covariances observed and those involved in the model by degrees of freedom, therefore with the advantage of being sensible to the model complexity⁽¹⁾.

The multi-sample confirmatory factor analysis (CFA) was used to test the factor solution power in all four samples simultaneously.

METHOD USED ON THE CRITERION TEST VALIDITY

A subset of 382 adult student athletes was used to test the POMS-A criterion validity. The subset accomplished the POMS-A and a second questionnaire, and 84 participants accomplished the Positive and Negative Affect Schedule – PANAS, of Watson, Clark and Tellegen, from the year of 1988; other 97 accomplished the State-Trait Anger-Expression Inventory, called STAXI, of Spielberg from the year of 1991, and 110 participants accomplished the Hospital Anxiety and Depression Scale – HADS, of Zigmond and Snaith, from the year of 1983. All participants accomplished the questionnaire according to procedure adopted by the student athletes on stage 1⁽¹⁾.

All selected criterion measures considered that a given criterion scale should be a valid and safe measure itself and it should be possible to foretell the relationship between the scores of the measure that is being validated and the criterion measure. The original POMS was an obvious choice, once it evaluates the same six mood dimensions, compared to the POMS-A. The PANAS was selected because it evaluates two wide affective dimensions that are conceptually related in a presumable path for the POMS-A scales. The STAXI and the HADS were selected because they evaluate specific constructs, which are part of the POMS-A, and, for that reason, they should present strong relations with some POMS-A scales. It is unquestionable that these arguments are equally applied to other potential criterion measures. The four criterion measures used are elucidated as follows.

The original POMS-A, which was used as basis for the POMS-A validation study has 65 items⁽⁹⁾, was developed through analytical studies of the six factors. McNair et al.⁽¹⁵⁾ showed evidences of confirmatory and simultaneous validity and produced normative data for athletes and psychiatric patients in medical clinics. Yet, the authors supported that the POMS was valid for the use in sports and exercises and provided an abstract of findings on this area as support of this proposition. A set of answers of "How are you feeling now?" was used in this study. Due to the fact that the POMS-A is derived from the original POMS, strong positive relations were established between the respective factor scales: anger, disturbance, depression, fatigue and tension. A moderate positive relation was established between two vigor scales because the original scale evaluated a wide positive mood basis (including items such as jovial and carefree), while the POMS-A vigor scale evaluates the most restricted constructs (vigorous, alert, smart, encouraged).

Watson and Tellengen in the year of 1988 developed the 20 items of PANAS to evaluate independent markers of negative and positive influences. In this study, it was supposed that the POMS-A vigor scale would be correlated with the positive influence scale of PANAS, while the tension, depression, anger, fatigue and disturbance scales would be correlated with the negative influence scale of PANAS.

The 10 items from the anger state scale of STAXI⁽¹⁸⁾ were validated in a 550-participants sample. In this study, it was determined that the POMS-A scale would be strongly correlated with the STAXI scores, whereas the other five POMS-A scales would have no relation with or would be moderately correlated with the STAXI scale.

The HADS scale from Zigmond and Snaith, in 1983, cited by Terry et al.⁽¹⁾, includes seven items to evaluate depression among clinic medical patients from the population in general. The HADS anxiety scale was not used in this study. Due to the axis position of depressed mood proposal in the mood-performance relation⁽²⁰⁾, the validity criterion of the POMS-A depression scale was particularly interesting. As the depressed mood was evaluated using both sets of answers ("How are you feeling now?" for POMS-A and "How did you feel during the last week?" for HADS), it was established that both scales would be moderately correlated rather than highly correlated. It was also supposed that the other five POMS-A scales would have no correlation with or would be weakly correlated with the HADS depression scale.

RESULTS OF THE INSTRUMENT VALIDATION

Collectively, the results of CFA (simple-sample confirmatory factor analysis) provided support for the confirmation of the hypothetic model and the next step was to investigate the congruence of the hypothetic model against data for the four samples simultaneously, using multi-sample CFA.

Some researchers such as Comrey (1988), Gerbin and Hamilton (1996), cited by Terry et al.⁽¹⁾, suggest the use of the CFA and the EFA (exploratory factor analysis) together in the scales validation and construction. The EFA was used to aid in the identification of differences potentially important among samples. The EFAs results supported to elucidate differences between samples. These authors demonstrated that the POMS-A structure was easily recovered by all samples and showed that the sets of crossed variables that caused some unsuitability on the CFAs were relatively smaller.

The EFAs point at the difficulties of fitting one single factor for the fatigue markers due to the conceptual superposition among adolescent students of terms such as "tired" and "sleepy". On the other hand, the EFAs indicated that for all samples, especially from adults, the item "uncertainness" was added to the factors tension (lowest scale) and disturbance (highest scale) in order to improve the measure model.

In the criterion validity, there was a strong relation between the POMS-A depression scales and the original POMS scale, suggesting that they evaluate similar constructs. It is worthy emphasizing that the POMS-A does not provide a clinic depression measure, but a depressed mood measure.

Correlations between the scores of POMS-A, PANAS and STAXI were consistent with those found by Terry et al.⁽¹⁷⁾. It is suggested that the correlation model between scores on the POMS-A and the criterion measures would provide strong evidence of simultaneous validity.

DISCUSSION OF THE POMS-A VALIDATION STUDY FOR USE WITH ADULTS

The findings of the study of Terry et al.⁽¹⁾ indicate that the factorial validity was confirmed in different samples and the hypothetic relations between the mood dimensions were collectively demonstrated. They also supported the notion that the POMS-A has shown validity acceptable indicators on the mood measure for both adults and adolescents.

The preceding analyses, using the tests STAXI, HADS, PANAS and the original POMS, comparing to the constructs of the six factors of POMS-A (anger, fatigue, vigor, depression, disturbance and tension), confirmed that the POMS-A is an instrument adequate for the mood profiles evaluation, besides the fact that the tests brevity facilitates the data collection in field researches.

The proposal of the study of Terry et al.⁽¹⁾ was to extend the POMS-A validation for the use with adults. The procedures demonstrated by the authors supported the six-factor model validity, from both statistical analyses: the independent and the multi-sample analyses. The validation was performed through the relation of factors with inventories previously validated.

Yet, this study indicates that the POMS-A construct validity adapted for the use with adults seems to be satisfactory and, therefore, the scale may improve a mood usable measure for further researches and works with adults.

CONCLUSIONS

The measures and instruments of psychological evaluation available to evaluate a given behavior or construct are submitted to a series of statistical analyses in order to group or to establish the items regarding the dimensions of the measured categories. Once the scale psychometric properties, the questionnaire or the test are evaluated, the selection of the analysis unit will depend on the objective of the evaluation. This was the procedure used on the POMS-A validation for the use with adults, as already discussed.

The POMS-A for the use with adults, currently called BRUMS, may be used shortly before competition, where examinations of the relation between the mood states and the performance have been remarkable in studies and practices of the Sports Psychology.

In Brazil, the sportive psychology is strongly influenced by practices of pioneer countries, especially at instruments of psychological evaluation. Before the specificity of the psychological phenomenon, directly influenced by sportive training contexts and cultures from different regions in Brazil, the BRUMS instrument, derived from the POMS-A, should be adapted for further studies, focusing Brazilian athletes and their training models, as well as the conditions of the Brazilian sportive institutions.

All the authors declared there is not any potential conflict of interests regarding this article.

REFERENCES

Received in 19/12/03

2^nd version received in 28/1/04

Approved in 30/1/04

• 1. Terry PC, Lane AM, Fogarty GJ. Construct validity of the POMS-A for use with adults. Psychology of Sport and Exercise 2003;4:125-39.
• 2. O'Brien M. Overtraining and sports psychology. In: Drix A, et al, editors. The Olympic book of sports medicine. Cambridge: Blackwell Scientific Publications, 1988;1:635-45.
• 3. Uusitalo ALT. Overtraining: making a difficult diagnosis and implementing targeted treatment. The Physician and Sportsmedicine 2001;29:178-86.
• 4. Lawrence E, Armstrong E, Vanheest J. The unknown mechanism of the overtraining syndrome. Sports Med 2002;32:185-209.
• 5. Brandăo MRF. Psicologia esportiva: psicometria esportiva. In: Ghorayeb N, Barros Neto TL. O exercício: preparaçăo fisiológica, avaliaçăo médica, aspectos especiais e preventivos. Săo Paulo: Editora Atheneu, 1999; 239-45.
• 6. De Rose Jr D. O esporte e a psicologia: enfoque profissional do esporte. In: Rubio K. Psicologia do esporte: interfaces, pesquisa e intervençăo. Săo Paulo: Casa do Psicólogo, 2000;29-39.
• 7. Weinberg RS, Gould D. Foundations of sport and exercise psychology. 2^nd ed. Champaign, Illinois: Human Kinetics Publishers, Inc, 1999.
• 8. McNair DM, Lorr M, Droppleman LF. Manual for the profile of mood states. San Diego, CA: Educational and Industrial Testing Services, 1971.
• 9. Morgan WP, Brown DR, Raglin JS, O'Connor PJ, Ellickson KA. Psychological monitoring of overtraining and staleness. Br J Sports Med 1987;25:107-14.
• 10. Gould D, Wilson CG, Tuffey S, Lochbaum M. Stress and the young athlete: the child's perspective. Pediatric Exercise Science 1993;5:286-97.
• 11. Selye H. Stress without distress. New York: The New American Library Inc., 1974.
• 12. Brandăo MR. Equipe nacional de voleibol masculino: um perfil sócio-psicológico ŕ luz da ecologia do desenvolvimento humano [dissertaçăo]. Santa Maria (RS): Universidade Federal de Santa Maria, 1996.
• 13. Rotta TM, Ortiz S, Pacheco CV. Perfil de estados de humor de atletas de diferentes modalidades esportivas de Florianópolis. Anais da Amostra em Práticas de Psicologia de Santa Catarina. Florianópolis, 2003.
• 14. Grove JR, Prapavessis H. Preliminary evidence for the reliability and validity of an abbreviated Profile of Mood States. International Journal of Sport Psychology 1992;23:93-109.
• 15. McNair DM, Lorr M, Droppleman LF. Revised manual for the Profile of Mood States. San Diego, CA: Educational and Industrial Testing Services, 1992.
• 16. Shacham S. A shortened version of the Profile of Mood States. J Pers Assess 1983;47:305-6.
• 17. Terry PC, Lane AM, Lane HJ, Keohane L. Development and validation of a mood measure for adolescents. J Sports Sci 1999;17:861-72.
• 18. Spielberger CD. Manual for the State-Trait Anger-expression Inventory. Odessa, FL: Psychological Assessment Resources, 1991.
• 19. Beck AT, Clark DA. Anxiety and depression: an information processing perspective. Anxiety Research 1988;1:23-56.
• 20. Lane AM, Terry PC. The nature of mood: development of a conceptual model with a focus on depression. Journal of Applied Sport Psychology 2000;12:16-33.

Publication Dates

• Publication in this collection
  16 Aug 2004
• Date of issue
  Apr 2004

History

• Accepted
  30 Jan 2004
• Received
  19 Dec 2003
• Reviewed
  28 Jan 2004