On-line version ISSN 1807-7692
BAR, Braz. Adm. Rev. vol.6 no.2 Curitiba Apr./June 2009
Valter Afonso Vieira*
E-mail address: email@example.com Universidade Tecnológica Federal do Paraná - UTFPR Pato Branco, PR, Brazil
Evaluation is defined as the assessment of the positive and/or negative qualities of an object, which is assumed to be among the most pervasive and dominant human responses. Individuals constantly need to evaluate things, people, products and so forth. The main goal of this paper is to analyze the Need to Evaluate [NES] scale in Brazil. Specifically, the paper assesses its psychometric proprieties. From the evidence reported in the study, the validity of the NES scale is poor and its dimensionality questionable. The alpha value was above .70 in only one of the three dimensions. Furthermore, the outcomes did not suggest that the NES is a unidimensional scale, as originally constructed. Moreover, a formative (vs. reflexive) scale model presented the best adjustments from the concurrent models.
Key words: scale; NES; evaluate.
Evaluation is defined as the assessment of the positive and/or negative qualities of an object, which is assumed to be among the most pervasive and dominant human responses (Jarvis & Petty, 1996). Individuals constantly need to evaluate things, people, products and so forth. In fact, the possibility that people consistently vary in both the likelihood and extension of evaluative responding across situations and objects seems to have escaped consideration in the literature (Jarvis & Petty, 1996). Therefore, studying how consumers evaluate objects across different situations could help the literature to explain and/or to predict better some buying behaviors.
Markus and Zajonc (1985) comment on the magnitude of evaluating objects, saying that "it is not possible to view a social object or a social act without at the same time making an assessment on dimensions closely corresponding to good/bad, pleasant/unpleasant, high/low, etc" (p. 210). This suggests that assessment is intrinsic to consumers' thinking. Moreover, there is the hypothesis that there is a chronic tendency among individuals to engage in evaluative responding, assessment inherent in decision making. In an effort to measure the magnitude of evaluating objects, Jarvis and Petty (1996) proposed the Need to Evaluate [NES] instrument. If this instrument is valid, it may be used by managers seeking to understand how people evaluate products, services, sellers, stores and the environment, etc.
The main purpose of this paper is to analyze the NES psychometric structure. Hence, this paper is structured as follows: the next part, the literature review, defines the NES construct and dimensions. After that, the method used in the field research is presented. Data analysis shows the results and general conclusions at the end of the paper.
Need to evaluate is defined as the assessment of the positive and/or negative qualities of an object (Jarvis & Petty, 1996). The term need is used here as it was intended to be understood in development of the Need for Cognition Scale (Cacioppo & Petty, 1982), the Personal Need for Structure Scale (Neuberg & Newsome, 1993) and the Need for Closure Scale (Webster & Kruglasnki, 1994). That is why we do not presume any biological basis for this individual difference, though one is possible.
According to Jarvis and Petty (1996) there are at "least four sources of evidence for the assertion the evaluation is a pervasive and dominant response for most consumers across the many situations and objects they encounter" (p. 173). These four sources are shared as (a) the factor analysis of adjective ratings, (b) research on the automatic activation of attitudes, (c) the common observation that most consumers can easily report their attitudes toward a wide variety of objects when asked, and (d) compelling though primarily theoretical literature on the functionality of attitudes. The hypothetical dimensions are discussed as follows.
The Factor Analysis of Adjective. In this first presumed dominance of evaluation in human judgment, the assumption is that evaluation emerges as the central dimension of meaning in judgments of a wide variety of objects. It occurs because Osgood, Suci and Tannenbaum (1957) found that there is a dominant first factor that accounted for the majority of total variance among ratings. These authors labeled this central dimension as an evaluative factor, which loaded scales such as good/bad, nice/awful, pleasant/unpleasant and others. The main point from that source is that the most important meaning in consumers' judgments is evaluation concept. These factor analytic results in no way attenuate the likelihood of individual differences in evaluative responding. This is because a dominant evaluative factor could have occurred in one of two ways. First, as commonly assumed, the evaluative factor could have accounted for a similar proportion of variance in most participants' judgments (Osgood et al., 1957). In other words, it means that each participant has equally strong evaluative responses across the set of objects rated. Alternatively, the same apparent dominance could have emerged if the evaluative factor were accounting for an even greater proportion of variance in the judgments of some respondents, while accounting for a proportionately smaller amount of variance in other participants' judgments (Jarvis & Petty, 1996).
Research on the Automatic Activation of Attitudes. A second line of research supporting the pervasiveness and dominance of evaluative responding comes from relatively recent studies on the automatic activation of attitudes (Bargh, Chaiken, Govender, & Pratto, 1992; Fazio, Sanbonmatsu, Powell, & Kardes, 1986). These studies have provided compelling evidence that attitudes are often activated from memory automatically, based on mere exposure to an attitude object and that the magnitude of this activation is proportional to the strength of the attitude (Jarvis & Petty, 1996). Although this evidence offers compelling support for the pervasiveness of attitudes toward common objects (Bargh et al., 1992), as yet there has been no evidence to suggest either that such effects and their magnitudes are similar across most consumers, or that there is consistency between individuals in the relative dominance of evaluation relative to other, forms of responding. In that sense, it assumes that if an object is presented to individuals, no matter where or when, they will automatically evaluate it, using their attitude toward the object as a basis (Jarvis & Petty, 1996). In addition, we should also recognize that the automatic activation of evaluative associations does not imply the dominance of evaluative thought over other types of thought across all people. According to most network models of memory (Collins & Loftus, 1975), most object representations in memory have multiple associations (e.g. color, size, etc) to which activation will spread on initial activation of the object. The automatic attitude activation effect primarily demonstrates that for common objects, one such association is evaluative. However, these findings do not suggest the strength or precedence of this association relative to the other object associations in memory.
Ease of Evaluative Responding. In this third presumed dominance of evaluation in human judgment, the grounding comes from the common observation of the invariable ease in which people are able to report attitudes toward an enormous array of stimuli and that these individuals having no trouble in reporting attitudes toward objects about which they have engaged in relatively little thought (Jarvis & Petty, 1996). For example, objects of negligible meaning, such as nonsense syllables, ideographs and faces of strangers (Zajonc, 1968) can be easily evaluated by consumers. In fact, this common observation has previously been offered as support for the pervasiveness of attitudes (Greenwald, 1989). Thus, the relative ease with which people report attitudes toward a variety of objects is clear and simple. However, whether this suggests that evaluative responding is equally pervasive among all people is not. Furthermore, these results do not indicate whether respondents would have engaged in evaluation if this was not required by the task.
Attitudes are Functional. Another factor contributing to the assumption that evaluation is a pervasive response is the notion that general evaluations (i.e. attitudes) serve as essential functions for people. For instance, theorists have argued that attitudes are adaptive in that they (a) prepare individuals to respond to and cope with life events (Fazio, 1995), (b) increase control over positive and negative outcomes (Katz, 1960), (c) facilitate social interaction (Snyder & Debono, 1985), (d) help one's environment to be more organized, structured and understandable (Katz, 1960), (e) allow expression of personal values and so forth. With such benefits to be had, it certainly seems reasonable that people should be chronically motivated to evaluate. However, even if all individuals were highly motivated by the functions described above, evaluation is not the only way to satisfy these motives. For example, the motive to achieve knowledge motive through other nonevaluative means such as by attempting to analyze the object's structural properties or functional relations to other objects. In fact, some researchers have argued that the preferred means of satisfying the motive to gain control over one's environment is through an effortful analysis of causal relations rather than through evaluation (Edwards & Weary, 1993). In this perspective, evaluations is not only a way of people judge and choose things, but also is assumed to be a mechanism for consumers to create better social interactions, know more people and increase their network (Russell, Norman, & Heckler, 2004).
These are at least the four hypothetical sources of evidence for the allegation that evaluation is an omnipresent and dominant reaction for most individuals across situations. The next topic presents the method used to assess the psychometric proprieties of NES scale.
In order to analyze the NES psychometric proprieties, back translation of the scale was used to create the Brazilian version of the NES instrument. Two marketing academics who were fluent in Portuguese did this job (Malhotra, 2001). The questionnaire was then translated back to English and compared with the original. The questionnaire was then submitted to three consumer behavior students fro pre-testing. An in-depth interview was conducted with each student to identify any eventual problems, in order to identify ambiguities and misleading aspects of the instrument. Modifications were implemented and a final version of the scale was shaped (see Appendix 1). A total of 171 observations were made at suitable university facilities. All those involved were undergraduate business students. The sample was defined as non-probabilistic by convenience (Malhotra, 2001). The questionnaire contained a 16-item the NES scale from Jarvis and Petty (1996) and an 18-item Need for Cognition [NFC] instrument from Cacioppo and Petty (1982). All scales were managed as a Likert 7point style; varying from Strongly Disagree to Strongly Agree.
Construct Conceptual Definitions. Need to Evaluate is defined as the assessment of the positive and/or negative qualities of an object (Jarvis & Petty, 1996). Need for Cognition [NFC] is the necessity of extracting the best of reasoning in the decision making process (Cacioppo & Petty, 1982). Need for Cognition was associated with the NES scale, analyzing their correlation results and moderating effect.
Initially, all variables were analyzed in terms of missing values, outliers' univariate (Z = ±3) multivariate (D2), linearity, multicoliniarity, skewness, kurtosis and normality (Hair, Anderson, Tatham, & Black, 1998). Although ten observations were excluded because of missing values, the remainder were found to be within the boundaries suggested in the literature (Kline, 1998). After that, exploratory factor analysis [EFA] sought to analyze the NES dimensionality (Floyd & Widaman, 1995). The criteria used for retaining the variables were three: factor loading above .35, eigenvalues over one, and parallel analysis. Tabachnick and Fidell (2001) suggested .32 as a minimum criterion for factor loading be retained. As a result, this paper chose .35 as more conservative criterion. The extraction method chosen was non-orthogonal (PAF-Oblimin). It is justified because (a) the factors are supposed to be correlated in social science, (b) oblique rotations will always meet the simple structure criterion better than orthogonal rotations and (c) some research supports a slight superiority of oblique rotations in terms of factor replicability (Reise, Waller, & Comrey 2000).
At the beginning of the data analysis, the first exploratory factor analysis presented five dimensions of the NES scale (Kaiser-Meyer-Olkin = .88). The total of variance extracted was 58%. Variables 'NES 5', 'NES 1' and 'NES 11' were excluded from the model since they did not achieve the minimum factor loading of .35. After excluding these three variables, the second exploratory factor analysis presented four dimensions of the scale (Kaiser-Meyer-Olkin = .63). The total variance extracted in this second model was 55%. Variable 'NES 7' had a negative factor loading on just one component and variable 'NES 9' also loaded on cross-components. In consequence, these two indicators were excluded and new exploratory factor analysis was done.
The solution suggested a three-factor structure (see Table 1). Kaiser-Meyer-Olkin = .67 was little under the .70 suggested by Hair et al. (1998). Communalities (h2) were all under the .45 suggested by Clark and Watson (1995), except variable 'NES 15'. The minimum difference between the factor loadings was in the variable 'NES 4', which is .38 -.26 = .12. It is above the minimum Δλ.10 criteria used by Laros and Puente-Palacios (2004). Interpreting the results, the NES scale is a three-factor model that explains 50.93%.
The empirical eigenvalues found by the EFA were 2.95; 1.93 and 1.13. Initially these results rejected the unidimensional model originally proposed by Jarvis and Petty (1996). In practice, some authors suggested that eigenvalues over one, as the criterion for determining the number of components to retain, are problematic since this method has an approximately eighty percent chance of being wrong when compared to scree plot, parallel analysis, χ2-Bartlett and MAP (Zwick & Velicer, 1986). Parallel analysis is the best one, since it produces errors near to ten percent. According to Zoski and Jurs (1996) "parallel analysis compares the eigenvalues of the correlation matrix to those of a matrix of randomly generated variables, where eigenvalues from the research data should be greater than those from the random data" (p. 444). Hence, parallel analysis (Enzmann, 1997) was done using the SPSS syntax (Appendix 2). The outcomes suggested the following artificial eigenvalues: 1.44, 1.31, 1.21 and 1.12. In that context, parallel analysis suggested that a two-factor model should exist rather than three components, rejecting again the Jarvis and Petty (1996) NES unidimensional structure and the initial three-factor structure presented by our EFA. It is because only the two empirical eigenvalues (2.95 and 1.93) were greater than the first two artificial eigenvalues (1.44 and 1.31).
Zwick and Velicer (1986) proposed that in the absence of parallel analysis, the scree plot is the second best method for extracting the components. The scree plot of the NES structure can be viewed in Figure 1. In the scree plot it is possible to see just two factors from the NES structure, confirming again the results of parallel analysis. It is because Costello and Osborne (2005) commented that "the number of datapoints above the 'break' (i.e. not including the point at which the break occurs) is usually the number of factors to retain" (p. 3). Therefore, two factors can be seen in Figure 1. To sum up, based on the EFA, parallel analysis and scree plot, the findings suggest a non unidimensional structure of the NES scale.
Summarizing, the three factors suggested the following values for internal consistence: factor 1 α = .70; factor 2 α = .57 and factor 3 α = .61. Note that all alpha values were under the value suggested by Nunnally (1978) as an indicator of high reliability structure, indicating a possible lack of consistency. The correlation values from exploratory factor analysis components were: between factor 1 and factor 2(r = .08; p = NS); between factor 1 and factor 3 (r = .36; p < .01) and between factor 3 and factor 2(r = -.08; p = NS).
Cross-Validation. Laros and Puentes-Palacios (2004) indicated that cross validation is a method for assessing the scale structure stability across a second sample. The assumption is that the capacity of structure found be the same in a second sample, as it was in the first. Hence, the sample was random shared in 50% and this new sample was used for assessing the instrument stability (N = 81). In this analysis, it is important to recognize that the total sample proportion by variables is below the 20:1 indicated by Costello and Osborne (2005). However, the main assumption in the cross-validation is attempted to confirm the three component structure in this new random sample. It is hypothesized that the same three components found in the EFA will appear again or at least the two components from the first parallel analysis.
The cross-validation results were: Kaiser-Meyer-Olkin = .88, cumulative variance extracted = 57%, and empirical eigenvalues = 2.82; 2.11; and 1.35. Reliability coefficients for the factors were α = .73; α = .63 and α = .72, respectively. According to Table 1, the outcomes of the cross validation confirm the three component structure found by the EFA. Therefore, parallel analysis was used again to prove whether it is the correct solution of the NES instrument. The artificial eigenvalues were 1.64; 1.44; 1.29; and when they are compared with the empirical eigenvalues (2.82; 2.11; and 1.35), a three-component structure appears.
To sum up, it can be inferred that the NES theoretical model was inconsistent across these analyses, since (a) the EFA showed a three-factor structure, (b) parallel analysis on the overall sample showed a two factor structure, (c) the scree plot showed a two factor structure, (d) the EFA on half sample showed a three-factor structure and (e) parallel analysis on half sample showed a three-factor structure. Hence, more tests need to be done in order to achieve a general conclusion of the NES dimensionality.
Higher-Order Factors or Hierarchical Structure. Thompson (2004) "described that factors extracted from inter-variable correlations (or other statistics measuring associations) are called first-order. The factors then extracted from the inter-factor correlations among the first-order are called second-order factors. If the second-order factors are correlated, then third-order factors can be extracted" (p. 72). The point assumed by Thompson (2004) is to identify the presence of subfactors or superordinate factors in an instrument (Smith & McCarthy, 1995). It was hypothesized that only one second-order factor might appear covering the three dimensions.
For testing the hypothetical hierarchical structure, an analysis of second-order factors was made using the SPSS Syntax of Thompson (2004), see Appendix 3. The three factors were then transformed into mean variables (on a scale of 1 to 7 points). After that, these mean variables were used in a second-order exploratory factor analysis. The mean variables (M), standardized deviation (σ), communalities (h2) and variance explained values [VE] found were: Factor 1 M= 5.24, σ = 1.26, h2 = .71, VE = 46%; Factor 2 M= 3.65, σ = 1.18, h2 = .98, VE = 33% and Factor 3 M= 4.54, σ = 1.34, h2 = .71, VE = 19%. According to the results, a second-order hierarchical structure did not appear. The factor loadings can be seen in the last two columns of Table 1.
Confirmatory Factor Analysis. The next step in the data analysis was to assess scale structure using confirmatory factor analysis. Concurrent models using the covariance matrix were estimated with AMOS software (Byrne, 2001; Kline, 1998). Eight competing measurement models were examined for: (A) a first-order model with correlation (Φ) free among the three factors (results from our EFA), (B) a first-order with Φ fixed in 0 among the three factors, (C) a second-order model, (D)a single one-factor model hypothesized by Jarvis and Petty (1996), (E) a first-order model with Φ free among the two factors (factor 1 and 2; results from first parallel analysis), (F) a third-order model from Thompson (2004) SPSS syntax suggestion and (G & H) two other models using formative constructs (Jarvis, Mackenzie, & Podsakoff, 2003), which will be explained later. The results and the adjustments of the concurrent models can be viewed in Table 2.
According to the outcomes, model C did not present an admissible solution, since a negative variance appears in error/disturbance of factor 1 and, because of that, model C is scratched out. Model F also did not present an admissible solution, since a Haywood case appears in the path from the third-order factor to the second-order factor. Model E appears as the best solution from the rival models to represent the NES construct. It uses only two factors generated by parallel analysis (Zwick & Velicer, 1986). The second best solution is model A, which is a first-order model with correlation free among the three factors. Looking to analyze the best one, a comparison of the models A versus E was done. It did not show a significant difference Δχ2 (d.f.) = 27.2 (22); p < .203. Thus, it can be concluded that these two models are the best from the eight rival models tested. Note that both models (A & E) have non-significant p-values, indicating similarities between the estimate and real covariance matrix.
As a whole, the structural indexes for models A and E were very good. For instance, AGFI, GFI, CFI were all above .90 and RMSEA was under .05 (Byrne, 2001; McDonald & Ho, 2002). It denotes that the theoretical models do fit well on the real data. Hox and Bechger (1998) explain that "perfect fit may be too much to ask for, instead, the problem is to assess how well a given model approximates the true model" (p. 9).
Figure 2 shows the confirmatory factor analysis of the NES Scale. The figure shows model A, where only one covariance is significant. It is from Factor 1 versus Factor 3 (r = .61; p < .000). The standardized residuals did not present values above ± 2.58.
Formative versus Reflective Constructs. Jarvis et al. (2003), McCallum and Browne (1993) and Diamantopoulos and Winkhofer (2001) comment that construct in majority of marketing and consumer behavior research is treated as reflective. However, some of them are in fact formative constructs, since the observed variation in the measures causes the latent construct. It makes more sense conceptually to view causality flowing from the measures to the construct (Fornell & Bookstein, 1982). In fact, formative models can be an alternative test of analyzing the featured phenomenon.
Bollen and Lennox (1991) justify this warning commenting that "researchers should not automatically confine themselves to the unidimensional classical test model" (p. 312). The importance of doing this alternative test for Diamantopoulos and Winkhofer (2001) is that "several marketing constructs currently operationalized by means of reflective indicators would be better captured if approached from a formative perspective" (p. 274). According to Jarvis et al. (2003) it is important to note that one could interpret the formative model is three ways: (a) as a single construct with six formative and five reflective measures, (b) as six exogenous variables influencing a single endogenous construct with five reflective measures, or (c) as a formatively measured construct that influences five manifest measures. In addition to the six concurrent models tested previously, two formative latent structures were assessed (G and H). Figure 3 shows one of them and Table 2 the results.
Model G assumes a formative construct using factor 1 and factor 3 to create the second-order NES construct, hierarchical comparison as suggested by Thompson (2004). In that model, variables from the factor 2 were used as reflective variables, as indicated by Jarvis et al. (2003) for specifying the formative model (see Figure 3). Model H assumes a formative construct using factor 1 and factor 2, as a result suggested by parallel analysis. Variables from factor 3 were used as reflective variables.
Model G adjustments values were χ2/d.f. = 1.18; p-value = .27; AGFI = .92; GFI = .98; TLI = .96 and RMSEA = .03. Model H, which had best fits, values were χ2/d.f. = .95; p-value = .54; AGFI = .93; GFI = .97; TLI = 1.01 and RMSEA = .00. The chi-squared difference between them was not significant Δχ2(d.f.) = 8.67 (13); p-value = .79.
From the model G (see Figure 3), the variables that did not have a significant impact on the NES construct were: 'NES 4', 'NES 3' and 'NES 10' and Factor 2 over the NES Scale. From the model G, the variables that did not have a significant impact on the NES construct were 'NES 15', 'NES 8', 'NES 14' and 'NES 16' and factor 3 over the NES Scale.
The correlation matrix did not show many significant values. In fact, the majority of the matrix presented non-significant values. This could be an indicative of poor performance of factor analysis. Moreover, no negative significant values were found. The results can be seen in Table 3. From the 136 possible correlations, just 49 were significant (36%).
MODERATING ROLE OF NES
We supposed that NES moderates the association between need for cognition and direct media. Direct media are comprehended as shopping by mail, TV and Internet. Consumers high in need for cognition should indicate that they contemplated the decision process well prior to their shopping behavior. In that sense, since a strong cognitive effort was structured, the need to evaluation the store may be lower. Thus, consumers high in need for cognition and low in need to evaluate should have more intention of buying by direct media. On the contrary, consumers low in need for cognition should indicate that they did not contemplate the decision process prior to their shopping behavior. It may be an unexpected shopping intention which may generate doubts. In that sense, since a low or absent cognitive effort exists, the need to evaluate the store/place may be higher in order to eliminate the regret. Consequently, consumers low in need for cognition and high in need to evaluate should have greater intentions in buying by direct media, control balancing their judgment. Based on these arguments, we supposed that NES moderates the association between need for cognition and direct media.
To test this hypothesis, a 2 X 2 factorial design was used. Need for cognition and need to evaluate groups were created by sharing the groups by using median groups (high and low). As manipulation checking, the high need for cognition group had a greater mean when compared with low need for cognition (Mhigh NFC = 4.27 vs. Mlow NFC = 2.34; F (1, 154) = 320.81; p< .000). In addition, the high need to evaluate group had a greater mean when compared with low need to evaluate (Mhigh NES = 6.00 vs. Mlow NES = 4.16; F (1, 159) = 283.86; p< .000). The results are shown in Figure 4.
As hypothesized, the moderation test showed a significant cross over interaction effect of NES on the relationship between NFC and shopping by internet (F(1,154) = 3.71, p< .05), between NFC and shopping by mail (F(1,154) = 3.72, p< .05) and not between NFC and shopping by TV (F(1,154) = 0.00, p=NS). Consumers in the low NES condition had more intention of shopping by internet in the high NFC rather than the low NFC (Mhigh NFC = 2.71 vs. Mlow NFC = 2.02; F(1,78) = 3.80, p<.05). When changing the groups, the participants in the high NES condition had more intention of shopping by internet in the low NFC rather than the high NFC (Mhigh NFC = 2.09 vs. Mlow NFC = 2.45; F(1,74) = .67, p=NS).
Another moderating role was identified in shopping via mail. Consumers in the low NES condition had more intention of shopping by mail in the high NFC rather than the low NFC (Mhigh NFC = 2.31 vs. Mlow NFC = 1.71; F(1,78) = 3.6, p<.06). The participants in the high NES condition had more intention of shopping by mail in the low NFC rather than the high NFC (Mhigh NFC = 1.77 vs. Mlow NFC = 2.02; F(1,74) = .74, p=NS). This evidence supports the NES cross over moderation effect, since when it is associated with need for cognition, greater intentions in buying by direct media appear.
It is interesting to note that although Jarvis and Petty (1996) affirmed that the NES has "a single factor structure" (p. 172) their factor analysis suggested two factors. In addition, although the eigenvalues were not shown, from the scree plot it could be inferred that the NES has a three-factor structure, rather than one, as advocated by Jarvis and Petty (1996). The results found here confirm the multidimensional aspect presented in the literature.
Specifically, the outcomes from this research indicate that factor 1 contains items that assess whether people pay attention (NES 13), decide (NES 15) or want to know (NES 4) things as good or bad in their lives. In other words, it means that objects can have just a dichotomy view in terms of assessing positive and negative. In this first dimension, consumers are not so convinced of their opinions about assessing objects. In short, this paper classifies the first dimension as Avoiding Extreme Opinion.
Factor 2 contains all the items that are reversed-scored from the scale. Jarvis and Petty (1996) commented that "the second factor might be a methodological one [since...] a number of studies have shown that when participants are asked multiple questions on the same rating scale, the correlation between those items will frequently be artificially inflated in a positive direction due to correlated measurement errors between scale items" (p. 177). The difference from factor 2 to factor 1 is that the former appoints items such as I prefer to avoid taking extreme positions; I only form strong opinions when I have to and there are many things for which I do not have a preference. Hence, this paper nominates factor two as Preference for Neutrality.
Factor 3 clearly suggests that the domain of opinion is important to consumers. While factor 1 assesses whether people see things as good/ bad or positive/negative, factor 3 tries to know whether people have strong, clear and decisive opinions about things independently of being extremely good or bad. Items in this dimension indicate that it is very important for consumers to have strong opinions. Thus, this factor is defined as Preference for Decisive Opinion.
This paper, establishing individual differences in evaluative responding, provides a challenge to the prevailing assumption that evaluation invariably pervades and dominates the responses of most consumers in most situations. Need to evaluate may moderate the likelihood and extent of the automatic attitude activation effect, especially for those objects with which consumers are not highly familiar. For example, if participants high in the need to evaluate are more likely to engage in spontaneous evaluative responding, then perhaps the need to evaluate would moderate the effects of mere thought on attitude polarization.
Second, in the public opinion field, need to evaluate has a positive impact on presidential campaign information acquisition. It means that both constructs are related to measures of candidate information, i.e. correct ideological placement, correct policy placement and number of candidate articulations (Holbrook, 2006). Need to evaluate focuses specifically on willingness to engage in evaluation, which presumably requires information to play a role in information acquisition during presidential campaigns. To the extent that need to evaluate taps individual differences in the willingness or capacity to engage in affective processes, this might also be expected to lead to more active information gathering, as suggested by existing research on affective intelligence (Marcus, Neuman, & MacKuen, 2000).
Third, the need to evaluate scale may be used to support the hypothesis that people with high need to evaluate are more irritated after exposure to specifics ads. Commercial attributes generate negative reactions to that commercial and the brand advertised. This suggests that consumers with a high need to evaluate will show such a transfer of irritation more clearly than will low need to evaluate consumers. This hypothesis was support by Fennis and Bakker (2001), demonstrating that high need to evaluate individuals were more irritated after exposure to disliked or many ads and, consequently, more negatively affected in their evaluations of the neutral ad and brand.
Fourth, NES moderates the association between need for cognition and direct media in a cross over direction. Specifically, it means that consumers low (vs. high) in need for cognition (i.e. unexpected shopping intention) and high (vs. low) in need to evaluate (i.e. assessing the store, place and sellers) should have greater (vs. lower) intentions in buying by direct media.
From the evidence reported in this study, the validity of the NES scale is poor and more studies are required to assess its reliability. Moreover, NES dimensionality may be contested, since Jarvis and Petty (1996) reported that NES is unidimensional, but presented the exploratory factor loading with two dimensions and a scree plot figure indicating three dimensions. From this study, the two versus three-factor structure did not differ significantly and it appears that the NES is reflex of the following three dimensions: Avoiding Extreme Opinion, Preference for Neutrality and Preference for Decisive Opinion.
Compose reliability and average of variance extracted were all under that suggested by literature (Fornell & Larcker, 1981). In addition, internal consistence was poor. The alpha value was above .70 in only one of the three components. Questions of validity and reliability need to retested in future studies. The other point demonstrated by the paper is that the variables suggested by Jarvis and Petty (1996) do not correlate well with each other. According to Table 3, just 36% of them were significant. Thus, future qualitative research could create new other variables to represent the NES construct. Another option for future research is to create a shorter version of the NES 16-item scale. For instance, Richins (2004) reported the development of a short version of the material values scale with better dimensions properties and described a psychometric approach for developing shorter versions of extant multi-item measures.
Bargh, J. A., Chaiken, S., Govender, R., & Pratto, F. (1992). The generality of the automatic activation effect. Journal of Personality and Social Psychology, 62(6), 893-912. [ Links ]
Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: a structural equation perspective. Psychological Bulletin, 110(2), 305-314. [ Links ]
Byrne, B. (2001). Structural equation modeling with AMOS: basic concepts, applications and programming. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
Cacioppo, J. T., & Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42(1), 116-131. [ Links ]
Clark, L. A., & Watson, D. (1995). Constructing validity: basic issues in objective scale development. Psychological Assessment, 7(3), 309-319. [ Links ]
Collins, A. M., & Loftus, E. F. (1975). A spreading-activation theory of semantic processing. Psychological Review, 82(6), 407-428. [ Links ]
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most of your analysis. Practical Assessment, Research & Evaluation, 10(7), 1-9. [ Links ]
Diamantopoulos, A., & Winklhofer, H. M. (2001). Index construction with formative indicators: an alternative to scale development. Journal of Marketing Research, 38(2), 269-277. [ Links ]
Edwards, J. A., & Weary, G. (1993). Depression and the impression formation continuum: piecemeal processing despite the availability of category information. Journal of Personality and Social Psychology, 64(4), 636-645. [ Links ]
Enzmann, D. (1997). RanEigen: a program to determine the parallel analysis criterion for the number of principal components. Applied Psychological Measurement, 21(3), 232. [ Links ]
Fazio, R. H. (1995). Attitudes as object-evaluation associations: determinants, consequences and correlates of attitude accessibility. In R. E. Petty, & J. A. Krosnick (Eds.). Attitude strength: antecedents and consequences (pp. 247-282). Mahwah, N.J: Erlbaum. [ Links ]
Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986). On the automatic activation of attitudes. Journal of Personality and Social Psychology, 50(2), 229-238. [ Links ]
Fennis, B. M., & Bakker, A. B. (2001). Stayed tuned we will be back right after these messages: need to evaluate moderates the transfer of irritation in advertising. Journal of Adversiting, 30(3), 15-26. [ Links ]
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286-299. [ Links ]
Fornell, C., & Bookstein, F. L. (1982). Two structural equation models: LISREL and PLS applied to consumer exit-voice theory. Journal of Marketing Research, 19(4), 440-452. [ Links ]
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. [ Links ]
Greenwald, A. G. (1989). Why are attitudes important? In A. R. Pratkanis, S. J. Beckler, & A. G. Greenwald (Eds.). Attitude structure and function (pp. 1-10). Hillsdale, N.J: Erlbaum. [ Links ]
Hair, J., Jr., Anderson, R. E., Tatham, R. L., & Black, W. (1998). Multivariate data analysis. New Jersey: Prentice Hall. [ Links ]
Holbrook, T. M. (2006). Cognitive style and political learning in the 2000 U.S. presidential campaign. Political Research Quarterly, 59(3), 343-353. [ Links ]
Hox, J. J., & Bechger, T. M. (1998). An introduction to structural equation modeling. Family Science Review, 11(4), 354-373. [ Links ]
Jarvis, C. B., Mackenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199-218. [ Links ]
Jarvis, W. B. G., & Petty, R. (1996). The need to evaluate. Journal of Personality and Social Psychology, 70(1), 172-194. [ Links ]
Katz, D. (1960). The functional approach to the study of attitudes. Public Opinion Quarterly, 24(2), 163-204. [ Links ]
Kline, R. B. (1998). Principles and practice of structural equation modeling. New York: Guilford Press. [ Links ]
Laros, J., & Puente-Palacios, K. (2004). Validação cruzada de uma escala de clima organizacional. Estudos de Psicologia, 9(11), 113-119. [ Links ]
Malhotra, N. (2001). Pesquisa de marketing (3rd ed.). Porto Alegre: Bookman. [ Links ]
Marcus, G. E., Neuman, R. W., & Mackuen, M. (2000) Affective intelligence and political judgment. Chicago: University of Chicago Press. [ Links ]
Markus, H., & Zajonc, R. B. (1985). The cognitive perspective in social psychology. In G. Lindzey, & A. Aronson (Eds.). Handbook of social psychology (Vol. 1, pp. 137-230). Hillsdale, NJ: Erlbaum. [ Links ]
McCallum, R. C., & Browne, M. W. (1993). The use of causal indicators in covariance structure models: some practical issues. Psychological Bulletin, 114(3), 533-541. [ Links ]
McDonald, R. P., & Ho, M. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64-82. [ Links ]
Neuberg, S. L., & Newsome, J. T. (1993). Personal need for structure: individual differences in the desire for simple structure. Journal of Personality and Social Psychology, 65(1), 113-131. [ Links ]
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill. [ Links ]
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957). The measurement of meaning. Urbana: University of Illinois Press. [ Links ]
Reise, S. P., Waller, N. G., & Comrey, A. L. (2000). Factor analysis and scale revision. Psychological Assessment, 12(3), 287-297. [ Links ]
Richins, M. L. (2004). The material values scale: measurement properties and development of a short form. Journal of Consumer Research, 31(1) 209-219. [ Links ]
Russell, C. A., Norman, A. T., & Heckler, S. E. (2004). The consumption of Television programming: development and validation of the connectedness scale. Journal of Consumer Research, 31(1), 150-161. [ Links ]
Smith, G. T., & McCarthy, D. M. (1995). Methodological considerations in the refinement of clinical assessment instruments. Psychological Assessment, 7(3), 300-308. [ Links ]
Snyder, M., & DeBono, K. G. (1985). Appeals to images and claims about quality: understanding the psychology of advertising. Journal of Personality and Social Psychology, 49(3), 586-597. [ Links ]
Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. Boston: Allyn and Bacon. [ Links ]
Thompson, B. (2004). Exploratory and confirmatory factor analysis: understanding concepts and applications. Washington, DC: American Psychological Association [ Links ]
Webster, D. M., & Kruglanski, A. W. (1994). Individual differences in need for cognitive closure. Journal of Personality and social Psychology, 67(6), 1049-1062. [ Links ]
Zajonc, R. B. (1968). Attitudinal effects of mere exposure. Journal of Personality and Social Psychology, 9(2), 1-27. [ Links ]
Zoski, K. W., & Jurs, S. (1996). An objective counterpart to the visual scree test for factor analysis: the standard error scree. Educational and Psychological Measurement, 56(3), 443-451. [ Links ]
Zwick, R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432-442. [ Links ]
Received 30 July 2008; received in revised form 05 February 2009.
* Corresponding author: Valter Afonso Vieira Rua Viuvinha, 69, Arapongas, PR, 86709-340, Brazil.
NES SCALE VARIABLES
NES 1: I form opinions about everything.
NES 2: I prefer to avoid taking extreme positions.**
NES 3: It is very important to me to hold strong opinions.
NES 4: I want to know exactly what is good and bad about everything.
NES 5: I often prefer to remain neutral about complex issues.**
NES 6: If something does not affect me, I do not usually determine if it is good or bad.**
NES 7: I enjoy strongly liking and disliking new things.
NES 8: There are many things for which I do not have a preference.**
NES 9: It bothers me to remain neutral.
NES 10: I like to have strong opinions even when I am not personally involved.
NES 11: I have many more opinions than the average person.
NES 12: I would rather have a strong opinion than no opinion at all.
NES 13: I pay a lot of attention to whether things are good or bad.
NES 14: I only form strong opinions when I have to.**
NES 15: I like to decide that new things are really good or really bad.
NES 16: I am pretty much indifferent to many important issues.**
Note. ** = reverse scored item.
PARALLEL ANALYSIS TO IDENTIFY THE NUMBER OF FACTORS
THOMPSON SYNTAX HIERARQUICAL STRUCTURE
subtitle '5 n=1000 Faculty ^^^ first-order ^^^^^' .
select if (ranktype eq 3) .
factor variables=var_0014 to var_0028/
analysis=var_0014 to var_0028/criteria=factors(3)/
print=all/save=reg(all reg-pc)/ .
subtitle '6 second-order $$$$$$$$$$$$$$$$$$$$$$$'.
factor variables=mean_1 to mean_3/