Psychometric assessment of the Instructional Materials Motivation Survey (IMMS) instrument in a remote learning environment

Introduction: Motivation contributes greatly to learning, being a predictor of student performance. Thus, instruments that assess motivation after exposure to different teaching strategies and materials can contribute to the analysis and decision on its effectiveness. In this sense, the Instructional Materials Motivation Survey (IMMS) instrument measures students’ motivation after instructional activities. Objective: This study aimed to evaluate the evidence of validity of the IMMS, previously translated and cross-culturally adapted to Brazilian Portuguese. Method: Cross-sectional study used to evaluate the psychometric properties of the IMMS questionnaire, applied to 211 students from the first, third and fourth semesters of the medical course at José do Rosário Vellano University (Unifenas - Campus Belo Horizonte). The principal component analysis (PCA) with Varimax rotation and Cronbach’s alpha coefficient were used to assess the validity and reliability of the instrument. Results: The PCA reduced the instrument’s items from 36 to 25 items, distributed in four dimensions. The saturation of the items in the dimensions ranged from 0.529 to 0.790 and the total explained variance was 63.12%. The reliability of the modified IMMS (IMMS-BRV), measured by Cronbach’s alpha, ranged from 0.76 (Attention dimension) to 0.93 (Interest dimension). Conclusion: The IMMS application in the remote education scenario, through asynchronous video lectures of human anatomy, resulted in an alternative instrument (IMMS-BRV), with fewer items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of its validity and reliability adequacy.


INTRODUCTION
The purpose of the teaching methods is to provide an environment that facilitates student learning.In this context, motivation is directly related to the efforts made by a certain person to acquire knowledge or develop a certain skill.Highly motivated students actively engage in studies without worrying about external rewards.On the other hand, when poorly motivated, they may have the skills necessary for learning and not achieve good proficiency 1 .Thus, instruments based on solid theories, which assess motivation, after exposure to different teaching strategies and materials, can contribute to the analysis and decision about their effectiveness.
Several theories have been conceived to explain the factors and phenomena that interfere with the motivation for learning, such as intrinsic and extrinsic motivation theory, selfdetermination, social cognitive theory, the expectancy-value theory, as well as the ARCS (Attention, Relevance, Confidence and Satisfaction) model, which supports the construct of the Instructional Materials Motivation Survey (IMMS) instrument, analyzed in the present study 2,3 .
The ARCS model of motivational design was proposed by Keller 3 , based on cognitivist perspectives.The author's objective was to find more effective ways to understand the main influences of motivation on learning and create a systematized method to identify and solve the associated problems, building a bridge between the study of motivation and instructional practice, aiming to increase student motivation.Its origin is based on the expectancy-value theory which, in turn, establishes that people become motivated to engage in an activity, if it is associated with the satisfaction of their personal needs (values) and a positive expectancy of success in its performance [4][5][6] .
In Keller's 3 original motivational design model, these two dimensions (Value and Expectancy) 5,6 were expanded to four, as follows: • Value was subdivided into two dimensions: Interest and Relevance; • The Interest dimension was more precisely related to factors associated with attention in the educational environment.
• Relevance was linked to activities directed by objectives or goals.

•
The Expectancy dimension was maintained, being related to the student's belief that they would be successful in the task; and the Result dimension was created, which represented the value of reinforcement provided by the instruction, as explained by operant conditioning.
Based on this initial construct (Interest, Relevance, Expectancy, Result), qualitative experiments were conducted to validate the model and then it was modified to the current ARCS (Attention, Relevance, Confidence, Expectation) model.
The dimensions of the ARCS model are defined as follows by the author 3,4 : Attention presents characteristics that stimulate and sustain interest and curiosity; Relevance is related to the students' personal needs and goals, generating a positive learning attitude; Confidence is related to the students' beliefs and feelings, so that they can be in control of their learning result and will succeed; Satisfaction is generated by the process and/or result of the learning experience and may be related to the intrinsic (sense of competence) or extrinsic (academic degrees, certificates, material reward) factors and the desire to continue learning.
Based on the ARCS theoretical construct, the Instructional Materials Motivation Survey (IMMS) instrument was developed to assess the motivation of students exposed to educational materials or strategies 4 .As a situational instrument, the IMMS does not measure levels of motivation in a generalized way, such as, for instance, motivation regarding school learning.The purpose of this instrument is to measure how much students are motivated for a certain instructional activity, such as video classes, or for a specific strategy such as, for instance, remote learning.Due to the importance of being well interpreted by the respondent, it can be used in populations of students as early as those attending high school l4 .
According to Keller 4 , his conception was based on the construction of a pool of items based on ARCS motivational concepts, which were reviewed by 10 undergraduate students well acquainted with motivational literature.Based on the students' answers, the items were revised and retested or excluded, thus originating the set of variables that currently constitute the IMMS in its four dimensions: Attention, Relevance, Confidence and Satisfaction.Its reliability, measured through internal consistency using Cronbach's alpha coefficient, was 0.96 for the full scale (Attention = 0.89; Relevance 0.81; Confidence 0.90; Satisfaction 0.92), according to Keller 4 .
Since its conception, the IMMS has been widely used, in several countries, in different teaching-learning contexts, especially in those using technological means in the pedagogical platform, such as web-based courses, e-learning and gamification [7][8][9][10] .Due to the robustness of the ARCS construct, the wide employability of the IMMS to assess student motivation and the need for an appropriate instrument to perform this measurement in Brazil, Cardoso-Júnior et al. 11 carried out the translation and cross-cultural adaptation of the IMMS into Brazilian Portuguese.
However, despite being widely used since its creation to measure student motivation, with the aim of improving teaching strategies, the studies that evaluated the psychometric validity of the IMMS showed heterogeneous results [12][13][14] .These studies resulted in the reduction of the number of items and the modification of their distribution into dimensions, emphasizing the instrument's situational characteristic, as demonstrated by Keller 15 , and emphasizing the need to modify the instrument to accommodate the context of its application.In other words, it is suggested that the instrument's situation is dynamic and varies according to factors related to its implementation, ranging from the students' characteristics to those of the involved instructional programs.
In this sense, Huang et al. 12  in the field of education is a growing trend, which needs evaluation of its motivational properties 7,9 .In addition to its applicability in this context, the IMMS also shows as a particular feature, in relation to other instruments that assess motivation for learning, the fact that it is based on the ARCS model of motivational design, whose concepts and strategies can be applied, based on the diagnosis made through the observation of the results presented by the instrument, for correction and improvement of the instructional activity under investigation 4 .

Study design
This was a cross-sectional study that evaluated the validity evidence of the Instructional Materials Motivation Survey (IMMS) questionnaire, using a version previously submitted to translation and cross-cultural adaptation 11 .

Sample characteristics
The

Asynchronous human anatomy video lessons
The  15 .
The IMMS used in this research was the version that was previously translated and adapted into Brazilian Portuguese by Cardoso-Júnior et al. 11 , which maintained all dimensions and items of the original questionnaire.The self-administered instrument was created using the Google Forms® application, preceded by the informed consent and the sociodemographic questionnaire.The access link was posted on the Moodle-UNIFENAS platform.After reading the consent form and accepting to participate in the study, the student was directed to the questionnaire.
As part of the information about the filling out of the questionnaire, it was clear that the instrument was intended to "... assess your motivation in relation to the Human Anatomy video classes, studied in Laboratory Practices (LP) ... " For that purpose, words related to the instructional material were adapted to this context of application in the items' sentences, according to the IMMS application instructions, without changing their meaning 15 .
Students who, after reading the consent form, checked the option "I don't agree" were directed to a message thanking them for their attention, not having access to the questionnaires.
The mean time to complete the forms was 15 minutes.

Principal component analysis
Aiming to verify the evidence of the studied construct validity, a statistical analysis was performed using the principal component analysis (PCA) extraction method and Varimax rotation.The use of the rotation aims to facilitate the interpretation of the dimensions, that is, the saturation of items in the components, finding a solution in which each variable shows high saturation in a few components 16,17 .Items with an inverse direction had their scores inverted.
For PCA, the sample size should be ≥100 observations, preferably reaching five or more observations per instrument item, to avoid extracting sample-specific components, which are not very generalizable 17 .In this study, the sample size (n=211) was adequate, comprising six subjects per IMMS item.
To assess the convenience of the PCA model, the Bartlett test of sphericity and the Kaiser-Meyer-Olkin (KMO) sample adequacy measure were used.Values > 0.5 in the KMO test and p<0.05 in the sphericity test were defined as parameters for the PCA to be considered adequate for the set of studied variables.
The establishment of the number of retained dimensions was performed through determination techniques based on eigenvalues.Eigenvalues > 1 were considered as a parameter (Kaiser-Guttman criterion).The loads (item saturation) were considered significant when they were greater than 0.40 (parameter considered adequate for a sample of 211 subjects at a significance level of 0.05 and 80% power) 17 .Measures related to the method without rotation were used, followed by the VARIMAX rotation, as performed in previous studies, which allows for a better comparison of results 12,14 .The parameters adopted in this study are based on publications by Landis and Koch 16 and Hair Jr et al. 17 .The statistical software SPSS (IBM), version 17.0, was used to perform the analyses.

Cronbach's Alpha
The Cronbach's alpha coefficient was the measure used to assess the reliability of the internal consistency of each of the dimensions determined by the PCA.This coefficient ranges from 0 to 1, with values ≥0.6 indicating satisfactory reliability of the internal consistency 16,17 .

Probability of significance
All results were considered significant for a probability of significance < 5% (p < 0.05), therefore having at least a 95% confidence in the presented conclusions.

RESULTS
A total of 211 students aged 17 to 46 years, with a mean age of 21.4 years, participated in this study.Of these, 33% were aged between 17 and 19 years, 44.5% between 20 and 22 years, 13% between 23 and 25 years, 6% between 26 and 30 years old and 3.5% aged at least 31 years.There was a predominance of women (67.8%).In relation to the course period, 46.4% of the students were attending the first period, 35.1% the third period and 18.5% the fourth period.The students attending the second-period were excluded from the study because, unlike the others, they participated in synchronous online classes.
Only 5.7% of students had another university degree.

Analysis of the IMMS Construct Validity Evidence
The initial PCA was performed with all 36 items that constitute the original IMMS questionnaire, translated and adapted into Brazilian Portuguese 11 .Table 1 shows the evaluation of the students' behavior towards each of the IMMS items.
The initial model showed the convenience of applying this statistical technique in terms of its adequacy (Kaiser-Meyer-Olkin [KMO] sample adequacy measure) =0.943; Bartlett's sphericity test p < 0.0001).Table 2 shows the result of the number of factors extracted by the initial PCA.Table 3 shows the items taken from the original IMMS and the causes of exclusion.
Consequently, the final PCA model was performed after the removal of these 11 items, which were considered inadequate.In this model, the sample adequacy measure (KMO=0.947)shows convenience for the use of the PCA.
Furthermore, the Bartlett test shows that there is a set of significant correlations (p < 0.0001) between the 25 remaining items of the questionnaire.Thus, based on these assumptions, the statistical technique of PCA can be applied.Therefore, based on the Kaiser-Guttman criterion (eigenvalues > 1), 4 components were extracted, as shown in the scree plot illustrated in Figure 1 and in the results depicted in Table 4.
The results of the final Principal Component Analysis model generated the modified alternative version of the IMMS (IMMS-BRV).Thus, the loads (item saturation in the dimensions), commonalities, measures of sample adequacy (MSA), explained variances, eigenvalues and Cronbach's alpha coefficients of the IMMS-BRV are summarized in Table 4.
Table 3. Items extracted from the original IMMS and causes of exclusion.The fit of the model was verified by examining the differences between the observed correlations and the reproduced correlations obtained from the reproduced correlation matrix.It is noteworthy that there were few cases (< 10%) with residuals considered "large"; therefore, the obtained model was considered to be valid.Table 5. Analysis of correlation between the four components generated by the Principal Component Analysis.In this study, significant correlations (p < 0.05) were observed between all dimensions generated by PCA.

Dimension/Pearson Dimension
However, the correlation observed between the Interest and Confidence dimensions showed a value > 0.80, showing that they are intrinsically linked, and may be measuring similar concepts of motivation.Table 5 shows the correlation analysis between the four components generated by the Principal Component Analysis.

IMMS-BRV reliability assessment
Table 6 shows the reliability measures of the IMMS-BRV internal consistency.
Cronbach's alpha coefficient was used to assess the reliability of the internal consistency of the items that constitute each of the 4 dimensions generated by the PCA.
As observed, all of them showed Cronbach's Alpha measures > 0.75, indicating good internal consistency of the IMMS-BRV dimensions.Moreover, item removal does not increase Cronbach's alpha coefficient.

Modified alternative Brazilian version of the IMMS (IMMS-BRV)
When comparing the original version of the IMMS and the results of the PCA performed in this study (IMMS-BRV), it is observed that 4 dimensions were maintained and 11 items were removed.The 25 items that were maintained were redistributed into 4 dimensions, in a different combination than the original instrument.Thus, the names of the dimensions were revised aiming to better explain the items allocated in the same dimension.For this purpose, in the content analysis, the semantics of the items combined with the theoretical reference of the ARCS construct and the expectancy-value theory were observed 3,5 .
Thus, once the PCA process was completed, the final structure of the IMMS-BRV was defined, which now has 25  Expectancy (explained variance = 9.3%; Cronbach's alpha = 0.78): the 3 items distributed in this dimension derive from the Confidence (66.7%) and Attention (33.3%) dimensions.
The semantic analysis of the three items shows that they are intrinsically related to the expectancy (expectation) of the occurrence or not of the understanding, therefore, of meaningful learning.Thus, the set of its meaning allows the aggregation of the term Expectancy to this dimension.
It is opportune to emphasize that the IMMS-BRV, as well as the IMMS, can be adapted to suit specific situations.In other words, the "standard" wording of the items contains more generic phrases such as "this course", "this class" or "many pages".They must be changed to suit the specific situation being evaluated, such as "this lecture", "this video lesson" or "many slides" 4,11 . The

DISCUSSION
The importance of instruments that measure student motivation in different teaching-learning environments, with adequate evidence of validity and reliability, initially motivated the translation and cross-cultural adaptation of the IMMS into Brazilian Portuguese 11 .The translation and cross-cultural adaptation of instruments based on solid constructs, created in other languages, saves time and resources 19,20 .
In this sense, the present study sought evidence of construct validity of the translated version of the IMMS into Brazilian Portuguese, through the analysis of its internal structure, against a pedagogical strategy that became mandatory during the social isolation period due to the COVID-19 pandemic.
which it seems, will be increasingly used even after the need for distancing is overcome: the asynchronous video lessons in the context of remote or hybrid teaching [21][22][23] .
The necessary premises to demonstrate the convenience of the PCA were adequately verified by the sample adequacy measure (KMO) and Bartlett's test of sphericity.After the exclusion of 11 items, the IMMS-BRV instrument now has 25 items divided into 4 dimensions.This behavior was also observed in other studies that empirically assessed the validity of the IMMS, with the exclusion of 16, 24 and 17 items having been reported in the three published studies [12][13][14] .
Chart 1. Validated Brazilian Version of the Instructional Materials Motivation Survey (IMMM-BRV).It is observed, as described in the results, that the PCA grouped the items in the IMMS-BRV in two dimensions close to the original IMMS, maintained as Confidence and Attention.
However, two new dimensions (Interest and Expectancy) were created according to the content analysis and with the higher loads of the items grouped in them.In this regard, it is worth noting that the ARCS model, from which the IMMS derives, is based on the expectancy-value theory, whose construct focuses on the interest and expectancy for learning 4,5 .
Another relevant fact is that the IMMS was originally validated using undergraduate students and self-directed instructional material printed on paper, quite different from the material used in this and other studies that analyzed its validity 15 .Furthermore, there was no empirical data treatment for the distribution of items in the four original dimensions, as in the present study.It is possible that such procedure, had it been carried out, would have generated different aggregation of its items in relation to the dimensions described in the original IMMS.
The PCA, conducted in the present study, showed significant loads (0.529 to 0.790), which characterized the adequate correlation of each variable (item) with the corresponding dimension (construct validity) 17 .Regarding the adequacy of content analysis, in redefining the nomenclature of the dimensions, although there are differences between the IMMS-BRV and the IMMS, regarding the distribution of items and the designation of components (dimensions), the coherence with the constructs that support the original IMMS was maintained 3,24 .
These dimensions relate the IMMS-BRV construct to the one of the first motivational design model proposed by Keller 3 and described in the introduction.In it, the four dimensions showing how the concepts underlying it are in line with the evolution of the motivational design construct postulated by Keller 3,4,15 .Given this composition of dimensions, the issue is highlighted that, if the initial pool of items, from which the IMMS was derived, had been submitted to multivariate techniques to define its dimensionality, the result would not have been closer to that found in the present study and in the others that evaluated the internal structure of the original instrument.Therefore, the results of the PCA and the adequacy of the content analysis in redefining the dimensions indicate initial evidence of construct validity and the Cronbach's alpha coefficients, found for the dimensions, disclose the good reliability of the IMMS-BRV.
Correlating with the literature, the studies that analyzed the evidence of the IMMS validity also resulted in a reduction in the number of items and the modification of their distribution in dimensions, once again highlighting the situational characteristic of the instrument and emphasizing the need to modify it to accommodate the context of its application [12][13][14] .In other words, it is suggested that the situation of the instrument is a dynamic one and varies according to factors correlated to its implementation, which range from the students' characteristics to those of the involved instructional programs.
In this sense, Huang et al. 12  Regarding the study by Huang et al. 12 , Keller 4 added that the factorial analysis, when applied to the IMMS, can change its structure, because the dimensions can show very high intercorrelations.He explains that this occurs partly because the instrument was designed to measure situation-specific attitudes rather than psychological constructs.In fact, in the present study, the correlation between the Interest dimension and the Confidence dimension was also high (r = 0.81).In the ARCS construct, the student's interest in the instructional activity is directly related to their confidence that they will be successful in the task, that is, in learning.Therefore, the items in these dimensions measure behaviors that walk in parallel, because the represented latent traits are highly intercorrelated.
However, for the purpose of diagnosis and correction or improvement of the instructional activity being evaluated, it is important to maintain these dimensions separately.
In turn, in the study by Loorbach et al. 13 , carried out in a self-directed learning environment, aiming at teaching tasks related to the use of cell phones by the elderly, the instrument was reduced to 12 items that adequately fit in the four original The reliability of the IMMS-BRV, measured by Cronbach's alpha, ranged from 0.76 (Attention) to 0.93 (Interest) in its dimensions, thus showing good internal consistency 25 .These findings, compared with other validation studies, show that the items of the IMMS-BRV demonstrate reliability, to the same or to a better degree than those verified in such studies [12][13][14] .In addition, the IMMS-BRV maintained 80% of the reverse items contained in the original instrument.A similar finding was verified by Hauze et al. 14 , demonstrating the resilience of the IMMS questionnaire to response bias and to the respondents' fatigue.
This study has limitations that must be considered, especially in relation to the generalization of results.This is a study carried out in a single medical course, using a convenience sample from a very specific population.Moreover, the instructional activity assessed by the instrument was also unique, as it only included video lessons on the human anatomy strategy.Added to this fact is the atypical period of the Covid-19 pandemic, during which data were collected, as well as the online application of the instrument.The way the data analysis of the variables generated by ordinal measures converted into numbers was performed, as in the case of those used in Likert scales, also raises debate in the literature, since the differences between the answers are not equidistant 26 .
Finally, it should be noted that this study was aimed in evaluating the validity of the IMMS in the remote learning scenario (asynchronous video lessons).Its results and data available in the literature emphasize the situational characteristic, as well as the non-universal nature of the IMMS and reinforce that the validity and reliability of the IMMS-BRV, demonstrated in this study, should be considered preliminary.Thus, potential uses in other contexts must be evaluated and further studies that seek to corroborate the IMMS-BRV validity in other teachinglearning contexts, giving it external validity, must be carried out to expand its application spectrum.Therefore, the accuracy of the generalization of its use, in contexts different from the one used in this study, remains unknown.

CONCLUSIONS
The application of the IMMS in the remote learning scenario, through asynchronous video lessons on human anatomy, resulted in an alternative instrument (IMMS-BRV), modified with a smaller number of items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of adequate validity and reliability in the employed context.
evaluated the validity of the IMMS using first-year engineering students studying a computer-based tutorial called MATLAB.The result of the validation was the maintenance of 20 items, distributed into four dimensions, differently from the original instrument.In turn, Loorbach et al. 13 conducted a study in a self-directed learning environment.They concluded that, in this context, the instrument could be reduced to 12 items that adequately fit the four original dimensions of the IMMS, thus proposing an instrument called the Reduced Instructional Materials Motivation Survey (RIMMS).Recently, Hauze et al. 14 studied the IMMS validity in a simulated training scenario applied to nursing students.In this study, 19 items were maintained, distributed into the four dimensions of the original IMMS.In conclusion, they emphasized that the validity of its use in other populations and to evaluate other types of instructional methods cannot be predicted by the study.Based on the analysis of these studies, a lack of homogeneity is observed in relation to the results of the evidence of the IMMS construct validity, when applied in different contexts, related to the students' characteristics, the evaluated instructional material, the teaching environment and the sociocultural context.Therefore, considering the heterogeneity of the results of the described studies, their situational characteristic and the importance of investigating their applicability to measure medical students' motivation in the context of remote teaching of basic sciences, this study aimed to analyze the evidence of the IMMS construct validity, previously translated and adapted into Brazilian Portuguese, applied to students attending the first two years of the undergraduate medical course at UNIFENAS (Campus Belo Horizonte), to assess their motivation in relation to asynchronous video classes of human anatomy, attended during the social isolation period due to the COVID-19 pandemic.The increasing use of this instrument in technological teaching environments, as observed in the literature, emphasizes the importance of having a version with valid parameters known in Brazil, since the use of new technologies ) and measures of sample adequacy were also performed for each of the analyzed items, considering adequate values for commonality and for sample adequacy (Measures of Sampling Adequacy -MSA) > 0.50.Aiming to assess the interdependence of the latent dimensions identified by the PCA, Pearson's Correlation analysis was performed.Additionally, the differences between the observed correlations (correlation matrix with all original items) and the reproduced correlations (correlations estimated by the construct matrix) were assessed, where such differences, called residuals, indicate a good adjustment of the generated model, when they show very low values.

Items 1 ,
2 and 26 for showing low reliability of internal consistency in the dimensions to which they were allocated.

The composition of the 4
latent dimensions generated by PCA with Varimax rotation is shown in Table 4.The coefficients (saturation of loads in the dimensions) represent the levels of correlations between the dimensions with each of the variables (items) that constitute them.Therefore, higher absolute values indicate that the dimensions and their respective variables are closely related.Moreover, differences between the observed correlations (correlation matrix with all original items) and reproduced correlations (correlations estimated by the dimension matrix) were examined.These differences, called residuals, showed very low values, confirming a good fit of the generated model.Therefore, based on these results, we will work with 4 dimensions that encompass blocks of items capable of explaining dimensions of motivation in the face of asynchronous video lessons on human anatomy, according to the medical students' opinion, instead of analyzing 25 items individually.The total score generated by the sum of the values assigned to the 25 items represents the overall motivation score.
's correlation coefficient; p: probability of significance of the correlation analysis.

Confidence (explained variance = 17 .
4%; Cronbach's alpha = 0.87): in the Confidence dimension, 4 (66.6%)items from the same dimension of the original IMMS were agglutinated.The other 2 items (33.3%) come from the original Satisfaction dimension.These two items are intrinsically related to the satisfaction generated by the confidence in learning, by the expectancy of success.In the very definition of the theoretical frameworks of the ARCS construct, from which the IMMS derives, the satisfaction dimension is seen as the result of the interaction between the three others (Attention, Relevance and Confidence).Thus, in the PCA of this study, the items related to satisfaction were agglutinated in different dimensions according to their semantic affinity with each set of items.Therefore, due to the predominance of items related to the confidence dimension of the original IMMS and the intricate confidence/satisfaction correlation, the designation of this dimension as Confidence in the IMMS-BRV was maintained.Attention (explained variance = 12.1%; Cronbach's alpha = 0.76): in this dimension, 3 items (75%) are derived from the original IMMS Attention dimension.Only 1(25%) item derives from the original Confidence dimension.Although originally allocated to the Confidence dimension, its semantic analysis demonstrates it is a statement whose interpretation is precisely in line with the Attention dimension.Therefore, the denomination was maintained.

are:
Interest, Expectancy, Relevance and Result.Therefore, the IMMS-BRV has two dimensions of the first motivational design model (Interest and Expectancy) and two dimensions of the second motivational design model (Attention and Confidence), evaluated the validity of the IMMS in first-year engineering students who used a computerbased tutorial as supplementary material for learning the use of a computational tool called MATLAB.The result was the maintenance of 20 items distributed in four dimensions, differently from the original instrument, as it occurred in the present study.Also correlating with the present study, Attention was the dimension that maintained the highest number of items in both of them and, of the 20 items maintained in the instrument validated by Huang, 15 (75%) items were also maintained in the IMMS-BRV, representing 62.5% of IMMS-BRV.
dimensions of the IMMS, with the proposal of the instrument called the "Reduced Instructional Materials Motivation Survey (RIMMS)".Of the 12 items present in the RIMMS, 10 (83.3%) items are also allocated in the IMMS-BRV.Recently, Hauze et al. 14 validated the IMMS in a simulated training scenario applied to Nursing students.In this study, 19 items were maintained, distributed in 4 dimensions, according to the original IMMS.Based on the analysis of these studies that have been published so far, a lack of homogeneity was observed in relation to the results of the IMMS validation, when applied to different contexts, related to the characteristics of the students and the evaluated instructional material.Thus, in the present study, motivation was analyzed in a different context than those previously researched in studies evaluating the validity of the original instrument.The final version of the IMMS-BRV, reduced to 25 items, makes its application more convenient in the evaluation of remote teaching strategies, such as asynchronous video lessons, as it can measure motivation while requiring less time to fill it out and, consequently, resulting in less fatigue and dispersion of attention when interpretating the different items, therefore, in line with the principle of parsimony of measuring instruments24 .

Table 1 .
Assessment of students' behavior towards each of the IMMS questions.
Note: The wording of the items underwent minor changes to adapt to the instructional activity evaluated (video lessons), without changing its meaning.

Table 1 .
(Continuation) Assessment of students' behavior towards each of the IMMS questions.

Table 2 .
Result of the number of factors extracted based on the initial Principal Component Analysis.
However, during the PCA rounds, 11 items were removed from the original instrument for different reasons: Items 6, 16, 18, 30 and 33 for presenting a low proportion of explained variance (commonality < 0.50) in the initial or subsequent PCA; Items 10 and 32 due to similar loads shown in various components (dimensions); Item 19 because it was presented as a component with a single item, that is, it did not show significant correlations with the other variables.DOI

Table 4 .
Results of the final model of the IMMS-BRV Principal Component Analysis.
11Items numbered as in the IMMS -version translated into Brazilian Portuguese (Cardoso-Júnior et al.11).MOC = measure of commonality; MSA = Measure of Sampling Adequacy.NOTE:
items, without changing the Likert scale originally used in the IMMS.The items were allocated, according to the PCA, into 4 dimensions (A, B, C and D), named as follows: " Also: "state of mind that one has towards what is considered worthy of attention." In turn, in the same dictionary, relevance is defined as "that which stands out in a comparative or value scale; importance, significance." Finally, satisfaction is: "...pleasure arising from the realization of what is expected, what is desired." In other words: ... what one is interested in.
modified alternative Brazilian version of the Instructional Materials Motivation Survey (IMMM-BRV) is shown in Chart 1.Although the version applied to the subjects of this survey was adapted to the study material (video lessons), as shown in Table 1, Chart 1 shows the standard wording of the items, according to the original IMMS, translated and crossculturally adapted into Brazilian Portuguese 11 .
* Inverted items: the score of the items must be inverted.