Internal construct validity of the Brazilian version of a tool for assessing the population’s knowledge of human papillomavirus

Validade interna do construto da versão brasileira de um instrumento para aferição do conhecimento sobre o papilomavírus humano

ABSTRACT:

Objective:

To verify the internal construct validity of the Brazilian Portuguese version of a tool for measuring the general population’s knowledge of human papillomavirus (HPV).

Materials and methods:

A cross-culturally adapted Brazilian Portuguese version of a measurement tool originally designed for English speaking populations was administered to 330 adults in Tubarão, Santa Catarina, Southern Brazil. After examining the overall suitability of the method, we performed investigations based on the item response theory and exploratory factor analysis.

Results:

Ten of the 29 items presented a low contribution to the construct and were excluded from subsequent analysis. The factor analysis yielded three factors, which explained approximately 51% of the variance variability. A different arrangement from the original measurement tool was found: general HPV knowledge, with six items; HPV vaccination knowledge, with five items; HPV transmission and testing knowledge, with eight items.

Conclusion:

The Brazilian Portuguese version under study presented a different behavior from the original measurement tool, but proved to be a reliable and valid instrument in assessing the Brazilian population’s knowledge about HPV.

Keywords:
Papillomaviridae; Questionnaires; Validation studies

RESUMO:

Objetivo:

Verificar a validade interna do construto da versão em português de uma ferramenta para aferir o conhecimento da população sobre o papilomavírus humano (HPV).

Materiais e métodos:

Uma versão brasileira transculturalmente adaptada de uma ferramenta de aferição de conhecimento sobre HPV originalmente projetada para ser utilizada em populações de língua inglesa foi aplicada a 330 adultos em Tubarão/SC, Brasil. Após examinar a adequação geral do método, foram realizadas análises baseadas na Teoria de Resposta ao Item e na Análise Fatorial Exploratória.

Resultados:

Dez dos 29 itens apresentaram baixa contribuição para o construto e foram excluídos das análises subsequentes. Três fatores foram gerados pela análise fatorial e explicaram aproximadamente 51% da variabilidade da variância. Um arranjo diferente em relação ao instrumento de medida original foi encontrado, baseado em: conhecimento geral do HPV, com seis perguntas; conhecimento sobre vacinação contra o HPV, com cinco perguntas; e conhecimento sobre transmissão e teste de HPV com oito perguntas.

Conclusão:

A versão brasileira em estudo apresentou um comportamento diferente da ferramenta de aferição original, mas demonstrou ser um instrumento confiável e válido para acessar o conhecimento da população brasileira sobre o HPV.

Palavras-chave:
Papillomaviridae; Questionários; Estudos de validação

INTRODUCTION

The persistent human papillomavirus (HPV) infection is the main cause of cervical cancer and is associated with neoplasms in other tissues. Cervical cancer is one of the most common causes of cancer-related deaths in women in low- and middle-income countries¹.

According to recent estimates by the HPV Information Center², cervical cancer is the third most frequent among women aged 15-44 years in Brazil. Infection with HPV types 16 and 18, which are responsible for approximately 70% of cervical cancer cases, can be prevented through vaccination³. However, vaccine coverage is low among adolescents, the target population of HPV immunoprophylaxis in Brazil⁴. Some authors have argued that the low HPV vaccine uptake in Brazil may be due to fear of adverse reactions (following media reports of neurological symptoms in clusters of girls in Brazil), parental vaccine hesitancy, and/or logistical challenges to vaccinating adolescents at health care centers^5,6.

Among the main restrictive factors of preventive practices regarding the cervical cancer is the lack of knowledge about the disease and its prevention, especially in adolescent populations, considered the most vulnerable group for acquiring HPV infection⁷. Media advertisements, health professionals, and parents are the most frequent sources of information, but doubts on the accuracy of the message transmitted remain⁸. We believe that by measuring the knowledge about HPV, it will be possible to identify the need to expand the information on the virus, diagnosis, treatment, and prevention.

There are several published studies on the knowledge about HPV in different population strata, in many countries^{9,10,11,12,13}. However, the lack of an instrument with the same theoretical construct to gauge this knowledge prevents the comparability of data. Waller et al.¹⁴ proposed a scale to measure lay knowledge of HPV in the United States, the United Kingdom, and Australia. The questionnaire consists of 29 items with three subscales - general HPV knowledge, HPV vaccination knowledge, and HPV testing knowledge.

Recently, we proposed and published a cross-culturally adapted Brazilian Portuguese version of that tool. The details of the cross-cultural adaptation process can be found in Manoel et al.¹⁵. The preliminary model showed satisfactory reliability; however, the construct validity still needs to be established. The type of validation that allows verifying whether an instrument actually measures what it proposes to measure is called construct validity, given by the ability of a test to measure a theoretical trait or construct, thus validating a background theory¹⁴. In fact, it checks whether the observations that supported the arguments correspond to the theoretical parameters of the investigated subject. Construct validity is not limited to the measurement. Its broader purpose focuses on the validation of the theory on which it relied for the construction of the instrument¹⁶.

In 2014, the Brazilian National Health System launched the HPV immunization campaign, but the goals were not reached¹. Possibly, the lack of general public knowledge has raised social and ethical discussions that could explain it, at least partially. Public understanding of preventive measures and consequences of HPV infection can play an important role in contributing to the achievement of these goals. Thus, it is crucial to have a valid instrument for measuring HPV knowledge that can be administered to different segments of the population.

This study aimed to verify the internal construct validity of the Brazilian Portuguese version of a tool for measuring the general population’s knowledge of HPV. We expect that a validated tool can help determine how education measures can be implemented.

MATERIALS AND METHODS

STUDY DESIGN AND PARTICIPANTS

This is a cross-sectional study. The 29 items of the cross-culturally adapted Brazilian Portuguese version¹⁵ of the instrument proposed to measure lay knowledge of HPV in English speaking countries¹⁴ were self-administered by 330 adults. The sample comprised parents of 9-15-year-old adolescents, recruited from public and private schools in the municipality of Tubarão, Santa Catarina, Southern Brazil, and community health agents from the same municipality, who had not been previously trained in HPV screening. The sample was non-probabilistic, as previously described^15,17.

An informed consent form, complying with standards of the Declaration of Helsinki, was delivered to the participants, along with the HPV knowledge survey instrument. The Human Research Ethics Committee of Universidade do Sul de Santa Catarina, Brazil, approved the research project, under protocol number 734,735.

DATA ANALYSIS

We assessed the psychometric properties of the Brazilian Portuguese version of the questionnaire at the item level based on the item response theory (IRT). Items that did not fit the IRT model, evaluated by the chi-square test, were excluded from the subsequent analysis. For the remained items, we used classical reliability and exploratory factor analysis (EFA) with principal component analysis (PCA) to assess internal consistency and determine possible factors or subscales.

Questions 1 (Have you ever heard of HPV?), 2 (Have you ever heard of HPV vaccination?), and 3 (Have you ever heard of HPV testing?) were excluded from the analysis because their purpose was solely to enable the participant to continue responding to each of the three proposed sections.

IRT is a modern method recommended by the Patient-Reported Outcomes Measurement Information System (PROMIS)¹⁸ group to test the item loading. We analyzed the 29 items to identify the discriminatory power of the instrument and of each item alone. The analysis was performed in the open software R 3.30.

Cronbach’s alpha was used to assess internal consistency reliability after a previous analysis of the overall suitability of the dataset. A matrix between each pair of questions was examined through Pearson’s linear correlation. We also carried out the Kaiser-Meyer-Olkin (KMO) and Bartlett’s sphericity tests. All tests were performed in the software IBM SPSS version 18.0 (IBM Corp., Armonk, USA) for statistical analysis.

The PCA to define the number of factors involved two analyses: using the Kaiser-Guttman criterion¹⁹, which considers factors with eigenvalues greater than or very close to one (λ ≥ 1); performing a scree plot test to observe the eigenvalues.

Based on the Kaiser-Guttman criterion, we assumed that the loadings between factors with eigenvalues smaller than one and the original variables should be low, given that they would have had higher correlations with previously extracted factors with higher eigenvalues^20,21. Therefore, the original questions that shared small variance percentages with the other questions had their factor loadings raised in a single factor. The analysis of communalities allowed us to verify if any question did not share a significant percentage of variance with the defined factors.

We used the Varimax method to minimize the number of questions that presented high loadings in a given factor by redistributing the loadings and maximizing the shared variance in factors with smaller eigenvalues²². Finally, we carried out a theoretical evaluation according to the information required by the item and performed a regrouping based on the possibilities offered by the statistical model.

RESULTS

The sample consisted mainly of women (87.6%), and the mean age was 41.3 ± 8.8 years. More details about the sample are available in Manoel et al.¹⁵ and Manoel et al.¹⁷.

ITEM RESPONSE THEORY

The one-dimensionality of the instrument allowed us to proceed with IRT. Three classic models were created:

• rasch;

• two-parameter logistic (ltm);

• three-parameter logistic (tpm).

They were analyzed through ANOVA. Compared to rasch, the ltm model presented better results [Akaike Information Criterion (AIC): ltm 9900.3 < rasch 10084.0; Bayesian Information Criterion (BIC): ltm 10120.6 < rasch 10194.2; p < 0.001]. The second analysis showed similar results between ltm and tpm (AIC: tpm 9881.3 < ltm 9900.3; BIC: tpm 10211.8 > ltm 10120.7; p < 0.001). Both models (ltm or tpm) could be valid, but we selected the two-parameter logistic, since it is the most classic model.

Figure 1 shows the item trace lines. They were expressed numerically by the discrimination and difficulty parameters. IRT demonstrated that the item 1e had the strongest discrimination (3.4) while the item 1q (0.0) had the lowest contribution. Otherwise, item 3f presented the highest difficulty level (1.7) while the lowest was identified in item 1q (-175.9). We excluded ten items with poor discrimination power (1g, 1k, 1m, 1q, 2c, 2e, 3a, 3b, 3d, and 3f) and performed a new IRT analysis. All items with a p-value greater than or equal to 0.05 remained for the EFA.

Figure 1.
Trace lines for possible answers to all items based on the item response theory.

RELIABILITY AND FACTOR ANALYSIS

The instrument demonstrated an overall Cronbach’s alpha index of 0.80. The Cronbach’s alpha index if each item was deleted from the subscale remained similar to the overall value.

The assessment of the overall suitability of the dataset for EFA showed that the relationship between the number of subjects interviewed and the number of questions was 11.4, which represented a favorable condition. The correlation matrix of the variables presented Pearson correlation coefficient values above 0.2. The overall adequacy of the EFA for the data set showed a score of 0.82 in the KMO statistic, evidencing a correlation between the variables. Bartlett’s test presented a significance level of p < 0.001.

The scree plot indicated the existence of two to five factors, depending on the slope of the curve points (Figure 2). According to the Kaiser-Guttman criterion²⁰, the extraction of five factors was responsible for explaining 51.38% of the total variance of the instrument, with eigenvalues greater than or close to one (Table 1). PCA was performed with two, three, four, and five factors to identify which configuration could better explain the theoretical affinity between items. We considered that, usually, the indicated difference between dimensions should be greater than 2.5 to allow selecting the next factor.

Figure 2.
Scree plot representing the relationship between the components and eigenvalues.

Table 1.
Variance and eigenvalues with five factors (λ ≥ 1).

Component	Square summation of the extracted factor loadings			Square summation of rotated factor loadings
	Total	Percent variance	Cumulative percent	Total	Percent variance	Cumulative percent
1	4.29	22.57	22.57	2.61	13.76	13.76
2	1.73	9.10	31.67	2.09	10.98	24.74
3	1.50	7.90	39.56	1.88	9.87	34.61
4	1.21	6.40	45.95	1.72	9.05	43.66
5	1.03	5.43	51.38	1.47	7.72	51.38

The best configuration was obtained with three factors. The rotation of the factors by the Varimax method sought to minimize the number of variables with high factor loadings in a factor and maximize the variation between the weights of each main component. The component matrix, after orthogonal rotation, aimed to maximize the factor loadings, so that each variable was associated with only one factor, simplifying the interpretation of these factors. All values lower than 0.2 were eliminated due to a weak correlation. The rotated factor loading matrix showed that factor 1 included items related to “general information,” factor 2 to “vaccination,” and factor 3 to “transmission and diagnosis.” Items 1c, 1e, and 1j demonstrated loadings for factors 1 and 3, but although the highest loading belonged to factor 1, they were nearest to factor 3 according to the theoretical analysis. The same occurred to item 2b, with loading in factors 2 and 3, but better proximity to factor 2. Table 2 shows how the items were effectively related to the factors. The sequence order followed the factor and value of correlation (above 0.2) of each item.

Table 2.
Rotated factor loading matrix with three factors by the Varimax method, rearranged and eliminating scores lower than 0.2.

	Items	Factors
		1	2	3
1a	HPV can cause cervical cancer	0.69
1d	HPV is very rare	0.63
1b	A person could have HPV for many years without knowing it	0.63
1f	HPV always has visible signs or symptoms	0.53
1h	HPV can cause HIV/AIDS	0.51
1n	HPV can be cured with antibiotics	0.31
2a	Girls who had an HPV vaccine do not need a Pap test when they are older		0.74
2f	The HPV vaccine requires three doses		0.66
2d	Someone who had an HPV vaccine cannot develop cervical cancer		0.65
2g	HPV vaccines are most effective if given to people who have never had sex		0.57
2b	HPV vaccines protect against genital warts		0.23
1i	HPV can be transmitted by genital skin-to-skin contact			0.58
3e	When you have an HPV test, you get the results on the same day			0.53
1p	Most sexually active people will get HPV at some point in their lives			0.47
1l	There are many types of HPV			0.43
3c	An HPV test can tell you how long you have had an HPV infection			0.38
1e	HPV can be transmitted during sexual intercourse			0.40
1j	Men cannot get HPV			0.33
1c	Having many sexual partners increases the risk of contracting HPV			0.29

• HPV: human papillomavirus; HIV: human immunodeficiency virus; AIDS: acquired immunodeficiency syndrome.

DISCUSSION

The results pointed to keeping the latent construct, and the Brazilian Portuguese version might retain 19 of the 29 items, with a different arrangement from the originally proposed instrument: general HPV knowledge, with six items; HPV vaccination knowledge, with five items; HPV transmission and testing knowledge with eight items. The first dimension comprised questions related to “general HPV knowledge” as proposed by Waller et al.¹⁴ The second also consisted of questions from the original “HPV testing knowledge.” However, the third dimension of the Brazilian Portuguese instrument involved a combination of two questions from the original “HPV vaccination knowledge” and six questions from the original “general HPV knowledge.” Nevertheless, we emphasize that ten items presented factor loadings in two dimensions and two other items in three dimensions, indicating certain non-specificity. It forced the researchers to arbitrate their distribution among the dimensions based on the theoretical status, respecting the statistical results of each loading on the factor. The practical need for separating the items clearly by dimension remains. On the other hand, probably the most important practical result of this study was providing a shorter and valid version with good internal consistency, indicating good reliability.

It is noteworthy that the Brazilian public health system does not use the HPV test as a screening tool, which limits the knowledge about the diagnosis even for health professionals. In addition, Brazil recently modified the vaccination schedule to two anti-HPV doses, while other countries maintained the three-dose vaccination schedule⁴.

The low anti-HPV vaccination coverage observed in Brazil is mainly due to hesitation and resistance from many parents who are still deciding on the health care of their children. When considering the child’s age and the presumed time frame until sexual exposure, parents usually underestimate the child’s susceptibility to acquiring sexually transmitted infections or even to developing cancer in the future⁶. Another relevant factor would be the connection between HPV and sexual activity. This issue has been a major source of religious controversy surrounding the HPV vaccine. Several religious groups and parents have expressed concern that the vaccine would be a trigger for promiscuity and early sexual life among adolescents. Furthermore, it has been argued that religious norms that regulate the sexual activity of unmarried women make the HPV vaccine unnecessary²³.

Once a valid instrument is available to gauge the general knowledge of the population about HPV and aspects related to vaccination, transmission, and diagnosis, it is possible to plan and develop more appropriate educational strategies. There are several differences between subgroups, as well as in sociodemographic status, including age, ethnicity, maternal schooling, healthcare coverage, and health providers’ recommendations about HPV²². Indeed, one study demonstrated that young people were unaware that the HPV vaccine could be given to males. Authors have suggested improving the discussion with health care providers about this issue, as some social barriers still need to be overcome²⁴. One of the principal concerns regarding the HPV diagnosis is the knowledge generated by the information that follows the diagnosis per se.

The search for the partner responsible for the transmission and the need to determine when the infection has occurred are questions that remain unanswered. The emotional stress generated by the diagnosis and non-scientific sources of information can contribute to negative results in the progress of the disease or even in the possibility of transmission. Therefore, an effective instrument able to measure HPV knowledge is crucial to focus on preventive programs and health policies.

The existence of an instrument to determine the knowledge about HPV allows safer choices and more reliable strategies for the dissemination of this knowledge in a specific population. It is important to remember that teachers and administrators will be on the front lines of these programs, coordinated with health providers and parents. Also, there will always be anti-campaigns to defeat^25,26.

Among the limitations of this study are the predominantly female sample and the HPV-related problems they might have experienced that are not known, which theoretically have the potential to influence the results. Such a hypothesis would imply the need to incorporate a generic question about the issue, even if the interviewee were male, since he could have experienced the problem, personally or in his family. The greater the heterogeneity of the sample, the more representative of the target population it would be. Nonetheless, further studies should include a discriminatory analysis between groups with and without a history of personal or family problems related to HPV infection.

Lastly, we underline that at the time of data collection, the vaccination schedule included three doses. Currently, the country has a two-dose regimen. Thus, we suggest changing question 2.2 of the final version of the instrument in Portuguese based on the current vaccination schedule.

CONCLUSION

We can conclude that the Brazilian Portuguese version under study presented a different behavior from the original measurement tool. A shorter version with 19 questions proved to be a reliable and valid instrument in assessing the Brazilian population’s knowledge about HPV. In this scenario, it is possible to infer that the chances of success of health promotion and disease prevention actions would improve.

REFERENCES

• ¹
  Gallagher KE, Howard N, Kabakama S, Mounier-Jack S, Burchett HED, LaMontagne DS, et al. Human papillomavirus (HPV) vaccine coverage achievements in low and middle-income countries 2007-2016. Papillomavirus Res 2017; 4: 72-8. https://doi.org/10.1016/j.pvr.2017.09.001
  » https://doi.org/https://doi.org/10.1016/j.pvr.2017.09.001
• ²
  HPV Information Center. Complementary data on cervical cancer prevention [Internet]. [accessed on Apr. 29, 2019]. Available at: Available at: http://www.hpvcentre.net
  » http://www.hpvcentre.net
• ³
  Couto E, Sæterdal I, Juvet LK, Klemp M. HPV catch-up vaccination of young women: a systematic review and meta-analysis. BMC Public Health 2014; 14: 867. https://doi.org/10.1186/1471-2458-14-867
  » https://doi.org/https://doi.org/10.1186/1471-2458-14-867
• ⁴
  Sistema de Informação do Programa Nacional de Imunização [Internet]. [accessed on May 5, 2018]. Available at: Available at: http://pni.datasus.gov.br/
  » http://pni.datasus.gov.br/
• ⁵
  Holman DM, Benard V, Roland KB, Watson M, Liddon N, Stokley S. Barriers to human papillomavirus vaccination among US adolescents: A systematic review of the literature. JAMA Pediatr 2014; 168(1): 76-82. https://doi.org/10.1001/jamapediatrics.2013.2752
  » https://doi.org/https://doi.org/10.1001/jamapediatrics.2013.2752
• ⁶
  VanWormer JJ, Bendixsen CG, Vickers ER, Stokley S, McNeil MM, Gee J, et al. Association between parent attitudes and receipt of human papillomavirus vaccine in adolescents. BMC Public Health 2017; 17: 766.
• ⁷
  Tu YC, Wang HH, Lin YJ, Chan TE. HPV knowledge and factors associated with intention to use condoms for HPV infection risk among adolescent women in Taiwan. Women Health 2015; 55(2): 187-202. https://doi.org/10.1080/03630242.2014.979970
  » https://doi.org/https://doi.org/10.1080/03630242.2014.979970
• ⁸
  Rosen BL, Shew ML, Zimet GD, Ding L, Mullins TLK, Kahn JA. Human Papillomavirus vaccine sources of information and adolescents’ knowledge and perceptions. Glob Pediatr Health 2017; 4: 2333794X17743405.
• ⁹
  Galbraith KV, Lechuga J, Jenerette CM, Moore LA, Palmer MH, Hamilton JB. Parental acceptance and uptake of the HPV vaccine among African-Americans and Latinos in the United States: a literature review. Soc Sci Med 2016; 159: 116-26. https://doi.org/10.1016/j.socscimed.2016.04.028
  » https://doi.org/https://doi.org/10.1016/j.socscimed.2016.04.028
• ¹⁰
  Brotherton JM, Jit M, Gravitt PE, Brisson M, Kreimer AR, Pai SI, et al. Eurogin Roadmap 2015: how has HPV knowledge changed our practice: vaccines. Int J Cancer 2016; 139(3): 510-7. https://doi.org/10.1002/ijc.30063
  » https://doi.org/https://doi.org/10.1002/ijc.30063
• ¹¹
  Patel HJY, Jeve YB, Sherman SM, Moss EL. Knowledge of human papillomavirus and the human papillomavirus vaccine in European adolescents: a systematic review. Sex Transm Infect 2016; 92(6): 474-9. https://doi.org/10.1136/sextrans-2015-052341
  » https://doi.org/https://doi.org/10.1136/sextrans-2015-052341
• ¹²
  Dodd RH, McCaffery KJ, Marlow LA, Ostini R, Zimet GD, Waller J. Knowledge of human papillomavirus (HPV) testing in the USA, the UK and Australia: an international survey. Sex Transm Infect 2014; 90(3): 201-7. https://doi.org/10.1136/sextrans-2013-051402
  » https://doi.org/https://doi.org/10.1136/sextrans-2013-051402
• ¹³
  Mast TC, Zhu X, Demuro-Mercon C, Cummings HW, Sings HL, Ferris DG. Development and psychometric properties of the HPV Impact Profile (HIP) to assess the psychosocial burden of HPV. Curr Med Res Opin 2009; 25(11): 2609-19. https://doi.org/10.1185/03007990903238786
  » https://doi.org/https://doi.org/10.1185/03007990903238786
• ¹⁴
  Waller J, Ostini R, Marlow LA, McCaffery K, Zimet G. Validation of a measure of knowledge about human papillomavirus (HPV) using item response theory and classical test theory. Prev Med 2013; 56(1): 35-40. https://doi.org/10.1016/j.ypmed.2012.10.028
  » https://doi.org/https://doi.org/10.1016/j.ypmed.2012.10.028
• ¹⁵
  Manoel AL, Traebert J, Rebello LC, Zapelini CM, Trevisol DJ, Schuelter-Trevisol F. Preliminary stages of a cross-cultural Brazilian Portuguese adaptation of a measurement tool for assessing public understanding of human papillomavirus. Cad Saúde Pública 2016; 32(7): e00087615. https://doi.org/10.1590/0102-311X00087615
  » https://doi.org/https://doi.org/10.1590/0102-311X00087615
• ¹⁶
  Ribeiro MAS, Vedovato TG, Lopes MHBM, Monteiro MI, Guirardello EB. Estudos de validação na enfermagem: revisão integrativa. Rev Rene 2013; 14(1): 218-28.
• ¹⁷
  Manoel AL, Rodrigues AB, Piva EZ, Warpechowski TP, Schuelter-Trevisol F. Evaluation of knowledge about the Human Papilloma Virus (HPV) and its vaccination among Community Health Agents in the municipality of Tubarão, Santa Catarina, Brazil, in 2014.Epidemiol Serv Saúde 2017; 26(2): 399-404. https://doi.org/10.5123/s1679-49742017000200017
  » https://doi.org/https://doi.org/10.5123/s1679-49742017000200017
• ¹⁸
  Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005; 8(2): 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
  » https://doi.org/https://doi.org/10.1111/j.1524-4733.2005.04054.x
• ¹⁹
  Raymundo VP. Construção e validação de instrumentos: um desafio para a psicolinguística. Rev Letras Hoje 2009; 44(3): 86-93.
• ²⁰
  Kaiser HF, Caffrey J. Alpha factor analysis. Psychometrika 1965; 30: 1-14. https://doi.org/10.1007/bf02289743
  » https://doi.org/https://doi.org/10.1007/bf02289743
• ²¹
  Vermunt JK, Magidson J. Factor analysis with categorical indicators: a comparison between traditional and latent class approaches. In: Van der Ark ACM, Sijtsma K, eds. New developments in categorical data analysis for the social and behavioral sciences. Mahwah: Erlbaum; 2005.
• ²²
  Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment. Res Eval 2005; 10(7): 13-24.
• ²³
  Bodson J, Wilson A, Warner EL, Kepka D. Religion and HPV vaccine-related awareness, knowledge, and receipt among insured women aged 18-26 in Utah. PLoS One 2017; 12(8): e0183725. https://doi.org/10.1371/journal.pone.0183725
  » https://doi.org/https://doi.org/10.1371/journal.pone.0183725
• ²⁴
  Choi Y, Eworuke E, Segal R. What explains the different rates of human papillomavirus vaccination among adolescent males and females in the United States? Papillomavirus Res 2016; 2: 46-51. https://doi.org/10.1016/j.pvr.2016.02.001
  » https://doi.org/https://doi.org/10.1016/j.pvr.2016.02.001
• ²⁵
  Tatar O, Perez S, Naz A, Shapiro GK, Rosberger Z. Psychosocial correlates of HPV vaccine acceptability in college males: a cross-sectional exploratory study. Papillomavirus Res 2017; 4: 99-107.
• ²⁶
  Vorsters A, Arbyn M, Baay M, Bosch X, de Sanjosé S, Hanley S, et al. Overcoming barriers in HPV vaccination and screening programs. Papillomavirus Res 2017; 4: 45-53. https://doi.org/10.1016/j.pvr.2017.07.001
  » https://doi.org/https://doi.org/10.1016/j.pvr.2017.07.001

• Financial support: Coordination of Superior Level Staff Improvement (CAPES), Financial Code 001

Publication Dates

• Publication in this collection
  05 June 2020
• Date of issue
  2020

History

• Received
  23 Jan 2019
• Reviewed
  10 June 2019
• Accepted
  05 Aug 2019