Acessibilidade / Reportar erro

Cross-cultural adaptation, content validity, and item analysis of the Objective and Subjective Knowledge and HIV Testing Scale for the Brazilian population

Abstract

Objectives

To propose a Portuguese version of the Objective and Subjective Knowledge and HIV Testing Scale (OSK-HIV-TS), assess its content validity, and perform item analysis after administration to a sample of undergraduate students.

Methods

Three translators translated the OSK-HIV-TS into Portuguese. Judges evaluated each item of a consensus version of the translated instrument for semantic, idiomatic, cultural, and conceptual equivalence. A consensus committee reviewed a back-translation against the original version of the OSK-HIV-TS. Content validity was calculated with the content validity index (CVI) and item analysis was conducted using Classical Test Theory (CTT).

Results

The translated scale achieved semantic, idiomatic, conceptual, and cultural equivalence to the original version. A total of 491 undergraduate students participated and the distribution of students’ responses to the OSK-HIV-TS revealed a high proportion of correct answers. All items were classified as easy or very easy and only item 16 was classified having strong discrimination power according to the discrimination index.

Conclusion

The OSK-HIV-TS is a novel instrument in the Brazilian literature for assessing human immunodeficiency virus (HIV) knowledge and should inspire more research into HIV/acquired immunodeficiency syndrome (AIDS) behavior and associated factors, which, despite being essential and necessary, is still lacking in the Brazilian literature.

Knowledge; attitudes; cross-cultural adaptation; human immunodeficiency viruses (HIV

Introduction

Human immunodeficiency virus (HIV) infection has been considered a global epidemic since the end of the last century and a public health issue, especially in low and medium-income countries. The number of AIDS cases in Brazil has been stable over the past few years but, despite adoption of control strategies, the incidence of HIV-infected persons is increasing and is concentrated in certain population groups. The Brazilian Ministry of Health epidemiological bulletin on HIV/AIDS, covering cases notified until December 2020,11. Brasil, Ministério da Saúde. Boletim epidemiológico HIV/Aids. Brasília: Ministério da Saúde; 2020. describes an increase in the AIDS detection rate, mainly observed among young men. In 2019, the highest detection rate was 52 cases per 100 thousand inhabitants, which occurred among individuals aged 25 to 29 years. Increases of 64.9% and 74.8% were observed in the 15 to 19 and 20 to 24 age groups, respectively.

According to several studies,22. Grant LM, Demetriou E. Adolescent sexuality. Pediatr Clin North Am. 1988;35:1271-89.

3. Magnusson C. Adolescent girls’ sexual attitudes and opposite-sex relations in 1970 and in 1996. J Adolesc Health. 2001;28:242-52.

4. Murphy DA, Durako SJ, Moscicki AB, Vermund SH, Ma Y, Schwarz DF, et al. No change in health risk behaviors over time among HIV infected adolescents in care: role of psychological distress. J Adolesc Health. 2001;29(3 Suppl):57-63.
- 55. Assis SG, Gomes R, Pires TO. Adolescence, sexual behavior and risk factors to health. Rev Saude Publica. 2014;48:43-51. the disease’s multiplication in young people can occur due to biological factors, such as an exposed histological system due to development of the reproductive system, psychological factors, due to impaired personal relations, formation and questions regarding sexuality, which can lead to varying partners, and social aspects, such as lack of knowledge regarding HIV, social inequality, prejudice, socioeconomic status, and functional and structural conditions of the health system.

In view of this, Cabral et al.66. Cabral JVB, Oliveira FHPC, Almeida-Messias DC, Santos KLLM, Bastos V. Perception of vulnerability related to HIV/Aids by the adolescent population. Esp Saude 2016;17:212-9. and Dzah et al.77. Dzah SM, Tarkang EE, Lutala PM. Knowledge, attitudes and practices regarding HIV/AIDS among senior high school students in Sekondi-Takoradi metropolis, Ghana. Afr J Prim Health Care Fam Med. 2019;11:e1-11. point out that lack of knowledge about HIV has been identified as a risk factor for dissemination of the virus among the young population and suggest that it is important to conduct more studies about the topic in different populations. Bednarsh and Eklund88. Bednarsh H, Eklund K. Management of occupational exposure to hepatitis B, hepatitis C, and human immunodeficiency virus. Compend Contin Educ Dent. 2002;23:561-6, 568-9; quiz 570. demonstrate that prevention is based mainly on promotion of behavioral changes and it is therefore necessary to conduct research regarding knowledge, attitudes, behaviors, practices, and perception. Thus, it is believed that sufficient knowledge may have implications for HIV prevention, such as decreased risk behaviors, better perception of exposure, more frequent testing, lower exposure, and adoption of safer behaviors. However, evaluation of psychometric constructs such as knowledge about HIV is limited in Brazil, in particular because of the scarcity of adapted and validated measurement scales for this purpose.

There are some scales in the literature for measurement of knowledge about HIV, such as the AIDS Attitude Scale,99. Froman RD, Owen SV, Daisy C. Development of a measure of attitudes toward persons with AIDS. Image J Nurs Sch. 1992;24:149-52. the scale of attitudes concerning AIDS,1010. Moriya TM, Gir E, Hayashida M. A scale of attitudes towards AIDS: a psychometric analysis. Rev Lat Am Enfermagem. 1994;2:37-53. the Objective and Subjective Knowledge and HIV Testing Scale (OSK-HIV-TS), for use among college students,1111. Hou SI. Objective and subjective knowledge and HIV testing among college students. J Health Educ. 2004;35:328-37. and the HIV/AIDS attitudes scale.1212. Silva-Filho N, Godinho PH, Reis CHD, Pacheco NMS. HIV/AIDS attitudes scale: factorial analysis. J Bras Psiquiatr. 2007;56:194-200. However, none of these scales have a Portuguese version and there are no instruments available for assessing the HIV knowledge construct that can be used in studies in Brazil. Of the scales proposed to date, the OSK-HIV-TS, developed by Hou1111. Hou SI. Objective and subjective knowledge and HIV testing among college students. J Health Educ. 2004;35:328-37. for use with college student populations has proven to be an interesting scale because it provides a more complete measure of knowledge (both objective and subjective). The original version of this scale is in English. The OSK-HIV-TS1111. Hou SI. Objective and subjective knowledge and HIV testing among college students. J Health Educ. 2004;35:328-37. was originally developed for use with college students and comprises 16 items; 11 general questions about HIV/AIDS and five specific questions that assess general knowledge about the topic (subjective). Since it is a knowledge scale, the response categories are “true” and “false.”

Therefore, considering the lack of available scales on this issue in Brazil and the relevance to the field of cross-cultural adaptations of scales on HIV knowledge, the objective of this study is to present the steps of translation into Brazilian Portuguese and cross-cultural adaptation, assessment of content validity, and item analysis of the OSK-HIV-TS when administered to a sample of undergraduate students.

Methods

Translation, cross-cultural adaptation, and content validity

Cross-cultural adaptation of the scale to Brazilian Portuguese followed the methodology proposed by Ferrer et al.1313. Ferrer M, Alonso J, Prieto L, Plaza V, Monsó E, Marrades R, et al. Validity and reliability of the St George’s Respiratory Questionnaire after adaptation to a different language and culture: the Spanish example. Eur Respir J. 1996;9:1160-6. Initially, translations were conducted independently by three bilingual translators (whose native language was Portuguese and second language was English), obtaining three Brazilian Portuguese versions. The translators were experienced in translating psychometric scales and were instructed on the goals of the translation and informed about the target population of the study. Their versions were subsequently synthesized to construct a first version of the instrument in Brazilian Portuguese by the researchers responsible. Following Fehring’s criteria,1414. Fehring RJ. Methods to validate nursing diagnoses. Heart Lung. 1987;16(6 Pt 1):625-9. five judges (health professionals with experience in validation studies) were selected to form a specialist committee to evaluate the items and suggest alterations to improve comprehension by the Brazilian population. In addition, these judges evaluated each item of the translated instrument individually for semantic, idiomatic, cultural, and conceptual equivalence. Semantic equivalence refers to the meaning of words in terms of vocabulary and grammar, idiomatic equivalence is related to the equivalence of expressions and “meanings” in different languages, cultural equivalence is related to adaptation to the context of the study’s target public, and conceptual equivalence is related to maintenance of the original instrument’s concepts. After this step, the researchers obtained a final version, considering the judges’ suggestions and the scale applicability criteria in the target population.

A panel of five specialists with experience in cross-cultural adaptation and validation of instruments independently assessed the content of the OSK-HIV-TS items to evaluate its objectivity and relevance. These specialists were informed about the study objectives and were asked to classify each item of the translated instrument as adequate or inadequate for use in the target population. Suggestions for modifications and simplification were requested when necessary. A content validity index (CVI) was calculated for each item, considering that CVI ≤ 0.70 (i.e., 30% or more of the judges classified the item as inadequate) is indicative that a new translation is needed.1515. Polit DF, Beck CT. The Content Validity Index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29:489-97.

As a final step, a back-translation was carried out by a bilingual translator who had no previous knowledge of the original version of the scale. This step is important to confirm that all adapted items are equivalent to the instrument’s original proposal.

Data collection in the target population

The Portuguese version of the OSK-HIV-TS was administered to a sample of undergraduate students in an open web survey. The study population comprised students enrolled on courses run by the eight units of the Universidade de São Paulo (USP), Ribeirão Preto Campus. An electronic version of the data collection instrument was developed on the Research Electronic Data Capture (REDCap) platform (http://project-redcap.org).1616. Patridge EF, Bardyn TP. Research electronic data capture (REDCap). J Med Libr Assoc. 2018;106:142-4.

An invitation to participate containing a link to the online survey was sent to all students by e-mail or messaging applications. The first questions on the survey were asked after agreement to participate had been given and were about the inclusion criteria (age ≥ 18 years and enrollment on an undergraduate course at one of the university’s eight units). Data collection was carried out from March to May 2021, and the average time taken to answer the survey was approximately 15 minutes.

OSK-HIV-TS item analysis

Participants were classified based on their performance on the instrument using Kelley’s1717. Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psychol. 1939;30:17-24. suggestion, which is to estimate cut-off points using the 27% of participants with the highest and lowest scores on the instrument. For the objective dimension of the OSK-HIV-TS, comprising 16 items, the cut-off points adopted to select the participants with the best and worst performances were 16 correct answers and ≤ 13 correct answers, respectively. Classical test theory (CTT) was used to assess the quality of OSK-HIV-TS items, using the facility and discrimination indices as parameters.1818. Crocker L, Algina J. Introduction to classical and modern test theory. Boston: Cengage Learning; 1986. For the facility index, the degree of facility of items is estimated through the proportion of correct answers, by which each item can be classified as “very easy” (proportion of correct answers from 80 to 100%), “easy” (60 to 80%), “medium difficulty” (40-60%), “difficult” (20-40%), or “very difficult” (0-20%). The discrimination index allows researchers to assess how well an item can distinguish between respondents who gave the best and worst responses on the instrument. In other words, the bigger the difference in the number of correct responses between participants with best and worse performance, the greater the item’s discrimination power. Discrimination index results from 0 to 30% represent weak discrimination, rates from 30 to 60% indicate moderate discrimination, and indices from 60 to 100% demonstrate strong discrimination.1919. Ebel RL. Measuring educational achievement. Hoboken: Prentice-Hall; 1965. The goal of this analysis is therefore to find easy items with high discriminatory power (i.e., questions that are most likely to be answered correctly).

Ethical considerations

The study was approved by the Research Ethics Committee at the Hospital das Clínicas, Faculdade de Medicina de Ribeirão Preto (CAAE: 31049220.4.0000.5440) and all ethical principles were respected. The informed consent form was presented on the first page of the online form and the survey only began if the participant agreed to participate in the study by clicking the option “I agree to the consent form.” The option “I prefer not to answer” was included for all questions on the online form and participants had the option to stop participating at any time.

Results

After completing the procedures of translation and cross-cultural adaptation as described in the Methods section, with assessment of all types of equivalence in the translation process and achieving CVI values ≥ 0.75 for all items, the final Brazilian Portuguese version of OSK-HIV-TS is presented in Table 1 . The original English language version is also presented for comparison and some changes made to items to update concepts about HIV/AIDS are shown.

Table 1
Original version of the 1010. Moriya TM, Gir E, Hayashida M. A scale of attitudes towards AIDS: a psychometric analysis. Rev Lat Am Enfermagem. 1994;2:37-53. OSK-HIV-TS and final version adapted to Brazilian Portuguese, Brazil, 2021

A total of 491 undergraduate students enrolled at eight USP units at the Ribeirão Preto Campus participated in the study. Of these, 61.5% were female and 0.6% declared they had a non-binary identity, while 6.5% of the participants did not answer the questions about sex and gender. With regard to sexual orientation, 61.7% declared they were heterosexual, followed by 23.2% bisexual and 11.4% homosexual.

The distribution of students’ responses to the OSK-HIV-TS is presented in Table 2 .

Table 2
Proportion of undergraduate students’ (n = 525) responses to each item of the OSK-HIV-TS, Ribeirão Preto, São Paulo, 2021

The distribution of the students’ responses to the OSK-HIV-TS revealed a high proportion of correct answers. The item about contracting HIV through a single unprotected sexual contact with an HIV-positive person had the highest percentage of correct answers in the sample. On the other hand, the item with the lowest percentage of correct answers was about HIV testing in the first few days after unprotected sexual intercourse (window period). Both sexes had similar frequencies of correct answers for most items. However, it was notable that males had a higher frequency of correct answers for item 15 (about HIV testing any time blood is drawn) and females had higher frequencies of correct answers for item 5 (about the window period). It was also noteworthy that in the individual assessments on subjective knowledge, most students classified their knowledge about HIV in general and about tests as reasonable.

The quality of items of the OSK-HIV-TS for the Brazilian population, according to facility and discrimination indices obtained with CTT, is presented in Table 3 .

Table 3
Quality of items comprising the objective dimension of the Objective and Subjective Knowledge and HIV Testing Scale (OSK-HIV-TS) according to facility and discrimination indices obtained using Classical Test Theory (CTT) with a sample of undergraduate students (n = 491), Ribeirão Preto, São Paulo, 2021

All items were classified as easy or very easy when applied to the sample of undergraduate students. Only item 16 was classified as having strong discrimination.

Discussion

Cross-cultural adaptation of an instrument is performed when there is a need to develop specific measures for countries other than where the scale was originally developed. This process needs rigorous methodology supported by a theoretical framework that can guide the translation, adaptation, and validation steps.2020. Alexandre NM, Guirardello EB. Cultural adaptation of instruments utilized in occupational health. Rev Panam Salud Publica. 2002;11:109-11. Thus, having conducted all of the steps presented above, the resulting Portuguese version of the OSK-HIV-TS can be considered adequate for administration to Brazilian populations and to support new studies in which assessment of knowledge about HIV/AIDS would be useful.

According to the high frequency of correct answers, we can classify the students’ general knowledge about HIV as high. However, it is of concern that around 20% of these students did not know about the window period. Few studies have assessed knowledge about HIV in the young Brazilian population and those that do exist do not cover the subject of the window period. In addition, studies that further assess knowledge about the HIV window period in Brazil are focused on the population of men who have sex with men or blood donors. Knowing about the window period is important to interrupt transmission of the disease and is a relevant topic to include in instruments and models for assessing knowledge about STIs. As such, the OSK-HIV-TS contributes to the literature by including a question specifically about the window period in its items on general knowledge about HIV.

In our sample of undergraduate students, the item quality analysis only classified item 16 as having strong discrimination power and all items were classified as easy or very easy according to the facility index. More studies are needed to evaluate item content in order to confirm the items’ low discrimination power and suggest changes to improve the instrument.

Although the original proposal focused on college students, we believe that the version proposed here may be suitable for administration to Brazilian populations in different contexts, due to its simple and easy-to-understand language. However, we suggest that pre-tests of comprehensibility and applicability in the target population should always carried out before each application, so that the quality of the data obtained is guaranteed, especially in studies that involve data collection using the self-administered format. In addition, we hope that this scale can motivate further studies on behavior towards HIV/AIDS and associated factors, which are still scarce in the Brazilian literature, despite being urgent and necessary.

Conclusion

The OSK-HIV-TS is a novel instrument for assessing HIV knowledge in the Brazilian literature that should inspire more research on HIV/AIDS behavior and associated factors, which, despite being essential and necessary, are still lacking in the Brazilian literature. According to all of the steps presented, the OSK-HIV-TS can be considered adequate for administration to Brazilian undergraduate students. Further studies examining other psychometric properties of the scale would be a welcome addition to overall assessment of the OSK-HIV-TS as would studies conducted in different contexts and among different subsets of the Brazilian population.

Acknowledgements

This study received financial support from the Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP; 2020/03039-9) and Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).

References

  • 1
    Brasil, Ministério da Saúde. Boletim epidemiológico HIV/Aids. Brasília: Ministério da Saúde; 2020.
  • 2
    Grant LM, Demetriou E. Adolescent sexuality. Pediatr Clin North Am. 1988;35:1271-89.
  • 3
    Magnusson C. Adolescent girls’ sexual attitudes and opposite-sex relations in 1970 and in 1996. J Adolesc Health. 2001;28:242-52.
  • 4
    Murphy DA, Durako SJ, Moscicki AB, Vermund SH, Ma Y, Schwarz DF, et al. No change in health risk behaviors over time among HIV infected adolescents in care: role of psychological distress. J Adolesc Health. 2001;29(3 Suppl):57-63.
  • 5
    Assis SG, Gomes R, Pires TO. Adolescence, sexual behavior and risk factors to health. Rev Saude Publica. 2014;48:43-51.
  • 6
    Cabral JVB, Oliveira FHPC, Almeida-Messias DC, Santos KLLM, Bastos V. Perception of vulnerability related to HIV/Aids by the adolescent population. Esp Saude 2016;17:212-9.
  • 7
    Dzah SM, Tarkang EE, Lutala PM. Knowledge, attitudes and practices regarding HIV/AIDS among senior high school students in Sekondi-Takoradi metropolis, Ghana. Afr J Prim Health Care Fam Med. 2019;11:e1-11.
  • 8
    Bednarsh H, Eklund K. Management of occupational exposure to hepatitis B, hepatitis C, and human immunodeficiency virus. Compend Contin Educ Dent. 2002;23:561-6, 568-9; quiz 570.
  • 9
    Froman RD, Owen SV, Daisy C. Development of a measure of attitudes toward persons with AIDS. Image J Nurs Sch. 1992;24:149-52.
  • 10
    Moriya TM, Gir E, Hayashida M. A scale of attitudes towards AIDS: a psychometric analysis. Rev Lat Am Enfermagem. 1994;2:37-53.
  • 11
    Hou SI. Objective and subjective knowledge and HIV testing among college students. J Health Educ. 2004;35:328-37.
  • 12
    Silva-Filho N, Godinho PH, Reis CHD, Pacheco NMS. HIV/AIDS attitudes scale: factorial analysis. J Bras Psiquiatr. 2007;56:194-200.
  • 13
    Ferrer M, Alonso J, Prieto L, Plaza V, Monsó E, Marrades R, et al. Validity and reliability of the St George’s Respiratory Questionnaire after adaptation to a different language and culture: the Spanish example. Eur Respir J. 1996;9:1160-6.
  • 14
    Fehring RJ. Methods to validate nursing diagnoses. Heart Lung. 1987;16(6 Pt 1):625-9.
  • 15
    Polit DF, Beck CT. The Content Validity Index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29:489-97.
  • 16
    Patridge EF, Bardyn TP. Research electronic data capture (REDCap). J Med Libr Assoc. 2018;106:142-4.
  • 17
    Kelley TL. The selection of upper and lower groups for the validation of test items. J Educ Psychol. 1939;30:17-24.
  • 18
    Crocker L, Algina J. Introduction to classical and modern test theory. Boston: Cengage Learning; 1986.
  • 19
    Ebel RL. Measuring educational achievement. Hoboken: Prentice-Hall; 1965.
  • 20
    Alexandre NM, Guirardello EB. Cultural adaptation of instruments utilized in occupational health. Rev Panam Salud Publica. 2002;11:109-11.

Publication Dates

  • Publication in this collection
    10 July 2023
  • Date of issue
    2023

History

  • Received
    22 Sept 2021
  • Accepted
    06 July 2022
Associação de Psiquiatria do Rio Grande do Sul Av. Ipiranga, 5311/202, 90610-001 Porto Alegre RS/ Brasil, Tel./Fax: (55 51) 3024 4846 - Porto Alegre - RS - Brazil
E-mail: trends@aprs.org.br