Abstract
The present study proposes and evaluates the test-retest reliability of indicators of the correct use of sodium alendronate in elderly patients. This is a test-retest reliability study for use of sodium alendronate. Six questions to evaluate the correct use of this medicine were elaborated after analysis of information in the literature. Data collection was performed through questionnaires in face-to-face in-home interviews by previously trained interviewers. The participants were initially interviewed (test) when they agreed to participate in the study, and secondly (retest), after a period of 7 to 14 days from the first interview. The reliability of the questions was evaluated by means of the agreement percentage and the Kappa coefficient. Fifty-seven pairs (test-retest) were obtained. The mean age was 69.3 (SD = 6.9) years, the majority (92.5%) completed elementary education, and declared themselves white (50.9%). All the questions presented high concordance ranging from 79.0% to 98.3%. The Kappa values ranged from 0.1 (low) to 0.83 (very good). The agreement percentage and the Kappa values suggest adequate reliability of the proposed questions. We suggest that they can be used as a simple and quick way to evaluate the quality of sodium alendronate use among the elderly.
Keywords:
Drug utilization; Alendronate; Osteoporosis; Postmenopausal
INTRODUCTION
Rational use of medicines (RUM) comprises all stages of medicine development until their use, and must ensure that the patient receives the medicine according to their clinical needs, in the appropriate dose, duration, and cost (WHO, 2002WHO - World Health Organization. Perspectivas políticas de la OMS sobre medicamentos. Promoción del uso racional de medicamentos: componentes centrales [Internet] Genebra: OMS; 2002 [citad 2018 Nov 11]. Available from: Available from: http://apps.who.int/medicinedocs/pdf/s4874s/s4874s.pdf
http://apps.who.int/medicinedocs/pdf/s48...
). In this sense, RUM seeks to ensure that the medicine is effective and safe (Escher, Coutinho, 2017Escher A, Coutinho T. Uso racional de medicamentos, farmaceuticalização e usos do metilfenidato. Ciênc Saúde Coletiva. 2017;22:2571-2580.). Correct use of medicine, i.e. following the recommendations of how to take, use, and store, are essential for RUM (Mahamood et al., 2016Mahamood A, Elneour AA, Ali AAA, Hassan N, Shehab A, Bhagavathula AS. Evaluation of rational use of medicines (RUM) in four government hospitals in UAE. Saudi Pharm J. 2016;24(2):189-196.). However, according to the World Health Organization, 50.0% of medicine prescriptions and dispensations are made incorrectly, and the same problem extends to use, which also approaches 50.0% (WHO, 2002WHO - World Health Organization. Perspectivas políticas de la OMS sobre medicamentos. Promoción del uso racional de medicamentos: componentes centrales [Internet] Genebra: OMS; 2002 [citad 2018 Nov 11]. Available from: Available from: http://apps.who.int/medicinedocs/pdf/s4874s/s4874s.pdf
http://apps.who.int/medicinedocs/pdf/s48...
).
Sodium alendronate is one of most recommended medicines for treating and preventing osteoporosis (Radominski et al., 2017Radominski SC, Bernardo W, Paula AP, Albergaria BH, Moreira C, Fernandes CE, et al. Diretrizes brasileiras para o diagnóstico e tratamento da osteoporose em mulheres na pós- menopausa. Rev Bras Reumatol. 2017;57(S2):S452-S466.), a silent disease which has required special attention for public health since it represents high expenses for its prevention and treatment, and is associated with increased risk of falls, disability, decreased quality of life, as well as increased risk of mortality (Mata et al., 2012Mata PR, Martins PA, Brito LG, Ramos MMP, Junior MCS. Tratamento farmacológico para a osteoporose. Rev Bras Geriatr Gerontol. 2012;6(4)422-431.).
Sodium alendronate is an example of a medicine which has several particularities in its use and can significantly interfere with its effectiveness and safety.
For example, its ingestion should be taken with a full glass of water after fasting, and the patient should not sit or lie down within 30 minutes of taking the medicine (Radominski et al., 2017Radominski SC, Bernardo W, Paula AP, Albergaria BH, Moreira C, Fernandes CE, et al. Diretrizes brasileiras para o diagnóstico e tratamento da osteoporose em mulheres na pós- menopausa. Rev Bras Reumatol. 2017;57(S2):S452-S466.). Non-adherence to these recommendations compromises the therapeutic effect, and increases the risk of adverse reactions such as dyspepsia, nausea/vomiting, abdominal pain, esophagitis and esophageal stenosis (Mackay et al., 1998Mackay FJ, Wilton LV, Pearce GL, Freemantle SN, Mann RD. United Kingdom experience with alendronate and oesophageal reactions. Br J Gen Pract. 1998;48(429):1161-1162.).
Studies on adherence to guidance by users of sodium alendronate are still scarce. However, a study conducted by Camargo, Minosso and Lopes, showed that numerous guidelines for the correct use of sodium alendronate were not provided to patients by medical professionals. Only 28.0% of physicians said they advised their patients that the medicine should be taken with a full glass of water (Camargo, Minosso, Lopes, 2007Camargo EP, Minosso M, Lopes LC. Caracterização do uso de alendronato de sódio no tratamento de osteoporose por clínicos da rede privada de duas cidades do interior de São Paulo. Rev Ciênc Farm Básica Apl. 2007;28(1)77-83.).
Knowing the profile of medicine use in populations is one of the objectives of drug utilization studies. In this sense, they allow the identification of possible pharmacotherapeutic problems and generate information that is fundamental for the promotion of RUM (Griep et al., 2003Griep RH, Chor D, Faerstein E, Lopes C. Confiabilidade teste-reteste de aspectos da rede social no Estudo Pró-Saúde. Rev. Saúde Pública. 2003;37(3):379-85.). The quality of epidemiological studies, including drug utilization studies, is dependent on valid and reliable measuring instruments. Reliability is the ability of an instrument to faithfully measure a phenomenon. One of the ways to assess reliability is test- retest, in which the same questionnaire is applied to the same individual at different times (Griep et al., 2003Griep RH, Chor D, Faerstein E, Lopes C. Confiabilidade teste-reteste de aspectos da rede social no Estudo Pró-Saúde. Rev. Saúde Pública. 2003;37(3):379-85.). As far as we know, there is still no instrument to measure the correct use of sodium alendronate in populations. Therefore, the present study proposes indicators to evaluate the correct use of sodium alendronate, as well as to evaluate the reliability of these indicators.
MATERIAL AND METHODS
Study design and setting
This is a test-retest reliability study. This study is part of a survey conducted with elderly patients (60+ years old) using sodium alendronate, being users of the Brazilian public health service in the municipality of Divinópolis, Minas Gerais state, Brazil, between October 2014 and May 2016.
Data collection was performed through questionnaires in face-to-face in-home interviews by previously trained interviewers. For the training, material for study and instructions of a theoretical nature were available, and face-to-face interview simulations were made. The theoretical material consisted of a detailed manual to guide the accomplishment of the interview and completion of the questionnaire, based on pre-tests and a pilot study, carried out before the beginning of data collection. All participants read and signed the Informed Consent Form before the interview. After data collection, all questionnaires were typed (double-typing) into Epi Info software, version 7.2.
After completion of the first interview (test), all participants were asked to respond again to questions regarding the correct use of sodium alendronate (retest). The retest occurred between 7 and 14 days after the test. It is worth noting that there are no standardized periods for applying the retest, but in order to avoid memory effect or changes in the behavior of the participant that have an impact on their responses, this period is recommended and used by most of the studies of reliability (Martins, 2006Martins GA. Sobre confiabilidade e validade. Rev Bras Gestão Negócios. 2006;8(20):1-12.). The participants were not informed about what issues they would respond to in the retest, so that they would not be able to remember any response.
Study variables
Correct use of sodium alendronate
The questions to evaluate the correct use of sodium alendronate were proposed from a literature review and analyzed by a committee of three judges with expertise in the subject of interest, with making adjustments regarding the technical content and format of the questions being possible. The judges are PhDs in Pharmaceutical Sciences, knowledgeable about osteoporosis, and active in clinical pharmacy. The questions were pre-tested and a pilot study was carried out through the application of the questionnaire to 10 users, men and women, in order to test the comprehension of the questions asked.
Ultimately, six questions on the correct use of sodium alendronate were used and inserted into a questionnaire (questionnaire for correct use of sodium alendronate):
-
“What time of the day do you take this medicine?” Answer options: morning; evening; night.
-
“How do you take this medicine?” Answer options: with any food (liquid or solid); fasting; as soon as I wake up.
-
“With what liquid do you take this medicine?” Answer options: with a full glass of water (American glass); with less than one glass of water (less than one American glass); with milk; with juice; with tea; with coffee; I do not use any liquid to take the tablet.
-
“How do you ingest sodium alendronate?” Answer options: swallow whole; dissolve in the mouth before swallowing; chew the tablet and then swallow; dissolve the tablet in a glass of water, for example, before swallowing; other.
-
“After taking sodium alendronate, what do you do?” Answer options: lie down; sit down; stand or walk until the time of the first meal of the day.
-
“After you use sodium alendronate, how long will you wait to eat the first meal of the day?” Response options: eat immediately after use of the tablet; wait at least 30 minutes for the first meal.
Socio-demographic and economic characteristics
These characteristics were evaluated by means of self-reporting, and the participants were classified according to age group (60-69/70-79/80+ years); schooling (never attended school/completed elementary school/ completed high school); self-reported race/color (white/ black/brown/Asian descent or indigenous); and private healthcare plan (yes/no).
Statistical analysis
Initially, the study population was distributed according to socio-demographic and economic characteristics by means of frequencies. The test-retest reliability was evaluated by percentage of concordance and the Kappa statistic. The 95% confidence intervals (95% CI) for the Kappa values were estimated. The Altman criteria were used for the interpretation of the
Kappa statistic: poor agreement: -1 to 0.2; weak: 0.2 to 0.4; moderate: 0.4 to 0.6; good: 0.6 to 0.8; very good: 0.8 to 1.0 (Altman, 1991Altman DG. Practical Statistics for Medical Research. London: Chapman and Hall; 1991.). All analysis were performed with Stata 14 software.
Ethical aspects
This study was approved by the Research Ethics Committee of the Federal University of São João del Rei (number: 27582214.9.00005545).
RESULTS AND DISCUSSION
Of the 779 elderly women eligible to participate in the study, 248 responded to the test. Of these, 74 (29.9%) initially accepted to participate in the retest, but 17 were not located or gave up at the time of the interview, thus totaling 57 (23.0%) elderly women who completed the research protocol (Figure 1). The mean time between the test and the retest was 9.3 days (SD =2.5 days).
The mean age was 69.3 years (SD = 6.9 years), the majority had low education (92.5%), were self-declared white (50.9%), and approximately half (49.1%) had a private health care plan (Table I).
In general, the questions presented high concordance, ranging from 79.0% to 98.3% and Kappa values ranged from 0.1 (poor) to 0.83 (very good) (Table II).
The question “After taking sodium alendronate, what do you do?” presented very good agreement, and the question “How do you ingest sodium alendronate?” presented good agreement. These results suggest that these questions may not present much subjectivity and therefore have been better understood by participants, in addition to the interviewees having prior knowledge about the guidelines.
The questions “How do you take this medicine?”; “With what liquid do you take this medicine?”; and “After you use sodium alendronate, how long will you wait to eat the first meal of the day?” showed moderate agreement. Some hypotheses may be used to explain this result: the question “How do you take this medicine?” may have been influenced by the subjectivity of the response options, since the term fasting may have different interpretations and generated confusion in answering the question. The question “With what liquid do you take this medicine?” may have been influenced by the amount of response options, which can knowingly influence the quality of the question, make it difficult for the respondent to answer, and as a consequence, reduce reliability (Terwee et al., 2012Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651-657.). The question “After you use sodium alendronate, how long will you wait to eat the first meal of the day?” may have been influenced by the size and difficulty of interpreting the question.
Only the question “What time of the day do you take this medicine?” presented poor reliability (≥0.1) and a high agreement percentage (94.5%), since only one of the respondents presented different answers between the test and the retest. It is known that one of the limitations of the Kappa statistic is that the result can be influenced by the marginal totals being symmetrically unbalanced, which leads to a high concordance percentage and a low Kappa value (Feinstein, Cicchetti, 1990Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543-9.). However, even with the low Kappa value, we do not believe that the question cannot be used in epidemiological studies and clinical practice, since it is not difficult to understand.
It is necessary to present some limitations of the present study. It is suggested that samples of reliability studies have at least 100 participants (Terwee et al., 2012Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651-657.). Thus, our sample of 57 participants limited the ability to evaluate the results stratified by characteristics that may influence reliability, for example, schooling and age. It is worth mentioning that studies show that individuals with more advanced age and a lower level of education tend to have greater difficulty answering some questionnaires (Pilger, Menon, Mathias, 2011Pilger C, Menon MH, Mathias TAF. Características sociodemográficas e de saúde de idosos: contribuições para os serviços de saúde. Rev Latino-Am Enfermagem. 2011;19(5):1-12.), which may have compromised the understanding of some questions and generated confusion in choosing the answer, reducing the agreement of some questions of the questionnaire. Generally, a good part of the population of sodium alendronate users are public health system users and have, on average, high age and low schooling. In addition, our study population is composed of only women, which was expected, since the prevalence of osteoporosis is much higher among women (17.0%) than men (7.0%) (Fontes, Araujo, Soares, 2012Fontes TMP, Araujo LFB, Soares PRG. Osteoporose no climatério I: epidemiologia, definição, rastreio e diagnóstico. Femina. 2012;40(2):109-116.). Therefore, it is expected that the number of female users of sodium alendronate will be much higher than that of males. Women are also the main users of health services and preventive treatments (Pinheiro et al., 2002Pinheiro RS, Viacava F, Travassos C, Brito AS. Gênero, morbidade, acesso e utilização de serviços de saúde no Brasil. Ciênc Saúde Colet. 2002;7(4):687-707.), as well as tend to participate more frequently in health surveys than men (Aquino et al., 2013Aquino EML, Araujo MJ, Almeida MCC, Conceição P, Andrade CR, Cade, NV, et al. Recrutamento de participantes no Estudo Longitudinal de Saúde do Adulto. Rev Saúde Pública. 2013;47(Supl 2):10-8.). Thus, we believe that our results support the use of these questions for this population, which in general are women, with a high age and low educational level.
Finally, questions to assess the correct use of sodium alendronate were included in a larger survey in the first interview (test), which had an average duration of 30 minutes. Thus, time may have generated fatigue and wear on the participants, leading to different responses at the two different times, impacting differently on reliability. Two interviewers participated in the survey, which may have led to inter-interviewer interference, which sought to be reduced by prior training and standardization of the interviews.
On the other hand, we emphasize that as far as we know there are no instruments that are able to evaluate the use of sodium alendronate. The use of questionnaires in data collection in epidemiological studies, as well as in clinical practice, is quite frequent since they are non- invasive, and in general easy to apply (Pilatti, Pedroso, Gutierrez, 2010Pilatti L.A, Pedroso B, Gutierrez G.L. Propriedades Psicométricas de Instrumentos de Avaliação: Um debate necessário. Rev Bras Ensino Cienc Tecnol. 2010;3(1):81-91.). The development of instruments such as those evaluated in this study is an interesting strategy to evaluate how sodium alendronate is being used. This is because it is a quick and easy to apply questionnaire that can also be easily applied during medicine dispensing. This study therefore innovates since it proposes quick and simple questions to evaluate the quality of the use of sodium alendronate and that the questions presented adequate reliability.
The concordance and Kappa percentage values found suggest adequate reliability of the six proposed questions as indicators of the correct use of sodium alendronate. In this sense, we suggest that the proposed questions can be used as a simple and quick way to evaluate the quality of use of sodium alendronate among the elderly, and thus contribute to strategies to promote the correct use of this medicine.
ACKNOWLEDGMENTS
We thank the participants of this study for agreeing to participate and donating part of their time, for this study to be possible. We are grateful to the Foundation for Research Support of the State of Minas Gerais (FAPEMIG) for the scholarship grant, and the Federal University of São João del Rei (UFSJ) for institutional support.
REFERENCES
- Altman DG. Practical Statistics for Medical Research. London: Chapman and Hall; 1991.
- Aquino EML, Araujo MJ, Almeida MCC, Conceição P, Andrade CR, Cade, NV, et al. Recrutamento de participantes no Estudo Longitudinal de Saúde do Adulto. Rev Saúde Pública. 2013;47(Supl 2):10-8.
- Camargo EP, Minosso M, Lopes LC. Caracterização do uso de alendronato de sódio no tratamento de osteoporose por clínicos da rede privada de duas cidades do interior de São Paulo. Rev Ciênc Farm Básica Apl. 2007;28(1)77-83.
- Escher A, Coutinho T. Uso racional de medicamentos, farmaceuticalização e usos do metilfenidato. Ciênc Saúde Coletiva. 2017;22:2571-2580.
- Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543-9.
- Fontes TMP, Araujo LFB, Soares PRG. Osteoporose no climatério I: epidemiologia, definição, rastreio e diagnóstico. Femina. 2012;40(2):109-116.
- Griep RH, Chor D, Faerstein E, Lopes C. Confiabilidade teste-reteste de aspectos da rede social no Estudo Pró-Saúde. Rev. Saúde Pública. 2003;37(3):379-85.
- Mackay FJ, Wilton LV, Pearce GL, Freemantle SN, Mann RD. United Kingdom experience with alendronate and oesophageal reactions. Br J Gen Pract. 1998;48(429):1161-1162.
- Mahamood A, Elneour AA, Ali AAA, Hassan N, Shehab A, Bhagavathula AS. Evaluation of rational use of medicines (RUM) in four government hospitals in UAE. Saudi Pharm J. 2016;24(2):189-196.
- Martins GA. Sobre confiabilidade e validade. Rev Bras Gestão Negócios. 2006;8(20):1-12.
- Mata PR, Martins PA, Brito LG, Ramos MMP, Junior MCS. Tratamento farmacológico para a osteoporose. Rev Bras Geriatr Gerontol. 2012;6(4)422-431.
- Pilatti L.A, Pedroso B, Gutierrez G.L. Propriedades Psicométricas de Instrumentos de Avaliação: Um debate necessário. Rev Bras Ensino Cienc Tecnol. 2010;3(1):81-91.
- Pilger C, Menon MH, Mathias TAF. Características sociodemográficas e de saúde de idosos: contribuições para os serviços de saúde. Rev Latino-Am Enfermagem. 2011;19(5):1-12.
- Pinheiro RS, Viacava F, Travassos C, Brito AS. Gênero, morbidade, acesso e utilização de serviços de saúde no Brasil. Ciênc Saúde Colet. 2002;7(4):687-707.
- Radominski SC, Bernardo W, Paula AP, Albergaria BH, Moreira C, Fernandes CE, et al. Diretrizes brasileiras para o diagnóstico e tratamento da osteoporose em mulheres na pós- menopausa. Rev Bras Reumatol. 2017;57(S2):S452-S466.
- Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651-657.
- WHO - World Health Organization. Perspectivas políticas de la OMS sobre medicamentos. Promoción del uso racional de medicamentos: componentes centrales [Internet] Genebra: OMS; 2002 [citad 2018 Nov 11]. Available from: Available from: http://apps.who.int/medicinedocs/pdf/s4874s/s4874s.pdf
» http://apps.who.int/medicinedocs/pdf/s4874s/s4874s.pdf
Publication Dates
-
Publication in this collection
20 Apr 2022 -
Date of issue
2022
History
-
Received
19 Feb 2019 -
Accepted
29 Sept 2019