Strategies to increase the sensitivity of pharmacovigilance in Portugal

Abstracts

OBJETIVO: Avaliar os resultados de intervenção para melhoria da quantidade e relevância das notificações de reacções adversas a medicamentos. MÉTODOS: Foi implementado um estudo controlado aleatorizado, por agrupamentos em farmacêuticos a exercer actividade profissional na região norte de Portugal, em 2007. Após aleatorização, 364 indivíduos foram alocados ao grupo de intervenção (261 na intervenção telefónica e 103 nos workshops); o grupo de controlo foi constituído por 1.103 farmacêuticos. Na intervenção educativa foram abordados a problemática das reacções adversas a medicamentos, o impacto na saúde pública e a notificação espontânea. Quanto à relevância, as reações adversas foram classificadas em graves e inesperadas. A análise estatística foi efectuada com base no princípio intention-to-treat; aplicaram-se modelos lineares generalizados mistos, utilizando o método penalized quasi-likelihood. Os farmacêuticos estudados foram seguidos durante um período de 20 meses. RESULTADOS: A intervenção aumentou três vezes a taxa de notificação espontânea das reações adversas (RR = 3,22; IC 95%: 1,33; 7,80) relativamente ao grupo de controlo. Houve incremento da relevância das notificações com aumento das reações adversas graves em cerca de quatro vezes (RR = 3,87; IC 95%: 1,29;11,61) e inesperadas em cinco vezes (RR = 5,02; IC 95%: 1,33;18,93), relativamente ao grupo de controlo. CONCLUSÕES: As intervenções educativas aumentam significativamente, por até quatro meses, a quantidade e a relevância das notificações espontâneas de reacções adversas a medicamentos por parte dos farmacêuticos da região norte de Portugal.

Preparações Farmacêuticas; Sistemas de Notificação de Reações Adversas a Medicamentos; Toxicidade de Drogas; Sistemas de Notificação de Reações Adversas a Medicamentos; Estudos de Intervenção; Educação em Saúde; Vigilância Sanitária

ORIGINAL ARTICLES

Strategies to increase the sensitivity of pharmacovigilance in Portugal^*

Estrategias para aumentar la sensibilidad de la farmacovigilancia en Portugal

Inês Ribeiro-Vaz^I; Maria Teresa Herdeiro^II; Jorge Polónia^I; Adolfo Figueiras^III

^IUnidade de Farmacovigilância do Norte. Faculdade de Medicina. Universidade do Porto. Porto, Portugal

^IIInstituto Politécnico de Saúde do Norte. Cooperativa de Ensino Superior, Politécnico e Universitário. Gandra (Paredes), Portugal

^IIIUniversidade de Santiago de Compostela. Santiago de Compostela, Galizia, España

Correspondence

ABSTRACT

OBJECTIVE: To evaluate the results of an intervention to improve the number and relevance of reports of adverse drug reactions.

METHODS: A cluster-randomized controlled trial was conducted with pharmacists working in Northern Portugal, in 2007. After randomization, 364 individuals were placed into the intervention group (261 in telephone interviews and 103 in workshops), while the control group was comprised of 1,103 pharmacists. The following were approached in the educational intervention: the problem of adverse drug reaction, the impact on public health and spontaneous reporting. With regard to relevance, adverse reactions were classified into severe and unexpected. Statistical analysis was performed, based on the intention-to-treat principle; generalized linear mixed models were applied, using the penalized quasi-likelihood method. The pharmacists studied were followed during a period of 20 months.

RESULTS: The intervention increased the rate of spontaneous reporting of adverse reactions three times (RR = 3.22; 95% CI 1.33;7.80), when compared to the control group. The relevance of reporting rose, with an increase in severe adverse reactions by approximately four times (RR = 3.87; 95% CI 1.29;11.61) and in unexpected adverse reactions by five times (RR = 5.02; 95% CI 1.33;18.93), compared to the control group.

CONCLUSIONS: During a period of up to four months, educational interventions significantly increased the number and relevance of spontaneous reporting of adverse drug reactions by pharmacists in Northern Portugal.

Descriptors: Pharmaceutical Preparations, adverse effects. Adverse Drug Reaction Reporting Systems. Drug Toxicity, prevention & control. Adverse Drug Reaction Reporting Systems. Intervention Studies. Health Education. Health Surveillance.

RESUMEN

OBJETIVO: Evaluar los resultados de intervención para mejoría de la cantidad y relevancia de las notificaciones de reacciones adversas a medicamentos.

MÉTODOS: Fue implementado un estudio controlado aleatorio, por agrupaciones de farmacéuticos que ejercen actividad profesional en la región norte de Portugal, en 2007. Posterior a la aleatoriedad, 364 individuos fueron distribuidos en el grupo de intervención (261 en la intervención telefónica y 103 en los workshops); el grupo control fue constituido por 1.103 farmacéuticos. En la intervención educativa fueron abordados la problemática de las reacciones adversas a medicamentos, el impacto en la salud pública y la notificación espontánea. Con relación a la relevancia, las reacciones adversas fueron clasificadas en graves e inesperadas. El análisis estadístico fue efectuado con base en el principio intention-to-treat; se aplicaron modelos lineares generalizados mixtos, utilizando el método penalized quasi-likelihood. Los farmacéuticos estudiados fueron seguidos durante un período de 20 meses.

RESULTADOS: La intervención aumentó tres veces la tasa de notificación espontánea de las reacciones adversas (RR=3,22; IC95%:1,33;7,80) con relación al grupo control. Hubo un incremento en la relevancia de las notificaciones con aumento de las reacciones adversas graves en cerca de cuatro veces (RR=3,87; IC95%:1,29;11,61) e inesperadas en cinco veces (RR=5,02; IC 95%: 1,33;18,93), con relación al grupo control.

CONCLUSIONES: Las intervenciones educativas aumentan significativamente, en hasta cuatro meses, la cantidad y la relevancia de las notificaciones espontáneas de reacciones adversas a medicamentos por parte de los farmacéuticos de la región Norte de Portugal.

Descriptores: Preparaciones Farmacéuticas, efectos adversos. Sistemas de Registro de Reacción Adversa a Medicamentos. Toxicidad de Medicamentos, prevención & control. Sistemas de Registro de Reacción Adversa a Medicamentos. Estudios de Intervención. Educación en Salud. Vigilancia Sanitaria.

INTRODUCTION

Adverse drug reactions (ADR) are a public health problem worldwide and an important cause of death and hospitalizations in developed countries, representing approximately 6.5% of all hospitalizations.^3,13,15

In effect, in the pre-commercialization phase, it is difficult to detect the majority of adverse reactions, namely those that are rare and those that are manifested in the long term. It is estimated that most serious adverse reactions are identified after approval of commercialization.¹²

Thus, it is essential to put into effect constant surveillance of drugs, after they are placed into the market, using pharmacovigilance activities. Following other European countries, the Portuguese Pharmacovigilance System covers all commercialized drugs, including vaccines, and it is particularly based on spontaneous (voluntary) reporting of suspected ADR by health professionals.

Spontaneous reporting is considered to be weak, scientifically speaking, when compared to the following post-commercialization surveillance methods: monitoring of prescription-event, cohort or case-control studies, and cluster-randomized controlled trials. However, spontaneous reporting of ADR is effective as it generates a safety sign, once each report is a source of information about the risk of commercialized drugs.

A major limitation of spontaneous reporting of ADR results from its being under-reported. In contrast with the proposed objectives of the World Health Organization (WHO) of 250 million reports/million inhabitants,

This problem persists, even with the regular qualification/sensitization activities that regional pharmacovigilance units (such as the Northern Pharmacovigilance Unit - UFN) perform with health professionals, approaching the theme of pharmacovigilance and spontaneous reporting of ADR.

Based on the results of a study that had been previously conducted,^8,9 a program for pharmacists of Northern Portugal was developed in 2007, using educational interventions. This program aimed to prevent the trend towards under-reporting, increasing the amount and relevance of the information about drug safety that was made available to the regulatory authorities.

Based on the reasons proposed by Inman¹¹ for under-reporting of ADR (Inman's seven deadly sins), it was concluded that the main obstacles to ADR reporting among pharmacists were as follows:

Complacency - very severe ADR are well documented in terms of drug commercialization;

Ignorance - only severe and unexpected ADR are reported;

Diffidence - only ADR that are positively associated with a certain drug are reported.

Educational interventions were designed, based on the attitudes of health professionals towards spontaneous reporting of ADR, identified by Herdeiro et al.,^7,8 using telephone interviews and workshops. The present study aimed to evaluate the results of an educational intervention, used to improve the number and relevance of reports of adverse drug reactions.

METHODS

A cluster-randomized controlled trial was conducted with pharmacists of Northern Portugal, in 2007. A control group was formed to eliminate potential sources of bias, caused by seasonal variations or vaccination campaigns that could result in an abnormal increase in the number of spontaneous reports of ADR.

The sample was comprised of 1,467 pharmacists, of which 92% worked in pharmacies and 8% in hospitals. In addition, the proportion of females predominated in this sample (79%).

The target population consisted of all community and hospital pharmacists working in the area covered by the Northern Regional Health Management (ARS-Norte). To achieve this, the database made available by the Portuguese Association of Pharmacies and the Portuguese Association of Hospital Pharmacists was consulted, in 2002. According to this database, there was information about a total of 1,446 pharmacists, belonging to 15 spatial groups that served as randomization unit. Throughout the study, corrections were made to the initial database, excluding inactive and deceased individuals (84), while including those who became active (105), totaling 1,467 pharmacists. In addition, a correction was made for individuals who had moved from the control group to the intervention group and vice-versa.

Professionals who were performing any of the following activities were excluded: exclusive teaching, administrative areas, pharmaceutical industry and pharmaceutical distribution companies; the northern pharmacovigilance unit; specialized hospitals; specific clinical services, such as medical genetic or histocompatibility centers.

The randomization unit was comprised of geographic spatial groups to eliminate cross-contamination between the control and intervention groups. Each spatial group consisted of pharmacists performing activities in a referral hospital and in community pharmacies in their area of influence.

The present study was designed before the reorganization of the Portuguese hospital model, with the creation of hospital centers, beginning in 2007. In this way, groups are based on individualized hospitals, rather than clustered in hospital centers. Such groups were created according to the five health sub-regions subject to ARS-Norte and having the smallest size possible, so as to minimize contamination between community pharmacies and hospitals. A total of five hospitals out of the 25 existing in the area of study were excluded as they were specialized. This could represent a contamination factor, once their area of influence includes the entire Northern region of Portugal. Of all 20 remaining hospitals, five were grouped because they were geographically very close to one another or because they were very small, resulting in 15 groups.

Differently from the majority of studies that form control and intervention groups at a ratio of 1:1, the present study opted for the inclusion of fewer groups in the intervention group, compared to the control one, due to economic reasons, thus obtaining an unequal randomization, at a ratio of 1:3, approximately.¹⁹

Next, the 15 groups were randomly distributed to form an intervention group (four groups) and a control group (11 groups). The intervention group was subsequently divided into two sub-groups, according to the intervention performed: telephone interview and workshop. Health professionals belonging to the 11 groups of the control group did not receive any of the previously mentioned interventions.

Workshop intervention

Interventions were performed between May 29 and June 26, 2007, in the regions of Vila Real, Macedo de Cavaleiros and Mirandela, including 48 (52%) pharmacists. Each session lasted approximately one hour, with a brief introduction about the problem of ADR and its impact on public health, followed by an approach of spontaneous reporting of ADR. Some of the attitudes and knowledge that pharmacists have about this issue were reported, based on the results of Herdeiro et al.⁸ Guidance on how to complete the ADR spontaneous report file, discussion about a practical case with participants, and completion of this file with the actual case by participants were performed. After the session, each participant was provided the following support materials, so that the process was established and facilitated: copy of the practical case, copy of the ADR spontaneous report file to be completed with the actual case, report file, UFN presentation pamphlet, and certificate of presence.

Telephone intervention

The telephone interview script was pre-tested in the region of Ovar (out of the intervention and control areas) with eight pharmacists (seven of whom performed community pharmacy activities and one, hospital pharmacy activities). The script was found to be efficient, enabling a flowing conversation between interviewer and pharmacist, and its initial format did not undergo changes.

Telephone interventions occurred between July 2 and 20, 2007, with pharmacists of the Porto and Bragança regions. Telephone calls lasted between four and 12 minutes, according to the pharmacist's participation. For each one, three attempts of contact were made, after which such contact was considered impossible, resulting in 36% of all contacted individuals. After the call, the following support materials were sent to participants: a thank-you letter, ADR spontaneous report file and UFN presentation pamphlet.

In all, 141 individuals effectively had an educational intervention. Thus, the global rate of participation obtained was 39%. The rate of participation in workshops was 46%, whereas telephone intervention totaled 36%.

Criteria of relevance of reported adverse reactions were established and those that were severe and unexpected and had a high level of probability were considered more relevant. A severe adverse reaction is that which causes death, poses risk to life, leads to or prolongs hospitalization, increases temporary or permanent incapacity and/or causes congenital anomalies. Unexpected adverse reactions are those not described in the respective summary of drug characteristics.

After validation, reports are evaluated by the regulatory authorities, when one of the following levels of probability is attributed to them: certain, probable, possible, improbable, conditional or non-classifiable.

All data were obtained from the UFN, coordinated by the Portuguese Authority of Drugs and Health Products and certified according to WHO directives. The expert responsible for the evaluation of adverse reactions was not aware of the study group to which each pharmacist belonged. Confidentiality was maintained during the entire study and data on those who made reports were changed into number codes. The UFN guaranteed that all ADR reports were followed in the study population, without losses during this follow-up. Post-intervention results were analyzed in four-month periods.

Statistical analysis was performed based on the intention-to-treat principle.¹⁰ Generalized linear mixed models were applied, using the penalized quasi-likelihood method,⁶ on three levels of observation: level 1 - the number of monthly spontaneous reports of ADR per pharmacist (dependent variable); level 2 - the individuals; and level 3 - spatial groups.

Randomization effects were considered both for individuals and spatial groups.

Due to the characteristics of the dependent variable, a Poisson generalized linear mixed model, adjusted according to the overdispersion parameter.⁶ To measure the intervention effect, a dichotomous variable (period) was created, with values ranging from 0 (for the basal period) to 1 (for the months between the beginning of the intervention and the end of the follow-up time). The intervention effect was evaluated by interacting the period variable with the group variable (with a value of 0 for the control group, 1 for the workshop intervention group and 2 for the telephone intervention group). This interaction enables the quantification of possible contamination of the control group by intervention, in addition to the basal differences among study groups.

Another variable with six categories (value of 0 for the basal period, value of 1 for the period of four months after intervention and values of 2, 3, 4 and 5 for the subsequent four-month periods) was created to analyze the duration of the intervention effect.

The SPSS^® software, version 14.0, was used to generate the database. Subsequently, the statistical analysis was conducted with the S-Plus^® software.

The results are expressed as relative risk (RR), with respective 95% confidence intervals (CI), indicating the number of times when the probability of reporting ADR increases.

The results are shown in terms of the number of times when the intervention increased the number and relevance of the ADR reports made in the UFN.

A previous authorization was requested to perform educational interventions in the ARS-Norte and Hospital Management Councils involved. The present study was approved by the Ethics Committees of each hospital (Processes 005015, from 13/03/2007, and 1539, from 25/05/2007). The ARS-Norte was informed about the interventions in all institutions involved.

RESULTS

There was a global increase in the number of ADR reports in the months of intervention, although this increase was not maintained throughout time. There was an increase in the rate of reporting in all four-month periods, except for the last one (Table 1).

The intervention increased the rate of spontaneous reporting of ADR three times (RR = 3.22; 95%CI 1.33;7.80), adjusted for basal values and place of work, compared to the control group. With regard to the reports, there was an increase in severe (RR = 3.87; 95%CI 1.29;11.61) and unexpected ADR reports (RR = 5.02; 95%CI 1.33;18.93) in the groups involved with interventions, compared to the control group.

Reports with a high level of probability did not have a statistically significant increase (Table 2).

DISCUSSION

Educational interventions conducted in workshops or telephone interviews significantly increased the number and relevance of spontaneous ADR reports by pharmacists of Northern Portugal.

However, as shown in other studies,^4,5,16 this increase loses significance throughout time. The population that can potentially make reports needs regular qualification courses to remain participative in the Portuguese Pharmacovigilance System. Based on the results of the present study, sensitization at every four months could be proposed, when loss of influence of intervention is identified.

With regard to the content of interventions, the importance of focusing on the attitudes associated with under-reporting of ADR is observed, so that an effective change occurs.² In addition, their effectiveness in terms of results could be due to the fact that these interventions have a highly interactive nature,¹⁸ especially because they include the discussion of a practical case, with the completion of an ADR report file in real time. The material provided to participants at the end of workshops and telephone interviews could also have had a key role in a successful intervention, contributing as a facilitating agent.¹

The results of workshop interventions must be analyzed with caution, because there may be an effect of contamination from continuous qualification activities developed by the UFN. Although the intervention designed for this study had its own characteristics, which distinguish it from common qualification courses developed by the UFN, the latter occurred in the sub-health area of Porto predominantly, which did not belong to the workshop intervention group.

It is believed that the only possible sources of error in the present study would be the cases of death or end of the professional activity of an individual who reported ADR during the study, whose information was not available. Nonetheless, these cases would not affect the accuracy of the number of ADR reports, although they could distort the rate of report per pharmacist.

In conclusion, a restructuring of regular activities of sensitization of health professionals is suggested, including telephone interview interventions, which had not been used until then. This aspect does not invalidate the continuity of normal in-person sensitization/qualification actions that the Regional Pharmacovigilance Unit regularly performs. Such actions must include the discussion about the attitudes of health professionals towards spontaneous reporting of ADR, in terms of the main reasons for under-reporting.

REFERENCES

• 1. Castel J, Figueras A, Pedrós C, Laporte J, Capellà D. Stimulating adverse drug reaction reporting: effect of a drug safety bulletin and of including yellow cards in prescription pads. Drug Saf. 2003;26(14):1049-55. DOI:10.2165/00002018-200326140-00005
• 2. Davis D, Thomson M, Oxman A, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700-5.
• 3. Einarson TR. Drug-related hospital admissions. Ann Pharmacother. 1993;27(7-8):832-40.
• 4. Figueiras A, Herdeiro M, Polónia J, Gestal-Otero JJ. An educational intervention to improve physician reporting of adverse drug reactions: a cluster-randomized controlled trial. JAMA. 2006;296(9):1086-93.
• 5. Gunderman RB, Phillips MD, Cohen MD. Improving clinical histories on radiology requisitions. Acad Radiol. 2001;8(4):299-303. DOI:10.1016/S1076-6332(03)80498-1
• 6. Heo M, Leon AC. Comparison of statistical methods for analysis of clustered binary observations. Stat Med. 2005;24(6):911-23. DOI:10.1002/sim.1958
• 7. Herdeiro MT, Figueiras A, Polónia J, Gestal-Otero JJ. Physicians' attitudes and adverse drug reaction reporting: a case-control study in Portugal. Drug Saf. 2005;28(9):825-33. DOI:10.2165/00002018-200528090-00007
• 8. Herdeiro MT, Figueiras A, Polónia J, Gestal-Otero JJ. Influence of pharmacists' attitudes on adverse drug reaction reporting: a case-control study in Portugal. Drug Saf. 2006;29(4):331-40. DOI:10.2165/00002018-200629040-00004
• 9. Herdeiro MT, Polónia J, Gestal-Otero JJ, Figueiras A. Improving the reporting of adverse drug reactions: a cluster-randomized trial among pharmacists in Portugal. Drug Saf. 2008;31(4):335-44. DOI:10.2165/00002018-200831040-00007
• 10. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999;319(7211):670-4.
• 11. Inman W. Assessment drug safety problems. In: Gent MSI, editor. Epidemiological issues in reported drug-induced illnesses. Honolulu: McMaster University Library Press; 1976. p.17-24.
• 12. Lasser KE, Allen PD, Woolhandler SJ, Himmelstein DU, Wolfe SM, Bor DH. Timing of new black box warnings and withdrawals for prescription medications. JAMA. 2002;287(17):2215-20.
• 13. Lazarou J, Pomeranz BH, Corey PN. Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA. 1998;279(15):1200-5.
• 14. McGettigan P, Golden J, Conroy RM, Arthur N, Feely J. Reporting of adverse drug reactions by hospital doctors and the response to intervention. Br J Clin Pharmacol. 1997;44(1):98-100. DOI:10.1046/j.1365-2125.1997.00616.x
• 15. Pirmohamed M, James S, Meakin S, Green C, Scott AK, Walley TJ, et al. Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients. BMJ. 2004;329(7456):15-9.
• 16. Richards D, Toop L, Graham P. Do clinical practice education groups result in sustained change in GP prescribing? Fam Pract. 2003;20(2):199-206. DOI:10.1093/fampra/20.2.199
• 17. Smith CC, Bennett PM, Pearce HM, Harrison PI, Reynolds DJM, Aronson JK, et al. Adverse drug reactions in a hospital general medical unit meriting notification to the Committee on Safety of Medicines. Br J Clin Pharmacol. 1996;42(4):423-9. DOI:10.1111/j.1365-2125.1996.tb00004.x
• 18. Thomson O'Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Harvey EL. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000(2):CD000409.
• 19. Torgerson DJ, Campbell MK. Economics notes: cost effectiveness calculations and sample size. BMJ. 2000;321(7262):697.

ª

there were 175 reports/million inhabitants in Portugal, in 2008. Thus, information about ADR is scarce and it does not represent the reality of adverse events resulting from drug use. This problem is not exclusively found in Portugal and several studies suggest that less than 10% of ADR are reported to regulatory authorities.

^14,17

^b

^c

In the present study, reports to which the probable or certain levels were attributed were considered relevant.

Publication Dates

• Publication in this collection
  12 Nov 2010
• Date of issue
  Feb 2011

History

• Received
  10 Nov 2009
• Accepted
  27 July 2010