Acessibilidade / Reportar erro

Psychometric Properties of Brief Screening Tests for Alcohol Use Disorders during Pregnancy in Argentina

Propriedades psicométricas de instrumentos de triagem de consumo de álcool durante gestação na Argentina

Abstract

Background

Considering the physical, mental and behavioral problems related to fetal alcohol exposure, prenatal clinical guides suggest a brief evaluation of alcohol consumption during pregnancy to detect alcohol intake and to adjust interventions, if required. Even if any alcohol use should be considered risky during pregnancy, identifying women with alcohol use disorders is important because they could need a more specific intervention than simple advice to abstain. Most screening tests have been developed and validated in male populations and focused on the long-term consequences of heavy alcohol use, so they might be inappropriate to assess consumption in pregnant women.

Objective

To analyze the internal reliability and validity of the alcohol screening instruments Alcohol Use Disorders Identification Test (AUDIT), Alcohol Use Disorders IdentificationTest- Consumption (AUDIT-C), Tolerance, Worried, Eye-Opener, Amnesia and Cut-Down (TWEAK), Rapid Alcohol Problems Screen - Quantity Frequency (RAPSQF) and Tolerance, Annoyed, Cut-Down and Eye-Opener (T-ACE) to identify alcohol use disorders in pregnant women.

Methods

A total of 641 puerperal women were personally interviewed during the 48 hours after delivery. The receiver operating characteristics (ROC) curves and the sensitivity and specificity of each instrument using different cut-off points were analyzed.

Results

All instruments showed areas under the ROC curves above 0.80. Larger areas were found for the TWEAK and the AUDIT. The TWEAK, the T-ACE and the AUDIT-C showed higher sensitivity, while the AUDIT and the RAPS-QF showed higher specificity. Reliability (internal consistency) was low for all instruments, improving when optimal cut-off points were used, especially for the AUDIT, the AUDIT-C and the RAPS-QF.

Conclusions

In other cultural contexts, studies have concluded that T-ACE and TWEAK are the best instruments to assess pregnant women. In contrast, our results evidenced the low reliability of those instruments and a better performance of the AUDIT in this population.

Keywords:
alcoholic beverages; screening; pregnancy; women; Argentina

Resumo

Introdução

Considerando os problemas físicos, mentais e comportamentais relacionados à exposição fetal ao álcool, as orientações clínicas pré-natais sugerem uma breve avaliação do consumo de álcool durante a gravidez para detectar o consumo de álcool e ajustar as intervenções, se necessário. Ainda que qualquer uso de álcool deva ser considerado arriscado durante a gravidez, identificar as mulheres com transtornos de uso de álcool é importante, porque elas podem precisar de uma intervenção mais específica do que um simples conselho para se abster. A maioria dos testes de triagem tem sido desenvolvidos e validados em populações masculinas, e estão focados nas consequências em longo prazo do uso excessivo de álcool, de modo que eles podem ser inadequados para avaliar o consumo em mulheres grávidas.

Objetivo

Analisar a confiabilidade e a validade internas dos instrumentos de triagem de álcool Alcohol Use Disorders Identification Test (AUDIT), Alcohol Use Disorders Identification Test - Consumption (AUDIT-C), Tolerance, Worried, Eye-Opener, Amnesia and Cut-Down (TWEAK), Rapid Alcohol Problems Screen - Quantity Frequency (RAPS-QF) e Tolerance, Annoyed, Cut-Down and Eye-Opener (T-ACE) para identificar transtornos por uso de álcool em mulheres grávidas.

Método

Um total de 641 puérperas foram entrevistadas pessoalmente durante as 48 horas após o parto. As curvas receiver operating characteristic (ROC), a sensibilidade e a especificidadede cada instrumento foramanalisadas utilizandodiferentespontosde corte. Resultados Todos os instrumentos mostraram áreas sob as curvas ROC acima de 0.80. Foram encontradas áreas maiores para o TWEAK e para o AUDIT. O TWEAK, o TACE e o AUDIT-C apresentaram maior sensibilidade, enquanto o AUDIT e o RAPS-QF apresentaram maior especificidade. A confiabilidade (consistência interna) foi baixa para todos os instrumentos, melhorando quando foram utilizados pontos de corte ótimos, especialmente para o AUDIT, o AUDIT-C e o RAPS-QF.

Conclusões

em outros contextos culturais, estudos concluíram que o T-ACE e o TWEAK são os melhores instrumentos para avaliar mulheres grávidas. Em contrapartida, nossos resultados evidenciaram baixa confiabilidade desses instrumentos e melhor desempenho do AUDIT nessa população.

Palavras-chave:
bebidas alcoólicas; triagem; gravidez; mulheres; Argentina

Introduction

From the first descriptions of serious developmental problems in children of alcoholic mothers in the 1970s,11 Lemoine P, Harousseau H, Borteyru JP, Menuet JC. Children of alcoholic parents-observed anomalies: discussion of 127 cases. Ther Drug Monit 2003;25:132-136 22 Jones KL, Smith DW, Ulleland CN, Streissguth P. Pattern of malformation in offspring of chronic alcoholic mothers. Lancet 1973; 1(7815):1267-1271 the literature in the field grew quickly, evidencing a wide spectrum of damages associated with heavy prenatal alcohol exposure.33 O'Leary C. Fetal alcohol syndrome. A literature review: Canberra: Commonwealth of Australia; 2002 Available at: https://www. flourishpaediatrics.com.au/docs/fnational-drug-straegy-fetal-alcohol-syndrome-a-literature-review-etalcsyn.pdf More recent studies have pointed out that moderate consumption is not harmless either.44 Gunzerath L, Faden V, Zakhari S, Warren K. National Institute on Alcohol Abuse and Alcoholism report on moderate drinking. Alcohol Clin Exp Res 2004;28(06):829-847 55 Lewis SJ, Zuccolo L, Davey Smith G, et al. Fetal alcohol exposure and IQ at age 8: evidence from a population-based birth-cohort study. PLoS One 2012;7(11):e49407 66 Windham GC, Fenster L, Swan SH. Moderate maternal and paternal alcohol consumption and the risk of spontaneous abortion. Epidemiology 1992;3(04):364-370 Prenatal alcohol exposure can lead to a wide spectrum of physical, mental, and conduct problems, encompassed in the term Fetal Alcohol Spectrum Disorders (FASD). Fetal Alcohol Syndrome (FAS), characterized by pre- and postnatal growth retardation, neurodevelopment problems evident in intellectual disabilities, and a set of facial abnormalities, is the most severe consequence of prenatal alcohol exposure.77 Stratton KR, Howe CJ, Battaglia FC. Fetal alcohol syndrome: diagnosis, epidemiology, prevention, and treatment. Washington (DC): Institute of Medicine/National Academy Press; 1996

The effects of alcohol exposure on the fetus depend on several factors, from the nutritional condition of the mother88 Carter RC, Jacobson JL, Sokol RJ, Avison MJ, Jacobson SW. Fetal alcohol-related growth restriction from birth through young adulthood and moderating effects of maternal prepregnancy weight. Alcohol Clin Exp Res 2013;37(03):452-462 99 Dreosti IE. Nutritional factors underlying the expression of the fetal alcohol syndrome. Ann N Y Acad Sci 1993;678:193-204 to the genetic characteristics of the mother and the child.1010 Bonthius DJ, Bonthius NE, Li S, Karacay B. The protective effect of neuronal nitric oxide synthase (nNOS) against alcohol toxicity depends upon the NO-cGMP-PKG pathway and NF-kappaB. Neurotoxicology 2008;29(06):1080-1091 1111 Schneider ML, Moore CF, Barr CS, Larson JA, Kraemer GW. Moderate prenatal alcohol exposure and serotonin genotype interact to alter CNS serotonin function in rhesus monkey offspring. Alcohol Clin Exp Res 2011;35(05):912-920 Thus, to this day, a safe dose of alcohol consumption during pregnancy has not been established. Therefore, official recommendations about drinking during pregnancy are changing globally and progressively from moderate consumption to abstinence. Nevertheless, and despite public efforts to reduce the prevalence of alcohol consumption in women of childbearing age and during pregnancy, many women continue to drink during pregnancy, and some of them are heavy drinkers. Alcohol consumption during pregnancy in the United States ranges from 10 to 12%.1212 Krulewitch CJ. Alcohol consumption during pregnancy. Annu Rev Nurs Res 2005;23:101-134 In some Latin-American countries like Uruguay and Argentina, the prevalence is much higher, ranging from 401313 Magri R, Míguez H, Parodi V, et al. Consumo de alcohol y otras drogas en embarazadas. Arch Pediatr Urug 2007;78(02):122-132 to 75%.1414 López MB, Filippetti VA, Cremonte M. Alcohol consumption before and during pregnancy in Argentina: prevalence and risk factors. Rev Panam Salud Publica 2015;37(4-5):211-217

To articulate massive information campaigns on the topic with individual counseling and intervention, an accurate screening tool is fundamental. Indeed, prenatal alcohol consumption screening is recommended in prenatal care clinical guides.1515 National Collaborating Centre for Women's and Children's Health [Internet]. Antenatal care: routine care for the healthy pregnant woman. London: RCOG; 2008 [cited 2016 Aug 26]. Available from: https://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0009601/pdf/ PubMedHealth_PMH0009601.pdf 1616 World Health Organization. Guidelines for the identification and management of substance use and substance use disorders in pregnancy. Geneva: WHO; 2014 Some studies suggest that screening itself could reduce alcohol consumption,1717 McCambridge J, Day M. Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction 2008;103(02):241-248 but knowing tightly the level of consumption and related problems of each woman would enable the administration of adequate interventions. Although during pregnancy any level of consumption is risky, identifying alcohol use disorders (AUDs) among pregnant women is important because women with AUDs could need targeted interventions, such as the referral to a specialized treatment, or close monitoring.1616 World Health Organization. Guidelines for the identification and management of substance use and substance use disorders in pregnancy. Geneva: WHO; 2014

Screening tools have some advantages over directly inquiring the quantity and the frequency of alcohol consumption. By focusing on the indirect effects of drinking, the defensiveness and the consumption underreport, which are common among pregnant women, could be reduced.1818 Mengel MB, Searight HR, Cook K. Preventing alcohol-exposed pregnancies. J Am Board Fam Med 2006;19(05):494-505 However, most of the available alcohol screening tools have been developed and tested in male populations, and focused on the social consequences of heavy and long-term alcohol use.1818 Mengel MB, Searight HR, Cook K. Preventing alcohol-exposed pregnancies. J Am Board Fam Med 2006;19(05):494-505 Considering the biological1919 Baraona E, Abittan CS, Dohmen K, et al. Gender differences in pharmacokinetics of alcohol. Alcohol Clin Exp Res 2001;25(04): 502-507 2020 Thomasson HR. Gender differences in alcohol metabolism. Physiological responses to ethanol. Recent Dev Alcohol 1995;12:163-179 and cultural2121 Wilsnack RW, Vogeltanz ND, Wilsnack SC, et al. Gender differences in alcohol consumption and adverse drinking consequences: crosscultural patterns. Addiction 2000;95(02):251-265 differences related to alcohol consumption between men and women, a screening tool developed for male populations could not be accurate for female populations. Hence, the cut-off points used to distinguish a positive from a negative result in a screening tool made to be used in male populations could not be appropriate to identify alcohol problems in female populations.

The need for an appropriate assessment tool to use in prenatal care led to the development of some specific instruments for this population. The first of these instruments was the Tolerance, Annoyed, Cut-Down and Eye-Opener (T-ACE), designed to detect risky drinking during pregnancy, which is defined as the consumption of 1 ounce (∼ 30 mL) or more of alcohol per day.2222 Sokol RJ, Martier SS, Ager JW. The T-ACE questions: practical prenatal detection of risk-drinking. Am J Obstet Gynecol 1989; 160(04):863-868, discussion 868-870 The second one was the Tolerance, Worried, Eye-Opener, Amnesia and Cut-Down (TWEAK), designed to detect alcoholism or heavy drinking,2323 Russell M, Bigler L. Screening for alcohol-related problems in an outpatient obstetric-gynecologic clinic. Am J Obstet Gynecol 1979;134(01):4-12 which proved useful in identifying risky drinking among pregnant women.2424 Russell M. New assessment tools for risk drinking during pregnancy: T-ACE and TWEAK, and others. Alcohol Health Res World 1994;18(01):55-61 Both instruments have been found to be particularly sensitive and specific for pregnant women when compared with other screenings tools.1818 Mengel MB, Searight HR, Cook K. Preventing alcohol-exposed pregnancies. J Am Board Fam Med 2006;19(05):494-505 2525 Burns E, Gray R,Smith LA. Brief screening questionnaires to identify problem drinking during pregnancy: a systematic review. Addiction 2010;105(04):601-614 Nevertheless, psychometric studies are scarce, and they are mostly concurrent validity studies, and studies performed in the United States.2626 Moraes CL, Viellas EF, Reichenheim ME. Assessing alcohol misuse during pregnancy: evaluating psychometric properties of the CAGE, T-ACE and TWEAK in a Brazilian setting. J Stud Alcohol 2005;66(02):165-173 Besides, to our knowledge, the use of other screening tools like the Alcohol Use Disorders Identification Test (AUDIT),2727 Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction 1993;88(06):791-804 the Alcohol Use Disorders Identification Test – Consumption (AUDIT-C)2828 Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med 1998;158(16):1789-1795 and the Rapid Alcohol Problems Screen – Quantity Frequency (RAPS-QF)2929 Cherpitel CJ. Screening for alcohol problems in the emergency room: a rapid alcohol problems screen. Drug Alcohol Depend 1995;40(02):133-137 for identifying alcohol use or AUDs during pregnancy has not been established; furthermore, we have found no evidences of the reliability of any of these screening tools for pregnant women.

Thus, the present article aims at exploring the validity, internal reliability and item-level statistics of the following brief alcohol screening tests: AUDIT,2727 Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction 1993;88(06):791-804 AUDIT-C,2828 Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med 1998;158(16):1789-1795 TWEAK,2323 Russell M, Bigler L. Screening for alcohol-related problems in an outpatient obstetric-gynecologic clinic. Am J Obstet Gynecol 1979;134(01):4-12 RAPS-QF2929 Cherpitel CJ. Screening for alcohol problems in the emergency room: a rapid alcohol problems screen. Drug Alcohol Depend 1995;40(02):133-137 and T-ACE,2222 Sokol RJ, Martier SS, Ager JW. The T-ACE questions: practical prenatal detection of risk-drinking. Am J Obstet Gynecol 1989; 160(04):863-868, discussion 868-870 to identify AUDs among pregnant women in Argentina.

Methods

Participants

A probabilistic sample of puerperal women (N= 641) was personally interviewed in a private maternity unit and in the largest public (state-owned) maternity unit in the city of Santa Fe, Argentina. The participants were between the ages of 13 and 44 years (mean [M] = 25.6); most were living with theirs partners, either cohabiting (59%) or married (24.6%), and almost 1/3 were primiparas (35.7%), with the mean of previous children of 2.4 (standard deviation [SD] = 1.5).

Over half of the participants (53.7%) reported being housewives, and among those who were employed (33.6%), most had a part-time job (19.3%). The formal schooling level of the sample was low: 62% had less than 12 years of formal education, and only 10% had either completed or started graduate programs.

Instruments

The AUDIT is a 10-item instrument that aims at assessing: alcohol consumption (items 1 to 3), dependence (items 4 to 6) and alcohol consumption-related consequences (items 7 to10). It has a score ranging from 0 to 40, and it is used to identify AUDs and hazardous drinking. The AUDIT-C is a shortened version of the AUDIT that consists of items to assess alcohol consumption (items 1 to 3), and it is used to identify hazardous drinkers. Its score ranges from 0 to 12. The TWEAK consists of 5 items that evaluate: tolerance, worries about consumption, morning consumption, amnesia, and the need to cut down the consumption. Its score ranges from 0 to 7. The RAPS-QF is a 6-item short questionnaire that assesses remorse, amnesia, performance, morning consumption and quantity and frequency of consumption. Its score ranges from 0 to 6. Finally, the T-ACE is a 4-item instrument that assesses tolerance, annoyance, need to cut down drinking and morning consumption. Its score goes from 0 to 5.

The gold standard used for the diagnosis of AUDs was obtained from the Alcohol section of the Composite International Diagnostic Interview (CIDI). The CIDI3030 World Health Organization. Composite International Diagnostic Interview. Geneva: WHO; 1990 is the most widely used structured diagnostic interview.3131 Kessler RC, Ustün TB. The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res 2004;13(02):93-121 It has been translated by an editorial committee and validated in different countries,3232 Wittchen HU. Reliability and validity studies of the WHO-Composite International Diagnostic Interview (CIDI): a critical review. J Psychiatr Res 1994;28(01):57-84 showing very good performance in different contexts.3333 Tacchini G, Coppola MT, Musazzi A, Altamura AC, Invernizzi G. [Multinational validation of the Composite International Diagnostic Interview (CIDI)]. Minerva Psichiatr 1994;35(02):63-80

Procedure

Data were obtained through probabilistic systematic cluster sampling. The face-to-face interviews took place in the perinatal centers during the 48 hours after labor, from October 2010 to February 2011. Prospective participants were invited to participate in the study, and informed consent was obtained either from them or from their parents/legal guardians, when the women were underage. After the interview, a brochure on “breastfeeding and alcohol” containing relevant information was given and commented with each woman. The study obtained the ethical approval from the ethics committee of one of our institutions.

Data Analysis

Exploration of the receiver operating characteristic (ROC) curves, using the Statistical Package for the Social Sciences (SPSS, SPSS Inc., Chicago, IL, US) software, version 12.0, and the sensitivity and specificity for each scale at various cut-off points were used to determine the optimal cut off-point for each scale.

Sensitivity refers to the percentage of true positives, that is, participants who screened positive and were diagnosed with an AUD, while specificity refers to the percentage of true negatives, that is, participants who screened negative and were not diagnosed with an AUD. In addition, we included the predictive values and likelihood ratios, both measures of diagnostic accuracy. These estimates and their 95% confidence intervals (95%CIs) were obtained using the online site Vassar Stats.3434 Lowry R.Vassar Stats:Website for Statistical Computation[Internet]. 1998 [cited 2016 Aug 26]. Available from: http://vassarstats.net/
http://vassarstats.net/...

The internal consistency was estimated as a measure of reliability using Cronbach's alpha for the AUDIT, and the Kuder–Richardson Formula 20 (KR-20) for the other screening instruments. The confidence intervals for the internal consistency coefficients were estimated using ICalfa, a Microsoft Excel (Microsoft Corporation, Redmond, WA, US) module to estimate CIs for Cronbach's alpha.3535 Merino C. ICalfa: módulo Excel para estimar intervalos de confianza para alfa de Cronbach. Lima: Universidad de San Martín de Porres; 2015

Results

Areas under the ROC curve are presented in Fig. 1. All screening instruments had areas under the curve of over 0.80.The highest area under the curve was from the AUDIT, which was closely followed by the TWEAK.

Fig. 1
ROC Curve for Alcohol Use Disorders Screening Tests.

The optimal cut off-point for each scale was determined by exploring the sensitivity and specificity at each cut-off point, along with their sensitivity and specificity, predictive values and likelihood ratios for the optimal cut-off scores and their 95%CIs, their mean and standard deviation. That information, along with the internal consistency coefficients (and their 95%CIs), the reliability for the cut-off scores used, and the correlation of the brief screening tests with the AUDIT are presented in Table 1. Weighted by prevalence, the likelihood ratios indicated that a positive result on the tests increased the probability of an AUD as follows: AUDIT - 56%, AUDIT-C - 38%, TWEAK - 36%, RAPS-QF - 39% and T-ACE - 35% (data not shown in tables).

Table 1
Psychometric properties of the screening tests

The optimal score for cut-off for the AUDIT was 4, while for the AUDIT-C it was 3. The highest sensitivity was obtained for the TWEAK, and the T-ACE, followed by the AUDIT-C, while the AUDIT and the RAPS-QF had a higher specificity. The mean endorsement was somewhat similar for the AUDIT and the AUDIT-C, and lower for the other brief screening tests. The reliability (internal consistency) was somewhat low for the instruments, especially for the TWEAK and the T-ACE. The differences among internal consistency coefficients were statistically significant (AUDIT and TWEAK: X2= 66.47, df =1, p< .0001; AUDIT and RAPS-QF: X2= 43.33, df =1, p< .0001; AUDIT and T-ACE: X2= 116.74, df =1, p< .0001). However, the reliability increased when it was estimated for the optimal cut-off scores, with the AUDIT, AUDIT-C and RAPS-QF showing the highest values. The correlation of the brief screening tests with the AUDIT (as the longest measure) was very high for the AUDIT-C, and high for the TWEAK and the RAPS-QF. The discrimination index for each item of the AUDIT is presented in Table 2, and the proportion of the indicator presence, the item discrimination index, and the decimal reduction time (D-value) are presented in Table 3.

Table 2
Item discrimination indexa for the Alcohol Use Disorder Identification Test (AUDIT)
Table 3
Item analyses for brief screening tests

The items of the AUDIT with the highest performance were items 2 (number of drinks), 3 (frequency of heavy episodic drinking), and 8 (frequency of amnesia), while items 7 (remorse), 9 (harm from drinking), and 10 (concern of other people) had a poor performance. Regarding the frequency of endorsement for the brief screening tests, the most endorsed items were the first items of the TWEAK and the T-ACE (tolerance), and the quantity frequency (QF) item of the RAPS-QF. Less endorsed were the items that evaluate drinking in the morning (starter, or eye-opener), namely item 3 of the TWEAK, and item 4 of the RAPS-QF and the T-ACE. Regarding performance, items 4 and 5 of the TWEAK, 2 and 5 of the RAPS-QF, and 3 of the T-ACE had the highest item discrimination indexes. The tolerance item of the TWEAK and the T-ACE, the QF item of the RAPS-QF, and the amnesia item of the TWEAK had the best discrimination indexes. The ones with the poorest performance were those indicating morning drinking: the eye-opener item of the TWEAK and the T-ACE, and the starter item of the RAPS-QF.

Discussion

Areas under the Curve

Our results indicate that all instruments have satisfactory areas under the ROC curve, meaning that they all have a good overall ability to discriminate the participants with AUDs from those without it. The areas under the ROC curve found in this study were notably higher than those reported for the T-ACE,3636 Chang G, Wilkins-Haug L, Berman S, Goetz MA, Behr H, Hiley A. Alcohol use and pregnancy: improving identification. Obstet Gynecol 1998;91(06):892-898 and similar to those found for the AUDIT-C in pregnant women from the US.3737 Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived Alcohol Use Disorders Identification Test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res 2005;29(05):844-854 We could not find previous studies reporting ROC curve values for the TWEAK or the RAPS-QF in pregnant women that used AUD as a criterion.

Optimal Cut-Off Scores

The optimal cut-off point for the AUDIT was 4. This is a low value compared with other values reported in the literature for different populations,3838 Babor TF, Robaina K. The Alcohol Use Disorders Identification Test (AUDIT): a review of graded severity algorithms and national adaptations. Int J Alcohol Drug Res 2016;5(02):17-24 and it is likely due to the characteristics of the sample, considering that alcohol consumption and the problems related to it are expected to be minimal in pregnant women. Although the use of a lower cut-off point for the AUDIT when screening women is often suggested, most intervention studies tend to use a cut-off point of 7.3838 Babor TF, Robaina K. The Alcohol Use Disorders Identification Test (AUDIT): a review of graded severity algorithms and national adaptations. Int J Alcohol Drug Res 2016;5(02):17-24 Studies evaluating the optimal cut-off point for pregnant women are scarce.

Interestingly, the cut-off point for the AUDIT-C was very close to that of the complete version of the AUDIT. This is probably explained by the characteristics of the population, who present frequent high consumption, but not in the more severe end of the spectrum of alcohol problems.

The optimal cut-off points for the other screening tests were like the ones reported in the literature,2525 Burns E, Gray R,Smith LA. Brief screening questionnaires to identify problem drinking during pregnancy: a systematic review. Addiction 2010;105(04):601-614 probably because the TWEAK and the T-ACE were designed especially for this population.

Sensitivity and Specificity

The highest sensitivity was obtained for the TWEAK and the T-ACE, followed by the AUDIT-C, while the AUDIT and the RAPS-QF had higher specificity. The AUDIT also had the lowest probability of false positives, while false negatives had a low probability in all tests. The high sensitivity of the TWEAK and the T-ACE could be due to the fact that they consider as positive the question about tolerance with two standard units, and the studied population has shown a high level of consumption.1414 López MB, Filippetti VA, Cremonte M. Alcohol consumption before and during pregnancy in Argentina: prevalence and risk factors. Rev Panam Salud Publica 2015;37(4-5):211-217 Conversely, their lower specificity could be due to the same fact: Argentinean pregnant women tend to drink while not presenting other indicators of an AUD. The high specificity of the AUDIT and the RAPS-QF for AUDs in women was already found in prior studies with Hispanic emergency patients,3939 Cherpitel CJ, Bazargan S. Screening for alcohol problems: comparison of the audit, RAPS4 and RAPS4-QF among African American and Hispanic patients in an inner city emergency department. Drug Alcohol Depend 2003;71(03):275-280 and the AUDIT itself has shown high specificity with pregnant women.3636 Chang G, Wilkins-Haug L, Berman S, Goetz MA, Behr H, Hiley A. Alcohol use and pregnancy: improving identification. Obstet Gynecol 1998;91(06):892-898 In this study the sensitivity of the AUDIT was also high, but surprisingly lower than that of the AUDIT-C, a finding probably due to the lower cut-off score of the latter.

Instrument Endorsement

The mean of the scores was rather similar for the AUDIT and the AUDIT-C, likely due to the tendency of this population to endorse items referring to risky drinking, and the lower probability to endorse items evaluating alcohol-related problems. Nevertheless, it is not possible to know whether this aspect relates to their willingness to endorse a given item or criteria, or to their drinking practices and lesser degree of alcohol-related problems. As expected due to their brevity and reduced answer scale, the scores were lower for the other screening tests compared with the AUDIT.

Reliability

Reliability was somewhat low for all the instruments, but especially for the TWEAK and the T-ACE, showing an important degree of measurement error. However, the reliability improved when it was estimated for the optimal cut-off scores it improved, with the AUDIT, the AUDIT-C and the RAPS-QF having the highest scores. Similar results indicating the highest reliability for the AUDIT and the RAPS-QF were found in a previous study in Argentinean Emergency Department patients.4040 Cremonte M, Ledesma RD, Cherpitel CJ, Borges G. Psychometric properties of alcohol screening tests in the emergency department in Argentina, Mexico and the United States. Addict Behav 2010;35(09):818-825

Concurrent Validity

The correlation of the brief screening tests with the AUDIT (as the longest measure) was very high for the AUDIT-C, and high for the TWEAK and the RAPS-QF, indicating a better performance of these three short instruments over the T-ACE .

Properties of the Items

The items evaluating the number of drinks, the frequency of heavy episodic drinking, and the frequency of amnesia (namely items 2 and 3 of the AUDIT, item 5 of the RAPS-QF and 8 of the AUDIT, and item 4 of TWEAK and 2 of RAPS-QF respectively) showed the best overall performance (discriminating power) in all instruments. Heavy episodic drinking may indicate in pregnant women a higher degree of AUD severity than in other populations, as the condition of pregnancy often leads to a lower consumption.1414 López MB, Filippetti VA, Cremonte M. Alcohol consumption before and during pregnancy in Argentina: prevalence and risk factors. Rev Panam Salud Publica 2015;37(4-5):211-217 For its part, alcoholic amnesia (blackouts) has also been related to rapid consumption of high quantities, and in other Argentinean populations, such as university students or emergency patients, it has been closely associated with AUDs.4141 Conde K, Remaggi ML, Cremonte M. Alcohol y amnesia en universitarios de Argentina y España: prevalencia y predicción. Health Addict 2014;14(01):37-46

The tolerance question of the T-ACE and the TWEAK (first item of both tests) was among the most endorsed items, probably because both instruments use two drinks as a cut-off point in this question. The consumption characteristics of Argentinean pregnant women might have resulted in a high number of positive responses to the item. The less-endorsed items, which also showed poor performance, were the items evaluating morning consumption (item 6 of the AUDIT, 3 of the TWEAK, and item 4 of the T-ACE and the RAPS-QF). This is one of the most severe consequences of AUDs,4242 Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test (AUDIT): guidelines for use in primary care. Geneva: WHO; 2001 usually indicating physiological dependence, and it may not be representative of the population of pregnant women, as they usually do not show the characteristics of the most severe end of the AUD spectrum.4343 Conde K, Cremonte M, López MB, Cherpitel CJ. Gender and Alcohol Use Disorders Diagnostic Criteria in Emergency Department Patients of Argentina. Subst Use Misuse 2016;51(12): 1629-1636

We have analyzed the psychometric performance of the most used alcohol screening tests for AUD in Argentinean pregnant women, providing data that could be useful for the design of local prenatal screening strategies. Screening for prenatal alcohol consumption has proved to reduce alcohol intake during pregnancy,1717 McCambridge J, Day M. Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction 2008;103(02):241-248 particularly if it is combined with a brief intervention.4444 Chang G. Screening and brief intervention in prenatal care settings. Alcohol Res Health 2004-2005;28(02):80-84 Although it is still necessary to discuss the place of prenatal alcohol assessment in relation with national health systems, implementing the evaluation is mandatory, considering the high prevalence of alcohol consumption during pregnancy reported in Argentina1414 López MB, Filippetti VA, Cremonte M. Alcohol consumption before and during pregnancy in Argentina: prevalence and risk factors. Rev Panam Salud Publica 2015;37(4-5):211-217 and other countries of the region.4545 Magri R, Miguez HA, Hutson J, et al. Sustancias psicoactivas y embarazo. Estudio en una población hospitalaria de Uruguay. Trastor Adict 2008;10(02):98-103 To our knowledge, this is the first report evaluating the performance of screening tests for pregnant women in a Spanish-speaking South American country.

Furthermore, the results presented here could be useful to the discussion about the cross-cultural validity of the analyzed screening tools to assess AUDs in prenatal care settings, particularly regarding the less broadly used instruments, like the T-ACE, the TWEAK or the RAPS-QF. Even though the T-ACE and the TWEAK have been used and recommended for screening pregnant women in other cultural contexts,4646 Lichtenberger A, Conde KN, Cremonte M. Investigación en intervención breve y consumo de alcohol durante la gestación: productividad e impacto. Rev Chil Obstet Ginecol 2016;81(01): 56-62 our results show that the AUDIT has the best performance in screening for AUDs among Argentinean pregnant women.

Despite those contributions, the present study has some limitations that should be considered. First, the sample was from a single city, and although it was probably representative of the centers it was drawn from, the conclusions could not be extended to other populations. Although the overall evidence suggests that self-reporting is reliable for measuring alcohol consumption, pregnant women in other cultural contexts have shown to underreport their intake,4747 Wurst FM, Kelso E, Weinmann W, Pragst F, Yegles M, Sundström Poromaa I. Measurement of direct ethanol metabolites suggests higher rate of alcohol use among pregnant women than found with the AUDIT-a pilot study in a population-based sample of Swedish women. Am J Obstet Gynecol 2008;198(04):407.e1-407.e5 undermining the reliability of the measures. However, considering the wide acceptance of drinking in Argentina, even among pregnant women,4848 López MB. Saber, valorar y actuar: relaciones entre información, actitudes y consumo de alcohol durante la gestación. Health Addict 2013;13(01):35-46 it is probably unlikely that this could result in a serious bias. The order of administration of the screening tests might also have an effect,4949 Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health (Oxf) 2005;27(03): 281-291 and more research is certainly needed to determine whether it could have affected the results, and in which manner.

Conclusions

Although any level of alcohol consumption in pregnant women should be considered of high risk and targeted, identifying pregnant women with AUDs is especially important, since these women might require more than simple advice to quit drinking, namely a brief intervention or a referral to a specialized treatment. Nevertheless, most screening tests have been developed and validated in male populations, and validation studies in pregnant women are scarce.

In prior studies, mostly from the US and Europe, the T-ACE and secondly the TWEAK were the most used and recommended screening tools in the target population,4646 Lichtenberger A, Conde KN, Cremonte M. Investigación en intervención breve y consumo de alcohol durante la gestación: productividad e impacto. Rev Chil Obstet Ginecol 2016;81(01): 56-62 probably because they were designed specifically for pregnant women. In that context, they both showed good sensitivity and specificity for detecting risk consumption and AUDs.2525 Burns E, Gray R,Smith LA. Brief screening questionnaires to identify problem drinking during pregnancy: a systematic review. Addiction 2010;105(04):601-614 However, in the local context, the psychometric performance of the AUDIT has proved to be superior for identifying AUDs in pregnant women. This result in not unexpected, since the AUDIT has proved to be the best screening tool in a variety of contexts and populations, especially in low-income countries.4242 Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test (AUDIT): guidelines for use in primary care. Geneva: WHO; 2001 5050 Cremonte M, Cherpitel CJ. Performance of screening instruments for alcohol use disorders in emergency department patients in Argentina. Subst Use Misuse 2008;43(01):125-138 5151 Daeppen JB, Yersin B, Landry U, Pécoud A, Decrey H. Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients. Alcohol Clin Exp Res 2000;24(05):659-665 5252 Reinert DF, Allen JP. The alcohol use disorders identification test: an update of research findings. Alcohol Clin Exp Res 2007;31(02): 185-199

Acknowledgments

The authors are thankful to Dr. Cesar Merino Soto for his insightful observations regarding the data analyses.

References

  • 1
    Lemoine P, Harousseau H, Borteyru JP, Menuet JC. Children of alcoholic parents-observed anomalies: discussion of 127 cases. Ther Drug Monit 2003;25:132-136
  • 2
    Jones KL, Smith DW, Ulleland CN, Streissguth P. Pattern of malformation in offspring of chronic alcoholic mothers. Lancet 1973; 1(7815):1267-1271
  • 3
    O'Leary C. Fetal alcohol syndrome. A literature review: Canberra: Commonwealth of Australia; 2002 Available at: https://www. flourishpaediatrics.com.au/docs/fnational-drug-straegy-fetal-alcohol-syndrome-a-literature-review-etalcsyn.pdf
  • 4
    Gunzerath L, Faden V, Zakhari S, Warren K. National Institute on Alcohol Abuse and Alcoholism report on moderate drinking. Alcohol Clin Exp Res 2004;28(06):829-847
  • 5
    Lewis SJ, Zuccolo L, Davey Smith G, et al. Fetal alcohol exposure and IQ at age 8: evidence from a population-based birth-cohort study. PLoS One 2012;7(11):e49407
  • 6
    Windham GC, Fenster L, Swan SH. Moderate maternal and paternal alcohol consumption and the risk of spontaneous abortion. Epidemiology 1992;3(04):364-370
  • 7
    Stratton KR, Howe CJ, Battaglia FC. Fetal alcohol syndrome: diagnosis, epidemiology, prevention, and treatment. Washington (DC): Institute of Medicine/National Academy Press; 1996
  • 8
    Carter RC, Jacobson JL, Sokol RJ, Avison MJ, Jacobson SW. Fetal alcohol-related growth restriction from birth through young adulthood and moderating effects of maternal prepregnancy weight. Alcohol Clin Exp Res 2013;37(03):452-462
  • 9
    Dreosti IE. Nutritional factors underlying the expression of the fetal alcohol syndrome. Ann N Y Acad Sci 1993;678:193-204
  • 10
    Bonthius DJ, Bonthius NE, Li S, Karacay B. The protective effect of neuronal nitric oxide synthase (nNOS) against alcohol toxicity depends upon the NO-cGMP-PKG pathway and NF-kappaB. Neurotoxicology 2008;29(06):1080-1091
  • 11
    Schneider ML, Moore CF, Barr CS, Larson JA, Kraemer GW. Moderate prenatal alcohol exposure and serotonin genotype interact to alter CNS serotonin function in rhesus monkey offspring. Alcohol Clin Exp Res 2011;35(05):912-920
  • 12
    Krulewitch CJ. Alcohol consumption during pregnancy. Annu Rev Nurs Res 2005;23:101-134
  • 13
    Magri R, Míguez H, Parodi V, et al. Consumo de alcohol y otras drogas en embarazadas. Arch Pediatr Urug 2007;78(02):122-132
  • 14
    López MB, Filippetti VA, Cremonte M. Alcohol consumption before and during pregnancy in Argentina: prevalence and risk factors. Rev Panam Salud Publica 2015;37(4-5):211-217
  • 15
    National Collaborating Centre for Women's and Children's Health [Internet]. Antenatal care: routine care for the healthy pregnant woman. London: RCOG; 2008 [cited 2016 Aug 26]. Available from: https://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0009601/pdf/ PubMedHealth_PMH0009601.pdf
  • 16
    World Health Organization. Guidelines for the identification and management of substance use and substance use disorders in pregnancy. Geneva: WHO; 2014
  • 17
    McCambridge J, Day M. Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction 2008;103(02):241-248
  • 18
    Mengel MB, Searight HR, Cook K. Preventing alcohol-exposed pregnancies. J Am Board Fam Med 2006;19(05):494-505
  • 19
    Baraona E, Abittan CS, Dohmen K, et al. Gender differences in pharmacokinetics of alcohol. Alcohol Clin Exp Res 2001;25(04): 502-507
  • 20
    Thomasson HR. Gender differences in alcohol metabolism. Physiological responses to ethanol. Recent Dev Alcohol 1995;12:163-179
  • 21
    Wilsnack RW, Vogeltanz ND, Wilsnack SC, et al. Gender differences in alcohol consumption and adverse drinking consequences: crosscultural patterns. Addiction 2000;95(02):251-265
  • 22
    Sokol RJ, Martier SS, Ager JW. The T-ACE questions: practical prenatal detection of risk-drinking. Am J Obstet Gynecol 1989; 160(04):863-868, discussion 868-870
  • 23
    Russell M, Bigler L. Screening for alcohol-related problems in an outpatient obstetric-gynecologic clinic. Am J Obstet Gynecol 1979;134(01):4-12
  • 24
    Russell M. New assessment tools for risk drinking during pregnancy: T-ACE and TWEAK, and others. Alcohol Health Res World 1994;18(01):55-61
  • 25
    Burns E, Gray R,Smith LA. Brief screening questionnaires to identify problem drinking during pregnancy: a systematic review. Addiction 2010;105(04):601-614
  • 26
    Moraes CL, Viellas EF, Reichenheim ME. Assessing alcohol misuse during pregnancy: evaluating psychometric properties of the CAGE, T-ACE and TWEAK in a Brazilian setting. J Stud Alcohol 2005;66(02):165-173
  • 27
    Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction 1993;88(06):791-804
  • 28
    Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med 1998;158(16):1789-1795
  • 29
    Cherpitel CJ. Screening for alcohol problems in the emergency room: a rapid alcohol problems screen. Drug Alcohol Depend 1995;40(02):133-137
  • 30
    World Health Organization. Composite International Diagnostic Interview. Geneva: WHO; 1990
  • 31
    Kessler RC, Ustün TB. The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res 2004;13(02):93-121
  • 32
    Wittchen HU. Reliability and validity studies of the WHO-Composite International Diagnostic Interview (CIDI): a critical review. J Psychiatr Res 1994;28(01):57-84
  • 33
    Tacchini G, Coppola MT, Musazzi A, Altamura AC, Invernizzi G. [Multinational validation of the Composite International Diagnostic Interview (CIDI)]. Minerva Psichiatr 1994;35(02):63-80
  • 34
    Lowry R.Vassar Stats:Website for Statistical Computation[Internet]. 1998 [cited 2016 Aug 26]. Available from: http://vassarstats.net/
    » http://vassarstats.net/
  • 35
    Merino C. ICalfa: módulo Excel para estimar intervalos de confianza para alfa de Cronbach. Lima: Universidad de San Martín de Porres; 2015
  • 36
    Chang G, Wilkins-Haug L, Berman S, Goetz MA, Behr H, Hiley A. Alcohol use and pregnancy: improving identification. Obstet Gynecol 1998;91(06):892-898
  • 37
    Dawson DA, Grant BF, Stinson FS, Zhou Y. Effectiveness of the derived Alcohol Use Disorders Identification Test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res 2005;29(05):844-854
  • 38
    Babor TF, Robaina K. The Alcohol Use Disorders Identification Test (AUDIT): a review of graded severity algorithms and national adaptations. Int J Alcohol Drug Res 2016;5(02):17-24
  • 39
    Cherpitel CJ, Bazargan S. Screening for alcohol problems: comparison of the audit, RAPS4 and RAPS4-QF among African American and Hispanic patients in an inner city emergency department. Drug Alcohol Depend 2003;71(03):275-280
  • 40
    Cremonte M, Ledesma RD, Cherpitel CJ, Borges G. Psychometric properties of alcohol screening tests in the emergency department in Argentina, Mexico and the United States. Addict Behav 2010;35(09):818-825
  • 41
    Conde K, Remaggi ML, Cremonte M. Alcohol y amnesia en universitarios de Argentina y España: prevalencia y predicción. Health Addict 2014;14(01):37-46
  • 42
    Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test (AUDIT): guidelines for use in primary care. Geneva: WHO; 2001
  • 43
    Conde K, Cremonte M, López MB, Cherpitel CJ. Gender and Alcohol Use Disorders Diagnostic Criteria in Emergency Department Patients of Argentina. Subst Use Misuse 2016;51(12): 1629-1636
  • 44
    Chang G. Screening and brief intervention in prenatal care settings. Alcohol Res Health 2004-2005;28(02):80-84
  • 45
    Magri R, Miguez HA, Hutson J, et al. Sustancias psicoactivas y embarazo. Estudio en una población hospitalaria de Uruguay. Trastor Adict 2008;10(02):98-103
  • 46
    Lichtenberger A, Conde KN, Cremonte M. Investigación en intervención breve y consumo de alcohol durante la gestación: productividad e impacto. Rev Chil Obstet Ginecol 2016;81(01): 56-62
  • 47
    Wurst FM, Kelso E, Weinmann W, Pragst F, Yegles M, Sundström Poromaa I. Measurement of direct ethanol metabolites suggests higher rate of alcohol use among pregnant women than found with the AUDIT-a pilot study in a population-based sample of Swedish women. Am J Obstet Gynecol 2008;198(04):407.e1-407.e5
  • 48
    López MB. Saber, valorar y actuar: relaciones entre información, actitudes y consumo de alcohol durante la gestación. Health Addict 2013;13(01):35-46
  • 49
    Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health (Oxf) 2005;27(03): 281-291
  • 50
    Cremonte M, Cherpitel CJ. Performance of screening instruments for alcohol use disorders in emergency department patients in Argentina. Subst Use Misuse 2008;43(01):125-138
  • 51
    Daeppen JB, Yersin B, Landry U, Pécoud A, Decrey H. Reliability and validity of the Alcohol Use Disorders Identification Test (AUDIT) imbedded within a general health risk screening questionnaire: results of a survey in 332 primary care patients. Alcohol Clin Exp Res 2000;24(05):659-665
  • 52
    Reinert DF, Allen JP. The alcohol use disorders identification test: an update of research findings. Alcohol Clin Exp Res 2007;31(02): 185-199

Publication Dates

  • Publication in this collection
    July 2017

History

  • Received
    03 Oct 2016
  • Accepted
    15 Mar 2017
Federação Brasileira das Sociedades de Ginecologia e Obstetrícia Av. Brigadeiro Luís Antônio, 3421, sala 903 - Jardim Paulista, 01401-001 São Paulo SP - Brasil, Tel. (55 11) 5573-4919 - Rio de Janeiro - RJ - Brazil
E-mail: editorial.office@febrasgo.org.br