Acessibilidade / Reportar erro

Assessing a cut-off point for the diagnosis of abnormal uterine bleeding using the Menstrual Bleeding Questionnaire (MBQ): a validation and cultural translation study with Brazilian women

ABSTRACT

BACKGROUND:

Abnormal uterine bleeding (AUB) is a common condition, and the Menstrual Bleeding Questionnaire (MBQ) is used for its assessment.

OBJECTIVES:

To translate, assess the cut-off point for diagnosis, and explore psychometric properties of the MBQ for use in Brazilian Portuguese.

DESIGN AND SETTING:

Prospective cohort study including 200 women (100 with and 100 without AUB) at a tertiary referral center.

METHODS:

MBQ translation involved a pilot-testing phase, instrument adjustment, data collection, and back-translation. Cut-off point was obtained using receiver operating curve analysis. Menstrual patterns, impact on quality of life due to AUB, internal consistency, test-retest, responsiveness, and discriminant validity were assessed. For construct validity, the Pictorial Blood Assessment Chart (PBAC) and World Health Organization Quality of Life – abbreviated version (WHOQOL-BREF) were applied.

RESULTS:

Women with AUB were older, had higher body mass indices, and had a worse quality of life during menstruation. Regarding the MBQ's psychometric variables, Cronbach's alpha coefficient was > 0.70 in all analyses, high intraclass correlation coefficient was found in both groups; no ceiling and floor effects were observed, and construct validity was demonstrated (correlation between MBQ score, PBAC score, and clinical menstrual cycle data). No difference between MBQ and PBAC scores were perceived after the test-retest. Significant differences were found between MBQ and PBAC scores before and after treatment. An MBQ score ≥ 24 was associated with a high probability of AUB; accuracy of 98%.

CONCLUSION:

The MBQ is a reliable questionnaire for Brazilian women. The cut-off ≥ 24 shows high accuracy to discriminate AUB.

KEY WORDS (MeSH terms):
Metrorrhagia; Translations; Validation study [publication type]

AUTHORS’ KEY WORDS:
Abnormal uterine bleeding; Menstrual bleeding questionnaire; Prospective cohort study

INTRODUCTION

Abnormal uterine bleeding (AUB) is defined by menstrual cycle changes, in regularity, volume, frequency, or duration in non-pregnant women.11 Benetti-Pinto CL, Rosa-e-Silva ACJ, Yela DA, Soares Júnior JM. Abnormal uterine bleeding. Rev Bras Ginecol Obstet. 2017;39(7):358-68. PMID: 28605821; https://doi.org/10.1055/s-0037-1603807.
https://doi.org/10.1055/s-0037-1603807...
,22 ACGO committee opinion no. 557: Management of an abnormal uterine bleeding in nonpregnant reproductive-aged women. Obstet Ginecol. 2013;121(4):891-6. PMID: 23635706; https://doi.org/10.1097/01.aog.0000428646.67925.9a.
https://doi.org/10.1097/01.aog.000042864...
Menstrual disorders represent the leading cause of seeking gynecological care; additionally, it is estimated that up to 40% of women are affected by this condition during their lifetime.33 Yela DA, Benetti-Pinto CL. Sangramento uterino anormal. São Paulo: Federação Brasileira das Associações de Ginecologia e Obstetrícia (FEBRASGO); 2018. (Protocolo FEBRASGO - Ginecologia, no. 42/Comissão Nacional Especializada em Ginecologia Endócrina). Available from: https://www.febrasgo.org.br/images/pec/Protocolos-assistenciais/Protocolos-assistenciais-ginecologia.pdf/Sangramento-uterino-anormal.pdf. Accessed in 2023 (May 5).
https://www.febrasgo.org.br/images/pec/P...
66 Bahamondes L, Ali M. Recent advances in managing and understanding menstrual disorders. F1000Prime Rep. 2015;7:33. PMID: 25926984; https://doi.org/10.12703/p7-33.
https://doi.org/10.12703/p7-33...
AUB may have a negative impact on economic productivity, relationships, quality of life (QOL), and increasing costs for health services.77 Kaunitz AM., Barbieri RL, Levine D, Falk SJ. Approach to abnormal uterine bleeding in nonpregnant reproductive-age women. UptoDate. 2019. Avaliable from https://portaldeboaspraticas.iff.fiocruz.br/biblioteca/approach-to-abnormal-uterine-bleeding-in-nonpregnant-reproductive-age-women/. Accessed in 2023 (May 5).
https://portaldeboaspraticas.iff.fiocruz...
99 Marnach ML, Laughlin-Tommaso SK. Evaluation and management of abnormal uterine bleeding. Mayo Clin Proc. 2019;94(2):326-35. PMID: 30711128; https://doi.org/10.1016/j.mayocp.2018.12.012.
https://doi.org/10.1016/j.mayocp.2018.12...

The approach for AUB is based on a clinical assessment. Studies that evaluated the assistance provided to these women showed that the classic clinical approach does not always include parameters considered important by women with this condition.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...
For example, difficulty in predicting when bleeding will occur and the chance of blood spilling onto clothing can cause discomfort. Also, excessive blood loss can lead to embarrassing experiences and symptoms that are not always considered in a traditional medical evaluation.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...
Few publications have reported experiences and feelings of women during the menstrual and intermenstrual period (“patient self-reported outcomes”), with reviews confirming that the classic model of medical care may be unable to understand the entire context experienced by patients. Recent research recognizes the importance of evaluating not only the response to the treatments related to blood loss reduction but also the experience of women. The Institute National Health and Care Unit of the United Kingdom recommendations reinforce that intervention for abnormal bleeding must be focused on improving the QOL and not just controlling the blood loss.33 Yela DA, Benetti-Pinto CL. Sangramento uterino anormal. São Paulo: Federação Brasileira das Associações de Ginecologia e Obstetrícia (FEBRASGO); 2018. (Protocolo FEBRASGO - Ginecologia, no. 42/Comissão Nacional Especializada em Ginecologia Endócrina). Available from: https://www.febrasgo.org.br/images/pec/Protocolos-assistenciais/Protocolos-assistenciais-ginecologia.pdf/Sangramento-uterino-anormal.pdf. Accessed in 2023 (May 5).
https://www.febrasgo.org.br/images/pec/P...
Thus, instruments have been suggested for both aspects (blood loss and QOL).

The dosage of alkaline hematin (AH) and graphical methods are widely used for quantitative evaluation. These tools correlate the visual appearance of the loss of menstrual fluid in standardized sanitary products to the volume estimated in milliliters.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...
Examples are the Pictorial Blood Assessment Chart (PBAC) and menstrual pictogram.1111 Higham JM, O’Brien PM, Shaw RW. Assessment of menstrual blood loos using a pictorial chart. Br J Obstet Gynaecol. 1990;97(8):734-9. PMID: 2400752; https://doi.org/10.1111/j.1471-0528.1990.tb16249.x.
https://doi.org/10.1111/j.1471-0528.1990...
1313 Magnay JL, Nevatte TM, Seitz C, O’Brien S. A new menstrual pictogram for use with feminine products that contain superabsorbent polymers. Fertil Steril. 2013;100(6):1715-21.e1-4. PMID: 24034941; https://doi.org/10.1016/j.fertnstert.2013.08.028.
https://doi.org/10.1016/j.fertnstert.201...
When menstrual symptoms are only assessed, there is a questionnaire called The Menstrual Evaluation Questionnaire, which includes statements about menstrual symptoms.1414 Warner PE, Critchley HO, Lumsden MA, et al. Menorrhagia I: measured blood loss, clinical features, and outcome in women with heavy periods: a survey with follow-up data. Am J Obstet Gynecol. 2004;190(5):1216-23. PMID: 15167821; https://doi.org/10.1016/j.ajog.2003.11.015.
https://doi.org/10.1016/j.ajog.2003.11.0...

However, these tools have limitations. AH requires the storage of sanitary products for further laboratory analysis; graphic methods do not include sanitary products, such as menstrual collectors, diapers, cloth pads, and menstrual panties. Moreover, instruments that exclusively assess symptoms cannot objectively assess the blood loss. Additionally, such instruments do not assess the possible social impact, may be affected by the patient's memory, do not distinguish between chronic and intermittent symptoms, or specifically assess the QOL.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...

There are general questionnaires to assess the QOL, such as the Medical Outcomes Study 36- Item Short Form Heath Survey (SF-36) and the World Health Organization Quality of Life – abbreviated version (WHOQOL-bref); questionnaires for AUB-specific causes, such as uterine fibroids, have been published.1414 Warner PE, Critchley HO, Lumsden MA, et al. Menorrhagia I: measured blood loss, clinical features, and outcome in women with heavy periods: a survey with follow-up data. Am J Obstet Gynecol. 2004;190(5):1216-23. PMID: 15167821; https://doi.org/10.1016/j.ajog.2003.11.015.
https://doi.org/10.1016/j.ajog.2003.11.0...
,1515 Oliveira Brito LG, Malzone-Lott DA, Sandoval Fagundes MF, et al. Translation and validation of the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) questionnaire for the Brazilian Portuguese language. Sao Paulo Med J. 2017;135(2):107-15. PMID: 28301630; https://doi.org/10.1590/1516-3180.2016.0223281016.
https://doi.org/10.1590/1516-3180.2016.0...
Specific questionnaires capable of assessing menstrual symptoms and the impact of AUB on women's QOL have been studied, such as the Menorrhagia Multiattribute Scale, the Menstrual Impact Questionnaire, and the Menstrual Bleeding Questionnaire (MBQ); none of them are validated for use in Brazil.1616 Ruta DA, Garratt AM, Chadha YC, et al. Assessment of patients with menorrhagia: how valid is a structured clinical history as a measure of health status? Qual Life Res. 1995;4(1):33-40. PMID: 7711689; https://doi.org/10.1007/bf00434381.
https://doi.org/10.1007/bf00434381...
1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
Comparative analyzes between these instruments suggest that they are capable of quantifying the blood loss and providing a qualitative assessment of the QOL.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...

OBJECTIVE

This study aimed to translate and culturally validate the first instrument capable of associating both qualitative and quantitative assessments of AUB for use in Brazilian women, in addition to assessing a cut-off point for the diagnosis of AUB.

METHODS

Translation and validation of the MBQ

We have followed the methodology described in the Guidelines for the process of intercultural adaptation of self-report measures2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
and the Guidelines for Reliability and Agreement Study Reports.2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
Permission and consent for translation and validation of the MBQ was obtained by email from Dr. Matteson.1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
Subsequently, the MBQ was translated from English into Brazilian Portuguese, through notarized translation, by two different native translators from Brazil with proficiency in English and official authorization to translate scientific documents One translator knew the questionnaire concepts, whereas the second translator did not. Subsequently, the synthesis of the two translated versions was performed, which was back-translated to English (“back-translation”) by a third translator, who was unaware of the original version of the MBQ. After confirming agreement between the retranslated instrument and its original version, the MBQ was analyzed by an expert panel (GPR, LGOB, and CLBP). A face-to-face pre-test was then carried out (preliminary pilot testing) with the application of the MBQ in 30 women to assess the need for new adaptations (which were not necessary). After completing all recommended steps, the instrument was applied for validation.

Study design and participants (inclusion/exclusion criteria)

A prospective cohort study was carried out at a tertiary, academic-affiliated, outpatient clinic at the Department of Obstetrics and Gynecology, School of Medical Sciences, University of Campinas, Brazil, including women diagnosed with AUB (case group) and women without the criteria for AUB (controls), who were native Brazilians and fluent in Brazilian Portuguese, invited to participate voluntarily, coming from urban or rural areas, and who had already scheduled appointments. Women who agreed to participate signed informed consent forms. This study was approved by the Institutional Review Board (CAAE number 24742619.4.0000.5404).

The inclusion criteria comprised women with AUB (case group; n = 100) presenting complaints of increased bleeding, considering frequency, duration, regularity, flow volume, and intermenstrual bleeding, according to the 2018 International Federation of Gynecology and Obstetrics (Federação Internacional de Ginecologia e Obstetrícia [FIGO]) for at least 6 months (Table 1).66 Bahamondes L, Ali M. Recent advances in managing and understanding menstrual disorders. F1000Prime Rep. 2015;7:33. PMID: 25926984; https://doi.org/10.12703/p7-33.
https://doi.org/10.12703/p7-33...
For the control group (n = 100), women without any history of menstrual disorders since menarche and without complaints of AUB were included, that is, with menstrual cycle within the limits considered normal according to the same criteria of FIGO (frequency of cycles between 24 and 38 days, duration of flow less than or equal to 8 days, adequate blood volume, according to the woman's impression, and absence of intermenstrual bleeding). The controls were not matched to the patients. For both groups, the menstrual pattern reported by participants was considered before using any contraceptive method, excluding iatrogenic causes of AUB or normal cycles secondary to anovulatory methods, such as combined oral contraceptives. In both groups, women should refer to the use of only regularly sized pads to reduce bias, and be between 18 and 55 years of age, following criteria used in the elaboration of the MBQ by Matteson.1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
Patients in the AUB group were recruited from the Abnormal Uterine Bleeding and surgical gynecology outpatient clinics, while control group patients were recruited from the Family Planning outpatient clinic. The exclusion criteria for both groups were as follows: conditions that prevented the reading and/or understanding of the instruments and women diagnosed with AUB already undergoing clinical or surgical treatment (oral contraceptives, intrauterine device of levonorgestrel, laparotomy, laparoscopy, hysteroscopy, or other) in order to avoid treatment bias.

Table 1
Clinical characteristics of women with (n = 100) and without (n = 100) abnormal uterine bleeding

Instruments

MBQ

The MBQ1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
consists of 20 questions, with the evaluation of four main domains - quantity (“heaviness”), pain, irregularity, and QOL, providing a score. The higher the score, the more negative the impact of bleeding on the QOL. However, there is no established cutoff for the diagnosis of AUB, with only an average score that allows the characterization of the existence of increased bleeding associated with menstrual irregularities. We aimed to translate and culturally validate the MBQ instrument for Brazilian Portuguese using psychometric variables. We also compared the MBQ with a graphic method (PBAC), to determine whether both tools were correlated.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....

PBAC

The visual system represents a graduated series of sanitary pads (external and internal) with drawings representing the amount of menstrual blood. Women were asked to choose the number of pads used in the bleeding cycle according to the amount of blood depicted in the graphic representation; the greater the amount of blood represented in the pad, the higher the score. Traditional graph described by Higham et al.,1111 Higham JM, O’Brien PM, Shaw RW. Assessment of menstrual blood loos using a pictorial chart. Br J Obstet Gynaecol. 1990;97(8):734-9. PMID: 2400752; https://doi.org/10.1111/j.1471-0528.1990.tb16249.x.
https://doi.org/10.1111/j.1471-0528.1990...
with a cut-off of > 100 points, was used. PBAC was used to assess the construct validity of the MBQ regarding quantitative pattern of blood loss.

WHOQOL-BREF

Developed by the World Health Organization to assess the QOL, and modified as a 26-question tool divided into four domains: physical, psychological, social relationships, and environment. It can be used in healthy populations and in those affected by chronic diseases. The answers followed a Likert scale (1–5); the higher the score, the better the QOL.2323 Kluthcovsky ACGC, Kluthcovsky FA. O WHOQOL-bref, um instrumento para avaliar qualidade de vida: uma revisão sistemática. Rev Psiquiatr Rio Gd Sul. 2009;31(3 suppl). https://doi.org/10.1590/S0101-81082009000400007.
https://doi.org/10.1590/S0101-8108200900...
It was used to assess the construct validity of MBQ regarding its impact on the QOL.

Validation - psychometric variables

All women answered a sociodemographic form and questions regarding their menstrual patterns (cycle duration, days of menstrual flow, number of pads used, need to change clothes due to blood overflow during menstruation, occurrence of bleeding after sexual intercourse, and intermenstrual bleeding). Furthermore, information regarding the history of anemia, need for blood transfusion due to uterine bleeding, and self-perceived impact of menstruation on QOL were collected. The MBQ, PBAC, and WHOQOL-BREF instruments were used for all women. MBQ and PBAC were reapplied to 30 women, randomly selected from the sample four weeks after the first interview and without any intervention, to assess test-retest. The MBQ was reapplied to 37 women from the AUB group, four weeks after starting treatment, which could be oral combined contraceptives, oral progestins, levonorgestrel intrauterine device, anti-inflammatory or antifibrinolytic, to assess the responsiveness.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
Other psychometric variables were internal consistency (degree of interrelationship between items), content validity, “floor” and “ceiling” effect (how much the content of a measure is adequate to reflect global content), discriminant validity between case and control groups, and construct validity (fundamental form of instrument validation, as it checks whether the test measures an attribute or quality that is not operationally defined).

Statistical analysis

There was no defined sample size pattern for the validation studies. For variables, such as test-retest and responsiveness, the ideal is a minimum of 30–60 cases. Therefore, a sample of 200 participants was used and divided into 100 cases and 100 controls.2424 Danielsen AK, Pommergaard HC, Burcharth J, Angenete E, Rosenberg J. Translation of questionnaires measuring health related quality of life is not standardized: a literature based research study. Plos One. 2015;10(5):e0127050. PMID: 25965447; https://doi.org/10.1371/journal.pone.0127050.
https://doi.org/10.1371/journal.pone.012...

Categorical variables are described as absolute and percentage frequency values (n/%), and numerical variables are described as mean and standard deviation values. To compare the categorical and continuous variables between the case and control groups, the chi square or Fisher's exact test and Mann–Whitney's non-parametric test were used.

For internal consistency, Cronbach's alpha and the correlation coefficient were calculated, and in the test-retest, the intraclass correlation coefficient (ICC) was used to assess temporal stability. This coefficient was used to verify the homogeneity (accuracy) of the items. Values above 0.70 indicate adequate internal consistency.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
The test-retest reliability (reproduction of repeated measures with similar responses by respondents, which assesses temporal stability) was assessed using the ICC. Values ≥ 0.70 signified adequate reliability.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
In the analysis of internal consistency and test-retest, the MBQ and PBAC scores obtained for both groups at first application and reapplication after 2–4 weeks, without any intervention, were compared, using the Wilcoxon test.

Content validity, “floor” and “ceiling” effect is considered for both effects when at least 15% of the scores are below or above the end of the scale. An instrument with adequate content validity is considered to have no effect.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
The construct validity was calculated using the Wilcoxon test and Spearman correlation to compare the MBQ with the PBAC or WHOQOL-BREF. The Wilcoxon test was used to assess the responsiveness (to compare pre- and post-treatment scores).

A receiver operating curve (ROC) analysis was used to obtain the cutoff point for MBQ score capable of discriminating the presence of AUB. The significance level was set at 5% (P < 0.05) for all calculations. All data were tabulated in Microsoft Excel using a spreadsheet and analyzed using SAS version 9.4 program (Cary, North Carolina, United States).

RESULTS

Table 1 presents the baseline characteristics of the women included in the study. Women with AUB presented a higher mean age (38.4 ± 9.6 versus 30.6 ± 8. 4 years; P < 0.001) and body mass index (28.3 ± 6.3 versus 25.0 ± 5.0 kg/m22 ACGO committee opinion no. 557: Management of an abnormal uterine bleeding in nonpregnant reproductive-aged women. Obstet Ginecol. 2013;121(4):891-6. PMID: 23635706; https://doi.org/10.1097/01.aog.0000428646.67925.9a.
https://doi.org/10.1097/01.aog.000042864...
; P < 0.001). They also presented more comorbidities than control group. The most common causes of AUB were leiomyomas (29%) and adenomyoses (15%). Women with AUB presented shorter menstrual cycles (22.8 ± 6.5 versus 27.8 ± 2.79 days; P < 0.001, longer blood flow duration (9.7 ± 6.9 versus 4.7 ± 0.8 days; P < 0.001) and used more menstrual pads per menstrual cycle (40.0 ± 44.0 versus 10.0 ± 4.3; P < 0.001). Additionally, women with AUB more frequently reported the association of more than one type of sanitary product to contain the bleeding, with a higher frequency of changing their underwear (95% versus 9%; P < 0.001), change of usual clothes (92% versus 4%; P < 0.001), and change of sheets and bedding (80% versus 3%; P < 0.001) due to blood overflow. The prevalence of bleeding outside the menstrual period and sinus bleeding was also higher in women with AUB (P < 0.001). Although 95% of women with AUB had already sought medical care to control the bleeding, and the diagnosis of anemia was reported in approximately half of the women with AUB (51%), only two women required an intravenous infusion of iron, and two women received blood transfusion in both groups. Almost all women with AUB reported a worsening of their QOL during menstruation (97% versus 27%; P < 0.001).

The highest MBQ and PBAC scores were obtained in the case group (40.1 ± 7.3 versus 7.2 ± 5.7; P < 0.001; and 654.1 ± 750.0 versus 31.5 ± 64.5; P < 0.001, respectively). For the WHOQOL-BREF, the total score (56.5 ± 12.0 versus 65.4 ± 12.9) and psychological (54.9 ± 13.8 versus 63.7 ± 11.8), social (56.0 ± 20.4 versus 69.5 ± 19.2), environmental (61.2 ± 14.8 versus 69.3 ± 16.0), and self-assessment of QOL expectancy domains (55.8 ± 13.9 versus 68.0 ± 16.4, respectively) were worse within women with AUB (P < 0.001), except for the physical domain (Table 2); these data display the discriminant validity for both instruments to differentiate the case and control groups.

Table 2
Comparison of the baseline scores of the menstrual bleeding questionnaire, pictorial blood assessment chart, and WHOQOL-BREF questionnaires between women with abnormal uterine bleeding (n = 100) and without abnormal uterine bleeding (n = 100)

Regarding the psychometric variables for the MBQ, Cronbach's alpha coefficient was significantly above 0.70 for the total sample, by group, and in the case group retest demonstrated internal consistency (Table 3). There was no significant difference between initial application and the reapplication of MBQ and PBAC between women with AUB without intervention and women in the control group, indicating the test-retest reliability of both questionnaires (P = ns). The agreement between the questionnaires was also verified using the ICC (Table 4). Regarding the content validity, none of the women in the case group had a maximum score (75 points) on the MBQ, and only four women in the control group had a minimum score (4%), with no ceiling or floor effects. Construct validity was demonstrated by the correlation between the total MBQ score and clinical characteristics of the menstrual cycle, PBAC; however, for the AUB group, the MBQ did not correlate with the total score and subdomains of the WHOQOL-BREF (Table 5). Responsiveness was demonstrated before and after treatment using MBQ and PBAC scores (Table 6).

Table 3
Internal consistency (20 items) of the menstrual bleeding questionnaire
Table 4
Test-retest and internal consistency of the menstrual bleeding questionnaire and pictorial blood assessment chart questionnaires
Table 5
Spearman correlation between the menstrual bleeding questionnaire score and clinical symptoms of bleeding, pictorial blood assessment chart, and WHOQOL-BREF in women with abnormal uterine bleeding (n = 100)
Table 6
Responsiveness of the menstrual bleeding questionnaire and pictorial blood assessment chart questionnaires for women with abnormal uterine bleeding (n = 37)

To detect an MBQ cutoff point capable of discriminating the presence of increased bleeding, the analysis of the ROC curve indicated that a total MBQ score ≥ 24 was associated with a high probability of abnormal bleeding, with a sensitivity of 98% (95% confidence interval [CI]: 92.26; 99.65), specificity 98% (95% CI: 92.26; 99.65), positive predictive value of 98% (95% CI: 92.26; 99.65), negative predictive value of 98% (95% CI: 92.26; 99.65), and 98% accuracy (95% CI: 94.62; 99.36) (Figure 1).

Figure 1
Receiver operating curve using the menstrual bleeding questionnaire score between abnormal uterine bleeding and control women, with a suggested cut-off point to indicate the diagnosis of abnormal uterine bleeding.

The final version of MBQ translated and validated can be accessed using the link https://docs.google.com/document/d/170CjydEk0NIIoHpGeWO7IY1qOnIe49Dd8kcN1qLGKJk/edit?usp=sharing.

DISCUSSION

When treating women with complaints of abnormal uterine bleeding, health professionals must be alert to assess not only the physical repercussions of bleeding, but also the woman's experience with such disorders and its reflection in the worsening of their QOL. The MBQ assesses the AUB quantitatively and qualitatively; however, it has not been validated for use in Brazil. This study showed that the cultural translation of the MBQ is a reliable and valid tool with high internal consistency, temporal stability, construct validity, and responsiveness to treatment. Furthermore, it was easy to use. Our study was also able to calculate a cut-off point for the MBQ instrument, which is capable of accurately discriminating the presence of increased bleeding. The MBQ also allows for the evaluation of response to treatment by comparing the scores before and after the therapy.

The MBQ was validated against one of the most commonly used tools in gynecological practice (PBAC) with high convergent validation. The PBAC is widely used to quantitatively assess the blood loss, owing to its easy understanding, with studies showing that scores between 50 and 185 points are associated with increased bleeding,2222 Magnay JL, O’Brien S, Gerlinger C, Seitz C. A systematic review of methods to measure menstrual blood loss. BMC Womens Health. 2018;18(1):142. PMID: 30134884; https://doi.org/10.1186/s12905-018-0627-8.
https://doi.org/10.1186/s12905-018-0627-...
with 100 points as the most common cut-off value used in most countries.1111 Higham JM, O’Brien PM, Shaw RW. Assessment of menstrual blood loos using a pictorial chart. Br J Obstet Gynaecol. 1990;97(8):734-9. PMID: 2400752; https://doi.org/10.1111/j.1471-0528.1990.tb16249.x.
https://doi.org/10.1111/j.1471-0528.1990...
Correlation between MBQ scores and those obtained from the PBAC for the total sample and in both groups individually shows that MBQ is an instrument that shows quantitative differences related to uterine bleeding. The original MBQ study proposed scores that discriminated increased bleeding, and whether it was associated with menstrual irregularity. Thus, MBQ scores of 30.8 ± 13.8 were related to increased uterine bleeding, associated or not with menstrual irregularity. The cut-off point suggested by this study (24 points) is compatible with the scores used in the original validation.1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
Future studies with a larger number of women may reinforce the sensitivity and specificity. Responsiveness of MBQ after AUB treatment strengthened the data. An improvement in the scores after treatment was observed, showing that the MBQ is also a useful instrument for assessing the therapeutic response and follow-up.

However, data from the literature indicate that clinical assessment focused only on quantitative aspects may be insufficient, since the impact of bleeding goes beyond the volume of blood lost, with negative repercussions and impact on the QOL.2525 Lam C, Anderson B, Lopes V, Schulkin J, Matteson K. Assessing abnormal uterine bleeding: are physicians taking a meaningful clinical history? J Womens Health (Larchmt). 2017;26(7):762-7. PMID: 28318358; https://doi.org/10.1089/jwh.2016.6155.
https://doi.org/10.1089/jwh.2016.6155...
Excessive bleeding should be considered when the woman reports the presence of blood loss that interferes with physical, social, emotional aspects, and/or her QOL, emphasizing the importance of qualitative aspects.2222 Magnay JL, O’Brien S, Gerlinger C, Seitz C. A systematic review of methods to measure menstrual blood loss. BMC Womens Health. 2018;18(1):142. PMID: 30134884; https://doi.org/10.1186/s12905-018-0627-8.
https://doi.org/10.1186/s12905-018-0627-...
,2525 Lam C, Anderson B, Lopes V, Schulkin J, Matteson K. Assessing abnormal uterine bleeding: are physicians taking a meaningful clinical history? J Womens Health (Larchmt). 2017;26(7):762-7. PMID: 28318358; https://doi.org/10.1089/jwh.2016.6155.
https://doi.org/10.1089/jwh.2016.6155...
Thus, considering that the PBAC does not allow evaluation of the impact on QOL or aspects such as the presence of pain during the menstrual period, a generic QOL questionnaire was also utilized (WHOQOL-BREF), due to its rapid application and good psychometric performance.2626 Fleck MP, Louzada S, Xavier M, et al. Aplicação da versão em português do instrumento abreviado de avaliação da qualidade de vida “WHOQOL-bref” [Application of the Portuguese version of the abbreviated instrument of quality life WHOQOL-bref]. Rev Saude Publica. 2000;34(2):178-83. PMID: 10881154; https://doi.org/10.1590/s0034-89102000000200012.
https://doi.org/10.1590/s0034-8910200000...
Specific questionnaires to assess the QOL in women with AUB are scarce, and some are specific to certain causes of AUB, such as the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) for uterine fibroids, and therefore not suitable for use in cases bleeding secondary to other etiologies,1515 Oliveira Brito LG, Malzone-Lott DA, Sandoval Fagundes MF, et al. Translation and validation of the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) questionnaire for the Brazilian Portuguese language. Sao Paulo Med J. 2017;135(2):107-15. PMID: 28301630; https://doi.org/10.1590/1516-3180.2016.0223281016.
https://doi.org/10.1590/1516-3180.2016.0...
reinforcing the need for a single instrument to assess quantitative and qualitative characteristics of AUB.

In our study, both questionnaires (MBQ and WHOQOL-BREF) showed worse QOL in women with AUB; however, no correlation was found between the total WHOQOL-BREF and MBQ scores in women in the case group. Other studies point in the same direction, such as the original MBQ study, which showed a weak to moderate correlation between the MBQ and the SF-36 and the UFS-QOL validation study, as well as a weak correlation between the two instruments.1515 Oliveira Brito LG, Malzone-Lott DA, Sandoval Fagundes MF, et al. Translation and validation of the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) questionnaire for the Brazilian Portuguese language. Sao Paulo Med J. 2017;135(2):107-15. PMID: 28301630; https://doi.org/10.1590/1516-3180.2016.0223281016.
https://doi.org/10.1590/1516-3180.2016.0...
,1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...
These findings can be explained by the fact that the MBQ encompasses specific and relevant questions for women with AUB, unlike the SF-36 and WHOQOL-BREF tools, which assess general aspects of the studied population; therefore, they are less specific. Other tools with the approach of all four domains of the MBQ are currently unavailable, and general QOL assessment tools have a global evaluation, which can explain the absence of correlation between these tools. Thus, we believe that the MBQ, as it encompasses situations exclusively related to AUB, may be a preferable tool for assessing QOL during increased bleeding.1010 Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009.
https://doi.org/10.1016/j.bpobgyn.2016.0...
,1919 Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273.
https://doi.org/10.1111/1471-0528.13273...

Considering the high prevalence of AUB in the female population, changes in diagnostic criteria, and the need for tools that help quantitatively and qualitatively in the diagnosis and reassessment of treatment, this study validated the Brazilian Portuguese language as the first questionnaire to assess AUB with a good sample size and compared the MBQ with questionnaires already validated and used to assess AUB and QOL. Another important point is the suggestion of a cut-off point to discriminate AUB and the calculation of the main psychometric variables, demonstrating a robust process of questionnaire validation.2020 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014.
https://doi.org/10.1097/00007632-2000121...
,2121 Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002.
https://doi.org/10.1016/j.jclinepi.2010....
As weaknesses: sociodemographic differences between groups may have interfered in the results, is necessary to compare the MBQ with other QOL instruments and short assessment period for responsiveness (four weeks), indicating the need for future studies with women followed up for a longer period with different interventions. The application of the MBQ to a larger population of Brazilian women will also be able to robustly demonstrate our results.

CONCLUSION

Finally, we believe that the MBQ is a valid, reliable, and stable tool that can be used to assess, diagnose, and follow up AUB treatments in Brazilian Portuguese women. It is important to evaluate women with AUB using validated, standardized questionnaires. Considering the high prevalence of AUB and the economic reality in Brazil, the implementation of a free tool for AUB diagnosis and treatment assessment may help improve the approach to this health condition.

  • Department of Obstetrics and Gynecology, School of Medical Sciences, Universidade Estadual de Campinas (UNICAMP), Campinas, SP, Brazil
  • Sources of funding: This study was partially funded by the Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP), grant no. 2020/10465-4
  • Editor responsible for the evaluation process:
    Paulo Manuel Pêgo-Fernandes, MD, PhD

REFERENCES

  • 1
    Benetti-Pinto CL, Rosa-e-Silva ACJ, Yela DA, Soares Júnior JM. Abnormal uterine bleeding. Rev Bras Ginecol Obstet. 2017;39(7):358-68. PMID: 28605821; https://doi.org/10.1055/s-0037-1603807
    » https://doi.org/10.1055/s-0037-1603807
  • 2
    ACGO committee opinion no. 557: Management of an abnormal uterine bleeding in nonpregnant reproductive-aged women. Obstet Ginecol. 2013;121(4):891-6. PMID: 23635706; https://doi.org/10.1097/01.aog.0000428646.67925.9a
    » https://doi.org/10.1097/01.aog.0000428646.67925.9a
  • 3
    Yela DA, Benetti-Pinto CL. Sangramento uterino anormal. São Paulo: Federação Brasileira das Associações de Ginecologia e Obstetrícia (FEBRASGO); 2018. (Protocolo FEBRASGO - Ginecologia, no. 42/Comissão Nacional Especializada em Ginecologia Endócrina). Available from: https://www.febrasgo.org.br/images/pec/Protocolos-assistenciais/Protocolos-assistenciais-ginecologia.pdf/Sangramento-uterino-anormal.pdf Accessed in 2023 (May 5).
    » https://www.febrasgo.org.br/images/pec/Protocolos-assistenciais/Protocolos-assistenciais-ginecologia.pdf/Sangramento-uterino-anormal.pdf
  • 4
    Hallberg L, Högdagl AM, Nilsson L, Rybo G. Menstrual blood loss--a population study. Variation at different ages and attempts to define normality. Acta Obstet Gynecol Scand. 1966;45(3):320-51. PMID: 5922481; https://doi.org/10.3109/00016346609158455
    » https://doi.org/10.3109/00016346609158455
  • 5
    Liu Z, Doan QV, Blumenthal P, Dubois RW. A systematic review evaluating health-related quality of life, work impairment, and health-care costs and utilization in abnormal uterine bleeding. Value Health. 2007;10(3):183-94. PMID: 17532811; https://doi.org/10.1111/j.1524-4733.2007.00168.x
    » https://doi.org/10.1111/j.1524-4733.2007.00168.x
  • 6
    Bahamondes L, Ali M. Recent advances in managing and understanding menstrual disorders. F1000Prime Rep. 2015;7:33. PMID: 25926984; https://doi.org/10.12703/p7-33
    » https://doi.org/10.12703/p7-33
  • 7
    Kaunitz AM., Barbieri RL, Levine D, Falk SJ. Approach to abnormal uterine bleeding in nonpregnant reproductive-age women. UptoDate. 2019. Avaliable from https://portaldeboaspraticas.iff.fiocruz.br/biblioteca/approach-to-abnormal-uterine-bleeding-in-nonpregnant-reproductive-age-women/ Accessed in 2023 (May 5).
    » https://portaldeboaspraticas.iff.fiocruz.br/biblioteca/approach-to-abnormal-uterine-bleeding-in-nonpregnant-reproductive-age-women/
  • 8
    Barcelos RS, Zanini Rde V, Santos Ida S. Distúrbios menstruais entre mulheres de 15-54 anos de idade em Pelotas, Rio Grande do Sul, Brasil: estudo de base populacional [Menstrual disorders among women 15 to 54 years of age in Pelotas, Rio Grande do Sul State, Brazil: a population-based study]. Cad Saude Publica. 2013;29(11):2333-46. PMID: 24233047; https://doi.org/10.1590/0102-311x00002813
    » https://doi.org/10.1590/0102-311x00002813
  • 9
    Marnach ML, Laughlin-Tommaso SK. Evaluation and management of abnormal uterine bleeding. Mayo Clin Proc. 2019;94(2):326-35. PMID: 30711128; https://doi.org/10.1016/j.mayocp.2018.12.012
    » https://doi.org/10.1016/j.mayocp.2018.12.012
  • 10
    Matteson KA. Menstrual questionnaires for clinical and research use. Best Pract Res Clin Obstet Gynaecol. 2017;40:44-54. PMID: 27829537; https://doi.org/10.1016/j.bpobgyn.2016.09.009
    » https://doi.org/10.1016/j.bpobgyn.2016.09.009
  • 11
    Higham JM, O’Brien PM, Shaw RW. Assessment of menstrual blood loos using a pictorial chart. Br J Obstet Gynaecol. 1990;97(8):734-9. PMID: 2400752; https://doi.org/10.1111/j.1471-0528.1990.tb16249.x
    » https://doi.org/10.1111/j.1471-0528.1990.tb16249.x
  • 12
    Wyatt KM, Dimmock PW, Hayes-Gill B, Crowe J, O’Brien PMS. Menstrual symptometrics: a simple computer-aided method to quantify menstrual cycle disorders. Fertil Steril. 2002;78(1):96-101. PMID: 12095497; https://doi.org/10.1016/s0015-0282(02)03161-8
    » https://doi.org/10.1016/s0015-0282(02)03161-8
  • 13
    Magnay JL, Nevatte TM, Seitz C, O’Brien S. A new menstrual pictogram for use with feminine products that contain superabsorbent polymers. Fertil Steril. 2013;100(6):1715-21.e1-4. PMID: 24034941; https://doi.org/10.1016/j.fertnstert.2013.08.028
    » https://doi.org/10.1016/j.fertnstert.2013.08.028
  • 14
    Warner PE, Critchley HO, Lumsden MA, et al. Menorrhagia I: measured blood loss, clinical features, and outcome in women with heavy periods: a survey with follow-up data. Am J Obstet Gynecol. 2004;190(5):1216-23. PMID: 15167821; https://doi.org/10.1016/j.ajog.2003.11.015
    » https://doi.org/10.1016/j.ajog.2003.11.015
  • 15
    Oliveira Brito LG, Malzone-Lott DA, Sandoval Fagundes MF, et al. Translation and validation of the Uterine Fibroid Symptom and Quality of Life (UFS-QOL) questionnaire for the Brazilian Portuguese language. Sao Paulo Med J. 2017;135(2):107-15. PMID: 28301630; https://doi.org/10.1590/1516-3180.2016.0223281016
    » https://doi.org/10.1590/1516-3180.2016.0223281016
  • 16
    Ruta DA, Garratt AM, Chadha YC, et al. Assessment of patients with menorrhagia: how valid is a structured clinical history as a measure of health status? Qual Life Res. 1995;4(1):33-40. PMID: 7711689; https://doi.org/10.1007/bf00434381
    » https://doi.org/10.1007/bf00434381
  • 17
    Pattison H, Daniels JP, Kai J, Gupta JK. The measurement properties of the menorrhagia multi-attribute quality-of-life scale: a psychometric analysis. BJOG. 2011;118(12):1528-31. PMID: 21790952; https://doi.org/10.1111/j.1471-0528.2011.03057.x
    » https://doi.org/10.1111/j.1471-0528.2011.03057.x
  • 18
    Bushnell DM, Martin ML, Moore KA, et al. Menorrhagia Impact Questionnaire: assessing the influence of heavy menstrual bleeding on quality of life. Curr Med Res Opin. 2010;26(12):2745-55. PMID: 21043553; https://doi.org/10.1185/03007995.2010.532200
    » https://doi.org/10.1185/03007995.2010.532200
  • 19
    Matteson KA, Scott DM, Raker CA, Clark MA. The menstrual bleeding questionnaire: development and validation of a comprehensive patient-reported outcome instrument for heavy menstrual bleeding. BJOG. 2015;122(5):681-9. PMID: 25615842; https://doi.org/10.1111/1471-0528.13273
    » https://doi.org/10.1111/1471-0528.13273
  • 20
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. PMID: 11124735; https://doi.org/10.1097/00007632-200012150-00014
    » https://doi.org/10.1097/00007632-200012150-00014
  • 21
    Kottner J, Audigé L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64(1):96-106. PMID: 21130355; https://doi.org/10.1016/j.jclinepi.2010.03.002
    » https://doi.org/10.1016/j.jclinepi.2010.03.002
  • 22
    Magnay JL, O’Brien S, Gerlinger C, Seitz C. A systematic review of methods to measure menstrual blood loss. BMC Womens Health. 2018;18(1):142. PMID: 30134884; https://doi.org/10.1186/s12905-018-0627-8
    » https://doi.org/10.1186/s12905-018-0627-8
  • 23
    Kluthcovsky ACGC, Kluthcovsky FA. O WHOQOL-bref, um instrumento para avaliar qualidade de vida: uma revisão sistemática. Rev Psiquiatr Rio Gd Sul. 2009;31(3 suppl). https://doi.org/10.1590/S0101-81082009000400007
    » https://doi.org/10.1590/S0101-81082009000400007
  • 24
    Danielsen AK, Pommergaard HC, Burcharth J, Angenete E, Rosenberg J. Translation of questionnaires measuring health related quality of life is not standardized: a literature based research study. Plos One. 2015;10(5):e0127050. PMID: 25965447; https://doi.org/10.1371/journal.pone.0127050
    » https://doi.org/10.1371/journal.pone.0127050
  • 25
    Lam C, Anderson B, Lopes V, Schulkin J, Matteson K. Assessing abnormal uterine bleeding: are physicians taking a meaningful clinical history? J Womens Health (Larchmt). 2017;26(7):762-7. PMID: 28318358; https://doi.org/10.1089/jwh.2016.6155
    » https://doi.org/10.1089/jwh.2016.6155
  • 26
    Fleck MP, Louzada S, Xavier M, et al. Aplicação da versão em português do instrumento abreviado de avaliação da qualidade de vida “WHOQOL-bref” [Application of the Portuguese version of the abbreviated instrument of quality life WHOQOL-bref]. Rev Saude Publica. 2000;34(2):178-83. PMID: 10881154; https://doi.org/10.1590/s0034-89102000000200012
    » https://doi.org/10.1590/s0034-89102000000200012

Publication Dates

  • Publication in this collection
    07 July 2023
  • Date of issue
    2024

History

  • Received
    11 Sept 2022
  • Reviewed
    22 Mar 2023
  • Accepted
    10 Apr 2023
Associação Paulista de Medicina - APM APM / Publicações Científicas, Av. Brigadeiro Luís Antonio, 278 - 7º and., 01318-901 São Paulo SP - Brazil, Tel.: +55 11 3188-4310 / 3188-4311, Fax: +55 11 3188-4255 - São Paulo - SP - Brazil
E-mail: revistas@apm.org.br