Validation of a scale assessing the impact of periodontal diseases on patients' quality of life in Bulgaria (pilot research)

Validation of a scale assessing the impact of periodontal diseases on patients' quality of life in Bulgaria (pilot research)

Nina Musurlieva^I; Maria Stoykova^I; Doychin Boyadjiev^II

^IDeparment of Social Medicine and Public Health, Faculty of Public Health, Medical University of Plovdiv, Paisii Xilendarski Bulgaria

^IIDepartment of Applied Mathematics and Modeling, Mathematics and Informatics Faculty, Plovdiv University, Paisii Xilendarski, Bulgaria

^{Correspondence}

ABSTRACT

The aim of the paper is to present the validation of a scale for assessing the impact of periodontal diseases on individuals' quality of life in Bulgaria. A pilot research was made among 30 diagnosed patients with periodontitis visiting the Department of Periodontology, Faculty of Dental Medicine, Medical University of Plovdiv, Bulgaria. The minimum sample size of 30 people was established based on a power analysis for sample size calculation. The mean age of participants was 48.95 ± 11.85 years, being 56.67 ± 9.05 years for males and 43.33 ± 9.05 years for females. Standard interviews were conducted using a specific instrument: self-designed questionnaire and a 5-degree ranked scale, containing initially 11 questions. The interviews were repeated after 3 months with the same patients for retest analysis. The data was statistically processed using SPSS v.13 software. Results received after the initial interviews: Cronbach's coefficient (α=0.882), Spearman-Brown coefficient (r_sb=0.998), average inter-item correlation coefficient (R=0.426), difficulty of the questions from 0.173 to 0.757 and discrimination power from 0.405 to 0.809. Results after the second interviews: α=0.883, r_sb=0.998, R=0.507, difficulty from 0.287 to 0.757 and discrimination power from 0.524 to 0.809. In two of the questions, a low level of inter-item correlation with the rest of the items was found and they were excluded. The final version of the questionnaire contained 9 questions. The validation proved that the developed scale is sufficiently reliable and will be used in the final research, the first one to use such an instrument for measuring oral health-related quality of life in Bulgaria.

Key Words: periodontitis, quality of life, validation, scale.

RESUMO

O objetivo deste artigo é apresentar a validação de uma escala que mede o impacto das doenças periodontais sobre a qualidade de vida das pessoas na Bulgária. Foi feito um estudo piloto com 30 indivíduos diagnosticados com doença periodontal, entre os pacientes do Departamento de Periodontologia da Faculdade de Medicina Odontológica da Universidade de Medicina de Plovdiv, Bulgária. A amostra mínima de 30 pessoas foi estabelecida baseada em análise de potência para cálculo do tamanho de amostra. A idade média dos participantes foi de 48,95 ± 11,85 anos, sendo de 56,67 ± 9,05 para homens e de 43,33 ± 9,05 para mulheres. Foram feitas entrevistas padronizadas usando um instrumento específico: um questionário com uma escala de 5 graus, contendo 11 perguntas iniciais. As entrevistas foram repetidas 3 meses depois, com os mesmos pacientes, para reanalisar o teste. Os dados foram processados estatisticamente pelo programa SPSS v.13. Os resultados das entrevistas iniciais foram: coeficiente de Cronbach (α=0,882), coeficiente de Spearman-Brown (rsb=0,998), coeficiente de correlação média inter-item (R=0,426), dificuldade das questões de 0,173 a 0,757 e potência de discriminação de 0,405 a 0,809. Os resultados da segunda série de entrevistas foram: α=0,883, rsb=0,998, R=0,507, dificuldade de 0,287 a 0,757 e potência de discriminação de 0,524 a 0,809. Duas das questões apresentaram baixo nível de correlação inter-item e foram excluídas. A versão final do questionário continha 9 perguntas. A validação comprovou que a escala desenvolvida é suficientemente confiável e será usada na pesquisa final, a primeira a utilizar tal instrumento para mensurar a qualidade de vida relacionada à saúde oral na Bulgária.

INTRODUCTION

Periodontal diseases in their most severe forms are one of the common oral diseases affecting 5-15% of the population in industrialized countries (1,2). Periodontal diseases involve structural and functional changes in the organs and tissues of oral cavity and are associated with gingival recession and formation of periodontal pockets. Pockets may lead to tooth mobility, gingival abscesses and loss of teeth (2). Furthermore, alteration of the speaking and chewing functions can be observed in patients with periodontitis (3-5), which may cause other health-related problems and general diseases.

Periodontal diseases are one of the main reasons for tooth loss among the population. A problem with a great social significance as it leads to a psychological trauma in patients, equivalent to the loss of any other organ. In a result of the worsen aesthetics conditions, tooth loss influences individuals' emotional status by inducing shame (3). It might also lead to limited social interaction and affect other daily activities.

The relationship between individuals' oral health and quality of life has been extensively discussed (6-9) and a number of studies (10,11) have examined the periodontal diseases' impact on patients' quality of life (QoL). In these researches, different general oral QoL instruments, such as Oral Health Impact Profile (OHIP), Oral Health Quality of Life in UK (OHQoL-UK) and Oral Impacts on Daily Performance (OIDP) were used to evaluate oral-health related QoL. The above-mentioned instruments measure health from a holistic conception including psychological and sociological aspects that only can be expressed by subjective feelings (12). Furthermore, some authors have validated QoL instruments based only on subjective criteria, without relating them to clinical indicators. Their main argument is that the presence of a disease does not always lead to a change in individuals' self- perception of QoL (13). Although these instruments have been used many times and have already proven their assessing qualities, it is hard to determine which of them the most effective one is. All these measures are developed to evaluate the impact of oral conditions on QoL and can be related to every oral disease. However a specific instrument for assessing the impact of periodontal diseases on QoL has not been validated (disease specific measure). This instrument is more likely to detect subtle changes in specific conditions thus having better responsiveness.

The purpose of this paper is to present the validation of a new original self-designed scale developed for assessing the impact of periodontal diseases on individuals' QoL of adult patients.

MATERIAL AND METHODS

Questionnaire

A new original instrument was designed and developed. The design phase of the scale included defining its content (writing of items) and construction of its format (type of the scale). The initial version contained 11 items (Table 1).

The authors grouped the 11 items into the following three subscales:

Choice of food/nutrition, chewing, swallowing, talking: Do you consider that the conditions of your gingiva/ teeth: influence your choice of food, chewing of harder food, cause problems in swallowing and/or cause speaking difficulties?

Social relations, friends and family, professional life: Do you consider that the conditions of your gingiva/teeth have an influence on your self-esteem, outlook, family life, and professional and/or social contacts? Have you ever received negative comments from your friends and relatives in regards to your gingiva/teeth?

Overall health: Do you consider that the conditions of your gingiva/teeth have an influence on your general health?

Coding of the Answers

Answers to every question were coded in a five-degree ranked scale depending on the degree of their influence (including 0 point when the patient considered that the asked issue did not have any influence): 1 point: insignificant influence; 2 points: weak influence; 3 points: moderate influence; 4 points: strong influence; 5 points: extremely strong influence. Overall rating (the sum of the points from the answers of all questions) varied from 0 to 45 total score.

Patients

A pilot research was conducted for the validation of face and content validity. The internal and external consistency of the scale was tested. Thirty patients were interviewed (n=30) using a pilot version of the instrument. The minimum sample size of 30 people has been established based on a power analysis for sample size calculation. Age<20 years was an exclusion criterion. The mean age of participants was 48.95 ± 11.85 years, being 56.67 ± 9.05 years for males and 43.33 ± 9.05 years for females. As much as 60.00 ± 8.94% had a high level of education.

All participants were clinically diagnosed with peridontitis and were visiting the Department of Periodontology, Faculty of Dental Medicine, Medical University of Plovdiv, Bulgaria in relation to their treatment. All patients were informed about the purpose of the research and gave their agreement to participate. After 3 months the same patients were interviewed again with the same questionnaire for the purpose of testing the stability of the scale and its reliability during the whole period of research.

Statistical Processing

The results were processed statistically with the help of SPSS Statistical Package for Social Science, version 13 (SPSS Inc., Chicago, IL, USA). First, the internal consistency was assessed with the coefficient of Cronbach (Cronbach's alpha). Second, the changing factors were researched using the coefficients of Pearson (r) and Spearman-Brown (r_sb). Afterwards in the research authors checked the reliability of the result by a performed test-retest analysis. The next step was to conduct an item analysis and to calculate the difficulty and discrimination power of all questions. Authors measured the difficulty as a proportion in which the average value refers to the maximum value, as the lowest level of response was coded with "0". The discrimination power was measured by the coefficient of linear correlation between the item rating and the overall unprocessed rating, from which the respective item was excluded.

RESULTS

After the conduction of the above-explained pilot research with 30 patients diagnosed with periodontitis, the face and content validity of the instrument were confirmed. The Cronbach's alpha coefficient value in the initial version of the pilot research was equal to (α=0.882), the Spearman-Brown coefficient (r_sb=0.998). Its high value confirmed the reliability of the scale. Important information about the reliability was derived from the average value of inter-item correlations (R=0.425). In general, the lower the values of this coefficient, the greater the validity of the results (11) (Table 2).

The Pearson's coefficient in the conducted further research was r =0.997. The internal consistency was first evaluated by analyzing the matrix of inter-item correlations. Coefficients ranged from (-0.112) to (0.869). In this initial version the coefficients of the discrimination power were relatively even and with high values from (0.405) to (0.809). The difficulty of the questions varied from (0.173) to (0.757).

After the statistical processing of the pilot version, two of the questions had to be excluded from the initial questionnaire (questions 6 and 11). After the second processing of the remaining 9 questions, the results were as follows: Cronbach's coefficient was α=0.883, Spearman-Brown's coefficient was r_sb=0.998, the average inter-item correlation coefficient was R=0.507; the values for difficulty of questions were: min = 0.287, max= 0.757. Also, authors defined the discrimination power values as being the lowest 0.524 and the highest 0.809 (Table 3).

DISCUSSION

The purpose of this study was to evaluate the validity of an original scale to assess the impact of periodontal diseases in the QoL of patients, not prove the suitable of the use this instrument for a given age group. It is the first research to use such an instrument in measuring oral health-related QoL in Bulgaria. The scale was proven to be a precise, valid and reliable disease-specific instrument. The high value of the coefficient Cronbach's alpha in the present case equal to (α=0.882) proved the reliability of the instrument.

Two questions occurred to be problematic during the research of the internal consistency - the question of related to "swallowing problems" and to "negative comments by the closest friends and relatives". When calculating their correlation with the rest of the items (inter-item correlations), the results were extremely minimal values and even a negative value in one of the cases (-0.112). As in general, it is possible for a certain scale to have a high inter-item correlation as a whole, but between some of its items to exist low correlation or other adverse features, an item analysis was performed by the authors to avoid this problem.

In the present research the coefficients of the discrimination power were relatively equal and with high values (varied in the range of 0.405- 0.809) with the exception of the above described two questions (0.405 and 0.417) where the lowest values were observed. The authors explained this with the fact that both questions are logically connected with already asked before questions. In the first case the chewing of harder food and the process of swallowing were in a close relation. In the other question the negative comments of the closest friends and relatives were directly related to family life and social contacts which patients had already commented. This was the logical ground based on which these questions were eliminated from the second statistical processing of data.

In the present study, the difficulty of the questions varied from 0.173 to 0.757. In general the acceptable limits for the difficulty are between 0.1 and 0.9 (14). Items for which the difficulty is bellow these limits give little information, therefore they can be excluded. Again the results for the two questions mentioned above were with the lowest values (0.173 and 0.207), another reason for excluding them from data processing. For greater certitude of the results the Cronbach's coefficient was calculated after the exclusion of every item of the scale. When excluding a well reconciled item this coefficient diminishes. In the current research, with the elimination of the two questions, which showed low inter-item correlation with the rest, the coefficient increased insignificantly to (α=0.883). All of the above arguments supported authors' decision that in the final research a 9-item scale should be used.

The analysis of the correlation coefficients among the questions of the scale in the pilot research and the results received after three months (test-retest) has proven the stability of the questions over a period of time. These coefficients showed insignificant differences, e.g.: at the beginning: 0.817; after 3 months: 0.800; or at the beginning: 0.639; after 3 months: 0.648.

Finally, the influence of periodontitis was assessed by calculating the total sum of the number of points that the answers to every question had given.

With the above described validation, the authors proved that the originally designed scale described in this paper is sufficiently reliable for assessing the impact of periodontal diseases on the QoL of patients. The instrument was efficient, easy to complete and easy to be administrated. These factors convinced the authors that the scale could be used in the final version of the research.

ACKNOWLEDGEMENTS

This paper is published with the financial support of project no. BG051PO001-3.3-05/0001, according to the "Science-Business" scheme.

Received November 2, 2011

Accepted November 5, 2012

• 1. Gerritsen AE, Allen PF, Witter DJ, Bronkhorst EM, Creugers NH. Tooth loss and oral health-related quality of life: a systematic review and meta-analysis. Health Qual Life Outcomes 2010;8:126.
• 2. Brennan DS, Spencer AJ, Roberts-Thomson KF. Quality of life and disability weights associated with periodontal disease. J Dent Res 2007;86:713-717.
• 3. Fereira Lopes M, Gusmao E. The impact of chronic periodontitis on quality of life in Brazilian subject. Acta Stomatol Croat 2009;43:89-98.
• 4. Araújo AC, Gusmão ES, Batista JE, Cimões R. Impact of periodontal disease on quality of life. Quintessence Int 2010;41:e111-e118.
• 5. Saito A, Hosaka Y, Kikuchi M, Akamatsu M, Fukaya C, Matsumoto S, et al.. Effect of initial periodontal therapy on oral health-related quality of life in patients with periodontitis in Japan. J Periodontol 2010;81:1001-1009.
• 6. Naito M, Yuasa H, Normura Y. Oral Health status and health-related quality of life: a systematic review. J Oral Sci 2006;48:1-7
• 7. Caglayan F, Altun O, Miloglu O. Correlation between oral health related quality of live and oral disorders in a Turkish patient population. Med Oral Cir Bucal 2009;14:573-578.
• 8. Allen PF. Assessment of oral health related quality of life. Health Qual Life Outcomes 2003;1:40.
• 9. Shanbhag S, Dahiya M, Croucher R. The impact of periodontal therapy on oral health-related quality of life in adults: a systematic review. J Clin Periodontol 2012;39:725-735.
• 10. Sam Ng, Leung K, Keung W. Oral health-related quality of life and periodontal status. Community Dent Oral Epidemiol 2006;34:114-122.
• 11. Needleman I, McGrant N, Colman P. Impact of oral health on the life quality of periodontal patients. J Clin Period 2004;31:454-457.
• 12. Montero-Martín J, Bravo-Pérez M, Albaladejo-Martínez A, Hernández-Martín LA, Rosel-Gallardo EM, et al.. Validation the OHIP-14sp for adults in Spain. Med Oral Patol Oral Cir Bucal 2009;14:44-50.
• 13. Montero J, Bravo M, Albadejo A. Validation of two complementary oral-health related quality of life indicators (OIDP and OSS 0-10) in two qualitatively distinct samples of the Spanish population. Health Qual Life Outcomes 2008;6:101.
• 14. http://rosoft.org/statistica/spsslectures Latest access: June 2, 2011. 12.47 h.
  » link

Publication Dates

• Publication in this collection
  08 Jan 2013
• Date of issue
  Oct 2012

History

• Received
  02 Nov 2011
• Accepted
  05 Nov 2012