Open-access Analysis of content, credibility, and reliability of information on chronic obstructive pulmonary disease treatment in YouTube™ videos: a cross-sectional observational study

Análisis de contenido, credibilidad y fiabilidad de la información sobre el tratamiento de la enfermedad pulmonar obstructiva crónica en vídeos de YouTube™: un estudio observacional transversal

ABSTRACT

Chronic Obstructive Pulmonary Disease (COPD) is characterized by airway abnormalities, resulting in persistent airflow obstruction. Treatment involves pharmacological and nonpharmacological interventions which are supported by several COPD consensus and guidelines. YouTube can often be used to share information about treatments for chronic diseases like COPD; however, the credibility of such information may not be adequate. This study evaluates the reliability and credibility of information concerning COPD treatment disseminated on YouTube, the most popular social media platform, and assess its alignment with the GOLD guideline. A cross-sectional observational study was conducted to select the first 200 English-language videos on COPD treatment posted on YouTube. Video evaluation used validated instruments, including the DISCERN tool (quality assessment), the Health on the Net Foundation Code of Conduct - HONcode (credibility assessment), and the GOLD guideline (reference). Poor agreement with the GOLD guideline (97.4%) was found. HONcode assessment showed that 75.7% of the videos achieved a high credibility rating. Regarding information quality, 75.7% of the videos received positive ratings based on the DISCERN tool. Despite exhibiting adequate credibility, the analyzed videos displayed fluctuating levels of quality, ranging from medium to low. Moreover, there was limited consensus between the videos and the GOLD guideline. Continuous analysis of such content can be used to ensure dissemination of reliable information on YouTube.

Keywords
COPD; Videos; Treatment; Clinical Guidelines

RESUMO

A Doença Pulmonar Obstrutiva Crônica (DPOC) é caracterizada por anormalidades das vias aéreas, resultando em obstrução persistente do fluxo aéreo. O tratamento dessa doença envolve intervenções apoiadas por vários consensos e diretrizes sobre DPOC. O YouTube pode muitas vezes ser utilizado para partilhar informações sobre o tratamento de doenças crônicas, no entanto a credibilidade dessa informação pode não ser adequada. Este estudo tem como objetivo avaliar a confiabilidade e credibilidade das informações relativas ao tratamento da DPOC no YouTube, a plataforma de mídia social mais popular, e avaliar seu alinhamento com a diretriz GOLD. Foi realizado um estudo observacional transversal, envolvendo a seleção dos primeiros 200 vídeos em inglês sobre tratamento da DPOC postados no YouTube. Os vídeos foram avaliados por meio de instrumentos validados, incluindo a ferramenta Discern (para avaliação de qualidade), o Health on the Net Foundation Code of Conduct – HONcode (para avaliação de credibilidade) e a diretriz GOLD (como referência). Os vídeos demonstraram baixa concordância com a diretriz GOLD (97,4%). Em relação à credibilidade, 75,7% dos vídeos obtiveram alto índice de credibilidade de acordo com a avaliação do HONcode. Quanto à qualidade da informação, 75,7% dos vídeos receberam avaliação positiva com base na ferramenta Discern. Os vídeos analisados apresentaram boa credibilidade, mas níveis variados de qualidade, variando de médio à baixo. Além disso, houve concordância limitada entre os vídeos e a diretriz GOLD. A análise contínua de tal conteúdo pode ser utilizada para garantir o fornecimento de informações confiáveis no YouTube.

Descritores
DPOC; Vídeos; Tratamento; Diretrizes Clínicas

RESUMEN

La enfermedad pulmonar obstructiva crónica (EPOC) se caracteriza por anomalías en las vías respiratorias que ocasionan una obstrucción persistente del flujo aéreo. El tratamiento de esta enfermedad implica intervenciones respaldadas por diversos consensos y guías sobre la EPOC. Aunque suelen utilizar YouTube para compartir información sobre el tratamiento de enfermedades crónicas como la EPOC, la credibilidad de esta información puede no ser adecuada. Este estudio tiene como objetivo evaluar la fiabilidad y la credibilidad de la información sobre el tratamiento de la EPOC en YouTube, una de las redes sociales más populares, y evaluar su alineación con la guía GOLD. Se realizó un estudio observacional transversal, que incluyó la selección de los primeros 200 vídeos en inglés, publicados en YouTube sobre el tratamiento de la EPOC. Los vídeos se evaluaron mediante instrumentos validados, como la herramienta Discern (para la evaluación de la calidad), el Código de Conducta HONcode (para la evaluación de la credibilidad) y la guía GOLD (como referencia). Los vídeos presentaron una baja concordancia con la guía GOLD (97,4%). En cuanto a la credibilidad, el 75,7% de los vídeos obtuvieron un alto índice de credibilidad según la evaluación de HONcode. En cuanto a la calidad de la información, el 75,7% de los vídeos recibieron una evaluación positiva basada en la herramienta Discern. Los vídeos evaluados tuvieron buena credibilidad, pero variados niveles de calidad, que van de mediano a bajo. Además, hubo un consenso limitado entre los vídeos y la guía GOLD. El análisis continuo de este tipo de contenido se puede utilizar para garantizar información confiable en YouTube.

Palabras clave
EPOC; Vídeos; Tratamiento; Guías clínicas

INTRODUCTION

Chronic Obstructive Pulmonary Disease (COPD) is a respiratory condition characterized by persistent and progressive airflow limitation, often accompanied by chronic inflammation of the airways due to exposure to inhaled particles and harmful gases1 , 2. COPD-affected individuals experience impaired functioning, lean mass loss , and various symptoms, including fatigue, dyspnea, and difficulty performing activities of daily living1.

COPD treatment involves pharmacological interventions with long-term anticholinergic medications and nonpharmacological approaches aimed at improving quality of life and symptom control. Nonpharmacological therapies like pulmonary rehabilitation include resistance and aerobic exercises, educational programs, breathing techniques, and smoking cessation guidance tailored to patients’ needs1 , 3.

Access to pulmonary rehabilitation programs is indeed a challenge, and several key factors contribute to this limitation, such as availability, referrals, and patient participation4 , 5. Consequently, COPD patients often turn to alternative sources of information—such as the Internet—for self-education and support6 among which YouTubeTM stands out as a popular video-sharing website6. Nonetheless, while the Internet offers several pieces of health information and self-care support, the lack of stringent quality control mechanisms can be a significant concern. Such abundance of health advice online makes it challenging for individuals to discern reliable and accurate information from misleading or scientifically unfounded content7 , 8.

Previous studies found that a substantial portion of the divulged content provided misleading or inaccurate information on health conditions such as rheumatoid arthritis and cerebral palsy. The potential to influence users negatively is indeed concerning9 - 11, especially considering that the study focusing on videos about COPD solely addresses the number of likes and views6. Considering the lack of research focusing specifically on the content, credibility, and quality of COPD treatment-related information on YouTube, particularly in alignment with the Global Initiative for Chronic Obstructive Lung Disease (GOLD) guidelines.

This study aims to identify and evaluate the content of COPD treatment videos on YouTube, focusing on their reliability, credibility, and adherence to the guidelines.

METHODOLOGY

This cross-sectional observational study adhered to the reporting guidelines outlined in the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) declaration. The study protocol was prospectively registered on the Open Science Framework (https://osf.io/adh56/) with the DOI 10.17605/OSF.IO/ADH56.

The study sample included 200 videos in English focusing on COPD treatment that individuals could perform independently. Video selection involved considering the first 200 videos found on YouTube based on research indicating that a 90% of users choose a result from the first three pages of search results. Additionally, 88% of users modify their search terms if the initial search result is not found12.

Advertisement videos, duplicates unrelated to the study’s purpose, videos focused on pulmonary rehabilitation without specifying COPD, or longer than 50 minutes were excluded. Studies have shown that shorter videos are more effective in retaining knowledge and generating interest13 , 14.

Two independent trained researchers searched the videos on February 14th, 2023, using the incognito tab without logging into any browser accounts. Afterward, the browser history was cleared to avoid saved preferences influencing the results. Search terms included COPD, treatment, pulmonary rehabilitation, and exercises.

Data extraction was conducted independently by the evaluators, following a standardized checklist (Figure 1) based on the GOLD guidelines1. Variables included the year of publication, source (health institution and professional in the field or individuals without professional background in the area and lacking references), video quality, and audio quality.

GOLD compliance was assessed using a scoring scheme developed by the authors, who drew inspiration from the HONcode credibility analysis instrument15. Each item presence in a video was assigned 1 point, and the sum of these points determined the level of compliance with guidelines. Total scores were categorized as low (0 to 11 points), medium (12 to 24 points), or high agreement (25 to 34 points) (Figure 2).

Figure 1.
Content score (based on guidelines)

Analysis also included the number of views, likes, and comments extracted from each video. The 8-principle HONcode instrument15 was used to assess content credibility which was considered high if a video adhered to six, seven, or eight of the mentioned principles, medium to 3 to 5 principles, and low if 0 to 2 principles (Figure 2).

Figure 2.
Health On the Net Foundation Code of Conduct (HONcode)

Information reliability was scored from 1 to 5 (reliability score), based on five questions (adapted from the DISCERN tool for assessing written health information)16. Higher scores indicated better content reliability9 , 16. The score obtained on the scale in each question was added, and its summation was classified from 1 to 14 points as low reliability, 15 to 19 as medium, and 20 to 25 as high reliability.

Statistical analysis

Analyses were performed using the Statistical Package for the Social Sciences Inc. (SPSS; Chicago, IL, USA; v.17). Frequency and median were used for non-normally distributed data. Spearman’s correlation test was used to analyze the relationships between views, likes, and comments. The chi-squared test was used for categorical independent variables (video source, image, and audio qualities).

Cohen’s Kappa coefficient was used to investigate the consistency between the two researchers based on McHugh values in compliance with guidelines, HONcode, and DISCERN1 , 15 , 16.

RESULTS

Video characteristics

From the 200 videos sample, the following were excluded: 67 (33.5%) were duplicates, 14 (7%) were in a language other than English, and 4 (2%) exceeded 50 minutes in length. Most videos were published by health institutions and professionals in the field (76.5%). In analyzing the content of the videos, 64 (55.7%) focused on CPOD pathophysiology, 20 (17.4%) addressed questions for patient evaluation, 35 (30.4%) discussed pharmacological treatment, and 91 (79.1%) covered nonpharmacological treatment2. Table 1 summarizes the video characteristics.

Table 1.
Video characteristics (n = 115)

Cohen’s Kappa coefficient values were 0.853 for the GOLD guideline, 0.630 for the HONcode instrument, and 0.613 for the DISCERN tool, suggesting a generally considerable agreement between researchers regarding video assessment.

Regarding content, the videos reached the maximum score only in the topic “terms” and “pharmacological treatment,” representing 27.8 and 20.0% of videos, respectively. DISCERN yielded the highest score (17 points), followed by HONcode at 8 points (Table 2).

Table 2.
Evaluation scores of included YouTube videos on COPD treatment

Reliability, credibility, and adherence to the GOLD guidelines

Of the 115 videos included in the final sample, 112 (97.4%) showed low agreement with the guidelines, and 3 (2.6%) demonstrated medium agreement1. Most videos (75.7%) achieved high credibility, whereas 24.3% obtained medium credibility. As for the quality of health information, 75.7% of the videos received an average rating indicating moderate reliability, whereas 24.3% were rated as low reliability.

Table 3 presents the video scores and characteristics. Video classes or lectures had a higher content score than those produced by health professionals (p=0.021). Non-health professional videos achieved a lower HONcode score than the other sources, excepting commercial and patient videos (p<0.01). Video classes and lectures and academic videos presented a higher DISCERN score than patient and non-heath professional videos. Additionally, video classes or lectures had higher DISCERN scores than health professional videos (p<0.01). Number of comments was higher in video classes or lectures compared with medical-sourced videos (p=0.003)

Table 3.
Video evaluation scores and characteristics according to source

DISCUSSION

Our results show that the content of COPD treatment-related videos on YouTube presented adequate credibility but varied in quality from low to moderate levels. Additionally, there was little agreement with the GOLD guidelines.

In analyzing the characteristics of the 115 most viewed COPD-related videos, we noted that most published videos addressed more than one content domain, such as disease definition, etiology, diagnosis, and treatment. Easy and practical access to the information in YouTube videos allows disseminating health content to many individuals6 , 17.

These findings concur with other studies that indicate that COPD patients frequently search the Internet for information about the disease, such as therapies and etiology18.

Regarding publication source, most videos were made available by health-related channels and professionals in the field, who tended to publish mainly instructive lectures aimed at informing about COPD. This instructional approach follows current research on health education as a primary objective in the self-care of COPD patients19 , 20.

Despite a high credibility rating, which indicates that health institutions mostly produce videos and provide contact details without any promotional intent, the quality of the health information in said videos was generally rated medium to low. This was due to a lack of references and clarification of the content presented according to DISCERN. Although professionals engage in sharing informative content about COPD treatment on YouTube, many of them still pass on some outdated paradigms. Since the target audience searching for this content may not be able to judge the information presented critically, the action must come from the creator to base information on criteria derived from scientific evidence, always providing references as additional material.

An important finding of the present study is that videos addressing COPD nonpharmacological treatment (79.1%) had the highest views. Seen as a non-pharmacological approach, rehabilitation promotes long-term benefits for the quality of life of COPD patients and includes specific muscle training for each individual1 , 21 , 22. However, most of the videos that addressed non-pharmacological therapies focused only on breathing techniques and flexibility training, rarely mentioning aerobic training, interval training, strength training, upper limb training, respiratory muscle training, and smoking cessation22 , 23. Moreover, only a few videos mentioned diagnostic and assessment guidelines that are essential for classifying patients’ functional capacity and adjusting treatment accordingly1 , 24.

Importantly, in the general context of treatment strategies, most YouTube videos about COPD treatment do not align with the current GOLD guideline recommendations1. Its use is strongly recommended as management guidelines play a crucial role in clinical practice, providing adequate guidance for diagnosis, treatment and management of the disease. Like the study on cerebral palsy10 and low back pain11, many COPD videos on YouTube provide outdated or unsubstantiated information despite their intent to share knowledge.

Based on the present findings, it becomes evident the need to educate the target audience about the challenges of relying on platforms like YouTube for health information, as they may contain incomplete or unreliable content. Thus, it is crucial to promote the use of reliable, evidence-based sources. Future research should increase the reliability of videos on this platform by offering educational resources and guidance to content creators.

CONCLUSION

YouTube videos on COPD treatment present varying reliability between medium and low with little agreement with GOLD1 guidelines despite high credibility, raising questions about how to properly improve information delivery. These findings can help raise awareness among the target audience about the challenges of seeking knowledge in platforms like YouTube, which may contain incomplete or misleading information. Promoting the use of reliable and evidence-based sources is crucial.

ACKNOWLEDGEMENTS

We thank the Universidade Federal dos Vales do Jequitinhonha e Mucuri, Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq), Fundação de Amparo à Pesquisa de Minas Gerais (FAPEMIG), and Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).

REFERENCES

  • 1. 1. Global Initiative for Chronic Obstructive Lung Disease (GOLD). Global Strategy for Prevention, Diagnosis and Management of COPD 2023 Report [Internet]. Fontana: GOLD; 2023 [cited 2025 Jan 6]. Available from: https://goldcopd.org/2023-gold-report-2/ .
    » https://goldcopd.org/2023-gold-report-2/
  • 2. McKeough ZJ, Velloso M, Lima VP, Alison JA. Upper limb exercise training for COPD. Cochrane Database Syst Rev. 2016;11(11):1-70. doi: 10.1002/14651858.CD011434.pub2.
    » https://doi.org/10.1002/14651858.CD011434.pub2.
  • 3. McCarthy B, Casey D, Devane D, Murphy K, Murphy E, et al. Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2015;(2):1-185. doi: 10.1002/14651858.CD003793.pub3.
    » https://doi.org/10.1002/14651858.CD003793.pub3.
  • 4. Amante DJ, Hogan TP, Pagoto SL, English TM, Lapane KL. Access to Care and Use of the Internet to Search for Health Information: Results from the US National Health Interview Survey. J Med Internet Res. 2015;17(4):e106. doi: 10.2196/jmir.4126.
    » https://doi.org/10.2196/jmir.4126.
  • 5. McCabe C, McCann M, Brady AM. Computer and mobile technology interventions for self-management in chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2017;5(5):1-34. doi: 10.1002/14651858.CD011425.pub2.
    » https://doi.org/10.1002/14651858.CD011425.pub2.
  • 6. Stellefson M, Chaney B, Ochipa K, Chaney D, Haider Z, et al. YouTube as a source of chronic obstructive pulmonary disease patient education. Chron Respir Dis. 2014;11(2):61-71. doi: 10.1177/1479972314525058.
    » https://doi.org/10.1177/1479972314525058.
  • 7. Kocyigit BF, Nacitarhan V, Koca TT, Berk E. YouTube as a source of patient information for ankylosing spondylitis exercises. Clin Rheumatol. 2019;38(6):1747-51. doi: 10.1007/s10067-018-04413-0.
    » https://doi.org/10.1007/s10067-018-04413-0.
  • 8. Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, Gramopadhye AK. Healthcare information on YouTube: a systematic review. Health Informatics J. 2015;21(3):173-94. doi: 10.1177/1460458213512220.
    » https://doi.org/10.1177/1460458213512220.
  • 9. Singh AG, Singh S, Singh PP. YouTube for Information on Rheumatoid Arthritis - A Wakeup Call? J Rheumatol. 2012;39(5):899-903. doi: 10.3899/jrheum.111114.
    » https://doi.org/10.3899/jrheum.111114.
  • 10. Furtado MAS, Sousa Junior RR, Soares LA, Soares BA, Mendonça KT, et al. Analysis of Informative Content on Cerebral Palsy Presented in Brazilian-Portuguese YouTube Videos. Phys Occup Ther Pediatr. 2022;42(4):369-83. doi: 10.1080/01942638.2022.2046677.
    » https://doi.org/10.1080/01942638.2022.2046677.
  • 11. Maia LB, Silva JP, Souza MB, Henschke N, Oliveira VC. Popular videos related to low back pain on YouTubeTM do not reflect current clinical guidelines: a cross-sectional study. Braz J Phys Ther. 2021;25(6):803-10. doi: 10.1016/j.bjpt.2021.06.009.
    » https://doi.org/10.1016/j.bjpt.2021.06.009.
  • 12. 12. iProspect. iProspect Blended Search Results Study 2008 [Internet]. London: iProspect; 2008 [cited 2025 Jan 6]. Available from: https://www.researchgate.net/profile/Alieda-Blandford/publication/276454791_Google_Public_Libraries_and_the_Deep_Web/links/574f2ff108aebb9880441df5/Google-Public-Libraries-and-the-Deep-Web.pdf .
    » https://www.researchgate.net/profile/Alieda-Blandford/publication/276454791_Google_Public_Libraries_and_the_Deep_Web/links/574f2ff108aebb9880441df5/Google-Public-Libraries-and-the-Deep-Web.pdf
  • 13. Souza CFL, Ferreira JM, Pereira AC, Silva MAD. Understanding the use of videos as a complementary teaching tool. J Health Inform. 2019;11(1):3-7.
  • 14. Abedin T, Ahmed S, Al Mamun M, Ahmed SW, Newaz S, et al. YouTube as a source of useful information on diabetes foot care. Diabetes Res Clin Pract. 2015;110(1):e1-e4. doi: 10.1016/j.diabres.2015.08.003.
    » https://doi.org/10.1016/j.diabres.2015.08.003.
  • 15. 15. HON. Health On the Net Foundation 2022. https://www.hon.ch .
    » https://www.hon.ch
  • 16. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Comm Health. 1999;53(2):105-11. doi: 10.1136/jech.53.2.105.
    » https://doi.org/10.1136/jech.53.2.105.
  • 17. Tang W, Olscamp K, Choi SK, Friedman DB. Alzheimer’s Disease in Social Media: Content Analysis of YouTube Videos. Interact J Med Res. 2017;6(2):e19. doi: 10.2196/ijmr.8612.
    » https://doi.org/10.2196/ijmr.8612.
  • 18. Delgado CK, Gazzotti MR, Santoro IL, Carvalho AK, et al. Internet Use for health-care information by subjects with COPD. Respir Care. 2015:60(9):1276-81. doi: 10.4187/respcare.03716.
    » https://doi.org/10.4187/respcare.03716.
  • 19. Lenferink A, BrusseKeizer M, van der Valk PD, Frith PA, Zwerink M, et al. “Self-management interventions including action plans for exacerbations versus usual care in patients with chronic obstructive pulmonary disease.” Cochrane Database Syst Rev. 2017;8(8):CD11682. doi: 10.1002/14651858.CD011682.pub2.
    » https://doi.org/10.1002/14651858.CD011682.pub2.
  • 20. Sigurgeirsdottir J, Halldorsdotirr S, Arnardottir RH, Gudmundsson G, Bjornsson EH. COPD patients’ experiences, self-reported needs, and needs-driven strategies to cope with self-management. Int J Chron Obstruct Pulmon Dis. 2019;14:1033-43. doi: 10.2147/COPD.S201068.
    » https://doi.org/10.2147/COPD.S201068.
  • 21. Spruit MA, Pitta F, MacAuley E, ZuWallack RL, Nici L. Pulmonary rehabilitation and physical activity in patients with Chronic Obstructive Pulmonary Disease. Am J Respir Crit Care Med. 2015;192(8):924-33. doi: 10.1164/rccm.201505-0929CI.
    » https://doi.org/10.1164/rccm.201505-0929CI.
  • 22. Janssens W, Verleden. “Nonpharmacological interventions in COPD”. Eur Respir Rev. 2023;32(167):230028. doi: 10.1183/16000617.0028-2023.
    » https://doi.org/10.1183/16000617.0028-2023.
  • 23. Garvey C, Bayles MP, Hamm LF, Hill K, Holland A, et al. Pulmonary rehabilitation exercise prescription in Chronic Obstructive Pulmonary Disease: review of selected guidelines. J Cardiopulmon Rehabil Prev. 2016;36(2):75-83. doi: 10.1097/HCR.0000000000000171.
    » https://doi.org/10.1097/HCR.0000000000000171.
  • 24. McCarthy B, Casey D, Devane D, Murphy K, Murphy E, et al. Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2015;2015(2):CD003793. doi: 10.1002/14651858.CD003793.pub3.
    » https://doi.org/10.1002/14651858.CD003793.pub3.
  • This work is an integral part of a master thesis developed at the Programa de Pós- Graduação em Reabilitação e Desempenho Funcional (PPGReab), Universidade Federal dos Vales do Jequitinhonha e Mucuri, Diamantina- MG, Brasil
  • Financing source: nothing to declare

Publication Dates

  • Publication in this collection
    04 Apr 2025
  • Date of issue
    2025

History

  • Received
    01 Dec 2023
  • Accepted
    26 Nov 2024
location_on
Universidade de São Paulo Rua Ovídio Pires de Campos, 225 2° andar. , 05403-010 São Paulo SP / Brasil, Tel: 55 11 2661-7703, Fax 55 11 3743-7462 - São Paulo - SP - Brazil
E-mail: revfisio@usp.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Reportar erro