TANAKA, Orlando Motohiro; GASPARELLO, Gil Guilherme; HARTMANN, Giovani Ceron; CASAGRANDE, Fernando Augusto; PITHON, Matheus Melo

Acessibilidade / Reportar erro

Brasil

Dental Press Journal of Orthodontics

Español English

Brasil

Español English

sumário « anterior atual seguinte »

Sumário

ORIGINAL ARTICLE • Dental Press J. Orthod. 28 (05) • 2023 • https://doi.org/10.1590/2177-6709.28.5.e2323183.oar copiar

Assessing the reliability of ChatGPT: a content analysis of self-generated and self-answered questions on clear aligners, TADs and digital imaging

Autoria SCIMAGO INSTITUTIONS RANKINGS

RESUMO

Introdução:

A Inteligência Artificial (IA) é uma ferramenta que já faz parte de nossa realidade, e esta é uma oportunidade de entendermos como ela pode ser útil na interação com os pacientes e no fornecimento de informações valiosas sobre Ortodontia.

Objetivo:

O objetivo deste estudo foi avaliar a precisão do ChatGPT em responder a perguntas sobre Alinhadores transparentes, Dispositivos de ancoragem temporária, e Imagens digitais em Ortodontia.

Métodos:

45 perguntas e respostas foram geradas pelo ChatGPT 4.0 e analisadas separadamente por cinco ortodontistas que, de forma independente, avaliaram a qualidade das informações fornecidas, usando uma escala de Likert, na qual pontuações mais altas indicavam uma maior qualidade das informações (1 = muito ruim; 2 = ruim; 3 = aceitável; 4 = bom; 5 = muito bom). Aplicou-se o teste H de Kruskal-Wallis (p < 0,05) e comparações pareadas post-hoc com correção de Bonferroni.

Resultados:

Das 225 avaliações dos cinco avaliadores diferentes, 11 (4,9%) foram consideradas como muito ruins, 4 (1,8%) como ruins, e 15 (6,7%) como aceitáveis. A maioria foi considerada boa [34 (15,1%)] ou muito boa [161 (71,6%)]. Com relação às pontuações dos avaliadores, percebeu-se uma leve concordância, com o Kappa de Fleiss igual a 0,004.

Conclusões:

O ChatGPT mostrou eficácia em fornecer respostas de qualidade para questões relacionadas a Alinhadores transparentes, Dispositivos de ancoragem temporária e Imagens digitais.

Palavras-chave:
ChatGPT; Inteligência artificial; Alinhador transparente; Dispositivo de ancoragem temporária; Imagem digital

Topics	n	Questions generated by ChatGPT 4.0	Answers generated by ChatGPT 4.0	Median	IQR	Range
Clear aligner	1	Effectiveness: Are clear aligners as effective as traditional braces in treating my orthodontic condition?	Clear aligners can be as effective as traditional braces for many types of orthodontic problems, including mild to moderate malocclusions, but severe or complex cases might still require traditional braces.	5.0	5.0	3.0-5.0
	2	Treatment duration: How long will I need to wear clear aligners?	The duration varies based on the individual's condition, but it typically ranges from 6 to 18 months. Some cases may take up to 2 years or more.	4.0	4.0	3.0-5.0
	3	Aligner visibility: Will people be able to notice that I'm wearing clear aligners?	Clear aligners are designed to be virtually invisible. Most people will not notice them unless they're looking closely.	4.0	4.0	1.0-5.0
	4	Pain or discomfort: Will clear aligners cause pain or discomfort?	Some discomfort or pressure is normal, especially when you first start using a new set of aligners. However, many people find clear aligners to be more comfortable than traditional braces.	4.0	4.0	4.0-5.0
	5	Maintenance and cleaning: How do I clean and maintain my clear aligners?	Clear aligners should be cleaned daily using a toothbrush and cold water. Hot water can warp the plastic. Special cleaning solutions are also available.	5.0	5.0	4.0-5.0
	6	Impact on daily life: Can I eat and drink while wearing clear aligners? Will they affect my speech?	Aligners should be removed when eating and drinking anything other than water. They can also cause temporary slight speech changes, but most people adapt quickly.	5.0	5.0	4.0-5.0
	7	Frequency of use: How many hours per day should I wear my aligners?	Clear aligners should be worn for 20 to 22 hours per day, and only removed for eating, drinking, brushing, and flossing.	5.0	5.0	4.0-5.0
	8	Follow-up appointments: How often will I need to see the orthodontist during my treatment?	Generally, you'll have a check-up every 6 to 8 weeks to monitor your progress and receive new sets of aligners.	2.0	2.0	1.0-4.0
	9	Aligner replacement: How often will I need to change my clear aligners?	Typically, you switch to a new set of aligners every one to two weeks, following your orthodontist's instructions.	5.0	5.0	4.0-5.0
	10	Treatment cost: How much does orthodontic treatment with clear aligners cost? Will insurance cover the treatment?	The cost varies based on the complexity of the case and geographic location. Insurance may cover part of the cost. Always check with your insurance provider and orthodontist for details.	3.0	3.0	1.0-5.0
	11	Dental hygiene during treatment: How will wearing clear aligners affect my oral hygiene routine?	Brush and floss after each meal before reinserting your aligners to maintain proper oral hygiene.	5.0	5.0	5.0
	12	Treatment suitability: Are there specific cases or conditions for which clear aligners are not suitable?	Clear aligners are suitable for many, but not all, orthodontic issues. Severely rotated teeth, large gaps, or certain types of malocclusions may require traditional braces.	5.0	5.0	5.0
	13	Post-treatment retainers: After treatment, will I need to wear a retainer to keep my teeth in their new position?	Yes, wearing a retainer post-treatment is crucial to prevent teeth from gradually shifting back to their initial positions.	5.0	5.0	5.0
	14	Potential side effects: Are there any side effects or risks associated with using clear aligners?	Some possible side effects include minor discomfort, speech alteration, dry mouth or excessive salivation. Rarely, an allergic reaction to the aligner material may occur.	5.0	5.0	4.0-5.0
	15	Emergency situations: What should I do if I lose or break my aligner before the replacement is due?	If an aligner breaks or gets lost, contact your orthodontist immediately. They may advise you to move to the next set or revert to the previous one until a replacement can be provided.	5.0	5.0	5.0
TADs	1	What are TADs?: How do TADs work in orthodontic treatment?	Temporary Anchorage Devices (TADs) are tiny titanium screws that are placed into the jawbone to act as stable anchors for moving teeth during orthodontic treatment.	5.0	5.0	4.0-5.0
	2	Procedure of placement: How are TADs placed in the mouth? Is it a surgical procedure?	TADs are placed using a minimally invasive procedure that can often be done under local anesthesia right in the orthodontist's office.	5.0	5.0	3.0-5.0
	3	Pain and discomfort: Does the placement of TADs hurt? Will there be pain or discomfort afterward?	Most patients report feeling pressure but not pain during TAD placement. Mild discomfort may occur for a day or so after placement.	5.0	5.0	4.0-5.0
	4	Effectiveness: How effective are TADs in treating my orthodontic condition?	TADs can be extremely effective in orthodontic treatment, allowing for more efficient and precise tooth movement that was previously difficult or impossible.	5.0	5.0	1.0-5.0
	5	Suitability: Are TADs suitable for everyone? Are there any age or health restrictions?	Most people are good candidates for TADs. However, conditions that affect bone quality may impact their success.	5.0	5.0	1.0-5.0
	6	Maintenance: How do I clean and maintain TADs?	TADs can be cleaned with a soft toothbrush and non-prescription mouth rinse. Your orthodontist will provide specific care instructions.	5.0	5.0	5.0
	7	Duration of treatment: How long will I need to have the TADs in my mouth?	The duration varies based on the specifics of each case, but TADs generally stay in place for a few months to over a year.	5.0	5.0	1.0-5.0
	8	Dietary changes: Will TADs affect what I can eat and drink?	There are no specific dietary restrictions, but you should avoid hard or sticky foods around the TAD area to prevent loosening.	5.0	5.0	4.0-5.0
	9	Oral hygiene: How do TADs impact my oral hygiene routine?	TADs don't significantly affect oral hygiene, but proper cleaning around the TAD is essential to prevent infection.	5.0	5.0	4.0-5.0
	10	Impact on daily life: Will TADs affect my speech or appearance?	TADs are relatively unobtrusive and do not significantly affect speech or appearance.	5.0	5.0	2.0-5.0
	11	Cost: How much does orthodontic treatment with TADs cost? Will insurance cover the treatment?	The cost varies depending on the treatment plan, geographic location, and insurance coverage. Always check with your insurance provider and orthodontist.	5.0	5.0	4.0-5.0
	12	Potential risks and complications: What are the risks and potential complications associated with TADs?	Risks include loosening of the TAD, infection, and irritation to the gums or mouth. However, serious complications are rare.	5.0	5.0	5.0
	13	Removal: Is the removal of TADs painful? What is the procedure like?	Removal is typically straightforward and can be performed with local anesthesia. It's generally less uncomfortable than the insertion.	5.0	5.0	3.0-5.0
	14	Activity limitations: Are there any activities to avoid while having TADs?	Most patients can carry on with their normal activities, but contact sports or other activities that could cause a direct blow to the mouth may require extra protection.	5.0	5.0	1.0-5.0
	15	Emergency situations: What should I do if a TAD becomes loose or falls out?	If a TAD becomes loose or falls out, contact your orthodontist immediately. They may replace it or adjust your treatment plan as necessary.	5.0	5.0	5.0-5.0
Digital imaging in orthodontics	1	What is digital imaging? How does it work in orthodontics?	Digital imaging is a technique that uses digital sensors instead of traditional photographic film to capture images. In orthodontics, it helps in precise diagnosis, planning, and treatment.	5.0	5.0	3.0-5.0
	2	Advantages: What are the benefits of digital imaging over traditional methods?	Digital imaging offers numerous advantages over traditional methods, including immediate image viewing, less radiation exposure, superior image quality, and easy image sharing and storage.	5.0	5.0	4.0-5.0
	3	Procedure: What is the process of taking digital images? Is it painful or uncomfortable?	The process is similar to taking traditional X-rays but quicker and more comfortable. A sensor is placed in the mouth, and the image is captured and instantly projected onto a computer screen.	3.0	3.0	1.0-5.0
	4	Safety: Is digital imaging safe? How much radiation is involved compared to traditional X-rays?	Digital imaging uses significantly less radiation than traditional film X-rays, making it safer for patients.	4.0	4.0	1.0-5.0
	5	Accuracy: How accurate are the images produced by digital imaging?	Digital images are highly accurate, showing minute details that can be overlooked in traditional imaging. They can be zoomed and enhanced for better diagnosis and treatment planning.	5.0	5.0	3.0-5.0
	6	Usage: How are these digital images used in my orthodontic treatment?	Digital images are used to diagnose orthodontic issues, plan treatments, monitor progress, and evaluate treatment outcomes.	5.0	5.0	5.0
	7	Security: How are my images stored and who has access to them?	Digital images are stored on secure servers and are typically backed up regularly. Access is restricted to your healthcare providers or others you grant permission to.	5.0	5.0	3.0-5.0
	8	Cost: Is digital imaging more expensive than traditional methods? Will my insurance cover it?	The cost can be slightly higher than traditional imaging due to the advanced technology. However, most insurance plans cover digital imaging as part of orthodontic treatment.	5.0	5.0	4.0-5.0
	9	Frequency: How often will I need to have these digital images taken?	The frequency of imaging depends on your specific orthodontic needs and treatment plan. Your orthodontist will guide you.	5.0	5.0	5.0
	10	Comparison with traditional methods: Can digital imaging detect more issues than traditional X-rays or photos?	Digital imaging can detect more issues and provide a more comprehensive view of your oral structures compared to traditional methods.	5.0	5.0	4.0-5.0
	11	Image availability: Will I be able to view my digital images?	Yes, you can typically view your digital images during your orthodontic visits. Some offices may also provide you access to your images through patient portals.	5.0	5.0	4.0-5.0
	12	Necessity: Is digital imaging necessary for my orthodontic treatment?	Digital imaging is not always necessary but can greatly assist in complex cases by offering precise and comprehensive visual information for planning and treatment.	5.0	4.0	4.0-5.0
	13	Children and digital imaging: Is this technology safe and appropriate for children?	Yes, digital imaging is safe and appropriate for children. In fact, the lower radiation exposure makes it an even better choice for pediatric patients.	4.0	4.0	3.0-5.0
	14	Allergies: Can I have a reaction or allergy to digital imaging?	There is no risk of allergic reactions with digital imaging as there is no physical material or substance involved that would trigger an allergy.	5.0	5.0	3.0-5.0
	15	Emergency situations: Can digital imaging help in emergency orthodontic situations?	Yes, digital imaging can provide immediate and detailed visual information that can assist in diagnosing and treating emergency orthodontic situations.	5.0	5.0	4.0-5.0

Topics	Mean	Standard deviation	Median	P value
Clear Aligners	4.33	1.189	5.0	0.356
TADs	4.57	1.015	5.0
Digital Image	4.49	0.890	5.0

Evaluators		(1) Very Poor	(2) Poor	(3) Acceptable	(4) Good	(5) Very Good
1	n	1	0	4	6	34
1	(%)	2.2%	0.0%	8.9%	13.3%	75.6%
2	n	2	2	6	12	23
2	(%)	4.4%	4.4%	13.3%	26.7%	51.1%
3	n	8	1	1	3	32
3	(%)	17.8%	2.2%	2.2%	6.7%	71.1%
4	n	0	0	1	4	40
4	(%)	0.0%	0.0%	2.2%	8.9%	88.9%
5	n	0	1	3	9	32
5	(%)	0.0%	2.2%	6.7%	20.0%	71.1%
Total	n	11	4	15	34	161
Total	(%)	4.9%	1.8%	6.7%	15.1%	71.6%

Evaluator	Bonferroni pairwise comparison
Evaluator	t	p
1 vs. 5	0	> 0.99
3 vs. 5	-1,899	0.061
1 vs. 4	-1,925	0.057
3 vs. 2	-0,155	0.877
1 vs. 2	2.149	0.034
2 vs. 5	-2,258	0.026
4 vs. 5	2.166	0.033
3 vs. 5	-0,018	0.061
1 vs. 3	1.844	0.069
4 vs. 2	0.042	> 0.001

Dental Press International Av. Luís Teixeira Mendes, 2712 , 87015-001 - Maringá - PR, Tel: (55 44) 3033-9818 - Maringá - PR - Brazil
E-mail: artigos@dentalpress.com.br

Acompanhe os números deste periódico no seu leitor de RSS

[1] tanakaom@gmail.com