Acessibilidade / Reportar erro

Users’ perceptions and preferences towards maxillary removable orthodontic retainers: a crossover randomized clinical trial

Abstract

The aim of this study was to assess, correlate, and compare users’ perceptions and preference related to maxillary removable retainers. Volunteers were recruited to use four retainer types: conventional wrap-around (CWA), wrap-around with an anterior opening (OWA), “U” wrap-around (UWA), and clear thermoplastic retainer (CT). The main outcomes were the volunteers’ perceptions, evaluated with a 100-mm visual analogue scale, and their preferred retainer. The retainers were used for 21 days each (washout intervals of 7 days). Nineteen volunteers (27 ± 4.53 years) were randomly divided into four groups that used the four retainers, but with a different sequence. Perceptions were evaluated immediately after the use of each retainer and the preference at the end of the research. Repeated measures ANOVA and Friedman tests with post-hoc Tukey’s test (intergroup comparisons), and Pearson and Spearman analyses (correlations between perceptions) were applied. The WA retainers did not significantly differ among themselves. The CT was rated significantly worse in speech (p ≤ 0.001), discomfort (p < 0.001), and occlusal interference (p < 0.001), and did not significantly differ from the others in esthetics. Users preferred significant more the WA retainers in comparison with the CT retainers. The occlusal interference caused by the CT was positively correlated to other perceptions, such as changes in speech and discomfort. WA retainers presented similar preference and perceptions, but were significantly better than the CT. The CT occlusal coverage appeared to be the primary cause of its rejection.

Orthodontic Retainers; Orthodontic Appliance Design; Malocclusion; Visual Analog Scale; Perception

Introduction

Several types of orthodontic retainers have been described in the literature, but there is no scientific support for the choice of the best device in clinical practice, or significant evidence that a specific retainer design has a better function than another.11. Littlewood SJ, Millett DT, Doubleday B, Bearn DR, Worthington HV. Retention procedures for stabilising tooth position after treatment with orthodontic braces. Cochrane Database of Syst Rev. 2016 Jan; 29(1):CD002283. https://doi.org/10.1002/14651858.CD002283.pub4
https://doi.org/10.1002/14651858.CD00228...
Immediately after orthodontic treatment, a full-time use of a retainer is usually indicated.22. Valiathan M, Hughes E. Results of a survey-based study to identify common retention practices in the United States. Am J Orthod Dentofacial Orthop. 2010 Feb;137(2): 170-7. https://doi.org/10.1016/j.ajodo.2008.03.023
https://doi.org/10.1016/j.ajodo.2008.03....
, 33. Ab Rahman N, Low TF, Idris NS. A survey on retention practice among orthodontists in Malaysia. Korean J Orthod. 2016 Jan;46(1):36-41. https://doi.org/10.4041/kjod.2016.46.1.36
https://doi.org/10.4041/kjod.2016.46.1.3...
Because of the uninterrupted use and as most of the maxillary retainers are removable, patient compliance is essential; therefore, the appliance should be comfortable. Some of the reasons reported for not using retainers include discomfort, forgetfulness, loss of the appliance, maladjustment, speech difficulties, and bad smile esthetics, but information on this topic is scarce.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...

Discomfort of the retainer is reported by 28% of patients as a reason not to use them.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...
Data show that clear thermoplastic retainers (CT) are more comfortable than wrap-around retainers (WA),66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6. , 77. Saleh M, Hajeer MY, Muessig D. Acceptability comparison between Hawley retainers and vacuum-formed retainers in orthodontic adult patients: a single-centre, randomized controlled trial. Eur J Orthod. 2017 Aug;39(4):453-61. https://doi.org/10.1093/ejo/cjx024
https://doi.org/10.1093/ejo/cjx024...
or that comfort does not differ between CT and Hawley retainer.88. Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
https://doi.org/10.1093/ejo/cjm039...
Speech interference is an important aspect of comfort, because components of the retainer are located on the lingual surface of teeth and palate, impairing tongue movements during speech.99. Kulak Kayikci ME, Akan S, Ciger S, Ozkan S. Effects of Hawley retainers on consonants and formant frequencies of vowels. Angle Orthod. 2012 Jan;82(1):14-21. https://doi.org/10.2319/032911-226.1
https://doi.org/10.2319/032911-226.1...
, 1010. Chen J, Wan J, You L. Speech and orthodontic appliances: a systematic literature review. Eur J Orthod. 2018 Jan;40(1):29-36. https://doi.org/10.1093/ejo/cjx023
https://doi.org/10.1093/ejo/cjx023...
Between 10 and 15% of patients report that speech difficulty is a reason not to use the appliance.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
Esthetics is also relevant, since 17.4 and 7.2% of patients reported to be ashamed to use Hawley and CT retainers, respectively. This difference corroborates the fact that CTs are more esthetic than other removable retainers.66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6. , 88. Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
https://doi.org/10.1093/ejo/cjm039...
On the other hand, WA is better during chewing in comparison with the CT.66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6.

Until now, these investigations were based on the subjective perception of different groups of patients with different retainers, which makes it susceptible to personal variations between samples. Currently, there is no randomized clinical investigation on perception of different retainers in the same group of volunteers. Therefore, the aim of this study was to evaluate, compare, and correlate the perceptions of the same group of persons to different types of maxillary removable orthodontic retainers. The null hypothesis was that perceptions and preference are not different regarding maxillary removable orthodontic retainers.

Methods

Trial design and changes after trial commencement

This randomized crossover controlled clinical trial involved four groups of volunteers randomized with a 1:1:1:1 allocation ratio.1111. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials. Int J Surg. 2012;10(1):28-55. https://doi.org/10.1016/j.ijsu.2011.10.001
https://doi.org/10.1016/j.ijsu.2011.10.0...
No change in methods were necessary after trial commencement. The trial was registered at the Brazilian Clinical Trials Registry – REBEC, ensaios clínicos.gov.br (RBR-2v3k6r).

Participants, eligibility criteria, and settings

Ethical approval was obtained from the Ethics Committee of Bauru Dental School, University of São Paulo, Brazil. Consecutive volunteers were recruited at the Institution from June 2015 to August 2016. They were post-graduate students at this University. The study was conducted in accordance with the ethical principles of the Declaration of Helsinki.

An orthodontist and a speech therapist of the research team performed the selection of volunteers. Eligibility criteria were the following: both sexes, between 20-40 years of age, native Portuguese speakers, presence of the first and second permanent molars, and acceptable Class I canine occlusal relationship (variations up to ¼ of Class II or III were accepted). Exclusion criteria were the presence of anterior or posterior crossbite, a zero or greater than 4 mm overjet, open bite, deep bite greater than 50%, space deficiency with crowding greater than 2 mm, and widespread anterior diastemas. Additionally, the subjects could not have been in orthodontic treatment or have had it completed for less than 12 months, have used any type of maxillary retainer in the last 12 months or any type of retainer in the mandibular arch (except the flat mandibular canine-to-canine bonded retainer). Finally, the presence of edentulous spaces, craniofacial anomalies, intellectual deficits, syndromes, neurological or psychiatric disorders, smoking, alcohol consumption, previous laryngeal surgery, altered lingual frenulum, active temporomandibular disorder, and pathological vocal alteration were also exclusion criteria.

Interventions

An orthodontist of the research team performed the interventions from August 2015 to January 2016. At the initial orthodontic exam, participants were invited to participate in the study and provided written informed consent after receiving a full explanation of the study objectives and structure. After that, alginate impressions of their maxillary arches were taken to obtain dental casts on which the retainers were made and participants were randomly allocated into four groups that used the four retainers in a different sequence. The same experienced professional manufactured all appliances. The wrap-around clasp was reused in all wrap-around retainers for a volunteer, switching only the acrylic part to minimize interferences in the research. The four retainers are described below and shown in Figure 1:

Figure 1
A. Conventional wrap-around retainer; B. Wrap-around retainer with an anterior opening. C. Horseshoe-shaped or “U” wrap-around retainer. D. Clear thermoplastic retainer.

  1. Conventional wrap-around (CWA): A vestibular arch wire of 0.9 mm stainless steel was constructed contouring the center of the maxillary teeth crowns until the most posterior tooth, around the distal surface at the gingival margin, reaching the palate, where the retention was made. Simple cervical loops were constructed between the canines and first premolars. The palatal acrylic had a thickness between 2.5 and 3 mm, with the anterior limit covering the cervical third of the anterior teeth, the lateral limit covering the cervical of the posterior teeth, and the posterior limit extending to a line connecting the first molars distal surfaces.

  2. Wrap-around with an anterior opening (OWA): The vestibular arch wire, the acrylic thickness, and its anterior and lateral limits were similar to the CWA. The posterior limit of the palatal acrylic extended to a line connecting the first molars mesial surfaces. The acrylic had an opening in the region of the palatine wrinkles, to guide the tongue position and function, and to facilitate speech. The dimensions of this opening are shown in Figure 1B .

  3. Horseshoe-shaped or “U” wrap-around (UWA): The vestibular arch wire, the acrylic thickness, and its anterior and lateral limits were similar to the CWA. There was no acrylic in the central portion of the palate and its dimensions are shown in Figure 1C . It was slightly wider in the anterior area and slightly thicker than the CWA to provide more resistance, but not exceeding 3 mm.

  4. Clear thermoplastic retainer (CT): Made of 1-mm thick clear Essix® thermoplastic material (Dentsply, York, USA), vacuum-molded to all maxillary teeth, including occlusal surfaces. The cervical limits were 2 mm above the gingival margins on the palatal and buccal surfaces.

Each type of maxillary retainer was used for 21 days (±1 day) by all participants of the four groups most of the time, except during meals, sleeping, and social events. Between each retainer, participants had a washout period without any appliance for 1 week. Therefore, all volunteers used the four retainers, each group in a different sequence. This characterized the crossover design of the study.

The volunteers’ perceptions to several factors during the use of the different appliances were investigated using a Visual Analogue Scale (VAS). A sheet of paper containing 7 100-mm scales (one for each perception assessed) were given to participants and they were instructed to make a perpendicular line on the scale at the point corresponding to the desired score (ranging from 0 to 100) for each evaluated item. A 15-mm rule (Trident; Itapuí, São Paulo, Brazil) was used to measure the scores in millimeters, from the left end of the scale to the mark. The VAS was applied to all volunteers immediately after the end of the period using each retainer. They had no access to the VAS results of the previous retainer. The perceptions evaluated were:

  1. Speech: Zero meant no change and 100 the maximum change in speech.

  2. Swallowing: Zero meant no difficulty and 100 the maximum difficulty in swallowing.

  3. Esthetics: Zero meant no impairment and 100 the maximum impairment to esthetics.

  4. Salivation: Zero meant no increase in salivation and 100 the maximum increase in salivation.

  5. Nausea: Zero meant no symptom and 100 the maximum nausea.

  6. Discomfort: Zero meant maximum comfort and 100 the maximum level of discomfort.

  7. Occlusion: Zero meant no interference and 100 the maximum level of occlusal interference.

Outcomes

Primary outcomes were the perceptions described above, registered in the 100 mm VAS. At the end of the research, participants were questioned about the general preference among the four retainers, giving a score from 1 to 4, from the best to worst. There were no outcome changes after trial commencement.

Sample size calculation

Sample size calculation was based on the ability to detect an intergroup difference in discomfort perception of 20 mm in the VAS, with a standard deviation of 24.3 mm (greater standard deviation observed in a previous similar study),1212. Choi JH, Moon CH. Discomfort caused by the circumferential comfortable retainer (CCR) as a removable maxillary retainer. Korean J Orthod. 2010 Oct; 40(5):325-33. https://doi.org/10.4041/kjod.2010.40.5.325
https://doi.org/10.4041/kjod.2010.40.5.3...
an alpha error of 5%, and a test power of 80%. The StatsToDo was used to calculate sample size for the analysis of variance, available on the website (https://www.statstodo.com/SSizAOV_Pgm.php). Seventeen participants were required in each group. It should be emphasized that the sample size calculation was performed for ANOVA. Because this was a crossover study, all the same volunteers participated in the four research groups.

Randomization

A simple computer-generated randomization with stratification by gender was accomplished with a 1:1:1:1 ratio for the four groups, according to the retainer sequence, using the Stata© software (StataCorp, College Station, TX) to ensure equal distribution of participants in the groups. Allocation concealment was achieved with sequentially numbered and sealed envelopes containing the orthodontic retainer sequence allocation cards, which were prepared before the trial. One operator (D.C.L.) was responsible for opening the sequence of envelopes and implementing the randomization process.

Blinding

Blinding of patients and operator regarding the type of appliance was not possible; however, the outcome assessment was blinded because VAS records were unidentified during the analysis. One operator (D.C.L.) performed all the measurements on the VAS.

Statistical analyses

Normal distribution of each variable was verified using Shapiro-Wilk test. Differences in perceptions of patients concerning the four retainers were investigated with repeated measures ANOVA and post-hoc Tukey’s test, for normally distributed data, or Friedman test and post-hoc Tukey’s test, for data with non-normal distribution . These analyses were conducted with the SigmaPlot 12© (Systat Software Inc., San Jose, USA). A statistical significance level of 5% was regarded for all tests.

Correlation between the different perceptions about each type of retainer was investigated with Pearson’s correlation coefficient. These correlations were conducted with the Statistical Package for Social Sciences, version 21 (SPSS Inc., Chicago, USA).

Results

Participant flow and baseline data

Forty-seven participants were recruited from June 2016 to August 2016; 20 (42.5%) patients were excluded because they did not meet the eligibility criteria and 6 (12.7%) because they declined to participate. Twenty-one volunteers, 13 men and 8 women with a mean age of 26.7 years (standard deviation ± 4.3), were included in this investigation. The sample size obtained allowed a dropout rate of 19%. Figure 2 shows a flowchart with reasons of losses and exclusions before and after randomization.

Figure 2
Flow diagram of study recruitment and interventions. CWA: Conventional Wrap-Around retainer; OWA: Wrap-Around retainer with an opening; UWA: “U” Wrap-Around retainer; CT: Clear Thermoplastic retainer.

Numbers analyzed for each outcome

Two participants (one man and one woman) dropped out (9.5%) immediately after the randomization process because they scheduled a long trip during the survey period. Thus, the final sample had 19 participants, 12 men and 7 women, with a mean age of 27 years (standard deviation ± 4.53).

Descriptive statistics of the participants’ perceptions are shown in Table 1 , as well as the results of statistical comparisons between retainers for each perception. Users’ preference of retainers is described in Table 2 . In an overall assessment, the UWA presented better scores and higher preference, but with no statistically significant difference in comparison to other WA designs. The UWA was preferred by 10 of 19 participants, but this was not enough to generate statistical difference from other WAs.

Table 1
Descriptive statistics of the perceptions of the four retainers.
Table 2
Users’ preference of retainers from the best (1st) to the worst (4th).

In general, the CT presented significantly worse perceptions, except in esthetics, which showed no significant difference compared to other WA retainers. The CT was chosen as the worst option by 15 of the 19 volunteers, differing significantly from all the other WAs.

Correlation results can be seen in Table 3 . Discomfort was positively correlated with speech changes on all retainers. Rejection to CT was positively correlated with speech changes, discomfort, and occlusal interference. In addition to rejection, occlusal interference with CT showed a significant positive correlation with discomfort. In the OWA, changes in swallowing were positively correlated with salivation, discomfort, and nausea. The UWA was the favorite retainer for most participants, but its worst scores for preference were correlated to greater changes in swallowing.

Table 3
Significant correlations between perceptions on different retainers.

Harms

A variable pressure sensation and mild pain in teeth were reported by the first participants during initial use of the CT. After this intercurrence, all CT retainers were redone with application of three layers of nail varnish on the teeth of the cast model. No more symptoms were reported.

Discussion

Main findings in the context of the existing evidence and their interpretation

Until now, there was no crossover study on perceptions of orthodontic retainers in which patients are their own controls. All previous studies have evaluated perceptions on different groups, which reduces the importance of the comparisons.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...
, 66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6. , 77. Saleh M, Hajeer MY, Muessig D. Acceptability comparison between Hawley retainers and vacuum-formed retainers in orthodontic adult patients: a single-centre, randomized controlled trial. Eur J Orthod. 2017 Aug;39(4):453-61. https://doi.org/10.1093/ejo/cjx024
https://doi.org/10.1093/ejo/cjx024...
, 88. Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
https://doi.org/10.1093/ejo/cjm039...
, 99. Kulak Kayikci ME, Akan S, Ciger S, Ozkan S. Effects of Hawley retainers on consonants and formant frequencies of vowels. Angle Orthod. 2012 Jan;82(1):14-21. https://doi.org/10.2319/032911-226.1
https://doi.org/10.2319/032911-226.1...
, 1212. Choi JH, Moon CH. Discomfort caused by the circumferential comfortable retainer (CCR) as a removable maxillary retainer. Korean J Orthod. 2010 Oct; 40(5):325-33. https://doi.org/10.4041/kjod.2010.40.5.325
https://doi.org/10.4041/kjod.2010.40.5.3...
, 1313. Erb DP. Speech effects of the maxillary retainer. Angle Orthod. 1967 Oct;37(4):298-303. https://doi.org/10.1043/0003-3219(1967)037<0298:SEOTMR>2.0.CO;2
https://doi.org/10.1043/0003-3219(1967)0...
, 1414. Feldman EW. Speech articulation problems associated with placement of orthodontic appliances. J Speech Hear Disord. 1956 Mar;21(1):34-8. , 1515. Haydar B, Karabulut G, Ozkan S, Aksoy AU, Ciger S. Effects of retainers on the articulation of speech. Am J Orthod Dentofacial Orthop. 1996 Nov;110(5):535-40. https://doi.org/10.1016/S0889-5406(96)70062-8
https://doi.org/10.1016/S0889-5406(96)70...
, 1616. Meade MJ, Millett D. Retention protocols and use of vacuum-formed retainers among specialist orthodontists. J Orthod. 2013 Dec;40(4):318-25. https://doi.org/10.1179/1465313313Y.0000000066
https://doi.org/10.1179/1465313313Y.0000...
, 1717. Stratton CS, Burkland GA. The effect of maxillary retainers on the clarity of speech. J Clin Orthod. 1993 Jun;27(6):338-40. The most commonly used maxillary orthodontic retainers are removable, especially the Hawley plate, the WA, and the CT, whose preferences vary according to country or region.22. Valiathan M, Hughes E. Results of a survey-based study to identify common retention practices in the United States. Am J Orthod Dentofacial Orthop. 2010 Feb;137(2): 170-7. https://doi.org/10.1016/j.ajodo.2008.03.023
https://doi.org/10.1016/j.ajodo.2008.03....
, 33. Ab Rahman N, Low TF, Idris NS. A survey on retention practice among orthodontists in Malaysia. Korean J Orthod. 2016 Jan;46(1):36-41. https://doi.org/10.4041/kjod.2016.46.1.36
https://doi.org/10.4041/kjod.2016.46.1.3...
, 1616. Meade MJ, Millett D. Retention protocols and use of vacuum-formed retainers among specialist orthodontists. J Orthod. 2013 Dec;40(4):318-25. https://doi.org/10.1179/1465313313Y.0000000066
https://doi.org/10.1179/1465313313Y.0000...
, 1818. Assumpção WA, Ota GKB, Ferreira RI, Cotrim-Ferreira FA. Orthodontic retainers: analysis of prescriptions sent to laboratories. Dental Press J Orthod. 2012 Mar-Apr;17(2):36.e1-6. http://dx.doi.org/10.1590/S2176-94512012000200007
http://dx.doi.org/10.1590/S2176-94512012...
, 1919. Lai CS, Grossen JM, Renkema AM, Bronkhorst E, Fudalej PS, Katsaros C. Orthodontic retention procedures in Switzerland. Swiss Dent J. 2014;124(6):655-61. , 2020. Lima, V.S.A., Carvalho, F.A.R., Almeida, R.C.C. and Capelli Jr, J. Different strategies used in the retention phase of orthodontic treatment. Dental Press J Orthod. 2012 July-Aug;17(4):115-21. http://dx.doi.org/10.1590/S2176-94512012000400022
http://dx.doi.org/10.1590/S2176-94512012...
, 2121. Renkema AM, Sips ET, Bronkhorst E, Kuijpers-Jagtman AM. A survey on orthodontic retention procedures in The Netherlands. Eur J Orthod. 2009 Aug;31(4):432-37. https://doi.org/10.1093/ejo/cjn131
https://doi.org/10.1093/ejo/cjn131...
, 2222. Singh P, Grammati S, Kirschen R. Orthodontic retention patterns in the United Kingdom. J Orthod. 2009 Jun;36(2):115-21. https://doi.org/10.1179/14653120723040
https://doi.org/10.1179/14653120723040...
, 2323. Wong P, Freer TJ. Patients’ attitudes towards compliance with retainer wear. Aust Orthod J. 2005 May;21(1):45-53. The WA was selected for this study in relation to the Hawley plate, because the aim was to evaluate the influence of the different palatal acrylic designs, and the occlusal interference generated by the Hawley retaining clasps could impair this evaluation.

Thinner maxillary removable retainers appear to generate less interference in speech.1313. Erb DP. Speech effects of the maxillary retainer. Angle Orthod. 1967 Oct;37(4):298-303. https://doi.org/10.1043/0003-3219(1967)037<0298:SEOTMR>2.0.CO;2
https://doi.org/10.1043/0003-3219(1967)0...
Thicknesses of up to 5 mm have been described for the WA,1717. Stratton CS, Burkland GA. The effect of maxillary retainers on the clarity of speech. J Clin Orthod. 1993 Jun;27(6):338-40. but this study used a thinner acrylic of around 2.5 mm, balancing appliance resistance and comfort to the patient, in agreement with recent data.1515. Haydar B, Karabulut G, Ozkan S, Aksoy AU, Ciger S. Effects of retainers on the articulation of speech. Am J Orthod Dentofacial Orthop. 1996 Nov;110(5):535-40. https://doi.org/10.1016/S0889-5406(96)70062-8
https://doi.org/10.1016/S0889-5406(96)70...
A thickness of 1 mm was chosen for the CT because it is used by most orthodontists.1616. Meade MJ, Millett D. Retention protocols and use of vacuum-formed retainers among specialist orthodontists. J Orthod. 2013 Dec;40(4):318-25. https://doi.org/10.1179/1465313313Y.0000000066
https://doi.org/10.1179/1465313313Y.0000...
Moreover, a CT thinner than 1 mm presents a higher fracture rate and does not appear to be more comfortable.2424. Zhu Y, Lin J, Long H, Ye N, Huang R, Yang X et al. Comparison of survival time and comfort between 2 clear overlay retainers with different thicknesses: A pilot randomized controlled trial. Am J Orthod Dentofacial Orthop. 2017 Mar; 151(3):433-9. https://doi.org/10.1016/j.ajodo.2016.10.019
https://doi.org/10.1016/j.ajodo.2016.10....

Three weeks of appliance use is a very short time compared to the usual time of the retention phase. However, we enrolled volunteers who were not in retention or in active orthodontic treatment to test the four different retainers with washout periods because this study design was unfeasible in patients under orthodontic treatment. To avoid participants’ exhaustion and a greater dropout rate, the period of time was restricted to three weeks. Each additional week of use of each appliance would mean a month more of observation for volunteers and, in a prospective clinical study, the risk of dropout should be considered. Also, for this reason, the retainers were not used during sleep, because speech does not occur and swallowing is reduced during this time. Furthermore, all models were used in the beginning, middle, and end of the research, to minimize any possible influence. Additionally, the daily time of use was not controlled with questionnaires or chips embedded in the appliances,2525. Hyun P, Preston CB, Al-Jewair TS, Park-Hyun E, Tabbaa S. Patient compliance with Hawley retainers fitted with the SMART((R)) sensor: a prospective clinical pilot study. Angle Orthod. 2015 Mar;85(2):263-9. https://doi.org/10.2319/030814-163.1
https://doi.org/10.2319/030814-163.1...
to reproduce the clinical routine, which usually does not include such protocols.

In general, the UWA received better scores but did not significantly differ from the CWA and OWA. The UWA seemed to be less uncomfortable and cause less changes in speech than the CWA.1212. Choi JH, Moon CH. Discomfort caused by the circumferential comfortable retainer (CCR) as a removable maxillary retainer. Korean J Orthod. 2010 Oct; 40(5):325-33. https://doi.org/10.4041/kjod.2010.40.5.325
https://doi.org/10.4041/kjod.2010.40.5.3...
On the other hand, the CT received significantly worse scores than the other retainers in all perceptions, except in esthetics, a result that differs from the literature in several respects. The CT has been considered more esthetic than other retainers.66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6. , 88. Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
https://doi.org/10.1093/ejo/cjm039...
In this study, the CT also obtained better scores for esthetics, but without significant difference compared to other appliances, similarly to a published research in which the CT and Hawley retainers were compared.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
Some explanations for this surprising fact can be given. Firstly, other perceptions could have been so negative in the CT (speech, swallowing, salivation, discomfort, nausea and occlusion) that esthetics lost its relevance. Another possibility could be related to the complaint about saliva accumulation in the plate-tooth interface and its unpleasant appearance in the anterior region. Finally, the CT used in this research was not completely clear, but translucent or slightly milky, as described by the manufacturer, a characteristic that may have negatively impacted the esthetic perception. It is noteworthy that among the many factors reported for the lack of compliance in using the retainers (forgetfulness, inconvenience in placing and removing the retainer, discomfort, loss of the retainer, speech changes), esthetics seems to have the lowest importance for patients.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...

Another highlighted perception was the discomfort caused by retainers, a fact described by 28% of patients as a reason not to use it.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...
The CT seemed more comfortable than the WA,66. Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6. and comfort did not differ between the CT and the Hawley plate.88. Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
https://doi.org/10.1093/ejo/cjm039...
Among the WA appliances, the UWA received better scores, but these retainers did not differ significantly among themselves. On the other hand, the CT was significantly more uncomfortable than all WA. Some reasons for the great discomfort caused by the CT can be inferred from correlations with other perceptions, since its discomfort was positively correlated with speech changes, salivation, and especially with the occlusal interference caused by the occlusal coverage, which is not present in the WA.

The occlusal interference generated by the occlusal coverage appeared to be the major cause of negative perceptions and the rejection of the CT in relation to the other WAs, as it was very positively correlated to other perceptions like speech changes, salivation, and discomfort. In addition, due to the occlusal coverage of the CT, the increase in the number of occlusal contacts during retention after fix appliance removal seems to hamper vertical adjustment and the increase in contact number during retention, which usually happens with the WA or Hawley plate.2626. Hoybjerg AJ, Currier GF, Kadioglu O. Evaluation of 3 retention protocols using the American Board of Orthodontics cast and radiograph evaluation. Am J Orthod Dentofacial Orthop. 2013 Jul;144(1):16-22. https://doi.org/10.1016/j.ajodo.2013.02.022
https://doi.org/10.1016/j.ajodo.2013.02....
, 2727. Sauget E, Covell Jr DA, Boero RP, Lieber WS. Comparison of occlusal contacts with use of Hawley and clear overlay retainers. Angle Orthod. 1997 Jun;67(3):223-30. Another issue is the soft characteristic of the material with which the CT is made. It is suggested that, differently from the hard occlusal splints, those made of soft material do not reduce muscle activity but, oppositely, seem to stimulate it in patients with nocturnal bruxism.2828. Okeson JP. The effects of hard and soft occlusal splints on nocturnal bruxism. J Am Dent Assoc. 1987 Jun;114(6):788-91. https://doi.org/10.14219/jada.archive.1987.0165
https://doi.org/10.14219/jada.archive.19...
For this reason, the CT should be avoided in these patients.

The CT should be extended over the entire maxillary arch to prevent extrusion of the most posterior teeth, which could lead to an anterior open bite. The need to encompass the most posterior teeth aggravates the occlusal interference, often beyond the limits of the freeway space, a fact reported by some volunteers, particularly those who presented third molars. Thus, it is suggested to extend the retainer only to the middle of the last teeth, which prevents their extrusion and minimizes posterior occlusal interference. The CT also seems to deteriorate more easily due to pressure of the teeth, especially in patients with bruxism, and incorporates fluids and pigments, which lead to color change over time.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
Unfortunately, due to the short period of use of each retainer (21 days), this fact could not be observed. At the beginning of the study, some patients reported that the CT pressed the teeth and gums in different places. This justified the retainer construction after relieving the teeth of the model, without extending to the gum.

Speech was positively correlated with discomfort in all appliances, especially in the CT, which was significantly more uncomfortable than the others. This result confirms the literature where speech changes are reported by 15% of patients as the reason for not using the retainer.44. Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
https://doi.org/10.1016/j.ajodo.2010.10....
, 55. Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111. eCollection 2015
https://doi.org/10.2147/PPA.S94111...
Moreover, it justifies the efforts to explore and seek solutions for this problem.99. Kulak Kayikci ME, Akan S, Ciger S, Ozkan S. Effects of Hawley retainers on consonants and formant frequencies of vowels. Angle Orthod. 2012 Jan;82(1):14-21. https://doi.org/10.2319/032911-226.1
https://doi.org/10.2319/032911-226.1...
, 1313. Erb DP. Speech effects of the maxillary retainer. Angle Orthod. 1967 Oct;37(4):298-303. https://doi.org/10.1043/0003-3219(1967)037<0298:SEOTMR>2.0.CO;2
https://doi.org/10.1043/0003-3219(1967)0...
, 1414. Feldman EW. Speech articulation problems associated with placement of orthodontic appliances. J Speech Hear Disord. 1956 Mar;21(1):34-8. , 1515. Haydar B, Karabulut G, Ozkan S, Aksoy AU, Ciger S. Effects of retainers on the articulation of speech. Am J Orthod Dentofacial Orthop. 1996 Nov;110(5):535-40. https://doi.org/10.1016/S0889-5406(96)70062-8
https://doi.org/10.1016/S0889-5406(96)70...
, 1717. Stratton CS, Burkland GA. The effect of maxillary retainers on the clarity of speech. J Clin Orthod. 1993 Jun;27(6):338-40.

The null hypothesis was rejected because the WA retainers did not significantly differ from each other, but presented significantly better perceptions and preference compared to the CT. The occlusal interference appeared to be the major cause of negative perceptions and the rejection of the CT. Therefore, WA retainers should be given preference for the retention phase of orthodontic treatment. Further studies would be interesting to confirm these results in orthodontic patients with a longer usage time.

Limitations

This investigation presents some limitations. First, the duration of use of the retainer was short (21 days) in comparison to the usual retention period. It is known that some changes, such as in speech, tend to greatly improve after 1 month of retainer use, but may still be present after 3 months.99. Kulak Kayikci ME, Akan S, Ciger S, Ozkan S. Effects of Hawley retainers on consonants and formant frequencies of vowels. Angle Orthod. 2012 Jan;82(1):14-21. https://doi.org/10.2319/032911-226.1
https://doi.org/10.2319/032911-226.1...
Secondly, the perceptions were evaluated by the volunteers themselves, and not by specialists. Finally, the volunteers were not orthodontic patients and were not using any appliance before entering this study. On the other hand, this fact also reduces the influence of previous appliance experiences and the effect of possible treatment relapses of the results.

The use of the VAS to numerically evaluate perception could be considered a limitation in this research. However, the VAS is a reliable2929. Howells DJ, Shaw WC. The validity and reliability of ratings of dental and facial attractiveness for epidemiologic use. Am J Orthod. 1985 Nov;88(5): 402-8. https://doi.org/10.1016/0002-9416(85)90067-3
https://doi.org/10.1016/0002-9416(85)900...
and commonly used scoring method in health research to generate parametric data from subjective notions, such as pain3030. Michelotti A, Farella M, Gallo LM, Veltri A, Palla S, Martina R. Effect of occlusal interference on habitual activity of human masseter. J Dent Res, 2005 Jul;84(7): 644-8. https://doi.org/10.1177/154405910508400712
https://doi.org/10.1177/1544059105084007...
and smile attractiveness.3131. Paiva TT, Machado RM, Motta AT, Mattos CT. Influence of canine vertical position on smile esthetic perceptions by orthodontists and laypersons. Am J Orthod Dentofacial Orthop. 2018 Mar; 153(3): 371-6. https://doi.org/10.1016/j.ajodo.2018.04.011
https://doi.org/10.1016/j.ajodo.2018.04....

Generalizability

These results are important because they reveal the perceptions of the users, who are the most important part in the retention phase with removable appliances, when compliance is essential. However, generalization of these results to orthodontic patients should be performed with caution, since the volunteers were not orthodontic patients and their perceptions may be slightly different. In addition, the retainers were used for a short period of time (21 days), and the perceptions may change with a longer time. Finally, since the volunteers were adults, these results should be carefully applied to children, whose adaptation to retainers may be different.

References

  • 1
    Littlewood SJ, Millett DT, Doubleday B, Bearn DR, Worthington HV. Retention procedures for stabilising tooth position after treatment with orthodontic braces. Cochrane Database of Syst Rev. 2016 Jan; 29(1):CD002283. https://doi.org/10.1002/14651858.CD002283.pub4
    » https://doi.org/10.1002/14651858.CD002283.pub4
  • 2
    Valiathan M, Hughes E. Results of a survey-based study to identify common retention practices in the United States. Am J Orthod Dentofacial Orthop. 2010 Feb;137(2): 170-7. https://doi.org/10.1016/j.ajodo.2008.03.023
    » https://doi.org/10.1016/j.ajodo.2008.03.023
  • 3
    Ab Rahman N, Low TF, Idris NS. A survey on retention practice among orthodontists in Malaysia. Korean J Orthod. 2016 Jan;46(1):36-41. https://doi.org/10.4041/kjod.2016.46.1.36
    » https://doi.org/10.4041/kjod.2016.46.1.36
  • 4
    Pratt MC, Kluemper GT, Hartsfield JK Jr, Fardo D, Nash DA. Evaluation of retention protocols among members of the American Association of Orthodontists in the United States. Am J Orthod Dentofacial Orthop. 2011 Oct;140(4):520-6. https://doi.org/10.1016/j.ajodo.2010.10.023
    » https://doi.org/10.1016/j.ajodo.2010.10.023
  • 5
    Lin F, Sun H, Ni Z, Zheng M, Yao L. A feasible method to improve adherence of Hawley retainer in adolescent orthodontic patients: a randomized controlled trial. Patient Prefer Adherence. 2015 Oct;9:1525-30. https://doi.org/10.2147/PPA.S94111 eCollection 2015
    » https://doi.org/10.2147/PPA.S94111
  • 6
    Kumar AG, Bansal A. Effectiveness and acceptability of Essix and Begg retainers: a prospective study. Aust Orthod J. 2011 May;27(1):52-6.
  • 7
    Saleh M, Hajeer MY, Muessig D. Acceptability comparison between Hawley retainers and vacuum-formed retainers in orthodontic adult patients: a single-centre, randomized controlled trial. Eur J Orthod. 2017 Aug;39(4):453-61. https://doi.org/10.1093/ejo/cjx024
    » https://doi.org/10.1093/ejo/cjx024
  • 8
    Hichens L, Rowland H, Williams A, Hollinghurst S, Ewings P, Clark S et al. (2007) Cost-effectiveness and patient satisfaction: Hawley and vacuum-formed retainers. Eur J Orthod. 2007 Aug;29(4):372-38. https://doi.org/10.1093/ejo/cjm039
    » https://doi.org/10.1093/ejo/cjm039
  • 9
    Kulak Kayikci ME, Akan S, Ciger S, Ozkan S. Effects of Hawley retainers on consonants and formant frequencies of vowels. Angle Orthod. 2012 Jan;82(1):14-21. https://doi.org/10.2319/032911-226.1
    » https://doi.org/10.2319/032911-226.1
  • 10
    Chen J, Wan J, You L. Speech and orthodontic appliances: a systematic literature review. Eur J Orthod. 2018 Jan;40(1):29-36. https://doi.org/10.1093/ejo/cjx023
    » https://doi.org/10.1093/ejo/cjx023
  • 11
    Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials. Int J Surg. 2012;10(1):28-55. https://doi.org/10.1016/j.ijsu.2011.10.001
    » https://doi.org/10.1016/j.ijsu.2011.10.001
  • 12
    Choi JH, Moon CH. Discomfort caused by the circumferential comfortable retainer (CCR) as a removable maxillary retainer. Korean J Orthod. 2010 Oct; 40(5):325-33. https://doi.org/10.4041/kjod.2010.40.5.325
    » https://doi.org/10.4041/kjod.2010.40.5.325
  • 13
    Erb DP. Speech effects of the maxillary retainer. Angle Orthod. 1967 Oct;37(4):298-303. https://doi.org/10.1043/0003-3219(1967)037<0298:SEOTMR>2.0.CO;2
    » https://doi.org/10.1043/0003-3219(1967)037<0298:SEOTMR>2.0.CO;2
  • 14
    Feldman EW. Speech articulation problems associated with placement of orthodontic appliances. J Speech Hear Disord. 1956 Mar;21(1):34-8.
  • 15
    Haydar B, Karabulut G, Ozkan S, Aksoy AU, Ciger S. Effects of retainers on the articulation of speech. Am J Orthod Dentofacial Orthop. 1996 Nov;110(5):535-40. https://doi.org/10.1016/S0889-5406(96)70062-8
    » https://doi.org/10.1016/S0889-5406(96)70062-8
  • 16
    Meade MJ, Millett D. Retention protocols and use of vacuum-formed retainers among specialist orthodontists. J Orthod. 2013 Dec;40(4):318-25. https://doi.org/10.1179/1465313313Y.0000000066
    » https://doi.org/10.1179/1465313313Y.0000000066
  • 17
    Stratton CS, Burkland GA. The effect of maxillary retainers on the clarity of speech. J Clin Orthod. 1993 Jun;27(6):338-40.
  • 18
    Assumpção WA, Ota GKB, Ferreira RI, Cotrim-Ferreira FA. Orthodontic retainers: analysis of prescriptions sent to laboratories. Dental Press J Orthod. 2012 Mar-Apr;17(2):36.e1-6. http://dx.doi.org/10.1590/S2176-94512012000200007
    » http://dx.doi.org/10.1590/S2176-94512012000200007
  • 19
    Lai CS, Grossen JM, Renkema AM, Bronkhorst E, Fudalej PS, Katsaros C. Orthodontic retention procedures in Switzerland. Swiss Dent J. 2014;124(6):655-61.
  • 20
    Lima, V.S.A., Carvalho, F.A.R., Almeida, R.C.C. and Capelli Jr, J. Different strategies used in the retention phase of orthodontic treatment. Dental Press J Orthod. 2012 July-Aug;17(4):115-21. http://dx.doi.org/10.1590/S2176-94512012000400022
    » http://dx.doi.org/10.1590/S2176-94512012000400022
  • 21
    Renkema AM, Sips ET, Bronkhorst E, Kuijpers-Jagtman AM. A survey on orthodontic retention procedures in The Netherlands. Eur J Orthod. 2009 Aug;31(4):432-37. https://doi.org/10.1093/ejo/cjn131
    » https://doi.org/10.1093/ejo/cjn131
  • 22
    Singh P, Grammati S, Kirschen R. Orthodontic retention patterns in the United Kingdom. J Orthod. 2009 Jun;36(2):115-21. https://doi.org/10.1179/14653120723040
    » https://doi.org/10.1179/14653120723040
  • 23
    Wong P, Freer TJ. Patients’ attitudes towards compliance with retainer wear. Aust Orthod J. 2005 May;21(1):45-53.
  • 24
    Zhu Y, Lin J, Long H, Ye N, Huang R, Yang X et al. Comparison of survival time and comfort between 2 clear overlay retainers with different thicknesses: A pilot randomized controlled trial. Am J Orthod Dentofacial Orthop. 2017 Mar; 151(3):433-9. https://doi.org/10.1016/j.ajodo.2016.10.019
    » https://doi.org/10.1016/j.ajodo.2016.10.019
  • 25
    Hyun P, Preston CB, Al-Jewair TS, Park-Hyun E, Tabbaa S. Patient compliance with Hawley retainers fitted with the SMART((R)) sensor: a prospective clinical pilot study. Angle Orthod. 2015 Mar;85(2):263-9. https://doi.org/10.2319/030814-163.1
    » https://doi.org/10.2319/030814-163.1
  • 26
    Hoybjerg AJ, Currier GF, Kadioglu O. Evaluation of 3 retention protocols using the American Board of Orthodontics cast and radiograph evaluation. Am J Orthod Dentofacial Orthop. 2013 Jul;144(1):16-22. https://doi.org/10.1016/j.ajodo.2013.02.022
    » https://doi.org/10.1016/j.ajodo.2013.02.022
  • 27
    Sauget E, Covell Jr DA, Boero RP, Lieber WS. Comparison of occlusal contacts with use of Hawley and clear overlay retainers. Angle Orthod. 1997 Jun;67(3):223-30.
  • 28
    Okeson JP. The effects of hard and soft occlusal splints on nocturnal bruxism. J Am Dent Assoc. 1987 Jun;114(6):788-91. https://doi.org/10.14219/jada.archive.1987.0165
    » https://doi.org/10.14219/jada.archive.1987.0165
  • 29
    Howells DJ, Shaw WC. The validity and reliability of ratings of dental and facial attractiveness for epidemiologic use. Am J Orthod. 1985 Nov;88(5): 402-8. https://doi.org/10.1016/0002-9416(85)90067-3
    » https://doi.org/10.1016/0002-9416(85)90067-3
  • 30
    Michelotti A, Farella M, Gallo LM, Veltri A, Palla S, Martina R. Effect of occlusal interference on habitual activity of human masseter. J Dent Res, 2005 Jul;84(7): 644-8. https://doi.org/10.1177/154405910508400712
    » https://doi.org/10.1177/154405910508400712
  • 31
    Paiva TT, Machado RM, Motta AT, Mattos CT. Influence of canine vertical position on smile esthetic perceptions by orthodontists and laypersons. Am J Orthod Dentofacial Orthop. 2018 Mar; 153(3): 371-6. https://doi.org/10.1016/j.ajodo.2018.04.011
    » https://doi.org/10.1016/j.ajodo.2018.04.011

Publication Dates

  • Publication in this collection
    15 Aug 2019
  • Date of issue
    2019

History

  • Received
    28 Aug 2018
  • Accepted
    13 June 2019
  • Reviewed
    27 June 2019
Sociedade Brasileira de Pesquisa Odontológica - SBPqO Av. Prof. Lineu Prestes, 2227, 05508-000 São Paulo SP - Brazil, Tel. (55 11) 3044-2393/(55 11) 9-7557-1244 - São Paulo - SP - Brazil
E-mail: office.bor@ingroup.srv.br