Acessibilidade / Reportar erro

Accuracy Assessment of Virtual Surgical Planning Comparing 3D Virtual Surgical Planning and Post-Operative CBCTs in Surgical Skeletal Class III Cases: A Retrospective Study

ABSTRACT

Objective:

To evaluate the accuracy of Virtual Surgical Planning (VSP) comparing VSPs and post-operative CBCT scans in patients undergoing bimaxillary orthognathic surgery of severe Skeletal Class III malocclusion.

Material and Methods:

Twenty-three patients (9 males and 14 females, mean age 24.1 ± 7.0 years) were selected and submitted to bimaxillary orthognathic surgery. Pre-operative VSPs and post-operative CBCTs were compared using both linear (taking into account four skeletal and six dental landmarks, each one described by the respective coordinates) and angular measures (seven planes in total). The threshold discrepancies for post-operative clinical acceptable results were set at ≤2 mm for liner and ≤4° for angular discrepancies. The mean difference values and its 95% confidence interval were identified, comparing which planned and which obtained in absolute value.

Results:

There were significant statistical differences for all absolute linear measures investigated, although only two overcome the linear threshold value of 2mm in both X and Y-linear dimensions. Linear deviations in Z-linear dimension do not reach statistical significance. All 12 angular measures reach the statistical significance, although none overcome the threshold angular value of 4°. Angular deviation for roll register the higher accuracy in contrast to pitch and yaw.

Conclusion:

Virtual surgical planning is a reliable planning method to be used in orthognathic surgery field; as a matter of fact, although some discrepancies between the planned on the obtained are evident, most of them meet the tolerability range.

Keywords:
Orthodontics; Malocclusion, Angle Class III; Epidemiologic Methods

Introduction

Skeletal Class III malocclusion is a condition in which early treatment is often advocated due to fact that in an early age, the skeletal responsivity to corrective orthopedic forces is good, leading to satisfactory results, especially in the short-term [1[1] Baccetti T, McGill JS, Franchi L, McNamara JA Jr, Tollaro I. Skeletal effects of early treatment of Class III malocclusion with maxillary expansion and face-mask therapy. Am J Orthod Dentofacial Orthop 1998; 113(3):333-43. https://doi.org/10.1016/s0889-5406(98)70306-3
https://doi.org/10.1016/s0889-5406(98)70...

[2] Pisani L, Bonaccorso L, Fastuca R, Spena R, Lombardo L, Caprioglio A. Systematic review for orthodontic and orthopedic treatments for anterior open bite in the mixed dentition. Prog Orthod 2016; 17(1):28. https://doi.org/10.1186/s40510-016-0142-0
https://doi.org/10.1186/s40510-016-0142-...

[3] Di Fazio D, Lombardo L, Gracco A, D'Amico P, Siciliani G. Lip pressure at rest and during function in 2 groups of patients with different occlusions. Am J Orthod Dentofacial Orthop 2011; 139(1):e1-6. https://doi.org/10.1016/j.ajodo.2010.02.030
https://doi.org/10.1016/j.ajodo.2010.02....
-4[4] Lombardo L, Palone M, Carlucci A, Siciliani G. Clear aligner hybrid approach: A case report. J World Fed Orthod 2020; 9(1):32-43. https://doi.org/10.1016/j.ejwf.2020.01.001
https://doi.org/10.1016/j.ejwf.2020.01.0...
].

Despite this, long-term stability results are not always good due to fact that poor patience compliance [5[5] Arreghini A, Trigila S, Lombardo L, Siciliani G. Objective assessment of compliance with intra- and extraoral removable appliances. Angle Orthod 2017; 87(1):88-95. https://doi.org/10.2319/020616-104.1.
https://doi.org/10.2319/020616-104.1...
] and unfavorable skeletal Class III pattern growth (rate and duration of mandibular lengthening) could not be previewed in some cases [6[6] Masucci C, Franchi L, Defraia E, Mucedero M, Cozza P, Baccetti T. Stability of rapid maxillary expansion and facemask therapy: a long-term controlled study. Am J Orthod Dentofacial Orthop 2011; 140(4):493-500. https://doi.org/10.1016/j.ajodo.2010.09.031
https://doi.org/10.1016/j.ajodo.2010.09....
].

Although some authors developed some orthopedic approaches, even with the use of miniscrews [7[7] Lopez MA, Andreasi Bassi M, Confalone L, Gaudio RM, Lombardo L, Lauritano D. Retrospective study on bone-level and soft-tissue-level cylindrical implants. J Biol Regul Homeost Agents 2016; 30(2 Suppl 1):43-8.

[8] Lopez MA, Andreasi Bassi M, Confalone L, Gaudio RM, Lombardo L, Lauritano D. Clinical outcome of 215 transmucosal implants with a conical connection: a retrospective study after 5-year follow-up. J Biol Regul Homeost Agents 2016; 30(2 Suppl 1):55-60.

[9] Lombardo L, Gracco A, Zampini F, Stefanoni F, Mollica F. Optimal palatal configuration for miniscrew applications. Angle Orthod 2010; 80(1):145-52. https://doi.org/10.2319/122908-662.1
https://doi.org/10.2319/122908-662.1...
-10[10] Gracco A, Luca L, Cozzani M, Siciliani G. Assessment of palatal bone thickness in adults with cone beam computerised tomography. Aust Orthod J 2007; 23(2):109-13.] and different expansive protocol to disarticulate maxillary jaw, making it more responsive to facemask forward protraction [11[11] Liou EJ. Effective maxillary orthopedic protraction for growing Class III patients: a clinical application simulates distraction osteogenesis. Prog Orthod 2005; 6(2):154-71.

[12] Masucci C, Franchi L, Giuntini V, Defraia E. Short-term effects of a modified Alt-RAMEC protocol for early treatment of Class III malocclusion: a controlled study. Orthod Craniofac Res 2014; 17(4):259-69. https://doi.org/10.1111/ocr.12051
https://doi.org/10.1111/ocr.12051...

[13] Sitaropoulou V, Yilmaz HN, Yilmaz B, Kucukkeles N. Three-dimensional evaluation of treatment results of the Alt-RAMEC and facemask protocol in growing patients. J Orofac Orthop 2020; 81(6):407-418. https://doi.org/10.1007/s00056-020-00240-8.
https://doi.org/10.1007/s00056-020-00240...

[14] Maino G, Turci Y, Arreghini A, Paoletto E, Siciliani G, Lombardo L. Skeletal and dentoalveolar effects of hybrid rapid palatal expansion and facemask treatment in growing skeletal Class III patients. Am J Orthod Dentofacial Orthop 2018; 153(2):262-8. https://doi.org/10.1016/j.ajodo.2017.06.022
https://doi.org/10.1016/j.ajodo.2017.06....

[15] Lombardo L, Stefanoni F, Mollica F, Laura A, Scuzzo G, Siciliani G. Three-dimensional finite-element analysis of a central lower incisor under labial and lingual loads. Prog Orthod 2012; 13(2):154-63. https://doi.org/10.1016/j.pio.2011.10.005
https://doi.org/10.1016/j.pio.2011.10.00...
-16[16] Lombardo L, Toni G, Stefanoni F, Mollica F, Guarneri MP, Siciliani G. The effect of temperature on the mechanical behavior of nickel-titanium orthodontic initial archwires. Angle Orthod 2013; 83(2):298-305. https://doi.org/10.2319/040612-287.1
https://doi.org/10.2319/040612-287.1...
], in about 25% of the cases the Class III growth pattern returns [6[6] Masucci C, Franchi L, Defraia E, Mucedero M, Cozza P, Baccetti T. Stability of rapid maxillary expansion and facemask therapy: a long-term controlled study. Am J Orthod Dentofacial Orthop 2011; 140(4):493-500. https://doi.org/10.1016/j.ajodo.2010.09.031
https://doi.org/10.1016/j.ajodo.2010.09....
] leading to unesthetic facial condition, poor occlusion, periodontal problems [17[17] Lombardo L, Carinci F, Martini M, Gemmati D, Nardone M, Siciliani G. Quantitive evaluation of dentin sialoprotein (DSP) using microbeads - a potential early marker of root resorption. Oral Implantol (Rome) 2016; 9(3):132-42. https://doi.org/10.11138/orl/2016.9.3.132
https://doi.org/10.11138/orl/2016.9.3.13...
] and psychological problems such as low self-esteem, stress, anxiety, problems undermining the quality of life [18[18] Burden DJ, Hunt O, Johnston CD, Stevenson M, O'Neill C, Hepper P. Psychological status of patients referred for orthognathic correction of skeletal II and III discrepancies. Angle Orthod 2010; 80(1):43-8. https://doi.org/10.2319/022709-114.1
https://doi.org/10.2319/022709-114.1...

[19] Ghorbani F, Gheibollahi H, Tavanafar S, Eftekharian HR. Improvement of Esthetic, Functional, and Social Well-Being After Orthognathic Surgical Intervention: A Sampling of Postsurgical Patients Over a 10-Year Period From 2007 to 2017. J Oral Maxillofac Surg 2018; 76(11):2398-2403. https://doi.org/10.1016/j.joms.2018.04.034
https://doi.org/10.1016/j.joms.2018.04.0...
-20[20] Manfredini D, Stellini E, Gracco A, Lombardo L, Nardini LG, Siciliani G. Orthodontics is temporomandibular disorder-neutral. Angle Orthod 2016; 86(4):649-54. https://doi.org/10.2319/051015-318.1
https://doi.org/10.2319/051015-318.1...
].

In these cases, the surgical bimaxillary orthognathic approach becomes the only possibility to solve severe Class III malocclusions with good facial aesthetics, especially in cases characterized by a high-angle, skeletal open-bite, skeletal asymmetry and thin periodontal biotype. As a matter of fact, in these patients, a camouflage orthodontic therapy would cause an unsatisfactory result under esthetic and biological points of view [21[21] Park JH, Yu J, Bullen R. Camouflage treatment of skeletal Class III malocclusion with conventional orthodontic therapy. Am J Orthod Dentofacial Orthop 2017; 151(4):804-11. https://doi.org/10.1016/j.ajodo.2016.04.033
https://doi.org/10.1016/j.ajodo.2016.04....
].

The surgical approach of skeletal Class III malocclusions sees the participation of both orthodontist and maxillo-facial surgeon, with the latter who has the aim to repositioning both jaws after surgical osteotomies. For more than 50 years, the planning of surgical repositioning of both jaws has been entrusted to conventional articulator model surgery (CAMS) with the combined use of lateral and postero/anterior cephalograms, orthopantomography, model casts, facial bows, semi-adjustable articulator, construction of resin splints. Although these methods are effective, they have some limitations, especially when complex cases with severe dento-facial deformities are present [22[22] Ritto FG, Schmitt ARM, Pimentel T, Canellas JV, Medeiros PJ. Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. Int J Oral Maxillofac Surg 2018; 47(2):160-6. https://doi.org/10.1016/j.ijom.2017.08.012
https://doi.org/10.1016/j.ijom.2017.08.0...
].

With the advent of 3D imaging technologies (cone beam computed tomography - CBCT), computer-aided design and manufacturing (CAD/CAM) and computer-aided surgical simulation (CASS) technologies in the orthognathic surgical field, the paradigm shifted by CAMS planning to virtual surgical planning (VSP) [23[23] Xia JJ, Gateno J, Teichgraeber JF, Christensen AM, Lasky RE, Lemoine JJ, et al. Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. J Oral Maxillofac Surg 2007; 65(2):248-54. https://doi.org/10.1016/j.joms.2006.10.005
https://doi.org/10.1016/j.joms.2006.10.0...
].

VSP allows to plan the surgical therapy with lesser laboratory and decisional steps, plan different surgical simulations to compare, preview the skeletal effects on soft and hard tissues with good reproducibility, and create surgical splint with 3D printers in a reduced working time [24[24] Gateno J, Xia JJ, Teichgraeber JF, Christensen AM, Lemoine JJ, Liebschner MA, et al. Clinical feasibility of computer-aided surgical simulation (CASS) in the treatment of complex cranio-maxillofacial deformities. J Oral Maxillofac Surg 2007; 65(4):728-34. https://doi.org/10.1016/j.joms.2006.04.001
https://doi.org/10.1016/j.joms.2006.04.0...

[25] Kwon TG. Accuracy and reliability of three-dimensional computer-assisted planning for orthognathic surgery. Maxillofac Plast Reconstr Surg 2018; 40(1):14. https://doi.org/10.1186/s40902-018-0154-4
https://doi.org/10.1186/s40902-018-0154-...
-26[26] Alkhayer A, Piffkó J, Lippold C, Segatto E. Accuracy of virtual planning in orthognathic surgery: a systematic review. Head Face Med 2020; 16(1):34. https://doi.org/10.1186/s13005-020-00250-2
https://doi.org/10.1186/s13005-020-00250...
].

Although these major advantages, there are some considerations that must be taken in mind; as a matter of fact, there could be limitations and imprecision inherent in the software with superficial rendering errors or less propensity of surgeons to face these innovations. In order to weigh both advantages and disadvantages mentioned above, the accuracy of this new digital working flow, that is to say, VSP has to be tested.

The aim of this study is to test the accuracy of VSP performed with DDS-PRO professional software (DDS-PRO, Czestochowa, Poland) in a group of Class III surgical cases treated by bimaxillary orthognathic surgery, comparing VSP planning and post-operative CBCT scans.

Material and Methods

Study Design and Sample

This retrospective study analyzed 23 patients (9 males and 14 females; mean age 24.1 ± 7.0) who had undergone orthognathic surgery for skeletal Class III malocclusion in the Department of Maxillo-Facial Surgery of San Bortolo Hospital of Vicenza, Italy, in a period from February 2018 to November 2019.

Inclusion criteria for retrospective patient selection were severe skeletal Class III malocclusion (ANB<3°, Wits<3mm and OVJ<3mm) with any divergence or skeletal asymmetry limitations; patients older than 17 years old; bimaxillary orthognathic surgery of skeletal Class III malocclusion; presence of pre-surgery CBCT scans with the execution of VSP with DDS-PRO professional software; presence of post-surgery CBCT scans performed no more than 1 month after orthognathic surgery; no craniofacial syndromes or congenital dento-facial deformities.

Orthognathic surgeries were performed by the same expert maxillo-facial surgeon (UB), and they comprised both Le Fort I maxillary osteotomy according to Bell [27[27] Bell WH. Le Forte I osteotomy for correction of maxillary deformities. J Oral Surg 1975; 33(6):412-26.] and bilateral sagittal split mandibular osteotomy (BSSO).

Descriptions of Methods

In total, 46 CBCTs scans were obtained, of which 23 pre- and 23 post-surgery CBCT scans. They were executed in the radiological center Novarad of Vicenza (Italy) with NewTom 5G XL Extra Vision machine (Newtom CEFLA SC, Imola, Italy).

This machine used the SafeBeamTM technology to reduce x-ray emission according to tissue characteristics of the patients with a dose-volume product comprising between 197.16 mGyCm3 a 260.78 mGyCm3. The beam voltage is set at 110kV with an amperage comprising between 7 and 11 mA. The x-rays emission mode is pulsed for a time of 5.4s.

The 23 pre-surgery CBCTs were used to perform VSPs with DDS-PRO professional software. Due to the fact that these could not be exported in an open format but only in .o3 extension, i.e., a format of property of DDS-PRO software (DDS-PRO, Czestochowa, Poland), authors imported the post-surgical CBCTs into the same software to make measures and to compare them. A substantial difference is the poor accuracy of post-surgical CBCTs regarding dental arches since post-surgical intraoral scans were not acquired.

Before to perform a direct comparison, each CBCT scan has been oriented in the space according to Natural Head Position (NHP (Arnett) using “orientation” tool. References points for this procedure are four:

The lowest and the most anterior point of left orbital rim (left Orbitale point or lO point).

The highest point of temporozygomatic suture bilaterally (left and right temporo/zygomatic points or lTZ and rTZ point).

Nasion point or Na point (the most anterior and medial point of frontonasal suture).

Cranium’s orientation allowed to set the Frankfort Horizontal plan (passing by TZ and lO points) of each cranium, lying to horizontal plane reference (xz-plane) of the software (Figure 1). After this, both linear and angular manuals measures are performed according to 10 landmarks and 7 planes. Landmarks used are:

Figure 1
Orientation of cranium in the space. Horizontal plane corresponds to Frankfurt plane (passing for both left and right ZT).

  • A point: the most retrusive mid-point of anterior concavity of maxillary bone.

  • B point: the most retrusive mid-point of anterior concavity of mandibular bone.

  • U1 point: upper interincisal mid-point of maxillary central incisors.

  • L1 point: upper interincisal mid-point of mandibular central incisors.

  • MBC 1.6 point: mesio-buccal cusp of 1.6 tooth.

  • MBC 2.6 point: mesio-buccal cusp of 2.6 tooth.

  • MBC 3.6 point: mesio-buccal cusp of 3.6 tooth.

  • MBC 4.6 point: mesio-buccal cusp of 4.6 tooth.

  • rMF point: right mental foramen point.

  • lMF point: left mental foramen point (Figure 2).

Figure 2
Orientation of cranium in the space. Horizontal plane corresponds to Frankfurt plane (passing for both left and right ZT).

Planes used are:

  • XZ-plane: horizontal plane corresponding to Frankfurt plane set in the orientation phase.

  • YZ-plane: sagittal plane (perpendicular to horizontal plane passing by Point Na).

  • XY-plane: coronal plane (perpendicular to horizontal plane passing by LZG and RZG point).

  • CBP: cranial base plane passing by Nasion point and bilateral Basion points. They are both 2mm laterally shifted points respect to the mid-point Basion (Ba) on the anterior rim of the magnum. Nasion point is the most anterior and medial point of frontonasal suture (Figure 1).

  • UOP: upper occlusal plane passing by the midpoint in the marginal ridges of both maxillary central incisors and the point in the disto-buccal cusp of both left and right maxillary first molar.

  • LOP: lower occlusal plane passing by the midpoint in the marginal ridge of mandibular central incisors and the point in the disto-buccal cusp of both left and right mandibular first molar.

  • MP: mandibular plane passing for both left and right gonion points and the menton point. Menton point (Me) is defined as the lowest point of mental symphysis bone. Bilateral gonion points (rGo and lGo) are constructions points with the intersection of two lines tangent to the posterior margin of mandibular ramus and the lower margin of the mandibular body (Figure 3).

Figure 3
Graphical representation of four construction planes. CBS is considered a reference plane.

The first four planes are used as a reference plane to detect deviations of UOP, LOP and MP plane calculating the roll, pitch and yaw (Figure 4) and to CBP, which is a stable structure not modified by double jaws orthognathic surgery.

Figure 4
Graphical representation of roll, pitch and yaw. Roll is turning around Z-axis, pitch around X-axis and yaw around Y-axis.

The coordinates of each single point (x, y, z) in the three planes of space were then obtained using the “reference point measurement” tool. Also, the angular measures between planes above mentioned were obtained with the use of “goniometer” tool. Deviations are considered clinically acceptable if they are within 2mm for linear and 4° for angular measure [23[23] Xia JJ, Gateno J, Teichgraeber JF, Christensen AM, Lasky RE, Lemoine JJ, et al. Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. J Oral Maxillofac Surg 2007; 65(2):248-54. https://doi.org/10.1016/j.joms.2006.10.005
https://doi.org/10.1016/j.joms.2006.10.0...
].

One month after taking the measures, 11 subjects were randomly selected and the measurements were repeated. Despite the possibility to superimpose the two scans, it could not be allowed a direct comparison of the two volumes due to limitations of this software; therefore, linear and angular measures were performed with the above-mentioned tools.

Statistical Analysis

All data were analyzed using R 3.5 software (R Foundation for Statistical Computing, Vienna, Austria) [28[28] Development Core Team. R: A Language and Environment for Statistical Computing; 2011.]. First, for each landmark identified, deviations between VSP and post-surgical CBCT scans were measured both like absolute linear value or relative value to each plan, obtaining respectively mean values confidence intervals (95%). Then, a paired t-test was used to calculate the mean differences for each deviation with the relative 95% confidence interval (p-value <0.05 considered significant). The same has been done for angular measurements.

The confidence intervals include plausible values for the differences between the two measures compared, and thus we need to identify statistical significant differences. When the confidence intervals do not overlap with each other, a significant statistical difference could be affirmed; on the other hand, if there is an overlapping of the two groups of values, also partially, this difference cannot be affirmed to be statistically significant. In partial overlapping, this difference could be considered clinically acceptable if most parts of values intersect each other.

In the event that the interval intersects the cut-off line, statistical significance cannot be affirmed, but it can still be clinically acceptable if a large part of it (therefore, most of the values) should be below the threshold. The confidence interval is directly influenced by the sample: the higher the number, the narrower the interval. The method error was quantified by calculating the Intra-Class Correlation (ICC) between the initial measures and those repeated at 1 month, on a subgroup (2 linear and 2 angular) for 11 randomly selected subjects. The ICC calculated was excellent (coefficient 0.99); therefore, reproducibility and accuracy of the measures is assumed.

Results

Mean linear variations between VSP and post-surgical CBCTs are reported in Table 1 as absolute deviations and respect to each plane. Statistically significant differences between the planned and the real are marked with asterisk (*).

Table 1
Linear deviations (mm) measured as absolute deviations and referred to X, Y and Z-linear dimension.

For the absolute deviations, all the linear measures overcome the 2 mm threshold value of clinical acceptability, with a mean discrepancy of 4.57 mm (3.79-9.87), and these differences are always statistical significance. About x-linear dimension, all measures are within threshold value except for MBC point of all the first molars. The mean value registered is 2.53 mm (1.79-3.26), and the statistical significance is reached four times. About y-linear dimension, all measures are within threshold value except for B point (2.21 mm; 1.48-2.94) and MBC 26 (3.19 mm; 0.00-7.98). The mean value registered is 1.7 mm (1.21-2.19) and the statistical significance is reached six times.

About z-linear dimension, all the mean values are beyond the 2 mm threshold value except for A point (1.82 mm; 1.15-2.82) and MBC 16 (1.89 mm; 1.17-2.60). Thus, the mean value registered is 2.25 mm (2.01-2.49) and the statistical significance is only for this latter value (Figure 5).

Figure 5
Graphical representation of mean linear values and their confidence interval (95%) according to 2 mm threshold value.

Mean angular deviations between VSP and post-surgical CBCT scans are all within 4° threshold value of clinical acceptability, although all comparisons reach the statistical significance except for UOP^MP comparison (Table 2).

Table 2
Angular deviations (°) of UOP, LOP and MP planes referred to CBP. Also roll, pitch and yaw deviations are recorded.

The highest discrepancy value is recorded between UOP and MP, with the mean deviation value of 3.61° (2.54-4.77), although the latter is within the clinical acceptability threshold and it does not reach a statistical significance (Figure 6).

Figure 6
Graphical representation of angular linear values and their confidence interval (95%) according to 4° threshold value.

Discussion

This retrospective study aims to investigate the accuracy of VSP for orthognathic surgery in Class III surgical cases. Class III malocclusions could be particularly socially disabling, especially when skeletal sagittal discrepancy is severe and it is perceived as a problem by the patient [29[29] Kim JY, Lee SJ, Kim TW, Nahm DS, Chang YI. Classification of the skeletal variation in normal occlusion. Angle Orthod 2005; 75(3):311-9.]; for this reason, Class III surgical treatment is the most common among the surgical orthognathic approaches [30[30] Lee CH, Park HH, Seo BM, Lee SJ. Modern trends in Class III orthognathic treatment: A time series analysis. Angle Orthod 2017; 87(2):269-78. https://doi.org/10.2319/043016-349.1
https://doi.org/10.2319/043016-349.1...
]. Therefore, the study of accuracy of VSP in these cases is of particular interest.

Comparisons have been made between VSP and 1-month post-surgical CBCT scans to avoid orthodontic mechanics, which can hide and underestimate the surgical movement of skeletal bases. After this direct comparison, we set a threshold value of both linear and angular deviation to register what variations could be considered acceptable under clinical point of view. These threshold values are set at 2 mm for linear values and 4° for angular values and they were proposed by Xia et al. [23[23] Xia JJ, Gateno J, Teichgraeber JF, Christensen AM, Lasky RE, Lemoine JJ, et al. Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. J Oral Maxillofac Surg 2007; 65(2):248-54. https://doi.org/10.1016/j.joms.2006.10.005
https://doi.org/10.1016/j.joms.2006.10.0...
] and Marchetti et al. [31[31] Marchetti C, Bianchi A, Bassi M, Gori R, Lamberti C, Sarti A. Mathematical modeling and numerical simulation in maxillofacial virtual surgery. J Craniofac Surg 2007; 18(4):826-32. https://doi.org/10.1097/scs.0b013e318068434b
https://doi.org/10.1097/scs.0b013e318068...
].

The first authors to propose a pilot study to overcome conventional model surgery planning were Xia et al. [23[23] Xia JJ, Gateno J, Teichgraeber JF, Christensen AM, Lasky RE, Lemoine JJ, et al. Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. J Oral Maxillofac Surg 2007; 65(2):248-54. https://doi.org/10.1016/j.joms.2006.10.005
https://doi.org/10.1016/j.joms.2006.10.0...
], who performed a pilot study to assess the accuracy of CASS, obtaining mean deviations of 0.9 mm and 1.7°. After this, others authors checked the accuracy of these 3D planning systems, always noticing a good accuracy and reproducibility of the method [31[31] Marchetti C, Bianchi A, Bassi M, Gori R, Lamberti C, Sarti A. Mathematical modeling and numerical simulation in maxillofacial virtual surgery. J Craniofac Surg 2007; 18(4):826-32. https://doi.org/10.1097/scs.0b013e318068434b
https://doi.org/10.1097/scs.0b013e318068...

[32] Tucker S, Cevidanes LH, Styner M, Kim H, Reyes M, Proffit W, et al. Comparison of actual surgical outcomes and 3-dimensional surgical simulations. J Oral Maxillofac Surg 2010; 68(10):2412-21. https://doi.org/10.1016/j.joms.2009.09.058
https://doi.org/10.1016/j.joms.2009.09.0...
-33[33] Zinser MJ, Mischkowski RA, Dreiseidler T, Thamm OC, Rothamel D, Zöller JE. Computer-assisted orthognathic surgery: waferless maxillary positioning, versatility, and accuracy of an image-guided visualisation display. Br J Oral Maxillofac Surg 2013; 51(8):827-33. https://doi.org/10.1016/j.bjoms.2013.06.014
https://doi.org/10.1016/j.bjoms.2013.06....
]. Finally, Mazzoni et al. [34[34] Mazzoni S, Badiali G, Lancellotti L, Babbi L, Bianchi A, Marchetti C. Simulation-guided navigation: a new approach to improve intraoperative three-dimensional reproducibility during orthognathic surgery. J Craniofac Surg 2010; 21(6):1698-705. https://doi.org/10.1097/SCS.0b013e3181f3c6a8
https://doi.org/10.1097/SCS.0b013e3181f3...
] studied in a group of 10 patients a new intra-operating guided procedure for jaws repositioning, funding good accuracy.

Hsu et al. were the first authors to investigate accuracy referring to each surgical plane (XY, YZ and XZ planes), reporting a good reproducibility for all the linear measures investigated, encouraging at the same time the use of a CAD-template to perform genioplasty [35[35] Hsu SS, Gateno J, Bell RB, Hirsch DL, Markiewicz MR, Teichgraeber JF, et al. Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: a prospective multicenter study. J Oral Maxillofac Surg 2013; 71(1):128-42. https://doi.org/10.1016/j.joms.2012.03.027
https://doi.org/10.1016/j.joms.2012.03.0...
].

Encouraging results have been found by other authors [22[22] Ritto FG, Schmitt ARM, Pimentel T, Canellas JV, Medeiros PJ. Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. Int J Oral Maxillofac Surg 2018; 47(2):160-6. https://doi.org/10.1016/j.ijom.2017.08.012
https://doi.org/10.1016/j.ijom.2017.08.0...
,36[36] Tonin RH, Iwaki Filho L, Yamashita AL, Ferraz FWDS, Tolentino ES, Previdelli ITDS, et al. Accuracy of 3D virtual surgical planning for maxillary positioning and orientation in orthognathic surgery. Orthod Craniofac Res 2020; 23(2):229-36. https://doi.org/10.1111/ocr.12363
https://doi.org/10.1111/ocr.12363...
], although Ritto et al. [22[22] Ritto FG, Schmitt ARM, Pimentel T, Canellas JV, Medeiros PJ. Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. Int J Oral Maxillofac Surg 2018; 47(2):160-6. https://doi.org/10.1016/j.ijom.2017.08.012
https://doi.org/10.1016/j.ijom.2017.08.0...
] and Tonin et al. [36[36] Tonin RH, Iwaki Filho L, Yamashita AL, Ferraz FWDS, Tolentino ES, Previdelli ITDS, et al. Accuracy of 3D virtual surgical planning for maxillary positioning and orientation in orthognathic surgery. Orthod Craniofac Res 2020; 23(2):229-36. https://doi.org/10.1111/ocr.12363
https://doi.org/10.1111/ocr.12363...
] investigated the only accuracy of maxillary position. Heufelder et al. [37[37] Heufelder M, Wilde F, Pietzka S, Mascha F, Winter K, Schramm A, et al. Clinical accuracy of waferless maxillary positioning using customized surgical guides and patient specific osteosynthesis in bimaxillary orthognathic surgery. J Craniomaxillofac Surg 2017; 45(9):1578-85. https://doi.org/10.1016/j.jcms.2017.06.027
https://doi.org/10.1016/j.jcms.2017.06.0...
] and Kim et al. [38[38] Kim J, Kim J, Jeong C, Cheon K, Cho S, Park I, et al. The accuracy and stability of the maxillary position after orthognathic surgery using a novel computer-aided surgical simulation system. BMC Oral Health 2019; 19:18. https://doi.org/10.1186/s12903-019-0711-y
https://doi.org/10.1186/s12903-019-0711-...
] confirmed previous investigations, although they used a waferless technique with a prototyped guide for osteotomy lines and drilling holes for fixation, and customized prototyped miniplates for repositioning and stabilizing the maxillary jaw, reducing thus vertical errors.

In our study, the good reproducibility of VSP is tested, although we experienced higher deviation values concerning threshold linear value, especially for absolute deviations and for dento-alveolar landmarks. About the x-linear dimension, the mean discrepancy value (2.53mm; 1.79-3.26) is slightly higher of 2mm cut-off value, but all skeletal deviations are lesser than 2 mm to a higher extent. The worst values are registered for dental values.

The accuracy on Y-linear dimension is good with a mean average value of 1.7 mm (1.21-2.19) and with only two deviations over 2 mm (B and MBC 26), while on Z-linear dimension, the average deviation value is beyond 2 mm (2.25; 2.01-2.49) with only two deviations under the cut-off linear value. These findings agree with Heufelder et al. [37[37] Heufelder M, Wilde F, Pietzka S, Mascha F, Winter K, Schramm A, et al. Clinical accuracy of waferless maxillary positioning using customized surgical guides and patient specific osteosynthesis in bimaxillary orthognathic surgery. J Craniomaxillofac Surg 2017; 45(9):1578-85. https://doi.org/10.1016/j.jcms.2017.06.027
https://doi.org/10.1016/j.jcms.2017.06.0...
], who registered less accuracy in Z-linear dimension with respect to Y-linear dimension.

According to our study, it can be partially explained by two phenomena. The first is that surgical setback of mandible acts inevitably on the condyle with a subsequent forward movement that usually occurred in the post-operative period. Another element is attributable to the inclination of maxillary osteotomy line that could affect the anteroposterior displacement of the mobilized segment. The more vertical is the cut, greater is the limitation compared to what was programmed with the wafer.

Regarding the angular discrepancies, our study shows that all mean deviations is within 4° with values ranging from 0.64 mm (0.23-1.05), between UOP and sagittal plane, to 3.61 mm (2.54-4.77), between UOP and PM. In detail, the greater accuracy is for the roll, followed by yaw and pitch.

Our findings agree with other studies, which register a good overall accuracy, but with greater discrepancies detected for pitch and yaw [35[35] Hsu SS, Gateno J, Bell RB, Hirsch DL, Markiewicz MR, Teichgraeber JF, et al. Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: a prospective multicenter study. J Oral Maxillofac Surg 2013; 71(1):128-42. https://doi.org/10.1016/j.joms.2012.03.027
https://doi.org/10.1016/j.joms.2012.03.0...
,36[36] Tonin RH, Iwaki Filho L, Yamashita AL, Ferraz FWDS, Tolentino ES, Previdelli ITDS, et al. Accuracy of 3D virtual surgical planning for maxillary positioning and orientation in orthognathic surgery. Orthod Craniofac Res 2020; 23(2):229-36. https://doi.org/10.1111/ocr.12363
https://doi.org/10.1111/ocr.12363...
,39[39] Stokbro K, Aagaard E, Torkov P, Bell RB, Thygesen T. Virtual planning in orthognathic surgery. Int J Oral Maxillofac Surg 2014; 43(8):957-65. https://doi.org/10.1016/j.ijom.2014.03.011
https://doi.org/10.1016/j.ijom.2014.03.0...
], and this could be due to reduced fitting of surgical intermediate splints [39[39] Stokbro K, Aagaard E, Torkov P, Bell RB, Thygesen T. Virtual planning in orthognathic surgery. Int J Oral Maxillofac Surg 2014; 43(8):957-65. https://doi.org/10.1016/j.ijom.2014.03.011
https://doi.org/10.1016/j.ijom.2014.03.0...
,40[40] Arreghini A, Lombardo L, Mollica F, Siciliani G. Torque expression capacity of 0.018 and 0.022 bracket slots by changing archwire material and cross section. Prog Orthod 2014; 15(1):53.].

An overview of these results shows a better accuracy for both linear respect to angular measures and for skeletal respect to dento-alveolar landmarks. The first aspect could be measuring procedures that enable better identification of planes compared to point-like landmarks in the DDS-PRO software. The second aspect could be fully explained by the less accuracy in reproducing dento-alveolar structures, especially in the post-surgical CBCTs, due to both poor superficial rendering and the fact that post-surgical intraoral scans were not performed and superimposed in post-surgical CBCTs.

This study, although well-conducting, seems to show some limitations. First of all, post-surgical intraoral scansion should be performed to increase superficial details of dento-alveolar component; while considering measures procedure, DDS-PRO software does not allow direct superimpositions and the use of complexes algorithms, should guarantee reproducibility and constancy for measures. According to the above-mentioned limits, further future studies are mandatories.

Conclusion

VSP could be considered an accurate method to plan orthognathic surgery in surgical Class III cases, although some imprecisions have been detected. The accuracy is optimal for angular and good for linear investigations, although further studies should be performed overcoming some abovementioned limitations.

  • Data Availability
    The data used to support the findings of this study can be made available upon request to the corresponding author.
  • Financial Support
    None.

References

  • [1]
    Baccetti T, McGill JS, Franchi L, McNamara JA Jr, Tollaro I. Skeletal effects of early treatment of Class III malocclusion with maxillary expansion and face-mask therapy. Am J Orthod Dentofacial Orthop 1998; 113(3):333-43. https://doi.org/10.1016/s0889-5406(98)70306-3
    » https://doi.org/10.1016/s0889-5406(98)70306-3
  • [2]
    Pisani L, Bonaccorso L, Fastuca R, Spena R, Lombardo L, Caprioglio A. Systematic review for orthodontic and orthopedic treatments for anterior open bite in the mixed dentition. Prog Orthod 2016; 17(1):28. https://doi.org/10.1186/s40510-016-0142-0
    » https://doi.org/10.1186/s40510-016-0142-0
  • [3]
    Di Fazio D, Lombardo L, Gracco A, D'Amico P, Siciliani G. Lip pressure at rest and during function in 2 groups of patients with different occlusions. Am J Orthod Dentofacial Orthop 2011; 139(1):e1-6. https://doi.org/10.1016/j.ajodo.2010.02.030
    » https://doi.org/10.1016/j.ajodo.2010.02.030
  • [4]
    Lombardo L, Palone M, Carlucci A, Siciliani G. Clear aligner hybrid approach: A case report. J World Fed Orthod 2020; 9(1):32-43. https://doi.org/10.1016/j.ejwf.2020.01.001
    » https://doi.org/10.1016/j.ejwf.2020.01.001
  • [5]
    Arreghini A, Trigila S, Lombardo L, Siciliani G. Objective assessment of compliance with intra- and extraoral removable appliances. Angle Orthod 2017; 87(1):88-95. https://doi.org/10.2319/020616-104.1
    » https://doi.org/10.2319/020616-104.1
  • [6]
    Masucci C, Franchi L, Defraia E, Mucedero M, Cozza P, Baccetti T. Stability of rapid maxillary expansion and facemask therapy: a long-term controlled study. Am J Orthod Dentofacial Orthop 2011; 140(4):493-500. https://doi.org/10.1016/j.ajodo.2010.09.031
    » https://doi.org/10.1016/j.ajodo.2010.09.031
  • [7]
    Lopez MA, Andreasi Bassi M, Confalone L, Gaudio RM, Lombardo L, Lauritano D. Retrospective study on bone-level and soft-tissue-level cylindrical implants. J Biol Regul Homeost Agents 2016; 30(2 Suppl 1):43-8.
  • [8]
    Lopez MA, Andreasi Bassi M, Confalone L, Gaudio RM, Lombardo L, Lauritano D. Clinical outcome of 215 transmucosal implants with a conical connection: a retrospective study after 5-year follow-up. J Biol Regul Homeost Agents 2016; 30(2 Suppl 1):55-60.
  • [9]
    Lombardo L, Gracco A, Zampini F, Stefanoni F, Mollica F. Optimal palatal configuration for miniscrew applications. Angle Orthod 2010; 80(1):145-52. https://doi.org/10.2319/122908-662.1
    » https://doi.org/10.2319/122908-662.1
  • [10]
    Gracco A, Luca L, Cozzani M, Siciliani G. Assessment of palatal bone thickness in adults with cone beam computerised tomography. Aust Orthod J 2007; 23(2):109-13.
  • [11]
    Liou EJ. Effective maxillary orthopedic protraction for growing Class III patients: a clinical application simulates distraction osteogenesis. Prog Orthod 2005; 6(2):154-71.
  • [12]
    Masucci C, Franchi L, Giuntini V, Defraia E. Short-term effects of a modified Alt-RAMEC protocol for early treatment of Class III malocclusion: a controlled study. Orthod Craniofac Res 2014; 17(4):259-69. https://doi.org/10.1111/ocr.12051
    » https://doi.org/10.1111/ocr.12051
  • [13]
    Sitaropoulou V, Yilmaz HN, Yilmaz B, Kucukkeles N. Three-dimensional evaluation of treatment results of the Alt-RAMEC and facemask protocol in growing patients. J Orofac Orthop 2020; 81(6):407-418. https://doi.org/10.1007/s00056-020-00240-8
    » https://doi.org/10.1007/s00056-020-00240-8
  • [14]
    Maino G, Turci Y, Arreghini A, Paoletto E, Siciliani G, Lombardo L. Skeletal and dentoalveolar effects of hybrid rapid palatal expansion and facemask treatment in growing skeletal Class III patients. Am J Orthod Dentofacial Orthop 2018; 153(2):262-8. https://doi.org/10.1016/j.ajodo.2017.06.022
    » https://doi.org/10.1016/j.ajodo.2017.06.022
  • [15]
    Lombardo L, Stefanoni F, Mollica F, Laura A, Scuzzo G, Siciliani G. Three-dimensional finite-element analysis of a central lower incisor under labial and lingual loads. Prog Orthod 2012; 13(2):154-63. https://doi.org/10.1016/j.pio.2011.10.005
    » https://doi.org/10.1016/j.pio.2011.10.005
  • [16]
    Lombardo L, Toni G, Stefanoni F, Mollica F, Guarneri MP, Siciliani G. The effect of temperature on the mechanical behavior of nickel-titanium orthodontic initial archwires. Angle Orthod 2013; 83(2):298-305. https://doi.org/10.2319/040612-287.1
    » https://doi.org/10.2319/040612-287.1
  • [17]
    Lombardo L, Carinci F, Martini M, Gemmati D, Nardone M, Siciliani G. Quantitive evaluation of dentin sialoprotein (DSP) using microbeads - a potential early marker of root resorption. Oral Implantol (Rome) 2016; 9(3):132-42. https://doi.org/10.11138/orl/2016.9.3.132
    » https://doi.org/10.11138/orl/2016.9.3.132
  • [18]
    Burden DJ, Hunt O, Johnston CD, Stevenson M, O'Neill C, Hepper P. Psychological status of patients referred for orthognathic correction of skeletal II and III discrepancies. Angle Orthod 2010; 80(1):43-8. https://doi.org/10.2319/022709-114.1
    » https://doi.org/10.2319/022709-114.1
  • [19]
    Ghorbani F, Gheibollahi H, Tavanafar S, Eftekharian HR. Improvement of Esthetic, Functional, and Social Well-Being After Orthognathic Surgical Intervention: A Sampling of Postsurgical Patients Over a 10-Year Period From 2007 to 2017. J Oral Maxillofac Surg 2018; 76(11):2398-2403. https://doi.org/10.1016/j.joms.2018.04.034
    » https://doi.org/10.1016/j.joms.2018.04.034
  • [20]
    Manfredini D, Stellini E, Gracco A, Lombardo L, Nardini LG, Siciliani G. Orthodontics is temporomandibular disorder-neutral. Angle Orthod 2016; 86(4):649-54. https://doi.org/10.2319/051015-318.1
    » https://doi.org/10.2319/051015-318.1
  • [21]
    Park JH, Yu J, Bullen R. Camouflage treatment of skeletal Class III malocclusion with conventional orthodontic therapy. Am J Orthod Dentofacial Orthop 2017; 151(4):804-11. https://doi.org/10.1016/j.ajodo.2016.04.033
    » https://doi.org/10.1016/j.ajodo.2016.04.033
  • [22]
    Ritto FG, Schmitt ARM, Pimentel T, Canellas JV, Medeiros PJ. Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. Int J Oral Maxillofac Surg 2018; 47(2):160-6. https://doi.org/10.1016/j.ijom.2017.08.012
    » https://doi.org/10.1016/j.ijom.2017.08.012
  • [23]
    Xia JJ, Gateno J, Teichgraeber JF, Christensen AM, Lasky RE, Lemoine JJ, et al. Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. J Oral Maxillofac Surg 2007; 65(2):248-54. https://doi.org/10.1016/j.joms.2006.10.005
    » https://doi.org/10.1016/j.joms.2006.10.005
  • [24]
    Gateno J, Xia JJ, Teichgraeber JF, Christensen AM, Lemoine JJ, Liebschner MA, et al. Clinical feasibility of computer-aided surgical simulation (CASS) in the treatment of complex cranio-maxillofacial deformities. J Oral Maxillofac Surg 2007; 65(4):728-34. https://doi.org/10.1016/j.joms.2006.04.001
    » https://doi.org/10.1016/j.joms.2006.04.001
  • [25]
    Kwon TG. Accuracy and reliability of three-dimensional computer-assisted planning for orthognathic surgery. Maxillofac Plast Reconstr Surg 2018; 40(1):14. https://doi.org/10.1186/s40902-018-0154-4
    » https://doi.org/10.1186/s40902-018-0154-4
  • [26]
    Alkhayer A, Piffkó J, Lippold C, Segatto E. Accuracy of virtual planning in orthognathic surgery: a systematic review. Head Face Med 2020; 16(1):34. https://doi.org/10.1186/s13005-020-00250-2
    » https://doi.org/10.1186/s13005-020-00250-2
  • [27]
    Bell WH. Le Forte I osteotomy for correction of maxillary deformities. J Oral Surg 1975; 33(6):412-26.
  • [28]
    Development Core Team. R: A Language and Environment for Statistical Computing; 2011.
  • [29]
    Kim JY, Lee SJ, Kim TW, Nahm DS, Chang YI. Classification of the skeletal variation in normal occlusion. Angle Orthod 2005; 75(3):311-9.
  • [30]
    Lee CH, Park HH, Seo BM, Lee SJ. Modern trends in Class III orthognathic treatment: A time series analysis. Angle Orthod 2017; 87(2):269-78. https://doi.org/10.2319/043016-349.1
    » https://doi.org/10.2319/043016-349.1
  • [31]
    Marchetti C, Bianchi A, Bassi M, Gori R, Lamberti C, Sarti A. Mathematical modeling and numerical simulation in maxillofacial virtual surgery. J Craniofac Surg 2007; 18(4):826-32. https://doi.org/10.1097/scs.0b013e318068434b
    » https://doi.org/10.1097/scs.0b013e318068434b
  • [32]
    Tucker S, Cevidanes LH, Styner M, Kim H, Reyes M, Proffit W, et al. Comparison of actual surgical outcomes and 3-dimensional surgical simulations. J Oral Maxillofac Surg 2010; 68(10):2412-21. https://doi.org/10.1016/j.joms.2009.09.058
    » https://doi.org/10.1016/j.joms.2009.09.058
  • [33]
    Zinser MJ, Mischkowski RA, Dreiseidler T, Thamm OC, Rothamel D, Zöller JE. Computer-assisted orthognathic surgery: waferless maxillary positioning, versatility, and accuracy of an image-guided visualisation display. Br J Oral Maxillofac Surg 2013; 51(8):827-33. https://doi.org/10.1016/j.bjoms.2013.06.014
    » https://doi.org/10.1016/j.bjoms.2013.06.014
  • [34]
    Mazzoni S, Badiali G, Lancellotti L, Babbi L, Bianchi A, Marchetti C. Simulation-guided navigation: a new approach to improve intraoperative three-dimensional reproducibility during orthognathic surgery. J Craniofac Surg 2010; 21(6):1698-705. https://doi.org/10.1097/SCS.0b013e3181f3c6a8
    » https://doi.org/10.1097/SCS.0b013e3181f3c6a8
  • [35]
    Hsu SS, Gateno J, Bell RB, Hirsch DL, Markiewicz MR, Teichgraeber JF, et al. Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: a prospective multicenter study. J Oral Maxillofac Surg 2013; 71(1):128-42. https://doi.org/10.1016/j.joms.2012.03.027
    » https://doi.org/10.1016/j.joms.2012.03.027
  • [36]
    Tonin RH, Iwaki Filho L, Yamashita AL, Ferraz FWDS, Tolentino ES, Previdelli ITDS, et al. Accuracy of 3D virtual surgical planning for maxillary positioning and orientation in orthognathic surgery. Orthod Craniofac Res 2020; 23(2):229-36. https://doi.org/10.1111/ocr.12363
    » https://doi.org/10.1111/ocr.12363
  • [37]
    Heufelder M, Wilde F, Pietzka S, Mascha F, Winter K, Schramm A, et al. Clinical accuracy of waferless maxillary positioning using customized surgical guides and patient specific osteosynthesis in bimaxillary orthognathic surgery. J Craniomaxillofac Surg 2017; 45(9):1578-85. https://doi.org/10.1016/j.jcms.2017.06.027
    » https://doi.org/10.1016/j.jcms.2017.06.027
  • [38]
    Kim J, Kim J, Jeong C, Cheon K, Cho S, Park I, et al. The accuracy and stability of the maxillary position after orthognathic surgery using a novel computer-aided surgical simulation system. BMC Oral Health 2019; 19:18. https://doi.org/10.1186/s12903-019-0711-y
    » https://doi.org/10.1186/s12903-019-0711-y
  • [39]
    Stokbro K, Aagaard E, Torkov P, Bell RB, Thygesen T. Virtual planning in orthognathic surgery. Int J Oral Maxillofac Surg 2014; 43(8):957-65. https://doi.org/10.1016/j.ijom.2014.03.011
    » https://doi.org/10.1016/j.ijom.2014.03.011
  • [40]
    Arreghini A, Lombardo L, Mollica F, Siciliani G. Torque expression capacity of 0.018 and 0.022 bracket slots by changing archwire material and cross section. Prog Orthod 2014; 15(1):53.

Edited by

Academic Editor: Alessandro Leite Cavalcanti

Publication Dates

  • Publication in this collection
    20 Oct 2021
  • Date of issue
    2021

History

  • Received
    29 Jan 2021
  • Reviewed
    11 Mar 2021
  • Accepted
    11 Apr 2021
Associação de Apoio à Pesquisa em Saúde Bucal Avenida Epitácio Pessoa, 4161 - Sala 06, Miramar, CEP: 58020-388, João Pessoa, PB - Brasil, Tel.: 55-83-98773 2150 - João Pessoa - PB - Brazil
E-mail: apesb@terra.com.br