Acessibilidade / Reportar erro

PROPOSAL OF A NEW MULTI-CRITERIA METHODOLOGY SAPEVO-WASPAS-2N APPLIED IN PRIORITIZING THE IMPLEMENTATION OF COMPLIANCE PROCESSES

ABSTRACT

Processes that establish Compliance at first do not seem to add to the value chain of companies. However, the need to address legislation or issues related to corporate governance, social management, and the environment, lead large corporations to adopt such processes. This article aimed to establish a plan for prioritizing the implementation of compliance processes in an electric power generation company, through the method Value-Focused Thinking (VFT) of structuring problems, and the application of the new hybrid multicriteria method SAPEVO-WASPAS-2N, derived from the unprecedented junction of SAPEVO-M (Simple Aggregation of Preferences Expressed by Ordinal Vectors - Multi Decision Makers) and WASPAS-2N (Weighted Aggregated Sum Product Assessment) with two standardization techniques. The application of the hybrid model SAPEVO-WASPAS-2N proved to be consistent and robust, generating two possibilities of ordering priorities aligned with the strategic situation of the organization based on the criteria established through the opinion of the decision makers.

Keywords:
MCDM; compliance; VFT; SAPEVO-WASPAS-2N; multi-criteria decision analysis; electric power

1 INTRODUCTION

Electricity has become a fundamental element for the survival, comfort, and quality of life of the human being and the development of any country. We cannot visualize the current world without the electric energy. The company to be studied in this paper is a leader in the electricity generation market in Brazil. Its energy matrix is clean and renewable and contributes to research and energy efficiency programs. It has shares listed on the Brazilian, Spanish, and North American stock exchanges. Because it is a holding company, it controls power generation companies in various parts of the country, having national coverage.

The Brazilian power system presents an integrated supply network with a total installed capacity of 180 GW and a dominant hydroelectric component (67%). Power plants are scattered across the country and after generation the electricity flows through a complex,100,000 Km long interconnected network operated under a centralized management (Matelli et al, 2020MARTELLI V, CHIMENTI P & NOGUEIRA P. 2020 Future scenarios for the Brazilian electricity sector: PV as a new driving force? Futures 120: 102555. https://doi.org/10.1016/j.futures.2020.102555.
https://doi.org/10.1016/j.futures.2020.1...
).

The use of Multiple Criteria Decision Making (MCDM) methods has played an important role in assisting or supporting people and organizations to make decisions, under the influence of multiple criteria, to select (sort, prioritize, classify) among a series of viable alternatives/solutions, in real-life decision-making problems (Gomes and Gomes, 2019GOMES L & GOMES CFS. 2019. Princípios e métodos para a tomada de decisão: Enfoque multicritério. São Paulo: Atlas.; Mishra and Chatterjee, 2018MISHRA M & CHATTERJEE S. 2018. Application of Analytical Hierarchy Process (AHP) algorithm to income insecurity susceptibility mapping-A study in the district of Purulia, India. Socioecon Plann Sci 62: 56-74.).

Despite the diversity of MCDA approaches, methods and techniques, the basic ingredients of MCDA are a finite or infinite set of actions (alternatives, solutions, courses of action, etc.), at least two criteria, and at least one Decision-Maker (DM) (Costa et al, 2022COSTA IPA, COSTA APA, SANSEVERINO AM, GOMES CFS & SANTOS, M. 2022. Bibliometric studies on multi-criteria decision analysis (MCDA) methods applied in military problems. Pesquisa Operacional, 42: e249414. doi: 10.1590/0101-7438.2022.042.00249414.
https://doi.org/10.1590/0101-7438.2022.0...
).

There is a prevalence of studies using unique MCDM methods in the literature. Entertaining the use of hybrid methods combining more than two techniques has received attention more recently due to its flexibility (Nguyen et al., 2014NGUYEN H-T, DAWAL SZM, NUKMAN Y & AOYAMA H. 2014. A hybrid approach for fuzzy multi-attribute decision making in machine tool selection with consideration of the interactions of attributes. Expert Syst Appl 41: 3078-3090.). As Stated by Zimmer et al. (2016ZIMMER K, FRÖHLING M & SCHULTMANN, F. 2016. Sustainable supplier management-a review of models supporting sustainable supplier selection, monitoring and development. Int J Prod Res 54: 1412-1442.) using a hybrid method compensates for the possible disadvantage of each method used. Each method uses its own approaches and assumptions, which can generate different orders for the ranking (Fakhrzad, Firozpour, and Hosseini Nasab, 2021FAKHRZAD MB, FIROZPOUR MR & HOSSEINI NASAB, H. 2021. Comparing Supply Chain Risks Ranking in Multi-Attribute Decision-Making Methods Using the Proposed Three-Dimensional Integration Mean Method. Asia-Pacific J Oper Res, 38.).

A bunch of multi-criteria decision-making methods that have arisen in the scientific literature are used to solve selection problems. (Gottwald et al, 2022GOTTWALD D, JOVČIĆ,S & LEJSKOVÁ P. 2022. Multi-Criteria Decision-Making Approach In Personnel Selection Problem - A Case Study At The University Of Pardubice. Economic Computation and Multiple-Criteria Decision-Making Based On The Use Of Single-Valued Neutrosophic Sets And Similarity Measures. Economic Cybernetics Studies and Research, 56(2): 149-164.). Many multi-criteria decision-making techniques have been introduced by scholars throughout the world, and have successfully been applied in solving numerous decision-making problems in different areas (Stanujkic et al, 2021STANUJKIC D, KARABASEVIC D, POPOVIC G, SMARANDACHE F, ZAVADSKAS EK, MEIDUTĖ-KAVALIAUSKIENĖ I. 2021. Economic Computation and Economic Cybernetics Studies and Research , 55(2): 5-22.)

The objective of this paper is to establish a plan for prioritizing the implementation of compliance processes in an electric power generation company, through the value-focused thinking (VFT) problem structuring method, which enables understanding of the problematic situation, aiming to define the objectives, alternatives, and criteria, to be implemented in the SAPEVO-WASPAS-2N, a new hybrid method, derived from the unprecedented combination of SAPEVO-M (Simple Aggregation of Preferences Expressed by Ordinal Vectors - Multi Decision Makers) and WASPAS-2N (Weighted Aggregated Sum Product Assessment) with two standardization techniques.

Combinations analogous to this can be found in the studies by Silva et al. (2018SILVA M DO C, GOMES CFS & COSTA JUNIOR CL DA. 2018. A hybrid multicriteria methodology Topsis-Macbeth-2n applied in the ordering of technology transfer offices. Pesquisa Operacional 38: 413-439. https://doi.org/10.1590/0101-7438.2018.038.03.0413.
https://doi.org/10.1590/0101-7438.2018.0...
), who used a methodology combining the TOPSIS method, using two standardization methods, MACBETH for the transformation of qualitative data, thus calling it TOPSIS-MACBETH-2N. Gomes et al. (2020GOMES CFS, SANTOS M, TEIXEIRA LFHSB, SANSEVERINO AM & BARCELOS MRS. 2020. Sapevo-m: A group multicriteria ordinal ranking method. Pesquisa Operacional 40: 1-23. https://doi.org/10.1590/0101-7438.2020.040.00226524.
https://doi.org/10.1590/0101-7438.2020.0...
) developed a combination of the AHP method for weight generation and the TOPSIS method for ordering alternatives, tied to two normalizations - AHP-TOPSIS-2N. Maêda et al. (2021MAÊDA SM DO N, COSTA IP DE A, CASTRO MAP DE, FÁVERO LP, COSTA AP DE A, CORRIÇA JV DE P, GOMES CFS & SANTOS M DOS. 2021. Multi-criteria analysis applied to aircraft selection by Brazilian Navy. Production 31. https://doi.org/10.1590/0103-6513.20210011.
https://doi.org/10.1590/0103-6513.202100...
) applied this method to the selection of aircraft by the Brazilian Navy.

Recent literature reviews on MCDM methods have presented several combinations between methods, including the WASPAS method: Zolfani et al. (2022ZOLFANI SH, HASHEMINASAB H, TORKAYESH AE, ZAVADSKAS EK & DERAKHTI A. 2022. A Literature Review of MADM Applications for Site Selection Problems-One Decade Review from 2011 to 2020. Int J Inf Technol Decis Mak 21: 7-57.) identified some with Fuzzy Logic, COPRAS; SWARA, BWM, TOPSIS and WASPAS integration with Pythagorean fuzzy numbers (PFN) was performed by Sivri et al. (2022SIVRI Ç, GÜL S & AKSU OR. 2022. A Novel Pythagorean Fuzzy Extension of DEMATEL and Its Usage on Overcoat Selection Attributes for Antarctic Clothing. Int J Inf Technol Decis Mak 21: 821-850.); Turskis, et al. (2015TURSKIS Z, ZAVADSKAS EK, ANTUCHEVICIENE J & KOSAREVA, N. 2015. A hybrid model based on fuzzy AHP and fuzzy WASPAS for construction site selection. Int J Comput Commun Control 10: 873-888.) proposed the new fuzzy multi-attribute performance measurement (MAPM) integrating fuzzy WASPAS and fuzzy AHP for selection of the best shopping centre construction site; Ghorshi Nezhad, et al. (2015)GHORSHI NEZHAD MR, ZOLFANI SH, MOZTARZADEHA F, ZAVADSKAS EK & BAHRAMI, M. 2015. Planning the priority of high tech industries based on SWARA-WASPAS methodology: The case of the nanotechnology industry in Iran. Econ Res Istraz, 28: 1111-1137. integrated the methods SWARA, to find the weights of the criteria, and WASPAS, to rank the alternatives, in the high technology selection; Kumar et al. (2022KUMAR V, KALITA K, CHATTERJEE P, ZAVADSKAS EK & CHAKRABORTY, S. 2022. A SWARA-CoCoSo-Based Approach for Spray Painting Robot Selection. Inform 33: 35-54.) propose an integrated combination between the step-wise weight assessment ratio analysis (SWARA) and combined compromise solution (CoCoSo) methods to classify, and thus identify, the most apposite spray painting robot for an automobile industry based on seven criteria quantitative evaluation; (Karabasevic et al., 2016KARABASEVIC D, ZAVADSKAS EK, TURSKIS Z & STANUJKIC, D. 2016. The Framework for the Selection of Personnel Based on the SWARA and ARAS Methods Under Uncertainties. Inform 27: 49-65.) develop a framework, based on the combination of SWARA and Additive Ratio Assessment (ARAS) methods, applied in the selection of candidates during the recruitment and selection process of personnel in a company. A search was conducted in the Scopus and ScienceDirect databases, and the proposed combination - SAPEVO-WASPAS-2N - was not found, highlighting the relevance of this article.

The paper is structured as follows. In section 2, the definition of the term compliance and the characteristics associated with it, the VFT approach and the MCDM SAPEVO-M and WASPAS methods are presented. In Section 3 the characteristics, research contributions of the proposal of the new hybrid method SAPEVO-WASPAS-2N and the standardization procedures adopted are presented. In section 4, the application of the SAPEVO-WASPAS-2N method to the decision-making model is shown and the results are analysed. Authors’ considerations and conclusions are presented in section 5.

2 THEORETICAL FOUNDATIONS

Governance, Risk and Compliance (GRC) is one of the ways to organize compliance by aggregating risk management and environmental governance concepts to comply with legislation and standards within and outside an organization. GRC is an integrated and holistic approach to organization-wide governance, risk and compliance, ensuring that an organization is ethically correct and in line with its risk appetite, internal policies, and external regulations, through the alignment of strategy, processes, technology, and people, thereby improving efficiency and effectiveness (Racz et al., 2010RACZ N, WEIPPL E & SEUFERT A. 2010. A frame of reference for research of integrated governance, risk and compliance (GRC). In IFIP International Conference on Communications and Multimedia Security. Springer, pp. 106-117.).

2.1 Compliance

Economists consider regulation to be a coercive force that requires firms to reduce negative externalities (Broeka, Veenstra, 2018BROEKA TVD & VEENSTRA AFV. 2018 Governance of big data collaborations: How to balance regulatorycompliance and disruptive innovation. Technological Forecasting & Social Change, 19: 330-338.). Compliance is an approach that brings together concepts that aim to align various practices of an institution or company with existing standards, laws, and rules, to generate value for the productive processes of a business. This provides a healthy corporate environment, as relationships occur on ethical bases that strengthen the company’s culture and brand before society. This reduces the risk of losses and expenses with fines, penalties, and judicial charges. Compliance generally describes the processes that ensure an organization’s adherence to regulatory, legal, contractual, and other types of obligations (Racz et al., 2011RACZ N, WEIPPL E & SEUFERT A. 2011. Governance, risk & compliance (GRC) software-an exploratory study of software vendor and market research perspectives. In: 2011 44th Hawaii International Conference on System Sciences. IEEE, pp. 1-10.).

Regulation may stimulate firms to improve their technology, may increase corporate awareness of the negative externalities, may reduce regulatory uncertainties of technological investments by providing a level playing field and may even trigger innovation. (Broeka, Veenstra, 2018BROEKA TVD & VEENSTRA AFV. 2018 Governance of big data collaborations: How to balance regulatorycompliance and disruptive innovation. Technological Forecasting & Social Change, 19: 330-338.). To highlight the average return on shares of publicly traded companies that own these values, the Corporate Sustainability Index of the São Paulo Stock Exchange (ISE B3) was created. According to Kocmanová and Šimberová (2014KOCMANOVÁ A & ŠIMBEROVÁ, I. 2014. Determination of environmental, social and corporate governance indicators: framework in the measurement of sustainable performance. J Bus Econ Manag 15: 1017-1033.), the definition of appropriate key indicators for the framework for measuring sustainable business performance that supported decision-making by managers, investors, and other sustainability stakeholders is the objective of determining ESG (environmental, social and governance) performance indicators at the corporate level.

2.2 Value Focused Thinking (VFT)

VFT is part of the Problem Structuring Methods (PSM). The decision-making process must be guided by the definition of the values that are intended to be achieved, as well as by the hierarchy between them, distinguishing between two types of objectives: the fundamental ones, which establish the essential reasons or objectives of the decisions to be taken; and the means objectives, which allow the fundamental objectives to be achieved (Keeney, 2009KEENEY RL. 2009. Value-focused thinking: A path to creative decisionmaking. Harvard University Press. p 432. ISBN 9780674931985.).

VFT is based on two fundamental phases, developed through meetings, interviews, and structured brainstorming with stakeholders. The first is the divergent phase, in which the intermediate and fundamental objectives of the problem or issue to be addressed are identified. Also in this phase, the problem is delineated, with the view of the environment and stakeholders. In the second, the convergent phase, there is the sequencing of activities, the choice of processes to be implemented and the criteria that will be used for classification, as well as the choice of MCDM methods to be used to prioritize the implementation (Abuabara et al., 2019ABUABARA L, PAUCAR-CACERES A & BURROWES-CROMWELL T. 2019. Consumers’ values and behaviour in the Brazilian coffee-in-capsules market: Promoting circular economy. Int J Prod Res, 57: 7269-7288.). Figure 1 shows in graphic form the application of the VFT.

Figure 1
VFT - Convergent and divergent phases.

The objectives defined by VFT through the established values were listed in Figure 2. These objectives become action plans, or activities to be carried out to solve the problem in question and achieve the strategic objective. There is a division between intermediate and fundamental objectives, organized according to their order of execution. In this way, the team that will deal with the problem can organize the work packages.

Figure 2
Hierarchy of objectives.

2.3 SAPEVO-M

In real-world decision-making problems, we usually need to evaluate some alternatives with respect to multiple criteria. To deal with such problems, MCDM techniques and methods are applied (Keshavarz-Ghorabaee et al, 2018KESHAVARZ-GHORABAEE M, AMIRI M, ZAVADSKAS EK, TURSKIS Z & ANTUCHEVICIENE J. 2018. A Comparative Analysis Of The Rank Reversal Phenomenon In The Edas And Topsis Methods. Economic Computation and Economic Cybernetics Studies and Research , 52(3): 121-134.). The SAPEVO-M method (Gomes et al., 2020GOMES CFS, SANTOS M, TEIXEIRA LFHSB, SANSEVERINO AM & BARCELOS MRS. 2020. Sapevo-m: A group multicriteria ordinal ranking method. Pesquisa Operacional 40: 1-23. https://doi.org/10.1590/0101-7438.2020.040.00226524.
https://doi.org/10.1590/0101-7438.2020.0...
), is an evolution of the SAPEVO ordinal MCDM method, initially proposed by Gomes et al. (1997)GOMES L, MURY A-R & GOMES CFS. 1997. Multicriteria ranking with ordinal data. Syst Anal 27: 139-146., for P.γ. (ordering) problems (Costa et al., 2020COSTA IP DE A, MAÊDA SM DO N, TEIXEIRA LFH DE S DE B, GOMES CFS & SANTOS M DOS. 2020. Choosing a hospital assistance ship to fight the covid-19 pandemic. Rev Saude Publica, 54: 79. https://doi.org/10.11606/s1518-8787.2020054002792.
https://doi.org/10.11606/s1518-8787.2020...
; Maêda et al., 2021MAÊDA SM DO N, COSTA IP DE A, CASTRO MAP DE, FÁVERO LP, COSTA AP DE A, CORRIÇA JV DE P, GOMES CFS & SANTOS M DOS. 2021. Multi-criteria analysis applied to aircraft selection by Brazilian Navy. Production 31. https://doi.org/10.1590/0103-6513.20210011.
https://doi.org/10.1590/0103-6513.202100...
).

The method can be divided into four stages: 1) transformation of ordinal preferences of criteria into a vector of criterion weights; 2) integration of the vector criteria of each DM; 3) ordinal transformation of preference between alternatives within a given set of classification criteria into a partial weight of alternatives; 4) determination of global preferences of alternatives (evaluation matrix) (Gomes et al., 2020GOMES CFS, SANTOS M, TEIXEIRA LFHSB, SANSEVERINO AM & BARCELOS MRS. 2020. Sapevo-m: A group multicriteria ordinal ranking method. Pesquisa Operacional 40: 1-23. https://doi.org/10.1590/0101-7438.2020.040.00226524.
https://doi.org/10.1590/0101-7438.2020.0...
).

In step 1, having defined the criteria and alternatives to be used, degrees of preference are established for all ordered pairs of criteria (ci, cj), where ci and cj are two criteria within a set of criteria C = {c1, c2, ... ci, ..., cj, ...}. The degree of preference between them is given by δci cj, such as:

  • δci cj=1cicj , i.e., ci is as important as cj;

  • δci cj>1ci>cj , i.e., ci is more important than cj; and

  • δci cj<1ci<cj , i.e., ci is less important than cj.

To represent the preferences of the criteria, the SAPEVO-M method uses a semantic relationship scale (Table 1).

Table 1
Table of preferences.

In step 2, the relationship associated with this scale allows to transform the matrix DMk = [δci cj], for the k-th decision maker, into a column vector [v i], in such a way that (1):

m i = 1 ( c i ) for i = 1 , , m and k = 1 , , n (1)

At the end of this step, the resulting vector is normalized (2). To ensure the non-generation of negative values in weights, the authors propose the use of 1% of the weight of the next lower weight criterion (least preferred penultimate). Where a ij represents the alternative i = 1, . . . , m in the criterion j = 1, . . . , h.

c t ¯ = a i j - min a i j max a i j - min a i j (2)

In step 3, each decision-maker evaluates the alternatives according to the criteria, resulting in a matrix E i for each decision-maker and each criterion.

Finally, in step 4 the lines of the E i matrix are summed and normalized (2), as performed in the second stage. Vector V, resulting from normalization, represents the preferences for the alternatives of each DM, and will make up the evaluation matrix M (n × m) associated with the sum of each criterion evaluated by each decision-maker.

2.4 WASPAS

The Weighted Aggregates Sum Product Assessment (WASPAS) method, developed by Zavadskas et al. (2012ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6.), is a compensatory method, considered simple, that uses a single combination of two well-known MCDM approaches, the Weighted Sum Model (WSM) and the Weighted Product Model (WPM) (Chakraborty and Zavadskas, 2014CHAKRABORTY S & ZAVADSKAS EK. 2014. Applications of WASPAS method in manufacturing decision making. Inform, 25: 1-20.; Zavadskas et al., 2013ZAVADSKAS EK, ANTUCHEVICIENE J, SAPARAUSKAS J & TURSKIS Z. 2013. MCDM methods WASPAS and MULTIMOORA: Verification of robustness of methods when assessing alternative solutions. Econ Comput Econ Cybern Stud Res 47.). By combining these two methods, the alternatives are evaluated and prioritized. The accuracy in aggregating the two methods is much higher compared to individual accuracy (Zavadskas et al., 2012ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6.).

To use the method, some input information is required: the decision matrix (alternatives and criteria) and the weight of the criteria, which are based on the information received from the decision-taker (Alinezhad and Khalili, 2019ALINEZHAD A & KHALILI J. 2019. New methods and applications in multiple attribute decision making (MADM). Springer.; Chakraborty, Zavadskas, and Antucheviciene 2015CHAKRABORTY S & ZAVADSKAS EK, ANTUCHEVICIENE, J. 2015. Applications of WASPAS method as a multi-criteria decision-making tool. Econ Comput Econ Cybern Stud Res, 49: 1-17.). Information cannot be distorted (Oliveira et al, 2019OLIVEIRA AO, OLIVEIRA HLS, GOMES CFS & RIBEIRO PCC. 2019. Quantitative analysis of RFID’ publications from 2006 to 2016. International Journal of Information Management, 48: 185-192. 10.1016/j.ijinfomgt.2019.02.001.
https://doi.org/10.1016/j.ijinfomgt.2019...
).

The STAGES OF WASPAS are defined as follows (Zavadskas et al., 2012ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6.):

  • 1. Elaboration of the decision/evaluation matrix: composed taking xij as the element of the decision matrix for the alternative i by the criterion j.

X = x 11 x 12 x 1 n x 21 x 22 x 2 n x m 1 x m 2 x m n m x n (3)

  • Where m is the number of alternatives, n is the number of evaluation criteria and xij is the performance of the ith alternative in relation to the jth criterion. In addition, it is necessary for the decision-taker to provide the weight of the criteria [w 1, w 2, ..., w n].

  • 2. Decision Matrix Normalization: The application of the WASPAS method, at first, requires linear normalization of the elements of the decision matrix using the following two equations:
    • For monotonic benefit criteria (MAX), i.e., the higher the better (4).

x ¯ i j = x i j max i x i j . (4)

  • For monotonic cost criteria (MIN), i.e., the lower the better (5).

x ¯ i j = min i x i j x i j (5)

  • where x¯ij is the normalized value of x ij.

  • 3. Calculation of Total Relative Importance: it is calculated based on the WSM method (MacCrimmon, 1968MACCRIMMON KR. 1968. Decisionmaking among multiple-attribute alternatives: a survey and consolidated approach (Rand Corp Santa Monica Ca). https://www.rand.org/pubs/research_memoranda/RM4823.html.
    https://www.rand.org/pubs/research_memor...
    ; Miller and Starr, 1969MILLER DW & STARR MK. 1969. Executive Decisions and Operations Research. Englewood Cliffs, New Jersey. ISBN 978-0132945387.), in the weighted standard data of each alternative, as follows (6):

Q i ( 1 ) = j = 1 n x ¯ i j w j , (6)

  • Where wj indicates the weight of the j-th criterion and Qi(1) indicates the relative importance additive in the i-th alternative.

  • 4. Calculation of Multiplicative Relative Importance: it is calculated based on the WPM method (Triantaphyllou and Mann, 1989TRIANTAPHYLLOU E & MANN SH. 1989. An examination of the effectiveness of multi-dimensional decision-making methods: A decision-making paradox. Decis Support Syst 5: 303-312.; Miller and Starr, 1969MILLER DW & STARR MK. 1969. Executive Decisions and Operations Research. Englewood Cliffs, New Jersey. ISBN 978-0132945387.), to determine the relative multiplicative importance of the weighted standard data of each alternative, using the following equation (7):

Q i ( 2 ) = j = 1 n ( x ¯ i j ) w j . (7)

  • where Qi(2) indicates the relative multiplicative importance of the i-th alternative.

  • 5. Calculation of the Generalized Criterion Set (Q): it is proposed to generalize and integrate the additive and multiplicative methods, defined as (8):

Q i = 0 . 5 Q i ( 1 ) + 0 . 5 Q i ( 2 ) (8)

  • In equation (8) a total importance of the alternative is determined, equal to WSM and WPM for a total evaluation.

In addition, a new equation has been proposed to increase the accuracy of the ranking (9):

Q i = λ j = 1 n x ¯ i j w j + ( 1 - λ ) j = 1 n ( x ¯ i j ) w j , λ = 0 , , 1 . (9)

Where λ can range from 0 to 1. When λ =0, WASPAS is transformed into WPM; and when λ =1, WASPAS is transformed into WSM. Therefore, it is recommended to start from an initial analysis with λ =0.5.

Obtaining the final ranking of the alternatives: finally, the alternatives are classified based on the Qi value, that is, the higher the qi value the better positioned the alternative i.

3 SAPEVO-WASPAS-2N APPROACH

According to Silva et al. (2018SILVA M DO C, GOMES CFS & COSTA JUNIOR CL DA. 2018. A hybrid multicriteria methodology Topsis-Macbeth-2n applied in the ordering of technology transfer offices. Pesquisa Operacional 38: 413-439. https://doi.org/10.1590/0101-7438.2018.038.03.0413.
https://doi.org/10.1590/0101-7438.2018.0...
), different approaches and techniques of MCDM can be proposed depending on various schools of thought and/or demands of specific situations. There is no better or worse method, what one has are several methods that can suit different situations. Wang et al. (2016WANG P, ZHU Z & WANG, Y. 2016. A novel hybrid MCDM model combining the SAW, TOPSIS and GRA methods based on experimental design. Inf Sci (Ny) 345: 27-45.) report that the combination of different MCDM techniques to build a hybrid model has been widely used and has also shown very expressive results. This path can be a good choice to overcome the limitations of each method.

The proposal of the hybrid method SAPEVO-WASPAS-2N meets some limitations/disadvantages found in the WASPAS method, to be compensated by the SAPEVO-M method.

The WASPAS method requires some elements to be able to start its application: the weights of the criteria and the decision matrix (alternatives and criteria), elements that must be established by the decision-taker. However, often the decision-taker is not sure to assign this data directly and accurately. Besides that, the method does not establish any process when there are qualitative criteria.

This statement is found in (Chakraborty and Zavadskas, 2014CHAKRABORTY S & ZAVADSKAS EK. 2014. Applications of WASPAS method in manufacturing decision making. Inform, 25: 1-20.; Zavadskas et al., 2012ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6., 2013ZAVADSKAS EK, ANTUCHEVICIENE J, SAPARAUSKAS J & TURSKIS Z. 2013. MCDM methods WASPAS and MULTIMOORA: Verification of robustness of methods when assessing alternative solutions. Econ Comput Econ Cybern Stud Res 47.), where the attributions of weights are calculated in several ways: by the entropy method (proposed by Zeleny in 1982); the AHP method; equal attribution between the criteria, or directly by the decision-taker. Regarding the evaluation of alternatives in qualitative criteria, it is necessary to use other techniques so that the analysis can be expressed quantitatively. In these studies, several forms were found to evaluate qualitative criteria, the most common are direct attribution of DM through a Likert scale (created by Rensis Likert in 1932) converted into 5 or 7 posts, and/or linguistic variables converted into scores.

The ELECTRE-MOr hybrid method uses an adaptation of the SAPEVO-M method to obtain the weights and evaluate qualitative criteria, transforming the ordinal preferences of the criteria (De Araújo Costa et al., 2022DE ARAÚJO COSTA IP, MOREIRA MÂL, DE ARAÚJO COSTA AP, DE SOUZA DE BARROS TEIXEIRA LFH, GOMES CFS, SANTOS MD, COSTA IPA, MOREIRA MÂL, DE ARAÚJO COSTA AP, DE SOUZA DE BARROS TEIXEIRA LFH, GOMES CFS & SANTOS MD. 2022. Strategic Study for Managing the Portfolio of IT Courses Offered by a Corporate Training Company: An Approach in the Light of the ELECTRE-MOr Multicriteria Hybrid Method. Int J Inf Technol Decis Mak, 21(01): 351-379. https://doi.org/10.1142/S0219622021500565.
https://doi.org/10.1142/S021962202150056...
). A similar approach is used in the SAPEVO-WASPAS-2N method.

Thus, the SAPEVO-WASPAS-2N method allows the use of quantitative and/or qualitative criteria, generating at the end two orders through different standardization processes.

The main reasons for integrating the two methods are:

  • SAPEVO-M is used to treat ordinal data, transforming ordinal values into cardinal (qualitative into quantitative).

  • WASPAS uses the criteria to order alternatives (including qualitative data processed by SAPEVO-M).

  • Aggregation uses two standard methods (allowing to generate different matrices associated with each normalization method, thereby increasing the robustness of the method and enabling a sensitivity analysis of the results).

3.1 Standardization Procedures: Application of WAPAS-2N

The second part of the method, WASPAS-2N, is so named because it performs two normalization procedures used during its execution. (Gomes and Gomes, 2019GOMES L & GOMES CFS. 2019. Princípios e métodos para a tomada de decisão: Enfoque multicritério. São Paulo: Atlas.) present the four main normalization procedures commonly used and their calculation formulas (N1), (N2), (N3) and (N4) (Figure 3).

Figure 3
Main normalization procedures Source (Gomes and Gomes, 2019GOMES L & GOMES CFS. 2019. Princípios e métodos para a tomada de decisão: Enfoque multicritério. São Paulo: Atlas.).

All four normalization procedures in Figure 1 were tested, however only two of them presented consistent results in terms of order of alternatives. Thus, the method developed and proposed in this article, WASPAS-2N, considers the standardization procedures N1 and N4.

We can identify that the N1 normalization process is equal to the original normalization process established by the WASPAS method.

At the end, the Generalized Criterion Set (Q) is calculated for the two normalization procedures, N1 and N4, and thus the priority orders of the alternatives are obtained based on the Qi value.

4 APPLICATION OF SAPEVO-WASPAS-2N METHOD

In strategic decision-making situations, large companies like this one need to reduce the inherent subjectivity of human beings.

4.1 Description of criteria

Following the VFT approach, based on the values identified, the criteria were defined together with the authors and with the help of the teams involved in the problem. The selected criteria were:

  • C1 - Improvement of the company’s reputation.

  • C2 - Ease of obtaining resources.

  • C3 - Minimization of legal and financial risks.

  • C4 - Positive impact on the market.

  • C5 - Cost of implementation.

  • C6 - Deployment time.

All criteria were evaluated qualitatively.

4.2 Definition of Alternatives

The alternatives were also obtained by the VFT method based on processes already widely disseminated in the literature on Compliance and based on the specific knowledge of the team of specialists involved. These alternatives were validated by the team involved and the decision-takers. Table 2 presents the alternatives and categories associated with compliance.

Table 2
Alternatives raised in VFT.

4.3 Definition of criteria weights in each scenario

Scenarios are platforms for strategic discussions that lead to continued organizational learning regarding its key decisions and priorities (Oliveira et al, 2018OLIVEIRA AS, BARROS MD, PEREIRA FC, GOMES CFS & COSTA HG. 2018. Prospective scenarios: A literature review on the Scopus database. Futures , 100: 20-33. https://doi.org/10.1016/j.futures.2018.03.005
https://doi.org/10.1016/j.futures.2018.0...
).

The weights of the criteria were obtained by applying the SAPEVO-M method, in its steps 1 and 2, considering the point of view of two DMs. The DMs are specialists in the compliance area, one of them works in the utilities company in the field of electricity. The second DM operates in a company in the financial market sector and works in compliance of this organization, thus bringing more external and financial view of the market (Table 3).

Table 3
Weight of criteria of each DM after the paritarian evaluations of the criteria and the integration of the criteria.

The results show the highest importance attributed to criteria C2 - Ease in obtaining resources and C3 - Minimization of legal and financial risks - a result consistent with the company’s concerns in carrying out processes that may result in risk minimization and facility to obtain investments that bring benefits to the organization. On the other hand, criteria C5 - Deployment Cost and C6 - Deployment time - were considered less important for the installation of compliance processes in the organization.

4.4 Evaluation of alternatives on the point of view of each criterion

In this stage, for qualitative criteria, such as those presented in this article, steps 3 and 4 of the SAPEVO-M method are applied (Table 4).

Table 4
Example of the paritarian evaluation of alternatives in criterion C1 by DM1.

In case of quantitative criteria, the DMs simply inform the monocity of the criteria (benefit or cost) and assign the values of the alternatives for each criterion directly in the decision matrix. From this, the SAPEVO-WASPAS-2N method allows the entry of quantitative and/or qualitative data in its application.

After evaluating the alternatives in each criterion, vector V, resulting from normalization, which represents the preferences of the alternatives of each DM, will make up the decision matrix M (n × m) associated with the sum of each criterion evaluated by each decision-maker (Table 5).

Table 5
Decision matrix.

In qualitative criteria, because it is a paritarian evaluation among the alternatives, the values of the resulting vector are established in order of magnitude, that is, the higher the value, the better the alternative will be. Thus, the normalization process is applied as if the qualitative criteria were monotonic for benefit, the higher the better.

4.5 Analysis of the results of the orders

Having established the weight of the criteria and the decision matrix, from this stage the WAPAS-2N method is applied to obtain the prioritization of compliance processes to be implemented, based on the established criteria.

The first step in the application of the WASPAS-2N method is the normalization of the decision matrix, through the two normalization procedures (N1 and N4), established in section 3.1.

After the normalization of the decision matrix, the Weighted Sum Model (WSM) and the Weighted Product Model (WPM) are calculated (Table 6).

Table 6
Calculation of WSM and WPM for each alternative to the two standardization procedures.

Finally, the generalized criterion set (Qi) is calculated using equation (3), and the ranking of alternatives is established based on the Qi value, that is, the higher the qi value, the better positioned the alternative. Initially, a λ =0.5 was used as suggested by Zavadskas et al. (2012ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6.) (Table 7).

Table 7
Generalized criterion set (Qi) and ranking of alternatives for each standardization procedure.

It can be observed from the results, that the process for implementation of Compliance, A2 - Management of corporate impact on the environment, was ranked first in the two standardization processes. This is followed very closely by processes A1 - Corporate impact management in society and A7 - Anti-corruption compliance management, which has inverted positions when compared to the two standardization processes: A1 rose to 2nd in the rank in the N4 standardization procedure and A7 dropped to 3rd in the rank in the N4 normalization procedure. Thus, these alternatives are presented as processes that should be prioritized in the implementation of Compliance in the organization.

In an opposite analysis, the processes for implementation of Compliance, A8 and A4, presented the worst results among all alternatives, equally in the two standardization procedures. Thus, they should have a lower prioritization among the analysed processes.

When evaluating the ordering resulting from the two separate normalization techniques, it is observed that the ranking of the alternatives changes just once, indicating the method's robustness and stability, despite the differences in weights between the DMs. To test the robustness and performance of the method, in the following section a λ variation is performed in the N1 normalization data.

4.6 Effect of λ variation

Table 8 shows the effects of the change in λ values (λ =0, 0.1, 0.2, ..., 1) on the result of the generalized criterion set (Qi) of each alternative using the data of normalization N1, and Figure 4 presents the order of classification of the alternatives, compared to the generalized criterion.

Table 8
Generalized criterion set (Qi) and ranking of alternatives for each standardization procedure.

Figure 4
VFT - Order of classification of alternatives when λ =0, 0.1, 0.2, . . . , 1.

It is interesting to note that for the variable values of λ , the positions of the first six alternatives remain entirely unchanged. The only variation is between the two worst alternatives, and only happens when λ is equal to or greater than 0.8. For a λ value of 0.8 the order of classification of alternatives is reached as: A2 >A7 >A1 >A5 >A6 >A9 >A8 >A4 >A3.

Although the classifications of the last two alternatives change slightly, it is observed that the general classification of the first six compliance implementation processes in the organization, is currently independent on the value of λ . Results similar to this, can be found in Chakraborty and Zavadskas (2014CHAKRABORTY S & ZAVADSKAS EK. 2014. Applications of WASPAS method in manufacturing decision making. Inform, 25: 1-20.), where the authors present results with little or no variation of the order of alternatives even varying λ.

5 FINAL CONSIDERATIONS AND CONCLUSIONS

This study can serve as a guide for companies and organizations that want to use a hybrid approach of multi-criteria techniques in their decision-making models for prioritizing processes for implementing compliance.

The SAPEVO-WASPAS-2N method is a proposal for a new hybrid method consisting of the unprecedented junction of two new MCDM methods: SAPEVO-M and WASPAS. This method enables the transformation of a qualitative analysis into a quantitative analysis, through the paritarian comparison of alternatives into qualitative criteria and the use of criteria weights through SAPEVO-M, and the ordering of alternatives by a new version of the WASPAS method, which uses two standardization techniques (WASPAS-2N).

The application of the new SAPEVO-WASPAS-2N method, which was the use of the VFT problem structuring method, made it possible to structure the problem with its analysis focused on values and to find the objectives, criteria and set of alternatives that led decision makers in the decision-making process. Breaking an approach typically focused on the alternative normally used, where the alternatives are defined first and only then the criteria and objectives of the analysis.

Given the results obtained and the consistency analysis, the hybrid method SAPEVO-WASPAS-2N proved to be a consistent and robust tool for problems of prioritization of compliance implementation process, besides being little affected by the variable values λ.

For future research, the authors suggest new applications of the MCDM SAPEVO-WASPAS-2N method to test its consistency and robustness, in different problems of different areas.

References

  • ABUABARA L, PAUCAR-CACERES A & BURROWES-CROMWELL T. 2019. Consumers’ values and behaviour in the Brazilian coffee-in-capsules market: Promoting circular economy. Int J Prod Res, 57: 7269-7288.
  • ALINEZHAD A & KHALILI J. 2019. New methods and applications in multiple attribute decision making (MADM). Springer.
  • BROEKA TVD & VEENSTRA AFV. 2018 Governance of big data collaborations: How to balance regulatorycompliance and disruptive innovation. Technological Forecasting & Social Change, 19: 330-338.
  • DE ARAÚJO COSTA IP, MOREIRA MÂL, DE ARAÚJO COSTA AP, DE SOUZA DE BARROS TEIXEIRA LFH, GOMES CFS, SANTOS MD, COSTA IPA, MOREIRA MÂL, DE ARAÚJO COSTA AP, DE SOUZA DE BARROS TEIXEIRA LFH, GOMES CFS & SANTOS MD. 2022. Strategic Study for Managing the Portfolio of IT Courses Offered by a Corporate Training Company: An Approach in the Light of the ELECTRE-MOr Multicriteria Hybrid Method. Int J Inf Technol Decis Mak, 21(01): 351-379. https://doi.org/10.1142/S0219622021500565
    » https://doi.org/10.1142/S0219622021500565
  • CHAKRABORTY S & ZAVADSKAS EK. 2014. Applications of WASPAS method in manufacturing decision making. Inform, 25: 1-20.
  • CHAKRABORTY S & ZAVADSKAS EK, ANTUCHEVICIENE, J. 2015. Applications of WASPAS method as a multi-criteria decision-making tool. Econ Comput Econ Cybern Stud Res, 49: 1-17.
  • COSTA IP DE A, MAÊDA SM DO N, TEIXEIRA LFH DE S DE B, GOMES CFS & SANTOS M DOS. 2020. Choosing a hospital assistance ship to fight the covid-19 pandemic. Rev Saude Publica, 54: 79. https://doi.org/10.11606/s1518-8787.2020054002792
    » https://doi.org/10.11606/s1518-8787.2020054002792
  • COSTA IPA, COSTA APA, SANSEVERINO AM, GOMES CFS & SANTOS, M. 2022. Bibliometric studies on multi-criteria decision analysis (MCDA) methods applied in military problems. Pesquisa Operacional, 42: e249414. doi: 10.1590/0101-7438.2022.042.00249414.
    » https://doi.org/10.1590/0101-7438.2022.042.00249414
  • FAKHRZAD MB, FIROZPOUR MR & HOSSEINI NASAB, H. 2021. Comparing Supply Chain Risks Ranking in Multi-Attribute Decision-Making Methods Using the Proposed Three-Dimensional Integration Mean Method. Asia-Pacific J Oper Res, 38.
  • GHORSHI NEZHAD MR, ZOLFANI SH, MOZTARZADEHA F, ZAVADSKAS EK & BAHRAMI, M. 2015. Planning the priority of high tech industries based on SWARA-WASPAS methodology: The case of the nanotechnology industry in Iran. Econ Res Istraz, 28: 1111-1137.
  • GOMES CFS, SANTOS M, TEIXEIRA LFHSB, SANSEVERINO AM & BARCELOS MRS. 2020. Sapevo-m: A group multicriteria ordinal ranking method. Pesquisa Operacional 40: 1-23. https://doi.org/10.1590/0101-7438.2020.040.00226524
    » https://doi.org/10.1590/0101-7438.2020.040.00226524
  • GOMES L & GOMES CFS. 2019. Princípios e métodos para a tomada de decisão: Enfoque multicritério. São Paulo: Atlas.
  • GOMES L, MURY A-R & GOMES CFS. 1997. Multicriteria ranking with ordinal data. Syst Anal 27: 139-146.
  • GOTTWALD D, JOVČIĆ,S & LEJSKOVÁ P. 2022. Multi-Criteria Decision-Making Approach In Personnel Selection Problem - A Case Study At The University Of Pardubice. Economic Computation and Multiple-Criteria Decision-Making Based On The Use Of Single-Valued Neutrosophic Sets And Similarity Measures. Economic Cybernetics Studies and Research, 56(2): 149-164.
  • KARABASEVIC D, ZAVADSKAS EK, TURSKIS Z & STANUJKIC, D. 2016. The Framework for the Selection of Personnel Based on the SWARA and ARAS Methods Under Uncertainties. Inform 27: 49-65.
  • KEENEY RL. 2009. Value-focused thinking: A path to creative decisionmaking. Harvard University Press. p 432. ISBN 9780674931985.
  • KESHAVARZ-GHORABAEE M, AMIRI M, ZAVADSKAS EK, TURSKIS Z & ANTUCHEVICIENE J. 2018. A Comparative Analysis Of The Rank Reversal Phenomenon In The Edas And Topsis Methods. Economic Computation and Economic Cybernetics Studies and Research , 52(3): 121-134.
  • KOCMANOVÁ A & ŠIMBEROVÁ, I. 2014. Determination of environmental, social and corporate governance indicators: framework in the measurement of sustainable performance. J Bus Econ Manag 15: 1017-1033.
  • KUMAR V, KALITA K, CHATTERJEE P, ZAVADSKAS EK & CHAKRABORTY, S. 2022. A SWARA-CoCoSo-Based Approach for Spray Painting Robot Selection. Inform 33: 35-54.
  • MACCRIMMON KR. 1968. Decisionmaking among multiple-attribute alternatives: a survey and consolidated approach (Rand Corp Santa Monica Ca). https://www.rand.org/pubs/research_memoranda/RM4823.html
    » https://www.rand.org/pubs/research_memoranda/RM4823.html
  • MAÊDA SM DO N, COSTA IP DE A, CASTRO MAP DE, FÁVERO LP, COSTA AP DE A, CORRIÇA JV DE P, GOMES CFS & SANTOS M DOS. 2021. Multi-criteria analysis applied to aircraft selection by Brazilian Navy. Production 31. https://doi.org/10.1590/0103-6513.20210011
    » https://doi.org/10.1590/0103-6513.20210011
  • MARTELLI V, CHIMENTI P & NOGUEIRA P. 2020 Future scenarios for the Brazilian electricity sector: PV as a new driving force? Futures 120: 102555. https://doi.org/10.1016/j.futures.2020.102555
    » https://doi.org/10.1016/j.futures.2020.102555
  • MILLER DW & STARR MK. 1969. Executive Decisions and Operations Research. Englewood Cliffs, New Jersey. ISBN 978-0132945387.
  • MISHRA M & CHATTERJEE S. 2018. Application of Analytical Hierarchy Process (AHP) algorithm to income insecurity susceptibility mapping-A study in the district of Purulia, India. Socioecon Plann Sci 62: 56-74.
  • NGUYEN H-T, DAWAL SZM, NUKMAN Y & AOYAMA H. 2014. A hybrid approach for fuzzy multi-attribute decision making in machine tool selection with consideration of the interactions of attributes. Expert Syst Appl 41: 3078-3090.
  • OLIVEIRA AS, BARROS MD, PEREIRA FC, GOMES CFS & COSTA HG. 2018. Prospective scenarios: A literature review on the Scopus database. Futures , 100: 20-33. https://doi.org/10.1016/j.futures.2018.03.005
    » https://doi.org/10.1016/j.futures.2018.03.005
  • OLIVEIRA AO, OLIVEIRA HLS, GOMES CFS & RIBEIRO PCC. 2019. Quantitative analysis of RFID’ publications from 2006 to 2016. International Journal of Information Management, 48: 185-192. 10.1016/j.ijinfomgt.2019.02.001.
    » https://doi.org/10.1016/j.ijinfomgt.2019.02.001
  • RACZ N, WEIPPL E & SEUFERT A. 2010. A frame of reference for research of integrated governance, risk and compliance (GRC). In IFIP International Conference on Communications and Multimedia Security. Springer, pp. 106-117.
  • RACZ N, WEIPPL E & SEUFERT A. 2011. Governance, risk & compliance (GRC) software-an exploratory study of software vendor and market research perspectives. In: 2011 44th Hawaii International Conference on System Sciences. IEEE, pp. 1-10.
  • SILVA M DO C, GOMES CFS & COSTA JUNIOR CL DA. 2018. A hybrid multicriteria methodology Topsis-Macbeth-2n applied in the ordering of technology transfer offices. Pesquisa Operacional 38: 413-439. https://doi.org/10.1590/0101-7438.2018.038.03.0413
    » https://doi.org/10.1590/0101-7438.2018.038.03.0413
  • SIVRI Ç, GÜL S & AKSU OR. 2022. A Novel Pythagorean Fuzzy Extension of DEMATEL and Its Usage on Overcoat Selection Attributes for Antarctic Clothing. Int J Inf Technol Decis Mak 21: 821-850.
  • STANUJKIC D, KARABASEVIC D, POPOVIC G, SMARANDACHE F, ZAVADSKAS EK, MEIDUTĖ-KAVALIAUSKIENĖ I. 2021. Economic Computation and Economic Cybernetics Studies and Research , 55(2): 5-22.
  • TRIANTAPHYLLOU E & MANN SH. 1989. An examination of the effectiveness of multi-dimensional decision-making methods: A decision-making paradox. Decis Support Syst 5: 303-312.
  • TURSKIS Z, ZAVADSKAS EK, ANTUCHEVICIENE J & KOSAREVA, N. 2015. A hybrid model based on fuzzy AHP and fuzzy WASPAS for construction site selection. Int J Comput Commun Control 10: 873-888.
  • WANG P, ZHU Z & WANG, Y. 2016. A novel hybrid MCDM model combining the SAW, TOPSIS and GRA methods based on experimental design. Inf Sci (Ny) 345: 27-45.
  • ZAVADSKAS EK, ANTUCHEVICIENE J, SAPARAUSKAS J & TURSKIS Z. 2013. MCDM methods WASPAS and MULTIMOORA: Verification of robustness of methods when assessing alternative solutions. Econ Comput Econ Cybern Stud Res 47.
  • ZAVADSKAS EK, TURSKIS Z, ANTUCHEVICIENE J & ZAKAREVICIUS, A. 2012. Optimization of weighted aggregated sum product assessment. Elektron Ir Elektrotechnika 122: 3-6.
  • ZIMMER K, FRÖHLING M & SCHULTMANN, F. 2016. Sustainable supplier management-a review of models supporting sustainable supplier selection, monitoring and development. Int J Prod Res 54: 1412-1442.
  • ZOLFANI SH, HASHEMINASAB H, TORKAYESH AE, ZAVADSKAS EK & DERAKHTI A. 2022. A Literature Review of MADM Applications for Site Selection Problems-One Decade Review from 2011 to 2020. Int J Inf Technol Decis Mak 21: 7-57.

Publication Dates

  • Publication in this collection
    09 Oct 2023
  • Date of issue
    2023

History

  • Received
    08 Sept 2022
  • Accepted
    21 May 2023
Sociedade Brasileira de Pesquisa Operacional Rua Mayrink Veiga, 32 - sala 601 - Centro, 20090-050 Rio de Janeiro RJ - Brasil, Tel.: +55 21 2263-0499, Fax: +55 21 2263-0501 - Rio de Janeiro - RJ - Brazil
E-mail: sobrapo@sobrapo.org.br