Acessibilidade / Reportar erro

Local Government Performance: Evaluating Efficiency, Efficacy, and Effectiveness at the Basic Education Level

ABSTRACT

Access to public education for many specialists is the most potent policy toward achieving an equitable and fair society. To accomplish this challenging goal, there must exist an efficient and effective public system. Therefore, to support and expand the issue, we have developed a study that focuses on the impacts that socioeconomic conditions have on efficiency and efficacy at the basic education level in municipalities from the state of São Paulo, Brazil. In order to achieve our main goal, we performed a descriptive statistical analysis, a correlation analysis, and three multiple linear regressions. First, the descriptive study exhibited public education inequality between the municipalities. Following this, the correlation analysis pointed out a positive and significant correlation amongst socioeconomic conditions as well as a more efficient and effective model. Finally, three multiple linear regressions demonstrate a positive and significant impact concerning the economic status between the social condition and the efficiency, efficacy, and effectiveness in public schools run by municipal authorities. Therefore, this paper generates an advance toward local government performance studies, through the analysis of possible impacts concerning socioeconomic conditions in the 3Es at the basic education level.

Keywords:
public management performance; effectiveness; public education; efficiency; local government performance

INTRODUCTION

According to the World Bank (2018)World Bank. (2018). Learning: To realize education’s promise. World Development Report, Washington: World Bank. https://doi.org/10.1596/978-1-4648-1096-1
https://doi.org/10.1596/978-1-4648-1096-...
, in contrast to any other policy, education is extremely powerful, as it improves freedom and benefits, as well as provides a better life to the members of a society. Although over recent years access to education has increased, there is seen a significant worldwide disparity in its delivery and effectiveness, mainly due to poverty, sociodemographic conditions, and disability (World Bank, 2018World Bank. (2018). Learning: To realize education’s promise. World Development Report, Washington: World Bank. https://doi.org/10.1596/978-1-4648-1096-1
https://doi.org/10.1596/978-1-4648-1096-...
). In the search for solutions to such problems, it is necessary to improve elementary schooling, the outcomes and environment for education, along with its equality (United Nations Children’s Fund [UNICEF], 2017United Nations Children's Fund. (2017). Annual Results Report 2017 -Education . New York: Unicef. Retrieved from https://www.unicef.org/sites/default/files/2019-01/Annual_Results_Report_2017_Education.pdf
https://www.unicef.org/sites/default/fil...
).

Therefore, for governments to achieve social improvement goals set through improved education, improvements to the efficiency, efficacy, and effectiveness of national educational systems are necessary (Rosser & Sulistiyanto, 2013Rosser, A., & Sulistiyanto, P. (2013). The Politics of Universal Free Basic Education in Decentralized Indonesia: Insights from Yogyakarta. Pacific Affairs, 86(3), 539-560. https://doi.org/10.5509/2013863539
https://doi.org/10.5509/2013863539...
; UNICEF, 2017United Nations Children's Fund. (2017). Annual Results Report 2017 -Education . New York: Unicef. Retrieved from https://www.unicef.org/sites/default/files/2019-01/Annual_Results_Report_2017_Education.pdf
https://www.unicef.org/sites/default/fil...
; World Bank, 2018World Bank. (2018). Learning: To realize education’s promise. World Development Report, Washington: World Bank. https://doi.org/10.1596/978-1-4648-1096-1
https://doi.org/10.1596/978-1-4648-1096-...
). In our case, Brazil has a socially unequal basic education system, according to Organization for Economic Co-operation and Development (OECD) (2018)Organization for Economic Co-operation and Development. (2018). Education at a Glance 2018, Paris, 460, https://doi.org/10.1787/eag-2018-en
https://doi.org/10.1787/eag-2018-en...
, with a low level of expenditure per student against OECD countries, with different salaries paid to teachers and number of students per state, as well as one of the highest disparities in income found among OECD countries and partners.

The main challenge facing the Brazilian basic education system is how policymakers and practitioners can improve the quality and impartiality concerning outcomes through better evaluations and governance (OECD, 2015Organization for Economic Co-operation and Development. (2015). Education Policy Outlook, Paris, 24. Retrieved from https://www.oecd-ilibrary.org/education/education-policy-outlook-2015_9789264225442-en
https://www.oecd-ilibrary.org/education/...
). The problem in Brazil exacerbates further, as shown in the state of São Paulo: despite being the richest state in Brazil (Instituto Brasileiro de Geografia e Estatística [IBGE] 2010Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
https://cidades.ibge.gov.br/brasil/sp...
; Campoli, Ferraz, & Rebelatto 2019Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering. New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
https://doi.org/10.1007/978-3-319-93488-...
), it has the title of being one of the least efficient states in Brazil in terms of education. While spending more money than any other, it still demonstrates the same or even worse results than other poorer states.

In the Brazilian context, according to the Federal Constitution (Brazil, 1988Brazil. (1988). Constituição da República Federativa do Brasil de 05 de dezembro de 1988. São Paulo: Saraiva. ), municipalities are responsible for executing the educational policies from nursery until the first part of the elementary school - grade five. Nevertheless, this decentralized model has caused some problems due to the incapacity on the part of municipalities to attend to educational demands (Fabrino, Valle, & Gomes, 2014Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
http://dx.doi.org/10.1016/j.ijme.2014.03...
). Consequently, there is an academic and practical gap in the public management performance area, at the local government performance level, when studying efficiency, efficacy, and effectiveness on a road map conception, starting from efficiency, passing to efficacy, and finishing with effectiveness at the basic education public school on a subnational level (Avellaneda & Gomes, 2015Avellaneda, C. N., & Gomes, R. C. (2015). Is small beautiful? Testing the direct and nonlinear effects of size on municipal performance. Public Administration Review, 75(1), 137-149. https://doi.org/10.1111/puar.12307
https://doi.org/10.1111/puar.12307...
; Olvera & Avellaneda, 2019Olvera, J. G., & Avellaneda, C. N. (2019). Subnational government performance: Testing multiple dimensions of Governors’ experience. Public Administration Review, 79(3), 383-398. https://doi.org/10.1111/puar.13035
https://doi.org/10.1111/puar.13035...
).

To collaborate in finding solutions to the gaps and problems mentioned above, our research question is ‘How socioeconomic conditions influence local government performance (efficiency, efficacy, and effectiveness), at the basic education level?’ To answer this question, we have analyzed the influence of socioeconomic conditions on local government performance of the 3Es (efficiency, efficacy, and effectiveness), at the basic education level. Therefore, through use of our study, we are stimulating advances concerning public administration studies, mainly in area of local government performance theory, by use of the 3Es analysis, while at the same time covering two periods of political mandates.

THEORETICAL FRAMEWORK

Public management performance, at local levels, has discussed the influence of sociodemographic, economic, and cultural factors concerning efficiency, efficacy, and effectiveness in municipalities (Avellaneda & Gomes, 2015Avellaneda, C. N., & Gomes, R. C. (2015). Is small beautiful? Testing the direct and nonlinear effects of size on municipal performance. Public Administration Review, 75(1), 137-149. https://doi.org/10.1111/puar.12307
https://doi.org/10.1111/puar.12307...
; Puppim, 2017Puppim, J. A. de O. (2017). Brazilian Public Administration: Shaping and being shaped by governance and development. Chinese Political Science Review, 2(1), 7-21. https://doi.org/10.1007/s41111-017-0052-4
https://doi.org/10.1007/s41111-017-0052-...
). The debate has advanced to the performance in central social policies, linked to these factors, where one finds studies based on educational efficiency, efficacy, and effectiveness (Olvera & Avellaneda, 2019Olvera, J. G., & Avellaneda, C. N. (2019). Subnational government performance: Testing multiple dimensions of Governors’ experience. Public Administration Review, 79(3), 383-398. https://doi.org/10.1111/puar.13035
https://doi.org/10.1111/puar.13035...
).

The study by Theunissen, Bosma, Verdonk, and Feron (2015)Theunissen, M. J., Bosma, H., Verdonk, P., & Feron, F. (2015). Why Wait? Early Determinants of School Dropout in Preventive Pediatric Primary Care. PLoS ONE, 10(11), e0142315. https://doi.org//10.1371/journal.pone.0142315
https://doi.org//10.1371/journal.pone.01...
, based on contributing factors in primary schools in the Netherlands, proved that sociodemographic factors are influencers in the dropout rate and efficiency associated with public schools. In support of the study by Theunissen et al. (2015), Bastos, Bottan, and Cristia (2016)Bastos, P., Bottan, N. L., & Cristia, J. (2016). Access to preprimary education and progression in primary school: Evidence from Rural Guatemala. World Bank Group, 33p. Retrieved from https://publications.iadb.org/en/access-preprimary-education-and-progression-primary-school-evidence-rural-guatemala
https://publications.iadb.org/en/access-...
discuss how the expansion in primary schools can collaborate with education coverage, under the condition that there exists better quality in the action taken by the school. Along these lines, Carnoy et al. (2017)Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
also debate the influence of sociodemographic conditions on the effectiveness of schools in Brazil, where each state has its own profile and route toward achieving a more effective education.

H1: The sociodemographic and economic conditions have a positive impact on an efficiency model at the basic education level in the Brazilian municipalities (Carnoy et al., 2017Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
).

On the other hand, a study developed in Ghana, a developing country, supports the idea that there is no correlation between sociodemographic and economic characteristics when dealing with educational performance in terms of efficacy and effectiveness (Amankwaa, Agyemang-Dankwah, & Boateng, 2015Amankwaa, I., Agyemang-Dankwah, A., & Boateng, D. (2015). Previous education, sociodemographic characteristics, and nursing cumulative grade point average as predictors of success in nursing licensure examinations. Nursing Research and Practice, ID 682479, 8p. http://dx.doi.org/10.1155/2015/682479
http://dx.doi.org/10.1155/2015/682479...
). Additionally, Marin, Peuker, and Kessler (2019)Marin, A. H., Peuker, A. C. & Kessler. F. H. P . (2019). Sociodemographic characteristics, school performance, pattern of consumption and emotional health as risk factors for alcohol use among adolescents. Trends in Psychology, 27(1), 279-292. http://dx.doi.org/10.9788/tp2019.1-20
http://dx.doi.org/10.9788/tp2019.1-20...
include psychological factors, aggregated with sociodemographic conditions, in student performance, such as alcohol consumption and pattern behaviors.

The study by Birchler and Michaelowa (2016)Birchler, K. & Michaelowa, K. (2016). Making aid work for education in developing countries: An analysis of aid effectiveness for primary education coverage and quality. International Journal of Educational Development, 48, 37-52. https://doi.org/10.1016/j.ijedudev.2015.11.008
https://doi.org/10.1016/j.ijedudev.2015....
, complementing the previous studies, discusses the relationship between economic conditions and enrolment in public primary schools, which represents a connection between a higher financial profile and a more efficient school. Likewise, the economic and efficiency indicators can impact upon the competencies developed during the school period, which results in an improvement in the efficacy and effectiveness of the school (Aesaert et al., 2015Aesaert, K., Van Nijlen, D., Vanderlinde, R., Tondeur, J., Devlieger, I.,& van Braak, J. (2015). The contribution of pupil, classroom and school level characteristics to primary school pupils' ICT competences: A performance-based approach. Computers & Education, 87, 55-69, https://doi.org/10.1016/j.compedu.2015.03.014
https://doi.org/10.1016/j.compedu.2015.0...
).

In addition, according to Pholphirul (2017)Pholphirul, P. (2017). Pre-primary education and long-term education performance: Evidence from Programme for International Student Assessment (PISA) Thailand. Journal of Early Childhood Research, 15(4), 410-432. https://doi.org/10.1177/1476718X15616834
https://doi.org/10.1177/1476718X15616834...
, there is a positive relation between social status and enrollments in pre-primary education, which later affect the effectiveness of these students in reading skills, science, and mathematics. However, it is essential to emphasize equity strategies in schools, working together in the improvement of efficiency and effectiveness (Lincove, 2006Lincove, J. A. (2006). Efficiency, equity and girls' education. Public Administration Development, 26, 339-357, https://doi.org/10.1002/pad.416
https://doi.org/10.1002/pad.416...
).

Furthermore, studies from all over the world validate the connection between efficiency, efficacy, and effectiveness. In Denmark, Norway, and Sweden, researchers have shown that the national educational systems have improved their efficiency through technologies and resources (Imsen, Blossing, & Moos, 2017Imsen, G., Blossing, U., & Moos, L. (2017). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 61(5), 568-583. https://doi.org/10.1080/00313831.2016.1172502
https://doi.org/10.1080/00313831.2016.11...
; Yoshida & Van der Walt, 2017Yoshida, K., & Van der Walt, J. L. (2017). The policy-implementation-results linkage for education development and aid effectiveness in the Education 2030 era. Compare: A Journal of Comparative and International Education, 48(1), 39-55. https://doi.org/10.1080/03057925.2017.1283583
https://doi.org/10.1080/03057925.2017.12...
). In Tunisia, research discussed a possible non-correlation between better resources and student performance, even though it pointed to poverty as a factor of inefficiency (Ramzi, Afonso, & Ayadi 2016Ramzi, S., Afonso, A., & Ayadi, M. (2016). Assessment of efficiency in basic and secondary education in Tunisia: A regional analysis. International Journal of Educational Development, 51, 62-76, https://doi.org/10.1016/j.ijedudev.2016.08.003
https://doi.org/10.1016/j.ijedudev.2016....
). It is also worth mentioning the movement in South Africa, where more efficient municipalities in public education have not provided a more effective society (Monkam, 2014Monkam, N. F. (2014). Local municipality productive efficiency and its determinants in South Africa. Development Southern Africa, 31(2), 275-298. http://dx.doi.org/10.1080/0376835X.2013.875888
http://dx.doi.org/10.1080/0376835X.2013....
).

In the case of Brazil, Diaz (2012)Diaz, M. D. M. (2012). Qualidade do gasto público municipal em ensino fundamental no Brasil. Brazilian Journal of Political Economy, 32(1), 128-141. http://dx.doi.org/10.1590/S0101-31572012000100008
http://dx.doi.org/10.1590/S0101-31572012...
determines that spending more resources in public schools does not guarantee achievements, as shown through a multilevel analysis study in Brazilian municipalities; in other words, more economic resources do not necessarily lead to an improvement in public education. Moreover, Rocha, Oliveira, Duarte, Gadelha, and Pereira (2017)Rocha, F., Oliveira, P. P., Duarte, J., Gadelha, S. R. B., & Pereira, L. F. V. N. (2017). Can education targets be met without increasing public spending? An analysis for Brazilian municipalities. Economics Bulletin, 37(1), 391-401. Retrieved from http://www.accessecon.com/Pubs/EB/2017/Volume37/EB-17-V37-I1-P35.pdf
http://www.accessecon.com/Pubs/EB/2017/V...
arrived at the same results in another study based on public schools in Brazilian municipalities, where using more resources without better management practices does not generate a more effective and efficient system. Finally, Lauro, Figueiredo, and Wanke (2016)Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
https://www.abacademies.org/articles/jee...
represent efficiency as vital for socioeconomics and management in terms of improving student performance in public schools.

H2: Socioeconomic conditions and an efficient model can introduce a more efficacious basic level of education to Brazilian municipalities (Lauro et al., 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
https://www.abacademies.org/articles/jee...
).

According to Si and Qiao (2017)Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
, contributions linked to structure and number of students per teacher can have a positive impact on performance at the basic education level. However, these contributions need to be administered correctly on a public administration level, in order not to cause under-investment, missed training teaching programs, and inequality in school infrastructure (Lu, Li, & Wu, 2015Lu, C., Li, C., & Wu, D. (2015). Districts performance evaluation of informatization of basic education based on DEA (pp. 359-369). In Hybrid Learning: Innovation in Education al Practices. New York: Springer . https://link.springer.com/chapter/10.1007/978-3-319-20621-9_30
https://link.springer.com/chapter/10.100...
). Therefore, school efficiency in primary education provides favorable conditions for increasing the achievement of the students, through good management (Si & Qiao, 2017).

H3: Socioeconomic conditions, with an efficient and efficacious model, can provide more effectiveness at the basic education level in Brazilian municipalities (Si and Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
).

To reach an effective public education system, it is necessary to administrate all resources with a multi-perspective view, through a social profile and economic and social policies (Adu-Gyamfi, 2014Adu-Gyamfi, E. (2014). Effective revenue mobilisation by districts assemblies: A case study of upper denkyira east Municipal Assembly of Ghana. Public Policy and Administration Review, 2(1), 97-122. Retrieved from http://pparnet.com/journals/ppar/Vol_2_No_1_March_2014/7.pdf
http://pparnet.com/journals/ppar/Vol_2_N...
). Through a more profound investigation, Ramos et al. (2018)Ramos, M. F. H., Pontes, F. A. R., Silva, S. S. D. C., Ramos, E. M. L., Casanova, D. C. G., & Azzi, R. G. (2018). Characterization of basic education teachers based on the social cognitive model of job satisfaction. Paidéia, 28, 1-8. http://dx.doi.org/10.1590/1982-4327e2811
http://dx.doi.org/10.1590/1982-4327e2811...
concluded that efficiency and effectiveness were seen as non-motivational aspects by teachers, but fundamental toward developing a good job. It is important to underline the influence of management in primary school performance, as it has the potential to shift the actual status quo to a higher level (Driessen, Agirdag, & Merry, 2016Driessen, G., Agirdag, O., & Merry, M. S. (2016). The gross and net effects of primary school denomination on pupil performance. Educational Review, 68(4), 466-480. http://dx.doi.org/10.1080/00131911.2015.1135880
http://dx.doi.org/10.1080/00131911.2015....
).

Subsequently, understanding which variables influence effectiveness in public schools is essential to the academic world, as is the social and economic status of the family of the pupil (Groot-Reuvekamp, Ros, van Boxtel, & Oort, 2017Groot-Reuvekamp, M., Ros, A., van Boxtel, C., & Oort, F. (2017). Primary school pupils’ performances in understanding historical time. Education, 45(2), 227-242. http://dx.doi.org/10.1080/03004279.2015.1075053
http://dx.doi.org/10.1080/03004279.2015....
; Martini & Fabbris, 2017Martini, M.C., & Fabbris, L. (2017). Beyond employment rate: A multidimensional indicator of higher education effectiveness. Social Indicators Research, 130(1), 351-370. http://dx.doi.org/10.1007/s11205-015-1179-z.
http://dx.doi.org/10.1007/s11205-015-117...
). In corroboration with this discussion, Saminathen, Låftman, Almquist, and Modin (2018)Saminathen, M. G., Låftman, S. B., Almquist, Y. B., & Modin, B. (2018). Effective schools, school segregation, and the link with school achievement. School. Effectiveness and School Improvement, 29(3), 464-484. https://doi.org/10.1080/09243453.2018.1470988
https://doi.org/10.1080/09243453.2018.14...
and Yogo (2017)Yogo, T.U. (2017). Assessing the effectiveness of foreign aid in the education sector in Africa: The case of primary education. African Development Review, 29(3), 389-402. https://doi.org/10.1111/1467-8268.12276
https://doi.org/10.1111/1467-8268.12276...
showed that the effectiveness of public education is dependent on characteristics of the parents, as well as on the access society has in participating in school decisions.

In Finland, recognized for its educational system through the implementation of the Basic Education Act, the government has improved efficacy in distributing resources between schools and, consequently, effectiveness (Pulkkinen & Jahnukainen, 2016Pulkkinen, J., & Jahnukainen, M. (2016). Finnish reform of the funding and provision of special education: The views of principals and municipal education administrators. Educational Review, 68(2), 171-188. https://doi.org/10.1080/00131911.2015.1060586
https://doi.org/10.1080/00131911.2015.10...
). The study of Craigwell, Bynoe, and Lowe (2012)Craigwell, R., Bynoe, D., & Lowe, S. (2012). The effectiveness of government expenditure on education and health care in the Caribbean. International Journal of Development Issues, 11(1), 4-18. https://doi.org/10.1108/14468951211213831
https://doi.org/10.1108/1446895121121383...
also demonstrated the impact of the Caribbean government and its capacity to change national education. In Brazil, a country with education inequality (Campoli et al., 2019Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering. New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
https://doi.org/10.1007/978-3-319-93488-...
), municipality expenditures in education can improve the effectiveness in public schools, and as a result, enhance education across the country (Fabrino et al., 2014Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
http://dx.doi.org/10.1016/j.ijme.2014.03...
).

H4: There is education inequality between Brazilian municipalities among the socioeconomic conditions of efficiency, efficacy, and effectiveness, at the basic level of education (Campoli et al., 2019Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering. New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
https://doi.org/10.1007/978-3-319-93488-...
).

H5: There is a positive and significant correlation between the sociodemographic conditions and efficacy, and between sociodemographic conditions and effectiveness, at the basic level of education in Brazilian municipalities (Fabrino et al., 2014Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
http://dx.doi.org/10.1016/j.ijme.2014.03...
).

Hence, after discussions concerning local government performance of public education and the points of influence (Adu-Gyamfi, 2014Adu-Gyamfi, E. (2014). Effective revenue mobilisation by districts assemblies: A case study of upper denkyira east Municipal Assembly of Ghana. Public Policy and Administration Review, 2(1), 97-122. Retrieved from http://pparnet.com/journals/ppar/Vol_2_No_1_March_2014/7.pdf
http://pparnet.com/journals/ppar/Vol_2_N...
; Aesaert et al., 2015Aesaert, K., Van Nijlen, D., Vanderlinde, R., Tondeur, J., Devlieger, I.,& van Braak, J. (2015). The contribution of pupil, classroom and school level characteristics to primary school pupils' ICT competences: A performance-based approach. Computers & Education, 87, 55-69, https://doi.org/10.1016/j.compedu.2015.03.014
https://doi.org/10.1016/j.compedu.2015.0...
; Carnoy et al., 2017Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
; Olvera & Avellaneda, 2019Olvera, J. G., & Avellaneda, C. N. (2019). Subnational government performance: Testing multiple dimensions of Governors’ experience. Public Administration Review, 79(3), 383-398. https://doi.org/10.1111/puar.13035
https://doi.org/10.1111/puar.13035...
), we can create a conceptual model to test Brazilian local governments at the basic education level, where sociodemographic and economic conditions could play a role in impacting the efficiency, efficacy, and effectiveness of Brazilian municipalities (Garcia, Prearo, Romero, Secco, & Bassi, 2016Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
http://dx.doi.org/10.14244/198271991784...
; Lauro, Figueiredo, & Wanke, 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
https://www.abacademies.org/articles/jee...
; Matias, Quaglio, Oliveira, Lima, & Bertolin, 2018Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
https://doi.org/10.5902/1983465916448...
; Theunissen, Bosma, Verdonk, & Feron, 2015Theunissen, M. J., Bosma, H., Verdonk, P., & Feron, F. (2015). Why Wait? Early Determinants of School Dropout in Preventive Pediatric Primary Care. PLoS ONE, 10(11), e0142315. https://doi.org//10.1371/journal.pone.0142315
https://doi.org//10.1371/journal.pone.01...
; Vinha, Karino, & Laros, 2016Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
http://dx.doi.org/10.1590/1413-827120162...
).

Finally, in our paper, we are using the following concepts of efficiency, efficacy, and effectiveness (Garcia et al., 2016Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
http://dx.doi.org/10.14244/198271991784...
; Matias et al., 2018Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
https://doi.org/10.5902/1983465916448...
; Vinha et al., 2016Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
http://dx.doi.org/10.1590/1413-827120162...
): (a) Efficiency also means cost-benefit, through which we can produce more with fewer resources - in our case, enrollments, students, and time; (b) Efficacy expresses the achievement of goals - in our case, the approval rate; (c) Effectiveness demonstrates a higher impact concerning municipality performance - in our case, basic education index.

METHODS

Data and samples

Brazil has 27 states and 5,570 municipalities (estimated) allied with these. The sample used is from the state of São Paulo (IBGE, 2010Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
https://cidades.ibge.gov.br/brasil/sp...
), derived from its 645 municipalities, which are divided into 17 administrative regions (not geographically). The state of São Paulo is considered the second best based on the human development index and second highest in the number of municipalities among the states (IBGE 2010Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
https://cidades.ibge.gov.br/brasil/sp...
). The data were collected using 12 indicators, collected in 2009, 2011, and 2013 (Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira [Inep] 2019Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. (2019). Censo Escolar - Matrícula Inicial. Brasília, DF. http://inep.gov.br/web/guest/matricula-inicial
http://inep.gov.br/web/guest/matricula-i...
; Sistema Estadual de Análise de Dados [Seade] 2019Sistema Estadual de Análise de Dados. (2019). Séries históricas referentes à saúde pública no Estado de São Paulo. São Paulo. Retrieved from http://www.seade.gov.br/
http://www.seade.gov.br/...
), and divided into sociodemographic, economic, efficiency, efficacy, and effectiveness dimensions (Garcia et al. 2016Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
http://dx.doi.org/10.14244/198271991784...
; Matias et al., 2018Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
https://doi.org/10.5902/1983465916448...
; Vinha et al., 2016Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
http://dx.doi.org/10.1590/1413-827120162...
). Exploring the database and after eliminating the outliers, our sample continued, with 1,329 observations.

Table 1
Indicators and dimensions

The dimensions are based on municipality responsibilities, which is basic education until 5th grade in the elementary school curriculum (Garcia et al., 2016Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
http://dx.doi.org/10.14244/198271991784...
; Matias et al., 2018Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
https://doi.org/10.5902/1983465916448...
; Vinha et al., 2016Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
http://dx.doi.org/10.1590/1413-827120162...
). The municipalities from the state of São Paulo were chosen due to their well-structured database, population variation, and regional characteristics, as noted in Avellaneda and Gomes (2015)Avellaneda, C. N., & Gomes, R. C. (2015). Is small beautiful? Testing the direct and nonlinear effects of size on municipal performance. Public Administration Review, 75(1), 137-149. https://doi.org/10.1111/puar.12307
https://doi.org/10.1111/puar.12307...
. The Microsoft Excel software was used to perform the processes before the statistical analysis. Noteworthy here is the non-consensus among studies concerning the subject of the chosen dimensions and indicators, which we solve by using the current bibliography (Garcia et al., 2016Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
http://dx.doi.org/10.14244/198271991784...
; Matias et al., 2018Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
https://doi.org/10.5902/1983465916448...
; Vinha et al., 2016Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
http://dx.doi.org/10.1590/1413-827120162...
).

Variables

The indicators and dimensions constitute the inputs, outputs, and outcomes of the first elementary level in public schools in São Paulo State municipalities and the possible relationships among these. Therefore, we used dependent variables to provide a better explanation of the concept, such as efficiency, efficacy, and effectiveness.

(1) J = β 0 + β A + β B + β C + β D + β E + β F + ɛ

The first equation represents the attempt to understand a possible cause-effect between the socioeconomic indicators and a more efficient model. Through regression analysis, one also notes the different effects of sociodemographic and economic conditions in public education efficiency.

(2) K = β 0 + β A + β B + β C + β D + β E + β F + β G + β H + β I + β J + ɛ

In the second equation, we explain the effects of the socioeconomic and efficiency indicators in public education efficacy. Additionally, by using regression analysis, a comparison is made that explains the difference of capacity between sociodemographic, economic, and efficiency using an efficacy variable.

(3) L = β 0 + β A + β B + β C + β D + β E + β F + β G + β H + β I + β J + β K + ɛ

In our last equation, the regression model analyzes the effects of all the indicators and dimensions with the effectiveness of public schools in the municipality. Here, the impacts are sought for socioeconomic, efficiency, and efficacy performance and, as such, for a more effective public school.

Statistical analysis

Our first step was to run a descriptive statistic to comprehend the distribution and variation of the sample, using the minimum, maximum, mean, and standard deviation of each indicator (Fávero & Belfiore, 2017Fávero, L. P., & Belfiore, F. (2017). Manual de análise de dados: Estatística e modelagem multivariada com Excel, SPSS e Stata. Rio de Janeiro: Elsevier. ), to give a general profile to the sample, without separating these by groups or quartiles. Following this, we developed a correlation analysis, through the Pearson coefficient, to recognize the relationship between the indicators and to understand its standards better (Hair, Anderson, Babin, & Black, 2010Hair, J. F. Jr., Anderson, R. E., Babin, B. J., & Black, W. C. (2010). Multivariate data analysis. New Jersey: Pearson. ). Finally, we run the multiple linear regression analysis in panel data to measure the possible explanation of the model by the indicators (Arthur, Asiedu-Addo, & Assuah, 2017Arthur, Y. D., Asiedu-Addo, S., & Assuah, C. (2017). Teacher-student variables as predictor of students' interest in Mathematics: The use of stepwise multiple linear regression analysis. Asian Research Journal of Mathematics, 4(3), 1-11. https://doi.org/10.9734/ARJOM/2017/33544
https://doi.org/10.9734/ARJOM/2017/33544...
; Si & Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
). Regarding the tests performed before running the regression, we can state that the sample is normal where there is an absence of multicollinearity (except for the population indicator), and VIF and Durbin-Watson are under control. We used the SPSS Software v. 25 to realize all the analyses.

RESULTS AND DISCUSSIONS

In order to provide a better comprehension, we divided our study by section according to the hypothesis, as public education inequality, linked to hypothesis 4, better condition - better effectiveness, linked to hypothesis 5, and socioeconomic conditions, efficiency, and effectiveness issues, related to hypotheses 1, 2, and 3.

Public education inequality (hypothesis 4)

As noted in Table 2, the municipalities in the state of São Paulo, Brazil, are heterogeneous concerning economic conditions and efficiency. The standard deviations attest to the affirmation - GDP per capita (13,468.06), average student per teacher (4.12), average for period duration (5.68), and approval rate (0.51). Another negative aspect is the average approval rate (5.06), remaining close to the average value of evaluations, between 0 and 10.

Table 2
Descriptive statistics

Nevertheless, a high mean is seen for the two socioeconomic indicators, two efficiency indicators, and the effectiveness indicators. The GDP per capita (21,610.92), the energy consumption ratio (0.83), the number of students per teacher (8.62), and the average duration period (14.68) are higher than the national mean (IBGE 2010Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
https://cidades.ibge.gov.br/brasil/sp...
; Inep, 2019Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. (2019). Censo Escolar - Matrícula Inicial. Brasília, DF. http://inep.gov.br/web/guest/matricula-inicial
http://inep.gov.br/web/guest/matricula-i...
). The average of the effectiveness indicator Ideb-AI (5.68) is above the Ideb-AI national goal of 3.8; 4.2 and 4.5. (Inep, 2019Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. (2019). Censo Escolar - Matrícula Inicial. Brasília, DF. http://inep.gov.br/web/guest/matricula-inicial
http://inep.gov.br/web/guest/matricula-i...
).

Therefore, through the above data, the authors support hypothesis 4: there is a public education inequality in the municipalities of São Paulo State (Campoli et al., 2019Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering. New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
https://doi.org/10.1007/978-3-319-93488-...
). With these results, we can discuss the extent of the disparity in the socioeconomic conditions and the public education at the basic education level in municipalities of the São Paulo State, even after having shown to have the second best score on the human development index among Brazilian states (Campoli et al., 2019Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering. New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
https://doi.org/10.1007/978-3-319-93488-...
; IBGE 2010Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
https://cidades.ibge.gov.br/brasil/sp...
).

Better conditions - Better effectiveness (hypothesis 5)

As shown on Table 3, there is a positive and significant correlation between the sociodemographic indicators of efficiency (0.152**; 0.133**; 0.089**; 0.096**; and 0.129**), efficacy (0.079**), and effectiveness (0.102**). At the same time, there is a negative and significant correlation between population and efficacy (-0.076**), and between energy consumption ratio and efficiency (-0.133**) and effectiveness (-0.164**).

Table 3
Correlation matrix

The economic condition has a positive and significant correlation with efficacy (0.085**) and effectiveness (0.103**), but a negative and significant correlation with efficiency (-0.105**). Regarding the main dimensions, one can detect a positive and significant correlation between average numbers of students per teacher and efficacy (0.126**), as well as a negative and significant correlation between average duration of school period and efficacy (-0.075**). Similarly, the same correlation standards can be seen between the efficiency indicators and effectiveness (0.483** and -0.097**, respectively). Finally, there is a positive and significant correlation between efficacy and effectiveness (0.222**).

With a more in-depth search, we can highlight that:

  1. The high positive and significant correlation between the number of students per teacher and the basic education index (0.483**), as well as between the approval rate and the basic education index (0.222**) (Lu et al., 2015Lu, C., Li, C., & Wu, D. (2015). Districts performance evaluation of informatization of basic education based on DEA (pp. 359-369). In Hybrid Learning: Innovation in Education al Practices. New York: Springer . https://link.springer.com/chapter/10.1007/978-3-319-20621-9_30
    https://link.springer.com/chapter/10.100...
    ). The first analysis relating students per teacher to the basic education index may occur due to the economic capacity of bigger cities, which have bigger classes, but also better conditions to study (Lauro et al., 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
    https://www.abacademies.org/articles/jee...
    ).

  2. The positive and negative, both are significant in the relationship between socioeconomic conditions and efficiency, efficacy, and effectiveness (Lauro et al., 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
    https://www.abacademies.org/articles/jee...
    ).

As a result, we can partially support hypothesis 5, which has a positive and significant correlation between efficacy/effectiveness and sociodemographic conditions (Fabrino et al., 2014Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
http://dx.doi.org/10.1016/j.ijme.2014.03...
), due to the contrary and significant correlation with the population (-0.076**) and the energy consumption ratio (-0.164**).

These points allow for the discussion and the support of the possibility that school resources and performance can influence the effectiveness of a given school within that municipality (Lauro et al., 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
https://www.abacademies.org/articles/jee...
; Lu et al., 2015Lu, C., Li, C., & Wu, D. (2015). Districts performance evaluation of informatization of basic education based on DEA (pp. 359-369). In Hybrid Learning: Innovation in Education al Practices. New York: Springer . https://link.springer.com/chapter/10.1007/978-3-319-20621-9_30
https://link.springer.com/chapter/10.100...
; Si & Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
).

Socioeconomic conditions over efficiency and effectiveness (hypotheses 1, 2, and 3)

The first point highlighted here is the values of R2 and adjusted R2 of the three regression models. The low values (0.330 and 0.280 - efficiency, 0.101 and 0.094 - efficacy, 0.305 and 0.299 - effectiveness, respectively) may also report a low capacity of the indicators, thus explaining the performance in public schools. However, here we are working with macro indicators, which justifies the acceptance of the low values for R2 and adjusted R2 (Allan, Mooney, & Ling, 2018Allan, C., Mooney, J.D., & Ling, J . (2018). Social deprivation as a marker for alcohol harms, and implications for local harm reduction policies in England: An ecological study. The Lancet, 392(2), S15. https://doi.org/10.1016/S0140-6736(18)32098-1
https://doi.org/10.1016/S0140-6736(18)32...
).

Table 4
Standardized coefficients (beta) for the four equations

The first model represents the attempt to explain the efficiency, represented by the average duration of the school period. The results of R2 (0.330) and adjusted R2 (0.280) show the low capacity of the socioeconomic indicators in explaining efficiency in the first elementary public schools. Hence, we can support partially the hypothesis that not all socioeconomic indicators have a positive effect on the efficiency of municipalities and consequently on Brazilian public schools (Carnoy et al., 2017Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
).

We can also point out that the coefficients for the rate of urbanization (0.159***) and GDP per capita (0.121***) are positive and statistically significant at 0.001. In addition, the coefficient of the residential energy ratio is negative (-0.111**) and statistically significant at 0.05. So, an increase of 1 percent above the mean rate of urbanization (0.8532) would generate 0.15 percent of the rise in the average duration of school period (1.3 minutes). Similarly, the increase of 1 percent above the GPD per capita mean (R$ 216.10) causes 0.12 percent of the rise in the average duration of the school period (1.05 minutes). Therefore, a more prosperous municipality with a higher GDP and possibly a better urbanization capacity could improve school student hours, hence its efficiency (Carnoy et al., 2017Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
; Imsen et al., 2017Imsen, G., Blossing, U., & Moos, L. (2017). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 61(5), 568-583. https://doi.org/10.1080/00313831.2016.1172502
https://doi.org/10.1080/00313831.2016.11...
; Yoshida & Van der Walt, 2017Yoshida, K., & Van der Walt, J. L. (2017). The policy-implementation-results linkage for education development and aid effectiveness in the Education 2030 era. Compare: A Journal of Comparative and International Education, 48(1), 39-55. https://doi.org/10.1080/03057925.2017.1283583
https://doi.org/10.1080/03057925.2017.12...
).

In the second model, we achieved the lowest R2 (0.101) and adjusted R2 (0.094) over the three models, therefore hypothesis 2 (socioeconomic conditions with an efficiency model are able to provide a more efficacious performance) is shown as false (Amankwaa et al., 2015Amankwaa, I., Agyemang-Dankwah, A., & Boateng, D. (2015). Previous education, sociodemographic characteristics, and nursing cumulative grade point average as predictors of success in nursing licensure examinations. Nursing Research and Practice, ID 682479, 8p. http://dx.doi.org/10.1155/2015/682479
http://dx.doi.org/10.1155/2015/682479...
). However, we can highlight that the coefficients for the rate of urbanization (0.311***) and the coefficient of the average duration of the school period (0.098***) are positive and statistically significant at 0.001. In contrast, the coefficient of the residential energy ratio is negative (-0.376***) and statistically significant also at 0.001. Thus, an increase of 1 percent above the mean rate of urbanization (0.8532) would bring a 0.31 percent rise in the approval rate (0.01). Likewise, the increase of 1 percent above the average duration of the school period mean (8.4 minutes) generates 0.09 percent of growth in the approval rate (0.004). These individual results can advance in the local government performance studies, since the municipalities being more urbanized and more efficient, measured herein by school period, could in fact be more effective (Imsen et al., 2017Imsen, G., Blossing, U., & Moos, L. (2017). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 61(5), 568-583. https://doi.org/10.1080/00313831.2016.1172502
https://doi.org/10.1080/00313831.2016.11...
; Lauro et al., 2016Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
https://www.abacademies.org/articles/jee...
; Yoshida & Van der Walt, 2017Yoshida, K., & Van der Walt, J. L. (2017). The policy-implementation-results linkage for education development and aid effectiveness in the Education 2030 era. Compare: A Journal of Comparative and International Education, 48(1), 39-55. https://doi.org/10.1080/03057925.2017.1283583
https://doi.org/10.1080/03057925.2017.12...
).

Finally, the third model with R2 of 0.305 and adjusted R2 of 0.299 best explains the results. Thus, hypothesis 3 is partially supported: a more effective model can be provided by better socioeconomic, efficiency, and efficacy indicators at the primary education level (Si & Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
). The third model shows a positive and statistically significant level at 0.001 for the rate of urbanization coefficients (0.221***), the average duration of the school period (0.139***), and the approval rate (0.403***), and at 0.05 for the GDP coefficient per capita (0.081**). There is also a negative and statistically significant level of 0.001 for the coefficient of residential energy ratio (-0.271***).

Moreover, the last multiple of linear regression shows that an increase of 1 percent above the mean rate of urbanization (0.8532), the average duration of the school period (8.4 minutes) and an approval rate of 0.05, brings an increase of 0.22 (0.012), 0.14 (0.007), and 0.40 (0.022) percent to the basic education index, respectively. The aforementioned results bring about the discussion about the importance of a more efficient and effective municipality, creating as such an increase in its effectiveness, and perhaps in society (Fabrino et al., 2014Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
http://dx.doi.org/10.1016/j.ijme.2014.03...
; Si & Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
).

Therefore, with the three runs of regression analysis, we were able to partially support the influence of the socioeconomic conditions in public management performance at the local level, measured here through the level of basic education in municipalities (Puppim, 2017Puppim, J. A. de O. (2017). Brazilian Public Administration: Shaping and being shaped by governance and development. Chinese Political Science Review, 2(1), 7-21. https://doi.org/10.1007/s41111-017-0052-4
https://doi.org/10.1007/s41111-017-0052-...
; Olvera & Avellaneda, 2019Olvera, J. G., & Avellaneda, C. N. (2019). Subnational government performance: Testing multiple dimensions of Governors’ experience. Public Administration Review, 79(3), 383-398. https://doi.org/10.1111/puar.13035
https://doi.org/10.1111/puar.13035...
). A more significant influence was seen for the urbanization rate indicators in all the 3Es, while GDP per capita in efficiency and effective performance and the educational indicators (average duration and approval rate) were significant in the efficacy and effectiveness models (Carnoy et al., 2017Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
https://doi.org/10.1086/693981...
; Si & Qiao, 2017Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA. Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
https://doi.org/10.12973/eurasia.2017.00...
).

CONCLUSION

Our research has five main findings. First, we have a public education inequality between the São Paulo State municipalities, with high values of standard deviation among GDP per capita, Average Stu/Tea (Pre.S), Average Dur. Per. (AI) and Approval Rate (AI). Second, we have shown a positive and significant correlation between better social conditions or schools and better performance in efficiency, efficacy, and effectiveness in municipalities of public schools in the state of São Paulo.

Third, some of the socioeconomic conditions have a positive and significant impact on efficiency, as the urbanization rate and GDP per capita indicators generate a greater duration of the elementary school period. Following this, our fourth finding is that greater urbanization and more time spent in schools have a positive and significant impact on the approval rate indicator, representing the efficacy dimension. The positive influence of the rate of urbanization in the efficiency, efficacy, and effectiveness at the basic education level can be found and discussed in the Brazilian educational studies, by comparing rural and urban areas. Finally, our last finding shows that social conditions, efficiency, and efficacy can provide a more effective public school system, represented by the positive and significant impact of the rate of urbanization, the average duration of the school period, and the approval rate with the basic education index.

The limitations of this study include the historical data series in Brazil (short time), the sample size, and the representativeness of the variables to explain the phenomenon. The data series problems in Brazil within social policies are conditions and not a limitation, like quality, discontinuation, and missing data in municipalities; however this affects the inclusion of new indicators, as enrollments and evasion rate. Additionally, to represent the dimension of ‘efficiency’ we used just one indicator, elementary school period, which could bias the analysis.

For future studies, it would be interesting to enlarge and divide the sample according to population ranges, as well as expanding the years of analysis, with at least one more year of examination. Moreover, other variables could appear to broaden the explication capacity of the model. Furthermore, to represent the dimension with more accuracy, the principal component regression analysis could be used, thus creating new factors with the corresponding indicators.

Therefore, our study has made significant advances in the literature concerning public management performance at a local level, particularly pertinent to the municipalities in the state of São Paulo, Brazil, embedded at the basic education level. The conclusion is that we can answer our main questions: ‘How socioeconomic conditions influence local government performance (efficiency, efficacy, and effectiveness), at the basic education level?’ A: Social conditions can have more influence in efficiency, efficacy, and effectiveness, while economic conditions can have a more significant relationship with efficiency of local governments.

REFERENCES

  • Adu-Gyamfi, E. (2014). Effective revenue mobilisation by districts assemblies: A case study of upper denkyira east Municipal Assembly of Ghana. Public Policy and Administration Review, 2(1), 97-122. Retrieved from http://pparnet.com/journals/ppar/Vol_2_No_1_March_2014/7.pdf
    » http://pparnet.com/journals/ppar/Vol_2_No_1_March_2014/7.pdf
  • Aesaert, K., Van Nijlen, D., Vanderlinde, R., Tondeur, J., Devlieger, I.,& van Braak, J. (2015). The contribution of pupil, classroom and school level characteristics to primary school pupils' ICT competences: A performance-based approach. Computers & Education, 87, 55-69, https://doi.org/10.1016/j.compedu.2015.03.014
    » https://doi.org/10.1016/j.compedu.2015.03.014
  • Allan, C., Mooney, J.D., & Ling, J . (2018). Social deprivation as a marker for alcohol harms, and implications for local harm reduction policies in England: An ecological study. The Lancet, 392(2), S15. https://doi.org/10.1016/S0140-6736(18)32098-1
    » https://doi.org/10.1016/S0140-6736(18)32098-1
  • Amankwaa, I., Agyemang-Dankwah, A., & Boateng, D. (2015). Previous education, sociodemographic characteristics, and nursing cumulative grade point average as predictors of success in nursing licensure examinations. Nursing Research and Practice, ID 682479, 8p. http://dx.doi.org/10.1155/2015/682479
    » http://dx.doi.org/10.1155/2015/682479
  • Arthur, Y. D., Asiedu-Addo, S., & Assuah, C. (2017). Teacher-student variables as predictor of students' interest in Mathematics: The use of stepwise multiple linear regression analysis. Asian Research Journal of Mathematics, 4(3), 1-11. https://doi.org/10.9734/ARJOM/2017/33544
    » https://doi.org/10.9734/ARJOM/2017/33544
  • Avellaneda, C. N., & Gomes, R. C. (2015). Is small beautiful? Testing the direct and nonlinear effects of size on municipal performance. Public Administration Review, 75(1), 137-149. https://doi.org/10.1111/puar.12307
    » https://doi.org/10.1111/puar.12307
  • Bastos, P., Bottan, N. L., & Cristia, J. (2016). Access to preprimary education and progression in primary school: Evidence from Rural Guatemala. World Bank Group, 33p. Retrieved from https://publications.iadb.org/en/access-preprimary-education-and-progression-primary-school-evidence-rural-guatemala
    » https://publications.iadb.org/en/access-preprimary-education-and-progression-primary-school-evidence-rural-guatemala
  • Brazil. (1988). Constituição da República Federativa do Brasil de 05 de dezembro de 1988 São Paulo: Saraiva.
  • Birchler, K. & Michaelowa, K. (2016). Making aid work for education in developing countries: An analysis of aid effectiveness for primary education coverage and quality. International Journal of Educational Development, 48, 37-52. https://doi.org/10.1016/j.ijedudev.2015.11.008
    » https://doi.org/10.1016/j.ijedudev.2015.11.008
  • Campoli, J., Ferraz, D., & Rebelatto, D. (2019). The efficiency of public expenditures on education: Data envelopment analysis of Brazilian Federative Units between 2011 and 2014 (pp. 75-82). In J. Mula, R. Barbastefano, M. Díaz-Madroñero, & R Poler (Eds), New global perspectives on industrial engineering and management. Lecture Notes in Management and Industrial Engineering New York: Springer. https://doi.org/10.1007/978-3-319-93488-4_9
    » https://doi.org/10.1007/978-3-319-93488-4_9
  • Carnoy, M., Marotta, L., Louzano, P., Khavenson, T., Guimarães, F. R. F., & Carnauba, F. (2017). Intranational comparative education: What state differences in student achievement can teach us about improving education— the case of Brazil. Comparative Education Review, 61(4), 726-759. https://doi.org/10.1086/693981
    » https://doi.org/10.1086/693981
  • Craigwell, R., Bynoe, D., & Lowe, S. (2012). The effectiveness of government expenditure on education and health care in the Caribbean. International Journal of Development Issues, 11(1), 4-18. https://doi.org/10.1108/14468951211213831
    » https://doi.org/10.1108/14468951211213831
  • Diaz, M. D. M. (2012). Qualidade do gasto público municipal em ensino fundamental no Brasil. Brazilian Journal of Political Economy, 32(1), 128-141. http://dx.doi.org/10.1590/S0101-31572012000100008
    » http://dx.doi.org/10.1590/S0101-31572012000100008
  • Driessen, G., Agirdag, O., & Merry, M. S. (2016). The gross and net effects of primary school denomination on pupil performance. Educational Review, 68(4), 466-480. http://dx.doi.org/10.1080/00131911.2015.1135880
    » http://dx.doi.org/10.1080/00131911.2015.1135880
  • Fabrino, R. J. G., Valle, B. S., & Gomes, R. C. (2014). The cost of educational effectiveness: Evidence from financing basic education in Brazil. The International Journal of Management Education, 12, 151-166, http://dx.doi.org/10.1016/j.ijme.2014.03.007
    » http://dx.doi.org/10.1016/j.ijme.2014.03.007
  • Fávero, L. P., & Belfiore, F. (2017). Manual de análise de dados: Estatística e modelagem multivariada com Excel, SPSS e Stata. Rio de Janeiro: Elsevier.
  • Garcia, P. S., Prearo, L. C., Romero, M. C., Secco, A., & Bassi, M. S. (2016). School performance: An IDEB analysis of the seven municipalities in the ABC region. Revista Eletrônica de Educação, 10(2), 115-134. http://dx.doi.org/10.14244/198271991784
    » http://dx.doi.org/10.14244/198271991784
  • Groot-Reuvekamp, M., Ros, A., van Boxtel, C., & Oort, F. (2017). Primary school pupils’ performances in understanding historical time. Education, 45(2), 227-242. http://dx.doi.org/10.1080/03004279.2015.1075053
    » http://dx.doi.org/10.1080/03004279.2015.1075053
  • Hair, J. F. Jr., Anderson, R. E., Babin, B. J., & Black, W. C. (2010). Multivariate data analysis New Jersey: Pearson.
  • Instituto Brasileiro de Geografia e Estatística. (2010). Censo demográfico brasileiro de 2010, Brasília, https://cidades.ibge.gov.br/brasil/sp
    » https://cidades.ibge.gov.br/brasil/sp
  • Instituto Nacional de Estudos e Pesquisas Educacionais Anísio Teixeira. (2019). Censo Escolar - Matrícula Inicial Brasília, DF. http://inep.gov.br/web/guest/matricula-inicial
    » http://inep.gov.br/web/guest/matricula-inicial
  • Imsen, G., Blossing, U., & Moos, L. (2017). Reshaping the Nordic education model in an era of efficiency. Changes in the comprehensive school project in Denmark, Norway, and Sweden since the millennium. Scandinavian Journal of Educational Research, 61(5), 568-583. https://doi.org/10.1080/00313831.2016.1172502
    » https://doi.org/10.1080/00313831.2016.1172502
  • Lauro, A., Figueiredo, O. H. dos S., & Wanke, P. F. (2016). Efficiency of municipal schools in Rio de Janeiro: evidence from two-stage DEA. Journal of Economics and Economic Education Research, 17(3), 149-166. Retrieved from https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
    » https://www.abacademies.org/articles/jeeervol-17issue-3.pdf
  • Lincove, J. A. (2006). Efficiency, equity and girls' education. Public Administration Development, 26, 339-357, https://doi.org/10.1002/pad.416
    » https://doi.org/10.1002/pad.416
  • Lu, C., Li, C., & Wu, D. (2015). Districts performance evaluation of informatization of basic education based on DEA (pp. 359-369). In Hybrid Learning: Innovation in Education al Practices New York: Springer . https://link.springer.com/chapter/10.1007/978-3-319-20621-9_30
    » https://link.springer.com/chapter/10.1007/978-3-319-20621-9_30
  • Marin, A. H., Peuker, A. C. & Kessler. F. H. P . (2019). Sociodemographic characteristics, school performance, pattern of consumption and emotional health as risk factors for alcohol use among adolescents. Trends in Psychology, 27(1), 279-292. http://dx.doi.org/10.9788/tp2019.1-20
    » http://dx.doi.org/10.9788/tp2019.1-20
  • Martini, M.C., & Fabbris, L. (2017). Beyond employment rate: A multidimensional indicator of higher education effectiveness. Social Indicators Research, 130(1), 351-370. http://dx.doi.org/10.1007/s11205-015-1179-z
    » http://dx.doi.org/10.1007/s11205-015-1179-z
  • Matias, A. B., Quaglio, G. M., Oliveira, B. G., Lima, J. P. R., & Bertolin, R. V. (2018). Expenditures’ level and efficiency in Public Education: A Study of São Paulo Municipalities Using Data Envelopment Analysis. Brazilian Journal of Management, 11(4), 1051-1067. https://doi.org/10.5902/1983465916448
    » https://doi.org/10.5902/1983465916448
  • Monkam, N. F. (2014). Local municipality productive efficiency and its determinants in South Africa. Development Southern Africa, 31(2), 275-298. http://dx.doi.org/10.1080/0376835X.2013.875888
    » http://dx.doi.org/10.1080/0376835X.2013.875888
  • Organization for Economic Co-operation and Development. (2015). Education Policy Outlook, Paris, 24. Retrieved from https://www.oecd-ilibrary.org/education/education-policy-outlook-2015_9789264225442-en
    » https://www.oecd-ilibrary.org/education/education-policy-outlook-2015_9789264225442-en
  • Organization for Economic Co-operation and Development. (2018). Education at a Glance 2018, Paris, 460, https://doi.org/10.1787/eag-2018-en
    » https://doi.org/10.1787/eag-2018-en
  • Olvera, J. G., & Avellaneda, C. N. (2019). Subnational government performance: Testing multiple dimensions of Governors’ experience. Public Administration Review, 79(3), 383-398. https://doi.org/10.1111/puar.13035
    » https://doi.org/10.1111/puar.13035
  • Pholphirul, P. (2017). Pre-primary education and long-term education performance: Evidence from Programme for International Student Assessment (PISA) Thailand. Journal of Early Childhood Research, 15(4), 410-432. https://doi.org/10.1177/1476718X15616834
    » https://doi.org/10.1177/1476718X15616834
  • Pulkkinen, J., & Jahnukainen, M. (2016). Finnish reform of the funding and provision of special education: The views of principals and municipal education administrators. Educational Review, 68(2), 171-188. https://doi.org/10.1080/00131911.2015.1060586
    » https://doi.org/10.1080/00131911.2015.1060586
  • Puppim, J. A. de O. (2017). Brazilian Public Administration: Shaping and being shaped by governance and development. Chinese Political Science Review, 2(1), 7-21. https://doi.org/10.1007/s41111-017-0052-4
    » https://doi.org/10.1007/s41111-017-0052-4
  • Ramos, M. F. H., Pontes, F. A. R., Silva, S. S. D. C., Ramos, E. M. L., Casanova, D. C. G., & Azzi, R. G. (2018). Characterization of basic education teachers based on the social cognitive model of job satisfaction. Paidéia, 28, 1-8. http://dx.doi.org/10.1590/1982-4327e2811
    » http://dx.doi.org/10.1590/1982-4327e2811
  • Ramzi, S., Afonso, A., & Ayadi, M. (2016). Assessment of efficiency in basic and secondary education in Tunisia: A regional analysis. International Journal of Educational Development, 51, 62-76, https://doi.org/10.1016/j.ijedudev.2016.08.003
    » https://doi.org/10.1016/j.ijedudev.2016.08.003
  • Rocha, F., Oliveira, P. P., Duarte, J., Gadelha, S. R. B., & Pereira, L. F. V. N. (2017). Can education targets be met without increasing public spending? An analysis for Brazilian municipalities. Economics Bulletin, 37(1), 391-401. Retrieved from http://www.accessecon.com/Pubs/EB/2017/Volume37/EB-17-V37-I1-P35.pdf
    » http://www.accessecon.com/Pubs/EB/2017/Volume37/EB-17-V37-I1-P35.pdf
  • Rosser, A., & Sulistiyanto, P. (2013). The Politics of Universal Free Basic Education in Decentralized Indonesia: Insights from Yogyakarta. Pacific Affairs, 86(3), 539-560. https://doi.org/10.5509/2013863539
    » https://doi.org/10.5509/2013863539
  • Saminathen, M. G., Låftman, S. B., Almquist, Y. B., & Modin, B. (2018). Effective schools, school segregation, and the link with school achievement. School. Effectiveness and School Improvement, 29(3), 464-484. https://doi.org/10.1080/09243453.2018.1470988
    » https://doi.org/10.1080/09243453.2018.1470988
  • Sistema Estadual de Análise de Dados. (2019). Séries históricas referentes à saúde pública no Estado de São Paulo São Paulo. Retrieved from http://www.seade.gov.br/
    » http://www.seade.gov.br/
  • Si, L., & Qiao, H. (2017). Performance of Financial Expenditure in China's basic science and math education: Panel Data Analysis Based on CCR Model and BBC Model, EURASIA Journal of Mathematics Science and Technology Education, 13(8), 5217-5224. https://doi.org/10.12973/eurasia.2017.00995a
    » https://doi.org/10.12973/eurasia.2017.00995a
  • Theunissen, M. J., Bosma, H., Verdonk, P., & Feron, F. (2015). Why Wait? Early Determinants of School Dropout in Preventive Pediatric Primary Care. PLoS ONE, 10(11), e0142315. https://doi.org//10.1371/journal.pone.0142315
    » https://doi.org//10.1371/journal.pone.0142315
  • United Nations Children's Fund. (2017). Annual Results Report 2017 -Education . New York: Unicef. Retrieved from https://www.unicef.org/sites/default/files/2019-01/Annual_Results_Report_2017_Education.pdf
    » https://www.unicef.org/sites/default/files/2019-01/Annual_Results_Report_2017_Education.pdf
  • Vinha, L.G. A., Karino, C.A., & Laros, J. A. (2016). Factors associated with Mathematics performance in Brazilian basic education. Psico-USF, 21(1), 87-100. http://dx.doi.org/10.1590/1413-82712016210108
    » http://dx.doi.org/10.1590/1413-82712016210108
  • Yogo, T.U. (2017). Assessing the effectiveness of foreign aid in the education sector in Africa: The case of primary education. African Development Review, 29(3), 389-402. https://doi.org/10.1111/1467-8268.12276
    » https://doi.org/10.1111/1467-8268.12276
  • Yoshida, K., & Van der Walt, J. L. (2017). The policy-implementation-results linkage for education development and aid effectiveness in the Education 2030 era. Compare: A Journal of Comparative and International Education, 48(1), 39-55. https://doi.org/10.1080/03057925.2017.1283583
    » https://doi.org/10.1080/03057925.2017.1283583
  • World Bank. (2018). Learning: To realize education’s promise World Development Report, Washington: World Bank. https://doi.org/10.1596/978-1-4648-1096-1
    » https://doi.org/10.1596/978-1-4648-1096-1

Edited by

Editor-in-chief: Carlo Gabriel Porto Bellini / (Universidade Federal da Paraíba, João Pessoa, PB, Brazil)
Associate editor: Dênis Renato de Oliveira / (Universidade Federal de Lavras, Lavras, MG, Brazil)

Publication Dates

  • Publication in this collection
    01 Mar 2021
  • Date of issue
    2020

History

  • Received
    18 Dec 2019
  • Accepted
    21 Dec 2020
  • Accepted
    28 Jan 2021
ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração Av. Pedro Taques, 294, 87030-008 - Maringá, PR, Brazil, Tel.: (+55) (44) 98826-2467 - Maringá - PR - Brazil
E-mail: bar@anpad.org.br