Abstract
Tradeoff analysis, between generalizability, precision, and realism, guides methodological choices in organizational behavior. These methodological choices were systematically reviewed in Brazilian articles and books (1996-2017) to answer the following question: why are there no Brazilian studies on organizational behavior that use big data or analytics? Among 1062 research articles on organizational behavior, published in 19 psychology and business journals, 68% used scales, and only 10% used observation. Observation was often unstructured and supported other methods. The focus was on “saying,” instead of “doing”. Big data and analytics have the potential to simultaneously reach generalizability, precision, and realism and may pave the way for new conclusions. Additionally, these methods could transform research in organizational behavior.
Keywords
Behavior observation techniques; Multivariate analysis; Techniques; measures; measurement equipment
Resumo
A análise de custo-benefício entre generalidade, precisão e realismo guia escolhas metodológicas em comportamento organizacional. Estas foram sistematicamente revistas em artigos e livros (1996-2017) brasileiros com o objetivo de responder à pergunta: por que não há estudos em comportamento organizacional no Brasil que usem big data ou analytics? Dentre 1.062 artigos com relatos de pesquisa sobre comportamento organizacional publicados em 19 periódicos de Psicologia e Administração, 68% empregaram escalas e apenas 10% a observação. A observação foi muito frequentemente adotada de forma não estruturada e servindo de suporte a outros métodos. O foco foi no “falar” e não no “fazer”. Big data e analytics têm o potencial para atingir ao mesmo tempo a generalidade, a precisão e o realismo e podem abrir o caminho para novas conclusões, sendo talvez capaz de transformar a investigação em comportamento organizacional.
Palavras-chave
Técnicas de observação do comportamento; Análise multivariada; Técnicas; medidas; equipamentos de medição
The colossal and varied volume of data currently available is revolutionizing the workplace (Kopp, Howaldt, & Schultze, 2016Kopp, R., Howaldt, J., & Schultze, J. (2016). Why Industry 4.0 needs workplace innovation: a critical look at the German debate on advanced manufacturing. European Journal of Workplace Innovation, 2(1), 7-24. https://doi.org/10.46364/ejwi.v2i1.373
https://doi.org/10.46364/ejwi.v2i1.373...
; Pinzone et al., 2017Pinzone, M., Fantini, P., Perini, S., Garavaglia, S., Taisch, M., & Miragliotta, G. (2017). Jobs and skills in Industry 4.0: an exploratory research. In H. Lödding, R. Riedel., K. D. Thoben, G. von Cieminski, & D. Kiritsis (Eds.), Advances in Production Management Systems (pp.282-288). Cham: Springer. https://doi.org/10.1007/978-3-319-66923-6_33
https://doi.org/10.1007/978-3-319-66923-...
). Techniques employing big data can identify complex signals by using analytics (machine learning, statistical learning, and data mining) (Mortenson, Doherty, & Robinson, 2015Mortenson, M. J., Doherty, N. F., & Robinson, S. (2015). Operational research from Taylorism to Terabytes: a research agenda for the analytics age. European Journal of Operational Research, 241(3), 583-595. http://doi.org/f8mk5z). For over a decade, these techniques are already used in Brazil in fields such as logistics (Aires, Almeida, & Silveira, 2019Aires, C. S. F., Almeida, G. J., & Silveira, S. O. (2019). Inteligência Artificial na Gestão de Estoque. Fateclog, 1, 1-7. Recuperado de http://fateclog.com.br/anais/2019/INTELIG%c3%8aNCIA%20ARTIFICIAL%20NA%20GEST%c3%83O%20DE%20ESTOQUE.pdf
http://fateclog.com.br/anais/2019/INTELI...
; Ferreira et al., 2016Ferreira, A., Ferreira, R. P., Silva, A. M., Ferreira, A., & Sassi, R. J. (2016). Um estudo sobre previsão da demanda de encomendas utilizando uma rede neural artificial. Blucher Marine Engineering Proceedings, 2(1), 353-364.; Wu & Cunha, 2008Wu, L., & da Cunha, C. B. (2008). The problem of periodic routing of vehicles. Transportes, 16(1), 5-16. https://doi.org/10.14295/transportes.v16i1.8
https://doi.org/10.14295/transportes.v16...
), marketing (Carnasciali & Delazari, 2007Carnasciali, A. M. D. S., & Delazari, L. S. (2007). Integração de sistemas de informações geográficas e técnicas de inteligência artificial para auxiliar a tomada de decisão locacional do setor bancário. Boletim de Ciências Geodésicas, 13(2), 353-368.; Cunha, Silva, & Chaves, 2018Cunha, M. O., Silva, J., M., & Chaves, P. V. A. (2017). As novas possibilidades apresentadas ao marketing digital pelas análises preditivas. Revista Getec, 7(15), 170-175. Recuperado de https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf
https://www.lbg-canada.ca/wp-content/upl...
; Santos & Carvalho, 2016Santos, F. C., & Carvalho, C. L. (2016). Aplicação da inteligência artificial em sistemas de gerenciamento de conteúdo [Relatório Técnico]. Goiânia: Universidade Federal de Goiás. Recuperado de http://www.inf.ufg.br/sites/default/files/uploads/relatorios-tecnicos/RT-INF_001-08.pdf
http://www.inf.ufg.br/sites/default/file...
), and finance (Ferreira & Costa, 2017Ferreira, T. S. V., & Costa, F. J. (2017). Big Data: reflexões epistemológicas e impactos nos estudos de finanças e mercado de capitais. Revista de Educação e Pesquisa em Contabilidade, 11(4), 396-407.; Lucio, 2009Lucio, J. C. M. (2009). Metodologia integrada para o gerenciamento de ativos no setor elétrico baseada no apoio à decisão multicritério e na inteligência artificial (Tese de doutorado não-publicada). Universidade Federal de Santa Catarina.; Porto, 2017Porto, E. G. (2017). A busca pela eficiência na fiscalização da gestão pública: a utilização de inteligência artificial para aperfeiçoamento do controle das finanças públicas. Revista de Direito da Empresa e dos Negócios, 1(2), 4-31.). The Work and Organizational Psychology (WOP) subarea should use more methods featuring these technological innovations, recommend Grimm, Jacobucci, and McArdle (2017). Why aren’t there Brazilian studies in WOP that use big data or analytics? This study aims to answer this question. It reviews the methods used in Organizational Behavior (OB) and analyses the use of scales, which is the predominant method, and behavior observation, which may be the most affected method by the abovementioned technological innovations.
Geopolitical and economic changes and technological innovations have promoted significant work and organizational changes; these changes have impacted WOP, which has expanded and become solid. As a subarea of knowledge, WOP analyzes human behavior within work and organization contexts. It can also be understood as a field of application wherein it solves practical problems. They are related to the interactions between human behavior, work, and organizations, and to the practices of these organizations, which have already incorporated several innovations of the so-called Information and Communications Technologies (ICT).
Studying the mutual influence between individuals and organizations is a challenge that requires investigations at the individual, team, and organizational levels. The fields of anthropology, sociology, administration, and psychology aimed at studying this influence based on their theoretical and methodological frameworks or developed other frameworks. They divided this influence into concepts and relationships, that were analyzed from different perspectives and used different methodological approaches. The broad and unsystematic investigation of the phenomena caused great fragmentation (Schein, 2015Schein, E. H. (2015). Organizational psychology then and now: some observations. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 1-19. https://doi.org/10.1146/annurev-orgpsych-032414-111449
https://doi.org/10.1146/annurev-orgpsych...
). Thus, several WOP subcultures emerged, each with its jargon and procedures. Each subculture developed an intellectual silo distant from a main theory and other silos, argued this author. Another impact was a possible disconnection between what scholars produced (knowledge area) and what professionals applied (field of application). Research studies are designed to obtain as much validity as possible and not necessarily to achieve maximum impact. On the other hand, professionals may twist the scholars’ findings to justify their interventions.
The application of WOP began with regular use of measures without evidence of validity in Brazil and Latin American (Borges-Andrade, Renteria, Pérez, & Toro, 2018Borges-Andrade, J. E., Renteria-Pérez, E., & Toro, J. P. (2018). Organizational/work psychology in Latin America. In R. Ardila (Ed.), Psychology in Latin America (pp.105-158). New York: Springer. http://doi.org/cxnb). The number of professionals in this field of application and the postgraduate programs, constituting the subarea of knowledge, increased sharply in Brazil, suggested these authors. They argued that the accelerated growth of the subarea of knowledge lead to many publications and the use of diverse approaches. Undergraduate programs offer few courses on WOP. As for professional internships, they focus on apprehension and application and are often not mandatory. This means that no skills are developed related to building knowledge and evaluating interventions. This scenario represents an inadequate academic training, making professional practice (field of application) defective and disconnected from academic production (subarea of knowledge).
Organizational behavior is a field grounded on psychology, sociology, and economics and is a relevant part of the scientific production of WOP. According to Siqueira (2009)Siqueira, M. M. M. (2009). Measures of organizational behavior: diagnostic and management tools. Porto Alegre: Artmed., its objects are organizational activities, that merge in three distinct and connected levels, namely, macro (organizations), meso (teams and groups), and micro (individual) levels. Organizational behavior adopted the idea that the method to evolve a theory must divide the human behavior into multiple components, measure these components and, through factorial analysis, unveil the underlying variables (Schein, 2015Schein, E. H. (2015). Organizational psychology then and now: some observations. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 1-19. https://doi.org/10.1146/annurev-orgpsych-032414-111449
https://doi.org/10.1146/annurev-orgpsych...
). A field’s production that consists in only one category of methods is prone to measuring errors; it could even end up prioritizing some errors.
Organizational behavior may be analyzed based on Burrell and Morgan (1979)Burrell, G., & Morgan, G. (1979). Sociological paradigms and organizational analysis: elements of the sociology of corporate life. Portsmouth: Heinemann Educational Books., where paradigms are divided into two axes, namely, concepts of society and social science. Moreover, the latter separates its approaches into subjectivist and objectivist. Each of these approaches has its own ontology, epistemology, view of human nature, and methodology. Therefore, this division implies that the paradigms from which the approaches originate define the method they use to investigate phenomena. Subjectivists base their ideas on the assumption that an individual’s external world is not built of real structures but denominations and conventions. This aspect causes the search for patterns and regularities to be excluded, as each person’s reality is unique. Thus, diaries and biographies, as methods of investigations, aid in understanding the social world by holistically comprehending the reality. Objectivists base their ideas on the assumption that an individual’s external world is composed of tangible and relatively unchangeable structures. This aspect makes them seek patterns and regularities that enable them to explain and predict phenomena, for which they employ controlled scientific tests, standardized tools, and quantitative data analysis (Corradi, Marcon, Loiola, Kanan, & Vieira, 2016Corradi, A. A., Marcon, S. R. A., Loiola, E., Kanan, L. A., & Vieira, L. R. (2016). Pesquisa empírica em POT no Brasil: uma análise paradigmática. Revista Psicologia: Organizações e Trabalho, 16(4), 349-357. http://dx.doi.org/10.17652/rpot/2016.4.12638.
https://doi.org/10.17652/rpot/2016.4.126...
).
Another paradigmatic division organizes WOP into three axes, namely, behavioral, subjectivity, and clinical (Bendassolli, Borges-Andrade, & Malvezzi, 2010Bendassolli, P. F., Borges-Andrade, J. E., & Malvezzi, S. (2010). Paradigmas, eixos temáticos e tensões na PTO no Brasil. Estudos de Psicologia (Natal), 15(3), 281-289. https://doi.org/10.1590/S1413-294X2010000300008
https://doi.org/10.1590/S1413-294X201000...
). The behavioral axis is based on post-positivism and seeks objectivity; even though it is understood that these functions cannot be fully achieved. The main influences of this axis are behaviorism, neobehaviorism, and sociocognitivism, which originally used experimental methods. The subjectivity axis uses the critical paradigm, which opposes post-positivism in its planning, execution, and interpretation of research results. Its main influences are the socio-historical and institutional approaches and post-structuralism. It uses methods and techniques that focus on analyzing the phenomenon, thus eliminating comparability and generalization of the results. The clinical axis also considers the critical paradigm as a theoretical paradigm and adopts qualitative methodologies for the analysis of the individual’s background. The third axis includes ergology, psychodynamics of work, clinical sociology, and the clinic of activity (Bendassolli et al., 2010Bendassolli, P. F., Borges-Andrade, J. E., & Malvezzi, S. (2010). Paradigmas, eixos temáticos e tensões na PTO no Brasil. Estudos de Psicologia (Natal), 15(3), 281-289. https://doi.org/10.1590/S1413-294X2010000300008
https://doi.org/10.1590/S1413-294X201000...
).
Although paradigms influence methodological choices, availability of tools may have a greater influence on the methodological choices. In other words, if an ideal tool existed, that would provide continuous access to a phenomenon, measuring all its variables without intervention, then all approaches could employ this tool.
The dilemmatic viewpoint of psychology research begins with the tradeoff analysis made in methodological choices, considering the lack of an ideal tool. This view indicates that all methods have errors and that researchers need to learn to deal with these errors. According to this viewpoint, there are three factors (or horns), namely, generalizability, precision, and realism. It would not be possible to satisfy (or grab) all three horns simultaneously. Thus, each researcher makes methodological decisions that favor one or two of the abovementioned horns; however, the researcher’s decisions can never simultaneously favor all the three horns. For example, surveys favor generalizability and exclude precision and realism. On the contrary, ethnographic research favors realism and exclude precision and generalizability. As no method grabs all the three horns, methodological diversification and colossal volume of research to study the same phenomenon are the derived solutions (McGrath, 1981McGrath, J. E. (1981). Dilemmatics: the study of research choices and dilemmas. American Behavioral Scientist, 25(2), 179-210. http://doi.org/fkf8gr). Therefore, irrespective of the epistemic positioning of the study’s authorship, it is subjected to tool-related restrictions; these tool-related constraints may be shifted by technological innovations.
Scientific research in OB is almost always based only on what an individual says, through qualitative or quantitative analyses. This predominant form of access to what is “said” could question the validity of the findings (Aguinis, Pierce, Bosco, & Muslin, 2009Aguinis, H., Pierce, C. A., Bosco, F. A., & Muslin, I. S. (2009). First decade of organizational research methods: trends in design, measurement, and data-analysis topics. Organizational Research Methods, 12(1), 69-112. http://doi.org/b2jd4d). Only 12.4% of Brazilian studies reported behavior observation as a method, and most observations are also focused on what the individual says, despite the claim to consider what people do. Thus, they do not incorporate fundamental elements to appropriately understand the phenomenon (Mourão, Bastos, Passos, & Oliveira, 2016). Studies on performance, commitment, and organizational citizenship refer directly to organizational behaviors, but these aspects are investigated almost exclusively by what individuals say, as indicated by Mourão et al. (2016)Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2.
The response to scales model, particularly those referring to behaviors, indicates steps that the respondent supposedly follows when answering an item, namely, (i) understand the question, (ii) understand the behavior of interest, (iii) correctly identify the period of interest, (iv) remember this period to identify all relevant incidents of the behavior, (v) correctly date these recalled incidents, (vi) add them correctly, (vii) place their quantity into the proposed response alternatives, and (viii) answer the question (Schwartz & Oyserman, 2001Schwartz, N., & Oyserman, D. (2001). Asking questions about behavior: cognition, communication, and questionnaire construction. American Journal of Evaluation, 22(2), 127-160.). Each step involves the possibility of making errors and its external validity cannot be attested even if the measure is internally consistent. To understand OB constructs, considering their inherent complexity and the difficulty to categorize them in a validly and reliably manner, a triangulation of methods is required where different ways of investigating “doing” and “saying” should be employed to ensure that the information is used together. Studies should focus less on responses based only on “saying” and seek ways to access “doing”, suggested Mourão et al. (2016)Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2. Consequently, this aspect would probably involve direct observations of behaviors.
Historical explanations, technological limitations, and operational difficulties are involved in the method of directly observing human behaviors in organizations. The first difficulty is to convince these organizations to allow to conduct observations related to their employees’ behaviors. The second difficulty involves the reliability of the collected data, as the observer’s presence affects the performance/behaviors of those being observed. The third difficulty is tradeoff analysis as this method requires considerable time and more than one observer to access even a slight change in one’s behavior while at work. The fourth difficulty is that data consistency is rarely achieved, as observers need to be well trained. Finally, some organizational context variables cannot be controlled, thus leading to low reproducibility (Mourão et al., 2016Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2). Observation methods were almost entirely replaced by surveys in the behavior axis and are used in an unsystematic manner in the other two axes to support the investigation of the individual’s context. Unfortunately, a subarea of knowledge that aims to examine, predict, and correlate behaviors has supposedly abandoned direct access to them. On the bright side, there is a new methodological option.
Analyzing “doing” in organizations may be accomplished in several ways. Organizations nowadays have huge amounts of data (big data) available, although they can rarely analyze it themselves. One of the areas that seek to analyze big data is called analytics, which is a field closely related to computer science and engineering that employs quantitative methods to organize, analyze, and draw conclusions from huge raw databases (Mortenson et al., 2015Mortenson, M. J., Doherty, N. F., & Robinson, S. (2015). Operational research from Taylorism to Terabytes: a research agenda for the analytics age. European Journal of Operational Research, 241(3), 583-595. http://doi.org/f8mk5z). The combination of big data and analytics may identify complex signals in the data through analysis based on statistical techniques (machine learning, statistical learning, and data mining) (Grimm et al., 2017Grimm, K. J., Jacobucci, R., & McArdle, J. J. (2017, January). Big data methods and psychological science. American Psychological Association. Retrieved from https://www.apa.org/science/about/psa/2017/01/big-data-methods.aspx
https://www.apa.org/science/about/psa/20...
). This combination has revolutionized areas such as economics and applied social sciences.
The application of analytics for human resources is called human resources analytics or people analytics. People analytics has obtained great popularity in recent years and is being considered not only a trend but a reality (Deloitte University Press, 2017Deloitte University Press. (2017). Global human capital trends: rewriting the rules for the digital age. New York: Author. Retrieved from https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf
https://www.lbg-canada.ca/wp-content/upl...
). The big data available in organizations is raw, unstructured, and derived from various sources such as emails, social media communications, web searches, images, and locations. These data, which are often behaviors, need to be handled and transformed into indicators so that they may be analyzed (Isson & Harriott, 2016Isson, J. P., & Harriott, J. S. (2016). People analytics in the era of big data: changing the way you attract, acquire, develop, and retain talent. New Jersey: Jon Wiley & Sons.). This task should be addressed to WOP professionals because they have the necessary theoretical knowledge. However, the lack of skills to understand data and manipulate databases makes it impossible for them to develop the task (Borges-Andrade et al., 2018Borges-Andrade, J. E., Renteria-Pérez, E., & Toro, J. P. (2018). Organizational/work psychology in Latin America. In R. Ardila (Ed.), Psychology in Latin America (pp.105-158). New York: Springer. http://doi.org/cxnb). The biggest challenge of people analytics is the integration of data to draw statistically valid and context-appropriate conclusions from data processing and analysis. This subarea lacks methods that integrate the conceptual knowledge of WOP into the new ways of analyzing data (Angrave, Charlwood, Kirkpatrick, Lawrence, & Stuart, 2016Angrave, D., Charlwood, A., Kirkpatrick, I., Lawrence, M., & Stuart, M. (2016). HR and analytics: why HR is set to fail the big data challenge. Human Resource Management Journal, 26(1), 1-11.).
Big data and analytics have the potential to eliminate, or at least reduce, dilemmas such as that of the three abovementioned horns, previously regarded as inherent in the investigation of phenomena in social sciences. Generalizability, precision, and realism could be achieved simultaneously, and scientific research would become predictive rather than being explanatory (Chang, Kauffman, & Kwon, 2014Chang, R. M., Kauffman, R. J., & Kwon, Y. (2014). Understanding the paradigm shift to computational social science in the presence of big data. Decision Support Systems, 63, 67-80. https://doi.org/10.1016/j.dss.2013.08.008
https://doi.org/10.1016/j.dss.2013.08.00...
). The main trends in using big data in WOP involve people selection, performance assessment, and identification of relationships networks (Guzzo, Fink, King, Tonidandel, & Landis, 2015Guzzo, R. A., Fink, A. A., King, E., Tonidandel, S., & Landis, R. S. (2015). Big data recommendations for industrial-organizational psychology. Industrial and Organizational Psychology, 8(4), 491-508. https://doi.org/10.1017/iop.2015.40
https://doi.org/10.1017/iop.2015.40...
). Considering this new opportunity and the dilemma of the three horns, this study analyzes the methods used in Brazilian publications on OB.
Method
The Brazilian publications on the OB field were analyzed using the review method described by Bastos, Maia, Rodrigues, Macambira, and Borges-Andrade (2014)Bastos, A. V. B., Maia, L. G., Rodrigues, A. C. A., Macambira, M. O., & Borges-Andrade, J. E. (2014). Vínculos dos indivíduos com a organização: análise da produção científica brasileira 2000-2010. Psicologia: Teoria e Pesquisa, 30(2), 153-162. https://doi.org/10.1590/S0102-37722014000200004
https://doi.org/10.1590/S0102-3772201400...
; Cantal, Borges-Andrade, and Porto (2015)Cantal, C., Borges-Andrade, J. E., & Porto, J. B. (2015). Cooperação, comportamentos proativos, ou simplesmente cidadania organizacional? Uma revisão da produção nacional na área. Revista Psicologia: Organizações e Trabalho, 15(3), 286-297. http://doi.org/10.17652/rpot/2015.3.331
https://doi.org/10.17652/rpot/2015.3.331...
; Fonseca, Porto, and Borges-Andrade (2015)Fonseca, A. M. O., Porto, J. B., & Borges-Andrade, J. E (2015). Liderança: um retrato da produção científica brasileira. Revista de Administração Contemporânea, 19(3), 290-310. https://doi.org/10.1590/1982-7849rac20151404
https://doi.org/10.1590/1982-7849rac2015...
; Nascimento, Borges-Andrade, and Porto (2016)Nascimento, T. T., Borges-Andrade, J. E., & Porto, J. B. (2016). Produção científica brasileira sobre comportamento organizacional no terceiro setor. Estudos de Psicologia (Campinas), 33(2), 367-374. http://dx.doi.org/10.1590/1982-02752016000200018
https://doi.org/10.1590/1982-02752016000...
; Resende and Neiva (2018)Resende, S., & Neiva, E. R. (2018). Avaliação dos instrumentos de medida de afeto e bem-estar no trabalho publicados em periódicos de psicologia e administração de 1996 a 2015. Trabalho (En)Cena, 3(2), 80-94. https://doi.org/10.20873/2526-1487V3N2P80
https://doi.org/10.20873/2526-1487V3N2P8...
; and Sampaio, Borges-Andrade, and Bonatti (2018)Sampaio, N. S. P, Borges-Andrade, J. E., & Bonatti, C. L. (2018). Aprendizagem no trabalho: pesquisa nas organizações públicas e privadas brasileiras. Psicología Desde el Caribe, (número especial), 1-21. http://dx.doi.org/10.14482/psdc.35.4.158.72
https://doi.org/10.14482/psdc.35.4.158.7...
. This review considers only articles that report empirical studies with OB as a criterion variable at the micro level, conducted with data from Brazilian workers, and published in impact journals in Brazil. In all, 19 journals were considered: Revista de Administração (by Universidade de São Paulo and by Universidade Presbiteriana Mackenzie), Revista de Administração Contemporânea and Brazilian Administration Review (both by Associação Nacional de Pós-Graduação em Administração), Revista de Administração Pública and Revista de Administração de Empresas (both by Fundação Getulio Vargas), Revista Organizações & Sociedade, Revista Eletrônica de Administração, Estudos de Psicologia (by Pontifícia Universidade Católica de Campinas and by Universidade Federal do Rio Grande do Norte), Psicologia Reflexão e Crítica, Psicologia em Estudo, Psicologia Teoria e Pesquisa, Psico (by Universidade São Francisco and by Pontifícia Universidade Católica do Rio Grande do Sul), Psicologia Ciência e Profissão, Avaliação Psicológica, Revista Psicologia Organizações e Trabalho and Paideia Revista de Psicologia. Graduate students, previously trained in analysis of research reports on OB, examined and classified the articles in pairs, which were subsequently reviewed by another pair. The articles were classified into 17 major OB themes: affection, learning, attitude when facing changes, organizational climate, cognition, skills, escape and avoidance behaviors, psychological contracts, creativity and problem-solving, organizational culture, productive performance, deviations in behavior, well-being and health, social interactions, motivation, meanings, senses and identity at work, and decision-making. In each article, information was collected on the nature and purpose of the study, characteristics of the research design, sampling, data source, type of measurement, data analysis procedure, sector, and segment of the economy. A total of 1,062 articles, which were published between 1996 and 2017, met the described criteria. The reported data collection tools were classified as scale or questionnaire, interview, observation, documentary analysis, and test or exam.
Measures that focused on OB were also collected from four books (Abbad et al., 2009Abbad, G., Mourão, L., Meneses, P. P., Zerbini, T., Borges-Andrade, J. E., & Vilas-Boas, R. (2009). Assessment measures in training, development and education: tools for people management. Porto Alegre: Artmed.; Puente-Palacios & Peixoto, 2015Puente-Palacios, K., & Peixoto, A. D. L. A. (2015). Ferramentas de diagnóstico para organizações e trabalho: um olhar a partir da psicologia. Porto Alegre: Artmed.; Siqueira, 2009Siqueira, M. M. M. (2009). Measures of organizational behavior: diagnostic and management tools. Porto Alegre: Artmed., 2014Siqueira, M. M. M. (2014). New measures of organizational behavior: diagnostic and management tools. Porto Alegre: Artmed.). These books, produced during the abovementioned period, aimed to provide scales with good evidence of validity and previously published in research reports in articles, theses, and dissertations. This provision aimed to enable WOP professionals to become aware of the tools they could use in their work. This strategy was used because most of these professionals do not usually have the skills to find research reports on measures, and when they have access to them, they rarely understand the technical language used in such reports. Each of those measures (n = 87), in each of the mentioned books, was classified according to the same 17 themes in which the previous articles were classified. Regarding the behaviors that were objects of the measurements, all articles reporting the use of the method were reanalyzed and classified according to the paradigmatic axis of the study, the use of quantitative analysis, the prior definition of behaviors or constructs to be observed, the systematicity of observation, the researcher’s participation, and the way in which the results were used in the research.
Results
There were two periods of acceleration in the dissemination of the Brazilian production on OB articles: the triennium period from 2000 to 2002 (107%) and the triennium period from 2009 to 2011 (35%). As for the measures in books, almost nonexistent until the beginning of the 2000s, there were three periods of acceleration: from 2000 to 2005 (333%), from 2009 to 2011 (56%), and from 2015 to 2017 (89%). Publication in books followed the pattern of the growing number of publications of articles in OB (Figure 1).
Number of articles published on organizational behavior and organizational behavior scales per triennium.
One of the milestones to produce scales may have been the article by Siqueira (2002)Siqueira, M. M. M. (2002). Medidas do comportamento organizacional. Estudos de Psicologia (Natal), 7, 11-18. https://doi.org/10.1590/S1413-294X2002000300003
https://doi.org/10.1590/S1413-294X200200...
. She analyzed OB measurements until 2002 and highlighted the lack of standardization in the measure-building process and the lack of measures with good evidence of validity. She emphasized that theoretical diversity made it difficult to define constructs to be analyzed and analysis procedures that captured all the complexity of the phenomena. Ultimately, she argued that this aspect culminated in the use of scales with low evidence of validity or scales that were built for other contexts. There has been significant growth in the scale production since 2002. However, this growth does not represent a methodological or procedural unification, as proposed by the mentioned author, but rather an even greater fragmentation of the subarea. As the paradigmatic axes of OB began to increasingly accept scales as a measuring tool, each of them developed tools to measure their constructs, rather than seeking unification. In most studies (87%) where there prevails a construction of a scale, the goal is only the construction of the scale itself. On comparing the scales published in books and articles, the production was similar from 1996 to 2007 but has become very discrepant in the past decade. The production of scales reported in articles in the past decade was more than double the disclosure of scales in books (Figure 2).
Less organizational behavior scale production was performed in the following themes: decision-making and judgments, creativity and problem-solving, escape and avoidance behaviors, and attitude when facing changes (Figure 3). Among the themes in which production was numerically relevant, those that were balanced for the two means of the disclosure include meanings, senses, and identity at work; motivation; social interactions; deviations in behavior; skills; learning; and affection. The themes that followed the pattern of greater dissemination of scales in journals than in books include well-being and health, productive performance, and organizational climate. Finally, the themes that were opposite to the standard, with more reports in books than in journals, include organizational culture, psychological contracts, and cognition.
The data presented here refer to the volume of reports on OB scales and not on their use in the WOP applied field. For example, organizational climate scales are among the most used by WOP professionals, although it is known that many of them have never undergone any analysis of validity evidence. They are the product of “home-made” solutions or they were directly imported by consulting companies that sell diagnosis of organizational climate. The number of climate scales in books (0.9%) is small concerning the total number of scales in books, being even less representative than the number of scales in articles (3.8%).
The use of observation as a method of data collection in studies on OB is scarce (8%). On the contrary, scales are present in most of these studies (68%). The representativeness of the use of scales varies greatly according to the OB theme. For example, almost all studies (85%) on psychological contracts use a scale, and less than half of the studies (43%) on meanings, senses, and identity at work use scales (Figure 4). Despite this variation, all themes have a significant number of studies where scales are used. On the contrary, the use of the observation method varies little among the OB themes. Even for themes that refer directly to behaviors, such as escape and avoidance behaviors and deviations in behaviors, few or no studies have reported the use of the observation method.
A more in-depth analysis of the 81 articles on OB, where the observation method was reported, reveals some possible patterns. The first pattern is that almost none (4%) of them presented a quantitative analysis of the observation data. Although some studies used combinations of methods such as field diary and Bardin’s categorical analysis, which would allow quantitative data analysis, none described such analyses. Only 3 out of the 81 articles used quantitative analysis. They represent an exception to the rule that seems to have dominated the use of observation in the OB studies found in the extant literature review. None of the 1,062 studies used big data or analytics.
Most of the articles describing the use of the observation method come from the subjectivity axis, and very few of them come from the clinical axis (Table 1). About the observed procedures, most studies use the exploratory method, without defining the behaviors to be observed or the construct of interest for which expressions should be observed through behaviors. Moreover, there is a great variety of methods that use observation in an exploratory manner (e.g., ethnography); however, these methods seek to understand a specific reality, and their results cannot be generalized. As for the results of the observation, in the behavioral axis, in a quarter of the cases, they are not even cited. When cited, they often supplemented the creation of questionnaires or scales. That is, the findings obtained through observation only served at an intermediate stage of a research process, in which a survey on “doing” would be replaced by the investigation on “saying.”
Use of the observation method reported in publications between 1996 and 2017 by paradigmatic axis
Discussion
The Brazilian publications on OB, mainly from the behavioral axis, have scales as a predominant method of data collection. Several articles are published only with the report of the validation of a scale. Considering that professionals in the field of application of WOP rely on books and not articles (Borges-Andrade et al., 2018Borges-Andrade, J. E., Renteria-Pérez, E., & Toro, J. P. (2018). Organizational/work psychology in Latin America. In R. Ardila (Ed.), Psychology in Latin America (pp.105-158). New York: Springer. http://doi.org/cxnb), many validated scales are rarely employed or not employed at all. The constructs for which the scales were created may not necessarily be useful to professionals in this area, as a significant discrepancy prevails between the themes of the scales published in journals and books.
Further, scales favor generalizability, but they may lack precision and realism. They are subjected to the reliability problems, highlighted by Schwartz and Oyserman (2001)Schwartz, N., & Oyserman, D. (2001). Asking questions about behavior: cognition, communication, and questionnaire construction. American Journal of Evaluation, 22(2), 127-160., and validity problems, as they are based solely on what the individual says (Mourão et al., 2016Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2). Several constructs, despite being investigated in various contexts, are not necessarily true to reality. A triangulation of methods is required to reduce the problems associated with measurements.
The low representativeness of the observation method is unsettling. Studies on OB do not seem to analyze what people do but rather what they say. This aspect can be explained by the high cost associated with using this method and the organizations’ resistance to make room for the method to be used in their environments (Mourão et al., 2016Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2). It can be a method of high precision, but with low generalizability, because it is used in small samples, and low realism, considering the researcher’s interference. All the listed problems apply to the classic methods of observation; however, when classic methods of observation are performed using behaviors in virtual environments or technological resources to record behaviors, all the above mentioned issues are inapplicable. New ICT allow researchers to measure many behaviors without interference.
The behaviors recorded through ICT present two new challenges, namely, data handling and analysis (Guzzo et al., 2015Guzzo, R. A., Fink, A. A., King, E., Tonidandel, S., & Landis, R. S. (2015). Big data recommendations for industrial-organizational psychology. Industrial and Organizational Psychology, 8(4), 491-508. https://doi.org/10.1017/iop.2015.40
https://doi.org/10.1017/iop.2015.40...
). By combining the WOP’s existing theoretical framework, big data, and analytics, a considerable amount of data may be accessed, which further can be analyzed and interpreted according to the existing theories. This aspect could lead to better generalizations and new conclusions that are likely to be closer to what professionals really do at work.
Behavior records stored in the database may or may not be accessible through virtual media (e.g., access to websites and recording through a computer’s camera). Some kinds of stored information are much more complex than the mentioned ones and go beyond human conscious perception (e.g., pupil dilation, galvanic skin response, body temperature, and facial micro expressions). As for data analysis, the benefits of big data can come from colossal data, great statistical power, or new techniques. Large databases facilitate in unveiling patterns that are not observable on smaller samples. One application of this benefit is the identification of personality traits based on behaviors in social networks (Youyou, Kosinski, & Stillwell, 2015Youyou, W., Kosinski, M., & Stillwell, D. (2015). Computer-based personality judgments are more accurate than those made by humans. Proceedings of the National Academy of Sciences, 112(4), 1036-1040. https://doi.org/10.1073/pnas.1418680112
https://doi.org/10.1073/pnas.1418680112...
).
New data analysis techniques include textual mining and mapping of relationship networks, which draw entirely new conclusions. The application of these benefits to WOP is still in the early stages, but some examples are already available. For instance, data mining was used to improve the effectiveness of personnel selection by Aghaee and Aghaee (2016)Aghaee, M., & Aghaee, R. (2016) Selection of logistics personnel by using and hybrid Fuzzy DEMATEL and Fuzzy ANP. International Research Journal of Management Science, 4(1), 14-22. and Azar, Sebt, Ahmadi, and Rajaeian (2013)Azar, A., Sebt, M. V., Ahmadi, P., & Rajaeian, A. (2013). A model for personnel selection with a data mining approach: a case study in a commercial bank. SA Journal of Human Resource Management, 11(1), 1-10. http://doi.org/cxm8. An algorithm that identifies relevant information, in resumés and job openings, and relates applicants to job openings was designed by Paoletti, Martinez-Gil, and Schewe (2015Paoletti, A. L., Martinez-Gil, J., & Schewe, K. D. (2015). Extending knowledge-based profile matching in the human resources domain. In Q. Chen, A. Hameurlain, F. Toumani, R. Wagner, & H. Decker (Eds.), Database and expert systems applications (pp.21-35). New York: Springer. http://doi.org/cxm3). Another algorithm, which predicts employee performance evaluation, aimed at promoting performance improvement, was developed by Kirimi and Moturi (2016)Kirimi, J. M., & Moturi, C. A. (2016). Application of data mining classification in employee performance prediction. International Journal of Computer Applications, 146(7), 28-35.. A software called CORPNET, which analyzes formal and informal relationships to build relationship networks and identify power and organizational structures, was developed by Liu and Moskvina (2016)Liu, J., & Moskvina, A. (2016). Hierarchies, ties and power in organizational networks: model and analysis. Social Network Analysis and Mining, 6(1), 106. https://doi.org/10.1007/s13278-016-0413-2
https://doi.org/10.1007/s13278-016-0413-...
. Eye movements, notes, logs, and facial recognition to identify self-regulatory processes during learning were used by Azevedo et al. (2013)Azevedo, R., Harley, J., Trevors, G., Duffy, M., Feyzi-Behnagh, R., Bouchet, F., & Landis, R. (2013). Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems. In R. Azevedo & V. Aleven (Eds.), International handbook of metacognition and learning technologies (pp.427-449). New York: Springer. http://doi.org/cxm9.
Big data and analytics, in a dilemmatic situation, have the potential to change the tradeoff of methodological choices. Achieving generalizability, precision, and realism simultaneously is possible as information comes from tools that are less intrusive and store large amounts of data at low cost (Chang et al., 2014Chang, R. M., Kauffman, R. J., & Kwon, Y. (2014). Understanding the paradigm shift to computational social science in the presence of big data. Decision Support Systems, 63, 67-80. https://doi.org/10.1016/j.dss.2013.08.008
https://doi.org/10.1016/j.dss.2013.08.00...
). In a paradigmatic view, they are closer to the axis of behavior or objectivist approach. However, the consolidation of the application of scales and the standardization of data analysis procedures seem to hinder the search for innovations by this axis. Behavior observation is used more frequently by the subjectivist axis and approach, which could take advantage of innovations to improve existing techniques. However, to use the new techniques, training is required for handling and analyzing large databases, which is an uncommon aspect in the area of WOP. Considering this scenario, the evolution of WOP in Brazil may be hindering the introduction of new technologies in the area.
We reiterate the following question: In Brazil, why don’t we find studies that use big data or analytics in WOP? The methodological choices of WOP, based on the paradigms from which each axis is derived, led to the construction of methodological frameworks that do not systematically observe human behaviors. Because big data and analytics rely on raw records, the lack of methods to systematically analyze behaviors prevents their use. It is thus necessary to review the methodological choices made in each paradigmatic axis and subarea of WOP to overcome this shortcoming and finally develop new methodological frameworks. There are several application possibilities for big data and analytics, and we expect them to completely transform the methods used in WOP.
How to cite this article
-
Balaniuk, R. M., & Borges-Andrade, J. E. (2021). Measures in organizational behavior: why don’t we use big data and analytics? Estudos de Psicologia (Campinas), 38, e180157. https://doi.org/10.1590/1982-0275202138e180157
References
- Abbad, G., Mourão, L., Meneses, P. P., Zerbini, T., Borges-Andrade, J. E., & Vilas-Boas, R. (2009). Assessment measures in training, development and education: tools for people management Porto Alegre: Artmed.
- Aghaee, M., & Aghaee, R. (2016) Selection of logistics personnel by using and hybrid Fuzzy DEMATEL and Fuzzy ANP. International Research Journal of Management Science, 4(1), 14-22.
- Aguinis, H., Pierce, C. A., Bosco, F. A., & Muslin, I. S. (2009). First decade of organizational research methods: trends in design, measurement, and data-analysis topics. Organizational Research Methods, 12(1), 69-112. http://doi.org/b2jd4d
- Aires, C. S. F., Almeida, G. J., & Silveira, S. O. (2019). Inteligência Artificial na Gestão de Estoque. Fateclog, 1, 1-7. Recuperado de http://fateclog.com.br/anais/2019/INTELIG%c3%8aNCIA%20ARTIFICIAL%20NA%20GEST%c3%83O%20DE%20ESTOQUE.pdf
» http://fateclog.com.br/anais/2019/INTELIG%c3%8aNCIA%20ARTIFICIAL%20NA%20GEST%c3%83O%20DE%20ESTOQUE.pdf - Angrave, D., Charlwood, A., Kirkpatrick, I., Lawrence, M., & Stuart, M. (2016). HR and analytics: why HR is set to fail the big data challenge. Human Resource Management Journal, 26(1), 1-11.
- Azar, A., Sebt, M. V., Ahmadi, P., & Rajaeian, A. (2013). A model for personnel selection with a data mining approach: a case study in a commercial bank. SA Journal of Human Resource Management, 11(1), 1-10. http://doi.org/cxm8
- Azevedo, R., Harley, J., Trevors, G., Duffy, M., Feyzi-Behnagh, R., Bouchet, F., & Landis, R. (2013). Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems. In R. Azevedo & V. Aleven (Eds.), International handbook of metacognition and learning technologies (pp.427-449). New York: Springer. http://doi.org/cxm9
- Bastos, A. V. B., Maia, L. G., Rodrigues, A. C. A., Macambira, M. O., & Borges-Andrade, J. E. (2014). Vínculos dos indivíduos com a organização: análise da produção científica brasileira 2000-2010. Psicologia: Teoria e Pesquisa, 30(2), 153-162. https://doi.org/10.1590/S0102-37722014000200004
» https://doi.org/10.1590/S0102-37722014000200004 - Bendassolli, P. F., Borges-Andrade, J. E., & Malvezzi, S. (2010). Paradigmas, eixos temáticos e tensões na PTO no Brasil. Estudos de Psicologia (Natal), 15(3), 281-289. https://doi.org/10.1590/S1413-294X2010000300008
» https://doi.org/10.1590/S1413-294X2010000300008 - Borges-Andrade, J. E., Renteria-Pérez, E., & Toro, J. P. (2018). Organizational/work psychology in Latin America. In R. Ardila (Ed.), Psychology in Latin America (pp.105-158). New York: Springer. http://doi.org/cxnb
- Burrell, G., & Morgan, G. (1979). Sociological paradigms and organizational analysis: elements of the sociology of corporate life Portsmouth: Heinemann Educational Books.
- Cantal, C., Borges-Andrade, J. E., & Porto, J. B. (2015). Cooperação, comportamentos proativos, ou simplesmente cidadania organizacional? Uma revisão da produção nacional na área. Revista Psicologia: Organizações e Trabalho, 15(3), 286-297. http://doi.org/10.17652/rpot/2015.3.331
» https://doi.org/10.17652/rpot/2015.3.331 - Carnasciali, A. M. D. S., & Delazari, L. S. (2007). Integração de sistemas de informações geográficas e técnicas de inteligência artificial para auxiliar a tomada de decisão locacional do setor bancário. Boletim de Ciências Geodésicas, 13(2), 353-368.
- Chang, R. M., Kauffman, R. J., & Kwon, Y. (2014). Understanding the paradigm shift to computational social science in the presence of big data. Decision Support Systems, 63, 67-80. https://doi.org/10.1016/j.dss.2013.08.008
» https://doi.org/10.1016/j.dss.2013.08.008 - Corradi, A. A., Marcon, S. R. A., Loiola, E., Kanan, L. A., & Vieira, L. R. (2016). Pesquisa empírica em POT no Brasil: uma análise paradigmática. Revista Psicologia: Organizações e Trabalho, 16(4), 349-357. http://dx.doi.org/10.17652/rpot/2016.4.12638.
» https://doi.org/10.17652/rpot/2016.4.12638 - Cunha, M. O., Silva, J., M., & Chaves, P. V. A. (2017). As novas possibilidades apresentadas ao marketing digital pelas análises preditivas. Revista Getec, 7(15), 170-175. Recuperado de https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf
» https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf - Deloitte University Press. (2017). Global human capital trends: rewriting the rules for the digital age New York: Author. Retrieved from https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf
» https://www.lbg-canada.ca/wp-content/uploads/2017/10/Michelle-Ryder_Global-HC-Trends-2017-Insideout-Nov-2-2017.pdf - Ferreira, T. S. V., & Costa, F. J. (2017). Big Data: reflexões epistemológicas e impactos nos estudos de finanças e mercado de capitais. Revista de Educação e Pesquisa em Contabilidade, 11(4), 396-407.
- Ferreira, A., Ferreira, R. P., Silva, A. M., Ferreira, A., & Sassi, R. J. (2016). Um estudo sobre previsão da demanda de encomendas utilizando uma rede neural artificial. Blucher Marine Engineering Proceedings, 2(1), 353-364.
- Fonseca, A. M. O., Porto, J. B., & Borges-Andrade, J. E (2015). Liderança: um retrato da produção científica brasileira. Revista de Administração Contemporânea, 19(3), 290-310. https://doi.org/10.1590/1982-7849rac20151404
» https://doi.org/10.1590/1982-7849rac20151404 - Grimm, K. J., Jacobucci, R., & McArdle, J. J. (2017, January). Big data methods and psychological science. American Psychological Association Retrieved from https://www.apa.org/science/about/psa/2017/01/big-data-methods.aspx
» https://www.apa.org/science/about/psa/2017/01/big-data-methods.aspx - Guzzo, R. A., Fink, A. A., King, E., Tonidandel, S., & Landis, R. S. (2015). Big data recommendations for industrial-organizational psychology. Industrial and Organizational Psychology, 8(4), 491-508. https://doi.org/10.1017/iop.2015.40
» https://doi.org/10.1017/iop.2015.40 - Isson, J. P., & Harriott, J. S. (2016). People analytics in the era of big data: changing the way you attract, acquire, develop, and retain talent New Jersey: Jon Wiley & Sons.
- Kirimi, J. M., & Moturi, C. A. (2016). Application of data mining classification in employee performance prediction. International Journal of Computer Applications, 146(7), 28-35.
- Kopp, R., Howaldt, J., & Schultze, J. (2016). Why Industry 4.0 needs workplace innovation: a critical look at the German debate on advanced manufacturing. European Journal of Workplace Innovation, 2(1), 7-24. https://doi.org/10.46364/ejwi.v2i1.373
» https://doi.org/10.46364/ejwi.v2i1.373 - Liu, J., & Moskvina, A. (2016). Hierarchies, ties and power in organizational networks: model and analysis. Social Network Analysis and Mining, 6(1), 106. https://doi.org/10.1007/s13278-016-0413-2
» https://doi.org/10.1007/s13278-016-0413-2 - Lucio, J. C. M. (2009). Metodologia integrada para o gerenciamento de ativos no setor elétrico baseada no apoio à decisão multicritério e na inteligência artificial (Tese de doutorado não-publicada). Universidade Federal de Santa Catarina.
- McGrath, J. E. (1981). Dilemmatics: the study of research choices and dilemmas. American Behavioral Scientist, 25(2), 179-210. http://doi.org/fkf8gr
- Mortenson, M. J., Doherty, N. F., & Robinson, S. (2015). Operational research from Taylorism to Terabytes: a research agenda for the analytics age. European Journal of Operational Research, 241(3), 583-595. http://doi.org/f8mk5z
- Mourão, L., Bastos, A. V. B., Passos, R., & Oliveira, D. (2016). The saying and the doing in research on WOP. Revista Psicologia: Organizações e Trabalho, 16(4), 333-339. http://doi.org/cxm2
- Nascimento, T. T., Borges-Andrade, J. E., & Porto, J. B. (2016). Produção científica brasileira sobre comportamento organizacional no terceiro setor. Estudos de Psicologia (Campinas), 33(2), 367-374. http://dx.doi.org/10.1590/1982-02752016000200018
» https://doi.org/10.1590/1982-02752016000200018 - Paoletti, A. L., Martinez-Gil, J., & Schewe, K. D. (2015). Extending knowledge-based profile matching in the human resources domain. In Q. Chen, A. Hameurlain, F. Toumani, R. Wagner, & H. Decker (Eds.), Database and expert systems applications (pp.21-35). New York: Springer. http://doi.org/cxm3
- Pinzone, M., Fantini, P., Perini, S., Garavaglia, S., Taisch, M., & Miragliotta, G. (2017). Jobs and skills in Industry 4.0: an exploratory research. In H. Lödding, R. Riedel., K. D. Thoben, G. von Cieminski, & D. Kiritsis (Eds.), Advances in Production Management Systems (pp.282-288). Cham: Springer. https://doi.org/10.1007/978-3-319-66923-6_33
» https://doi.org/10.1007/978-3-319-66923-6_33 - Porto, E. G. (2017). A busca pela eficiência na fiscalização da gestão pública: a utilização de inteligência artificial para aperfeiçoamento do controle das finanças públicas. Revista de Direito da Empresa e dos Negócios, 1(2), 4-31.
- Puente-Palacios, K., & Peixoto, A. D. L. A. (2015). Ferramentas de diagnóstico para organizações e trabalho: um olhar a partir da psicologia Porto Alegre: Artmed.
- Resende, S., & Neiva, E. R. (2018). Avaliação dos instrumentos de medida de afeto e bem-estar no trabalho publicados em periódicos de psicologia e administração de 1996 a 2015. Trabalho (En)Cena, 3(2), 80-94. https://doi.org/10.20873/2526-1487V3N2P80
» https://doi.org/10.20873/2526-1487V3N2P80 - Sampaio, N. S. P, Borges-Andrade, J. E., & Bonatti, C. L. (2018). Aprendizagem no trabalho: pesquisa nas organizações públicas e privadas brasileiras. Psicología Desde el Caribe, (número especial), 1-21. http://dx.doi.org/10.14482/psdc.35.4.158.72
» https://doi.org/10.14482/psdc.35.4.158.72 - Santos, F. C., & Carvalho, C. L. (2016). Aplicação da inteligência artificial em sistemas de gerenciamento de conteúdo [Relatório Técnico]. Goiânia: Universidade Federal de Goiás. Recuperado de http://www.inf.ufg.br/sites/default/files/uploads/relatorios-tecnicos/RT-INF_001-08.pdf
» http://www.inf.ufg.br/sites/default/files/uploads/relatorios-tecnicos/RT-INF_001-08.pdf - Schein, E. H. (2015). Organizational psychology then and now: some observations. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 1-19. https://doi.org/10.1146/annurev-orgpsych-032414-111449
» https://doi.org/10.1146/annurev-orgpsych-032414-111449 - Schwartz, N., & Oyserman, D. (2001). Asking questions about behavior: cognition, communication, and questionnaire construction. American Journal of Evaluation, 22(2), 127-160.
- Siqueira, M. M. M. (2002). Medidas do comportamento organizacional. Estudos de Psicologia (Natal), 7, 11-18. https://doi.org/10.1590/S1413-294X2002000300003
» https://doi.org/10.1590/S1413-294X2002000300003 - Siqueira, M. M. M. (2009). Measures of organizational behavior: diagnostic and management tools Porto Alegre: Artmed.
- Siqueira, M. M. M. (2014). New measures of organizational behavior: diagnostic and management tools Porto Alegre: Artmed.
- Wu, L., & da Cunha, C. B. (2008). The problem of periodic routing of vehicles. Transportes, 16(1), 5-16. https://doi.org/10.14295/transportes.v16i1.8
» https://doi.org/10.14295/transportes.v16i1.8 - Youyou, W., Kosinski, M., & Stillwell, D. (2015). Computer-based personality judgments are more accurate than those made by humans. Proceedings of the National Academy of Sciences, 112(4), 1036-1040. https://doi.org/10.1073/pnas.1418680112
» https://doi.org/10.1073/pnas.1418680112
Publication Dates
-
Publication in this collection
24 Aug 2020 -
Date of issue
2021
History
-
Received
30 Jan 2019 -
Reviewed
13 Mar 2020 -
Accepted
03 June 2020