Acessibilidade / Reportar erro

Artificial Intelligence Applied to Assess Perceptions of the Quality of E-Commerce Logistics: Case Study of Rio de Janeiro

ABSTRACT

The COVID-19 pandemic imposed many market changes, driven partially by new consumer needs. In the electronic commerce field, changes occurred in parallel to an upsurge in demand, directly impacting logistics service quality. Within that context, this paper seeks a way of assessing the quality of e-commerce logistics, based on end-customer perceptions at the close of the purchasing cycle. The objective is thus to develop a mathematical model based on the artificial intelligence precepts that can interpret qualitative expressions captured through a questionnaire. Such values form partial indexes and the E-Commerce Logistics Quality Index (IQLE). After processing 180 records, it was noted that three of the seven analyzed attributes scored below 5.0, denoting some concern, but also opening up opportunities for improvement and the development of marketing solutions.

Keywords:
Logistics; E-commerce; Artificial Intelligence; IQLE

RESUMO

É fato que com a pandemia da COVID-19 ocorreram muitas mudanças de mercado, em parte, impulsionadas pelas novas necessidades dos consumidores. No âmbito do comércio eletrônico, as mudanças aconteceram em paralelo com o aumento rápido de demanda, impactando diretamente na qualidade do serviço logístico prestado. É nesse contexto que este artigo busca desenvolver uma forma de avaliar a qualidade da logística do e-commerce, baseando-se na percepção do cliente final ao final do ciclo do pedido. Para tanto, objetiva-se desenvolver um modelo matemático, baseando-se nos preceitos da inteligência artificial, que possa interpretar expressões qualitativas, capturadas por intermédio de questionário, transformando-as em valores quantitativos, passíveis de análise no mundo real. Tais valores formam índices parciais e o IQLE (Índice da Qualidade da Logística do E-commerce). Após o processamento de 180 registros, observou-se que dos sete atributos analisados, três deles redundaram em nota abaixo de 5,0, denotando certa preocupação, mas oportunidade de melhora e desenvolvimento de soluções mercadológicas.

Palavras-chave:
Logística; E-commerce; Inteligência Artificial; IQLE

1. INTRODUCTION

There is no denying the importance of technology for most people in their daily lives. During the COVID-19 pandemic, its importance became clear for shortening distances in human relationships, and, above all, for obtaining goods through electronic commerce, better known as e-commerce.

At the start of the purchasing cycle, after the customer places an order, logistics comes into play, providing operational support for the activities needed to convey the goods to their destination: the end-customer.

It should be noted here that these activities are underpinned by planning, operations, and control of the entire cycle, streamlining flows of data and goods, and extending beyond aspects linked to mere physical movements. Consequently, in order to keep service levels up to contracted quality, a systemic overview is needed, that encompasses inventory management and compliance with requirements established for storing, handling, and packing goods, all focused on customer satisfaction.

A satisfied customer implies better possibilities of repeat purchases, building up customer loyalty. Along these lines, it is cheaper to build up loyalty than to attract new buyers. Furthermore, building loyalty may also underpin inflows of new purchasers, through word-of-mouth recommendations.

After goods are delivered to buyers, many after-sales actions are required in the e-commerce field, particularly should any adverse events occur, that might undermine trust in commercial relationships.

In this context, the importance of a systemic overview of the entire process is needed, because any unsuitable action may have negative effects on pre-established service levels. It is thus understood that the ripple effect of these impacts will affect the recipients of e-commerce services.

In order to monitor the many activities involved in complex logistics, it is understood that each of them must be controlled, as well as checking impacts on end-customers, comparing their perceptions with specified quality standards at the end of the purchasing process.

This is the aspect addressed by this paper, due to the possibility of contributing to the uptake of end-customer impressions of e-commerce logistics service quality at the end of the order cycle. The question arises here: is it possible to measure these customer perceptions accurately, establishing a database steering subsequent decisions?

To do so, attempts were made to develop a mathematical model based on artificial intelligence precepts that could interpret qualitative expressions learned from questionnaires completed by end-customers, transforming them into quantitative values that can be analyzed in the real world.

This is where the relevance of this paper lies, identifying effects that are certainly related to underlying cause(s). This is a crossroads between cause and effect, with this connection underpinned by the need for control, justifying measurement systems: “if you can’t measure it, you can’t manage it, you can’t define what you don’t understand, there’s no success that’s not managed.” (Deming, 1990Deming, W. E. (1990). Qualidade: A Revolução Da Administração. Editora Saraiva.)

It is also a fact that customer perceptions may indicate quality standards for planning, designing and operating purposes (Rodrigues, 2006Rodrigues, M. O. (2006). Avaliação Da Qualidade Do Transporte Coletivo Da Cidade De São Carlos [Master’s degree, Universidade De São Paulo].), converging on a management mindset that places the customer as the main focus of organizations. Customers are understood through the use of more accurate tools, as pursuing their satisfaction is not an option, but rather a matter of survival for any enterprise. Their satisfaction is the result of foreseeing their needs and exceeding their expectations, both implicit and explicit, and should be a corporate raison d’être. (Cordeiro et al., 2005Cordeiro, C. de O., Machado, W.V., Carvalho, R.L.S., Heloisa, M.B.C., & Dacol, S. (2005). A Visão Do Cliente Para Melhoria Da Qualidade Do Sistema De Transporte Coletivo Por Ônibus. XXV Encontro Nacional De Engenharia De Produção.)

2. METHODOLOGY

According to Prodanov and Freitas (2013Prodanov, C. C., & Freitas, E. C. (2013). Metodologia Do Trabalho Científico: Métodos E Técnicas Da Pesquisa E Do Trabalho Acadêmico (2nd ed.). Universidade Feevale.), the research conducted for this paper may be divided into four aspects: nature, objectives, technical procedures, and approach to the problem.

In terms of its nature, this research is rated as applied, as it strives to generate knowledge for developing a mathematical model that will provide input for drawing up e-commerce logistics ratings, with practical applications for solving problems, with a case study examining the City of Rio de Janeiro.

In terms of the main objective of this paper, it is firmly linked to a case study for testing and validating a mathematical model. The research is classified as exploratory, providing a diagnosis of e-commerce logistics through collecting data from a survey of end-customers. Along these lines, it is also viewed as explanatory research, as it is designed to underpin the development of a monitoring system, linking causes and effects through registering, analyzing, and classifying researched data.

The technical procedures used in this study are related to the modeling process and data collection for its validation. The following aspects are noteworthy:

  • Data were collected through a survey with direct questions completed electronically over the internet by end-customers. The method used was a survey, with questions on customer characterization, followed by specific questions with replies based on Likert scales. To do so, a sample was defined through statistical procedures;

  • Next, the collected data were run through quantitative analysis, divided into four parts: respondent characteristics; average order profile; end-customer perceptions of logistic services; and end-customer perceptions of services after closing the deal;

  • The mathematical model processing data collected during the survey used a hypothetical-deductive approach to identify other information relevant to the e-commerce logistics analysis, such as the E-Commerce Logistics Quality Index (IQLE) developed by the Getulio Vargas Foundation (FGV), and its partial ratings. This is considered as the model validation phase;

  • This is an ex-post-facto survey, meaning after the fact (receipt of the purchased goods), as the collected data reflect end-customer experiences under certain everyday conditions, for explaining and understanding this experience in terms of a logistics quality profile.

With regard to the approach to the problem, this research project is characterized as qualitative + quantitative, meaning: it is qualitative, because there is a dynamic link between Logistics activities in the real world and the subject (the end-customer), forming an unbreakable connection between subjectivity and objectivity; it is quantitative, through translating customer perceptions by means of the mathematical model, giving rise to numerical data and information used to classify these perceptions and analyze them.

Consequently, it is understood that the following steps should be followed in order to reach this objective:

1) As an exploratory survey, the following aspects must be characterized:

  1. Attributes are related to the mean profile of the orders, perceptions of logistics services, and after-sales services once the purchased goods are received;

  2. Under these attributes, qualitative data are recorded representing subjective aspects of user perceptions.

2) For modeling the data collection and processing system:

  1. Preparation of a data collection questionnaire, requesting qualitative replies for each attribute;

  2. Characterization of attributes as entry variables (Fuzzy variable format), defining the pertinent functions associated with each linguistic label (qualitative reply) mapped out within a specific discourse universe;

  3. Modeling the attributes according to Fuzzy Integer precepts;

  4. Characterization of the output variables constituting the IQLE, based on Fuzzy Integers;

  5. Data processing and analysis, converted into information.

3. THEORETICAL FRAMEWORK

3.1. Remarks on E-commerce Logistics

Usually shortened to e-commerce, electronic commerce is a type of trade using electronic devices and the internet as a channel for accessing virtual stores.

Dating back to the 1970s with Michael Aldrich, the popularity of e-commerce was strongly leveraged in 1995 with the arrival of Amazon, soon becoming a core sector of the world economy as globalization spread. Consisting of inter-organizational data systems, this type of trade allows buyers and sellers to exchange goods and data, related mainly to buying, selling, ordering and paying transactions, in addition to after-sale services after the receipt of purchased goods. (Pereira & Pereira, 2020Pereira, B. A., & Pereira, J. M. (2020). A Importância da Logística no E-Commerce. XI FATECLOG, São Paulo. Retrieved from, https://fateclog.com.br/anais/2020/v4/A%20IMPORTÂNCIA%20DA%20LOGÍSTICA%20NO%20ECOMMERCE.%20.BRUNO%20APARECIDO%20PEREIRA,%20JOSEANE%20MACIEL%20PEREIRA.pdf
https://fateclog.com.br/anais/2020/v4/A%...
)

As societies shut down during the COVID-19 pandemic, e-commerce became a vital tool for the survival of the retail sector, due to plummeting demands at brick-and-mortar stores, with some of them shutting down. This process triggered an upsurge in access to portals that were already in place, forcing entrepreneurs to adapt rapidly to this new context.

In order to offer a better idea of this sudden change, an article published in the e-commercebrasil portal estimated that the pandemic shoehorned five years of digitization into just a couple of months in Brazil, as Brazilian online buyers soared from 35% to 57%. This expansion may be affecting the post-pandemic world, with 55% of consumers in Brazil stating that they intend to continue buying over the internet. (E-Commercebrasil, 2021E-Commercebrasil (2021). 1 em cada 4 brasileiros querem manter compras online diárias após a pandemia. Retrieved November 17, 2021, from Retrieved November 17, 2021, from https://www.ecommercebrasil.com.br/noticias/brasileiros-compras-online-coronavirus/
https://www.ecommercebrasil.com.br/notic...
)

Fueled by the need to keep the economy turning over, e-commerce became the main tool for buyers to access consumer goods. In its wake, some subsystem upgrades were needed, prompted by greater market awareness of demands for good quality products and services, in parallel to keener competitive edge in all niches. Noteworthy among them are aspects related to electronic security for internet communications, storing data in the cloud, marketing structures for end-customers and, above all, for logistics operations.

Earlier studies have indicated a concern with logistics activities, which influence e-commerce quality as perceived by end-customers. Particularly noteworthy among the approaches adopted during the pandemic are those adopted by Guimaraes Junior et al. (2020Guimaraes Junior, D. S., De Sant'anna, C. H. M., Soares, E. J. O., De Melo, F. J. C., & De Medeiros, D. D. (2020). Measurement of logistics service quality of e-commerce. International Journal of Logistics Systems and Management, 37(1), 1-17.) using SERVPERF modeling to process data from 249 consumers; the study by Rachmawati et al. (2020Rachmawati, D. Z., & Agus, A.A. (2020). E-Service and Logistics Service Quality in E-Commerce, Study Case: Shopee Indonesia. 3rd International Conference on Computer and Informatics Engineering (IC2IE), Indonesia.) using descriptive research with 546 users of the Shopee platform to analyze the impacts of logistic service quality on customer satisfaction and loyalty, using the structural equations modeling method provided by the LISREL software; Vasić et al. (2021Vasić, N., Kilibarda, M., Andrejić, M., & Jović, S. (2021). Satisfaction is a function of users of logistics services in e-commerce. Technology Analysis & Strategic Management 33(7), 813-828. https://doi.org/10.1080/09537325.2020.1849610
https://doi.org/10.1080/09537325.2020.18...
) affirm in their study that customer satisfaction in the e-commerce sector depends directly on eight aspects of logistics services. They used a model based on Confirmatory Factor Analysis (CFA) and Partial Least Squares method (PLS) to process the data collected from 425 e-commerce customers.

In order to explore how important this issue is over time, even prior to the pandemic, studies explored the need to upgrade e-commerce logistics quality. Although recent, the study by Gajewska et al. (2020Gajewska, T., Zimon, D., Kaczor, G., & Madzík, P. (2020). The impact of the level of customer satisfaction on the quality of e-commerce services. International Journal of Productivity and Performance Management, 69(4), 666-684.) did not include the influences of the pandemic, instead focusing on e-commerce service quality criteria, particularly within a specific ranking of importance assessed through the Servqual method. Using an empirical approach, Hua and Jing (2015Hua, W., & Jing, Z. (2015). An Empirical Study on E-commerce Logistics Service Quality and Customer Satisfaction. The Fourteen Wuhan International Conference on E-Business - WHICEB. ) sought explanations for the main logistics factors affecting customer satisfaction with e-commerce. Lin et al. (2016Lin, Y., Luo, J., Cai, S., Ma, S. & Rong, K. (2016). Exploring the service quality in the e-commerce context: a triadic view. Industrial Management & Data Systems, 116(3), 388-415.) address quality factors influencing customer satisfaction from three standpoints: the logistics provider, the retailer, and the customer; Davidavičienė and Meidutė (2011Davidavičienė, V., & Meidutė, I. (2011). Quality of e-Logistics in e-Commerce: Consumer Perception. 10th International Conference - Liberec Economic Forum.) noted service efficiency as a key quality measurement factor for consumer satisfaction, encompassing logistics quality assessment criteria and considering specific aspects of consumer behavior. Finally, Yang et al. (2006Yang, Y., Humphreys, P., & McIvor, R. (2006). Business service quality in an e‐commerce environment. Supply Chain Management, 11(3), 195-201. https://doi.org/10.1108/13598540610662086
https://doi.org/10.1108/1359854061066208...
), analyze and assess e-commerce services in general in order to propose a quality assessment measurement system in four aspects, one of which is logistics; Ballou (1992Ballou, R. H. (1992). Business Logistics Management (3rd ed.). Prentice Hall., p. 5) adopted the convergence of logistics attributes for customer services, based on the 7 Rights of Logistics: getting the Right Product, in the Right Quantity, in the Right Condition, at the Right Place, at the Right Time, to the Right Customer, at the Right Price.

3.2. Customer Satisfaction Approach

Perceptions of logistics service quality are a noteworthy and also determining factor, to some extent, for assessing e-commerce performance. However, dealing with human “perceptions” requires a subjective approach, attempting to indicate customer expectations and needs, as a springboard for building up loyalty-based market relationships.

Consumer satisfaction is closely linked to opinions on services rendered. This means that the higher the chances that expectations and needs are met, the higher the perceived quality.

As mentioned in Fonseca and Borges (2002Fonseca, M. J., & Borges Jr., A. A. (2002). O Uso Da Pesquisa De Satisfação Do Consumidor Como Instrumento De Política Pública: O Potencial De Uso No Caso Do Transporte Coletivo De Porto Alegre. Revista Interdisciplinar De Marketing, 1(3), 38-50.) Anderson et al. (1994Fonseca, M. J., & Borges Jr., A. A. (2002). O Uso Da Pesquisa De Satisfação Do Consumidor Como Instrumento De Política Pública: O Potencial De Uso No Caso Do Transporte Coletivo De Porto Alegre. Revista Interdisciplinar De Marketing, 1(3), 38-50.) stress that user satisfaction is affected by three preceding factors: perceived quality (current system performance assessment); price (perceived value); and expectations. In this paper, logistics quality must be reflected through customer perceptions after the service is rendered.

More pragmatically, some studies attempt to approach the customer satisfaction view in terms of perceived quality; it is thus worth listing some of them here:

  • De Albuquerque (2019De Albuquerque, A. P. G. (2019). Aplicação Do Modelo De Kano Em Companhias Aéreas: Discussão Da Satisfação Dos Clientes [Master’s Degree, Universidade Federal De Pernambuco].) offers an analysis of attributes related to customer satisfaction, focusing on the link between customer satisfaction and product or service performance. He mentions that some product/service attributes boost customer satisfaction significantly, in counterpart to others that make little difference;

  • De Farias and De Oliveira (2020De Farias, B. L. A., & De Oliveira, L.A.B. (2020). Aplicação Do Modelo De Kano Para Avaliação Da Qualidade Em Serviços Prestados Por Um Restaurante Na Cidade Do Assú/RN [Trabalho de Conclusão de Curso, Universidade Federal Rural do Semi-Árido].) analyzed quality assessment models, underscoring the 5 Gaps designed to help managers understand the origin of service quality problems, reflecting differences between the expected service and the received service; the Servqual is located in the gaps left by the previous model, assessing service quality through differences between expectations and performance in five dimensions; and the Kano system that ranks product/service attributes by satisfaction or dissatisfaction with the performance level;

  • Soares and De Oliveira (2019Soares, R. A. D., & De Oliveira, L. A. B. (2019). Aplicação Do Modelo Kano Para Avaliação Da Qualidade Em Serviços De Veículos Motorizados [Trabalho de Conclusão de Curso, Universidade Federal Rural do Semi-Árido].) strive to rank carwash service attributes in order to estimate the trustworthiness of functional/dysfunctional questions, together with satisfaction/dissatisfaction coefficients, while measuring customer satisfaction levels by the Kano System;

  • Dias (2018Dias, J. E. G. (2018). Atributos de qualidade: aplicação do modelo de Kano em uma indústria especializada na produção e comercialização de artefatos de borracha localizada na região Sul do Brasil. XII EEPA - Encontro de Engenharia de Produção Agroindustrial, Paraná. ) addresses the Kano model by proposing a practical application identifying major quality attributes, indicating the requirements that could potentiate customer satisfaction.

It is understood that perceived qualities are associated with the attributes representing them. Among those most widely studied are the related triad of quality x logistics x e-commerce, listed in Table 1 below.

Table 1
Equivalent Trapezes and Levels of Importance of Attributes

In brief, based on the attributes listed in Table 1, the following descriptions may be reached for each attribute:

  • Trustworthiness: customer analysis of what was contracted and what was effectively rendered;

  • Speed: fast delivery, minimizing time variations;

  • Empathy: service provider stance when servicing the customer with care, in an individualized manner;

  • Flexibility: able to adapt processes to customer needs;

  • Accessibility: ease in accessing information during and after the transaction;

  • Availability: records of constant customer care from the company;

  • Tangibility: presentation of the company with material physical evidence of rendering the service.

3.3. Artificial Intelligence and Fuzzy Theory

Artificial Intelligence is addressed as a set of techniques applicable through computer systems that are related to intelligent human behavior. Noteworthy among these techniques is Fuzzy Logic (Lopes et al., 2014Lopes, I. L., Santos, F. A. O., & Pinheiro, C. A. M. (2014) Inteligência Artificial (1st ed.). Elsevier.; Bittencourt, 2001Bittencourt, G. (2001). Inteligência Artificial (2nd ed.). Ed. UFSC.) whose starting point was the paper by Zadeh, published in the Information and Control journal in 1962 (Volume 8, page 338 - 353). (Tanaka, 1997Tanaka, K. (1997). An Introduction To Fuzzy Logic For Practical Applications. Springer-Verlag.)

For a certain discourse universe, in a crisp dataset considering only binary values (0 or 1), the variation is sharp. However, under the same condition, the transition is taken at a subjective border for a certain fuzzy dataset element, where this element might or might not belong to this dataset. Ross (1995Ross, T. J. (1995). Fuzzy Logic With Engineering Applications. Mcgraw-Hill.)

The level to which elements belong to a fuzzy dataset is thus represented by the Pertinence Level for a certain discourse universe X = {x1, x2,..., xn}. The relationship among the discourse universe elements and pertinence levels [0,1] is expressed through pertinence function A, which may be discrete or continuous, according to expressions 1 and 2, respectively. In them, μ 𝐴 ( 𝑥 𝑖 ) is considered the pertinence level of element i, x1 is the value of element i in discourse universe X. (Tanaka, 1997Tanaka, K. (1997). An Introduction To Fuzzy Logic For Practical Applications. Springer-Verlag.)

A = μ A x 1 / X 1 + μ A x 2 / X 2 + . . . + i = 1 n μ A x i / X i (1)

A = x μ A x i / X i (2)

Fuzzy datasets A and B may be processed through Union AB (3) and Intersection AB (4), resulting in a third Fuzzy C dataset. The pertinence of the Fuzzy C dataset results from the union obtained through the expression (5); for the intersection (6) is used. (Tanaka, 1997Tanaka, K. (1997). An Introduction To Fuzzy Logic For Practical Applications. Springer-Verlag.)

μ C ( x ) = max ( μ A ( x ) , μ B ( x ) ) = μ A ( x ) O U μ B ( x ) = μ A ( x ) μ B ( x ) (5)

μ C ( x ) = min ( μ A ( x ) , μ B ( x ) ) = μ A x E μ B x = μ A ( x ) μ B ( x ) (6)

A linguistic variable in any fuzzy dataset must be represented by its linguistic terms, which reflect its pertinence functions. For continuous datasets, this variable may be represented by a Fuzzy Integer, as shown in (2). (Sucena & Andrade, 2021Sucena, M. P., & Andrade, T. B. (2021). Proposta de BSC com Modelo Neuro-Fuzzy: Um Estudo de Caso. Revista Engenharia e Tecnologia, 13(13), 110-122. ) Shaw and Simões (1999Shaw, I. S., & Simões, M. G. (1999). Controle E Modelagem Fuzzy (1st ed.). Edgard Blucher-FAPESP.) mention that pertinence functions may be developed on the basis of the analyst´s experience and/or the process under analysis. The authors also stress that a Fuzzy variable must have between 2 and 7 functions, with more functions leading to more accurate findings and heavier computer demands, but with greater interpretation difficulties for analysts.

A fuzzy number is an algebraic representation of a subsidiary fuzzy dataset, a mathematical artifice used to represent subjective or vague situations. The formats most commonly used are triangular and trapezoid (Figure 1). (Sucena & Andrade, 2021Sucena, M. P., & Andrade, T. B. (2021). Proposta de BSC com Modelo Neuro-Fuzzy: Um Estudo de Caso. Revista Engenharia e Tecnologia, 13(13), 110-122. )

Figure 1.
Examples of numbers

As noted in Sucena and Andrade (2021Sucena, M. P., & Andrade, T. B. (2021). Proposta de BSC com Modelo Neuro-Fuzzy: Um Estudo de Caso. Revista Engenharia e Tecnologia, 13(13), 110-122. ), two fuzzy numbers Aa = (a1,a2,a3,a4) and Ab = (b1,b2,b3,b4) may be processed through simple arithmetical operations. Expressions (7) to (12) indicate the most common of them.

Addition: Aa Ab = {a1+ b1, a2+b2, a3+b3, a4+b4 (7)

Subtraction: Aa Ab = {a1-b4, a2-b3, a3-b2, a4-b1} (8)

Product: Aa Ab = {a1.b1, a2.b2, a3.b3, a4.b4} (9)

Division: Aa Ab = {a1/b4, a2/b3, a3/b2, a4/b1} (10)

Product of an n scale: n.Aa = {n.a1, n.a2, n.a3, n.a4} (11)

Division by an n scale: Aa/n = {a1/n, a2/n, a3/n, a4/n} (12)

Applications using fuzzy numbers are versatile, useful for analyzing problems involving perceptions, uncertainties and performance and quality assessments. Using Google Academic as a basis, with “fuzzy numbers” as the search keyword, 264 studies were located. Using the same keyword and adding “Perception” this resulted in 108 studies; with the “Quality” keyword, 185 works were listed.

Consequently, it is valid to stress some of these studies, such as Pinho et al. (1997Pinho, A. F. de, Montevechi, J.A.B., & Pamplona, E. de O. (1997). Aplicação De Números Fuzzy Triangulares Em Análises De Investimentos Em Situações De Incerteza - Método Baseado Na Teoria Dos Jogos. Encontro Nacional De Engenharia De Produção - ENEGEP.), associating fuzzy numbers with Games Theory for uncertain decision processes for analyzing investments; Montevechi and Pinho (1999Montevechi, J. A. B., & Pinho, A. F. (1999). De Incertezas Em Algoritmos De Programação De Operações. Encontro Nacional De Engenharia De Produção - ENEGEP.), addressing uncertainties in production flow-shop operations programming, based on triangular fuzzy numbers linked to the NEH algorithm; Almeida et al. (2010Almeida, L. N., Moré, J. D., & Villela, L.E. (2010). Avaliação Fuzzy Da Percepção De Empresários Do Apl De Moda Intima De Nova Friburgo Sobre O Desempenho Em Relação À Sustentabilidade Ambiental. XIII Simpósio De Administração Da Produção, Logística E Operações Internacionais-SIMPOI.), exploring how entrepreneurs perceive environmental sustainability actions; Sá et al. (2007Sá, I. I. R. de, More, J. D., & Fernandes, C. A. (2007). Um Enfoque Fuzzy Para Avaliação Das Ações Empresariais Segundo A Percepção Do Consumidor Área Gestão Social E Ambiental. IV Simpósio De Excelência Em Gestão E Tecnologia.) also used triangular numbers to interpret consumer perceptions; Boente et al. (2009Boente, A. N. P., Moré, J. D., & Cosenza, H. J. S. R. (2009). Avaliação Fuzzy da Qualidade de Produtos de Software numa Fundação Pública Estadual. VI Simpósio De Excelência Em Gestão E Tecnologia.), assessed software quality for products developed in a state government foundation; Ibáñez (2018Ibáñez, D. E. S. (2018). Problemas De Valores De Contorno Envolvendo Teoria De Conjuntos Fuzzy [Doutorado, Universidade Estadual De Campinas].), observed Fuzzy Boundary Value Problems (FBVPs), focused on dataset theory precepts and fuzzy numbers; and Silva (2020Silva, M. B. (2020). Um Estudo Sobre Operações Aritméticas Com Números Fuzzy [Master’s degree, Universidade Federal De São Carlos].), working with dataset operations using fuzzy numbers in a government-run middle school.

Another way of dealing with subjective sentences is through the use of Fuzzy Logic, whose inference between the fuzzy datasets uses an if-then form that results in linguistic vector Ã, like μ(x)ILabel 1+μ(x)2Label 2+μ(x)3Label 3, exemplified in this case by three pertinence functions with linguistic labels 1 - 3 and their activated pertinence levels. This vector represents a distribution of possibilities of a specific condition, analyzed in a specific fuzzy dataset. (Oliveira Jr., 1999Oliveira Jr., H. A. (1999). Lógica Difusa - Aspectos Práticos E Aplicações. Interciência.; Ross, 1995Ross, T. J. (1995). Fuzzy Logic With Engineering Applications. Mcgraw-Hill.)

Based on the above-mentioned fuzzy vector, it is then possible to return to the crisp domain (defuzz), underpinning the feasibility of the analyst understanding the extent of the real implications of the inference. Shaw and Simões (1999Shaw, I. S., & Simões, M. G. (1999). Controle E Modelagem Fuzzy (1st ed.). Edgard Blucher-FAPESP.) stress that there are several methods for returning to the crisp domain, after which the real-world context of the decision may be modified. One of the most common defuzzification methods is the Center-of-Maximum (13) which represents a weighted average of the pertinence levels ( μi) ) by the crisp entries Xi, with i being the quantity of linguistic variables, varying from 1 to n (quantity of linguistic variables).

O u t p u t i = i = 1 n μ i × X i i = 1 n μ i (13)

4. MODELING INPUT AND OUTPUT VARIABLES

The input variables for the mathematical model are obtained from an investigation of the literature in sub items 3.1 and 3.2, which relate pertinent attributes to logistics quality assessment, focused on e-commerce. It should be stressed that the attributes are observed from the end-customers standpoint after purchases have been made through the internet.

The analyzed studies indicate a broad range of attributes, many of them with redundancies, despite different nomenclatures. This is why the Ballou (1992Ballou, R. H. (1992). Business Logistics Management (3rd ed.). Prentice Hall., p. 5) approach was selected, as it includes the logistics mission represented by the 7Rs, which are modeled in this sub item by Fuzzy Theory precepts.

Consequently, the attributes described below are used in this project:

  1. Right Product - ability to deliver the order as specified on purchase.

  2. Right Quantity - ability to respond to requests for quantities of the ordered item in full, due to either damages to part or all of the item, or through a reduction in the quantity of the item recorded in the order.

  3. Right Time - this refers to the order cycle time variability, from placing the order through to effective delivery to the end-customer.

  4. Right Condition - this is the ability to deliver the order faultlessly, with no defects or damage during storage and/or transportation.

  5. Right Customer - condition of delivering the order to the end-customer as specified during the act of purchase.

  6. Right Place - this refers to the condition of delivering the order at the place specified during the act of purchase.

  7. Right Price - this reflects the balance between the shipping charged and the amount added to the order, and the delivery time.

In order to generate the IQLE and its partial ratings, a Fuzzy variable was created for each reply to the questionnaire, representing each of the 7Rs. Furthermore, end-customers were asked about the importance of each of the attributes, in terms of their importance.

Five pertinence functions were qualified, identified by labels or linguistic terms as being “very dissatisfied”, “dissatisfied”, “neutral”, “satisfied” and “very satisfied”, recorded according to their respective Fuzzy Integers, developed as set forth in expression 2, resulting in Equations 15 to 19 for a certain discourse universe X => [0,10], in which 0 is the worst rating, meaning the “very dissatisfied” label.

μ ( x ) v e r y d i s s a t i s f i e d ( E I ) = 0 1 1 0 - x + 1 / X (15)

μ ( x ) d i s s a t i s f i e d ( I N ) = 0 0 2 1 x 2 / X + 2 1 3 1 1 / X + 3 1 5 0 - x + 5 2 / X (16)

μ ( x ) n e u t r a l ( N E ) = 4 0 5 1 x - 4 / X + 5 1 6 0 - x + 6 / X (17)

μ ( x ) s a t i s f i e d ( S A ) = 5 0 7 1 x - 5 2 / X + 7 1 8 1 1 / X + 8 1 10 0 - x + 10 2 / X (18)

μ ( x ) v e r y s a t i s f i e d ( E S ) = 9 0 10 1 x - 9 / X (19)

The replies to each item in the questionnaire were aggregated in the Fuzzy Integers, using trapezoidal arithmetical operations as shown in expressions 7 to 12, representing a consensus of the respondents, which also encompasses the level of importance of each one of the 7Rs for each end-customer. The outcome is expressed as a Fuzzy 𝐴 vector, as presented in Ross (1995Ross, T. J. (1995). Fuzzy Logic With Engineering Applications. Mcgraw-Hill.), according to expression 20.

Next, using expression 4, the fuzzy datasets were united, represented by each pertinence function of “very dissatisfied”, “dissatisfied”, “neutral”, “satisfied” and “very satisfied”. Through these results, it is possible to move from the fuzzy domain into the crisp area, through the application of equation 13. This result constitutes a partial indicator for each one of the 7Rs. When all of them are aggregated, they result in the IQLE, which represents a consensus on end-customer perceptions, also within the discourse universe [0,10].

In brief, the procedure for defining the partial indicators is shown in Figure 2, as well as the IQLE.

A ~ = { μ ( x ) E I E I + μ ( x ) I N I N + μ ( x ) N E N E + μ ( x ) S A S A + μ ( x ) E S E S (20)

Figure 2.
Methodological Procedure Adopted for Modeling

5. APPLICATION OF THE MODEL

5.1. Data Collection

The extensive, direct observation survey conducted to obtain quality on perceived data uses a questionnaire accessed via the internet, with multiple-choice, closed, and opinion questions. Each respondent was characterized through questions identifying their profiles, but with no identification by name or any other information. Questions focused on purchases and other questions specific to logistics. All the questions generated metrics associated with e-commerce logistics quality attributes.

For the City of Rio de Janeiro, 180 replies were collected for the composition of the IQLE, from October 4 - 20, 2021. The respondents were characterized in four questions: age bracket, education level, gender, and the city where they received most of their internet purchases.

The general profile of their orders was also established through the questionnaire, examining order frequency, mean product quantity, main (most frequent) delivery company, and mean shipping cost.

In order to rate e-commerce logistics quality, each of the 7Rs was used, representing attributes reflecting their mission. The same number of questions was also used to explore the importance of each one of the seven attributes for end-customers.

5.2. Data Processing

As noted in the methodological procedure Illustrated in Figure 2, Step 1 defined the attributes (subitem 3.1); and in Step 2 they were modeled as Fuzzy Integers, as presented in item 4. Aggregating the end-customer replies (Step 3) was handled through trapezoidal arithmetical operations, resulting in the registration of the equivalent trapezes. These trapezes are linked to attribute levels of importance (Step 4) from the customer standpoint. Table 2 presents the results of the last two steps.

Table 2
Equivalent Trapezes and Levels of Importance of the Attributes

Step 5 of the methodological procedure is rooted in the need to bring the fuzzy datasets together, represented by a Fuzzy vector (expression 20) for each attribute. The results are presented in Table 3.

Table 3
Fuzzy Vectors for each Attribute

5.3. Findings and Analysis

Designed to collect mathematical data for testing and validating the model, the survey begins by characterizing respondent profiles, expressed through gender, age bracket and education. The findings are presented in Figure 3.

Figure 3.
Respondent Profiles

Next, the order profile was explored. It was noted that just over a third (36.7%) of them purchased at least once a month, with a mean of 1 product ordered each month (51%) and free shipping (40.6%). In addition to the five main shipping companies mentioned by the respondents, these three attributes are shown in Figure 4.

Figure 4.
Order profile

As shown in Figure 2 Step 6 (methodological procedure) pursues the objective of this project, recording the need to interpret end-customers perceptions through developing a mathematical model. Partial ratings were defined, based on the 7Rs, which represent the quality of logistics providing operational support for e-commerce, and leading to the IQLE value (Figure 5). The outcomes of these ratings are listed in Table 4.

Figure 5.
Partial Ratings and IQLE

Table 4
Results for Partial Ratings and IQLE

The survey also asked about the main delivery company used for most of the orders placed by each respondent. It was noted that competition is heating up on the e-commerce logistics market, due to new arrivals, with current contenders upgrading their services. This has undermined the prevalence of the Brazilian Post Office (Correios) which is nevertheless a major player with 55% of deliveries, followed by the local E-Bay subsidiary delivery service (Mercado Livre Envios Full) at 32%. This aspect is forcing players to engage in ongoing analysis and constant modifications and innovations in their business procedures.

With a market share over 80% held by just two shippers, the survey collected replies from customers on the seven attributes, in order to define the logistics services profile from the end-customers standpoint. The data presented in Table 4 show that four of the seven attributes analyzed are scored at less than 50% on the scale, indicating that there is still significant headroom for improvement in e-commerce services in Rio de Janeiro, in the view of the end-customer.

In addition to the quality of wares acquired through electronic channels, which is not dependent on logistic services, it is a fact that storage and packaging for shipping may affect the “Right Condition” attribute, which scored 3.13.

In storage facilities, the selection of the floorplan for optimizing space and protecting goods may interfere in the handling and integrity of these loads. For example, for perishable goods, attention must be paid to use-by date, lighting, temperature, moisture, and other aspects. The use of Warehouse Management System (WMS) platforms may offer substantial upgrades in cargo protection.

While packaging is designed to protect products and ensure their integrity, there are other aspects that may intervene, as seen by customers, as this is where they first come into contact with the logistics outcomes. This also reflects indications of care and trust in people shipping the product, and may constitute a comparative advantage in terms of the competition. This can also buttress brands through upgrading their visual identity.

The score for the “Right Customer” attribute was also unsatisfactory at 3.96. It is not uncommon for problems to arise at the start of the order cycle, when keying in delivery address information and recipient data, which may be different from the person actually making the purchase.

For example, one of the fields in the destination address is the ZIP code (CEP) which may also affect the “Right place” attribute. This information may have negative effects on cycle times, in addition to stepping up losses through deliveries to the wrong recipients (at the wrong addresses). In order to minimize this problem, there are computerized platforms that compare a ZIP code to the address keyed in by an end-customer, or even simple solutions that allow automatic completion (and not alteration) of the street data, when keying the ZIP code at the top of the form.

Also scoring around 3 points is the “Right price” attribute, at 3.44. Defining shipping prices at competitive levels is challenging for the logistic system. To do so, several factors are taken into consideration, including the ZIP codes of the sender and the recipient, as well as the cargo characteristics (cubic measurement - load mass x packaging volume, perishability), the added value of the wares, and others.

Along these lines, it is a fact that fractional freight, for example, is one of the factors that increases the price. A possible strategy is known as fulfillment, which encompasses the complete cycle through centralizing inventories from several product suppliers, with shorter separation and preparation (picking) times for orders within the cycle, as well as quicker packaging. This strategy may be adopted by the marketplace, which handles the inventory management and delivers goods to end-customers, which affects the ease of managing the inventory, with better adjustments between demands and capacities.

In this evolving process, it is appropriate to mention e-fulfilment, which includes marketplace integration strategies with back-office actions linked to marketing, sales and finance, as well as the entire logistics process. In this area, information technologies play a leading role, connecting up links in logistics chains and the many different actors involved, with better synchronized flows of goods and data.

The “Right Time” is the attribute with the highest score (7.09) mentioned by end-customers. It appears that companies are meeting their delivery deadlines in terms of variability, with better processes for managing flows of information and goods. They begin with the preparation, transmission, and processing of an order, encompassing inventory management, synchronized operations with suppliers, separating and packing the goods and hand-over to shippers for final delivery, with many variables related to physical and informational aspects that intervene in this issue, but are not visible to customers.

The attribute with the second-highest score from end-customers (6.12) is the “Right Product”. This scores compliance with the items selected for purchase. Very close to 50% on the measurement scale is the “Right Quantity” attribute, at 5.45 points. Which includes questions related to the overall quantities ordered.

The 7Rs rating focuses on the logistics mission; however, for e-commerce, this may underpin excellence in services rendered, with enhanced possibilities of boosting customer loyalty, which in turn contributes to upgrading the entire business.

It is noted that even considering specific scores in simulations using the proposed mathematical model (which represents customer perceptions) it is still feasible to invest in related aspects, such as service reliability, as well as delivery oversight processes and easy access to complaint channels with fast customer service, should any unexpected contingencies arise.

Attempting to embody the aspects listed in the data collection questionnaire, a final question was thus included, in order to allow end-customers to reflect and express their overall views in a qualitative manner (Figure 6).

Figure 6.
IQLE Qualification

6. CONCLUSIONS

Initially, it was concluded that the main objective proposed for this project could be attained through the proposed methodology by generating a mathematical model addressing the possibility of capturing end-customers perceptions of logistics providing operating support for e-commerce.

A case study of Rio de Janeiro produced substantial data for testing and validating this mathematical model, which was considered to be valid and suitable for use in other future data collection projects, in any city. Consequently, it is possible to generate historical datasets that underpin strategic, tactical, and operating decisions, based on future forecasts.

Regarding the analysis of the findings, the possibilities of cross-referencing these data are not exhausted, using different filters, screens, and rankings, as well as the characteristics of the respondents and their orders. This fact indicates versatility, allowing the expansion of other attributes related to generating the IQLE.

REFERENCES

  • Almeida, L. N., Moré, J. D., & Villela, L.E. (2010). Avaliação Fuzzy Da Percepção De Empresários Do Apl De Moda Intima De Nova Friburgo Sobre O Desempenho Em Relação À Sustentabilidade Ambiental. XIII Simpósio De Administração Da Produção, Logística E Operações Internacionais-SIMPOI.
  • Ballou, R. H. (1992). Business Logistics Management (3rd ed.). Prentice Hall.
  • Bittencourt, G. (2001). Inteligência Artificial (2nd ed.). Ed. UFSC.
  • Boente, A. N. P., Moré, J. D., & Cosenza, H. J. S. R. (2009). Avaliação Fuzzy da Qualidade de Produtos de Software numa Fundação Pública Estadual. VI Simpósio De Excelência Em Gestão E Tecnologia.
  • Cordeiro, C. de O., Machado, W.V., Carvalho, R.L.S., Heloisa, M.B.C., & Dacol, S. (2005). A Visão Do Cliente Para Melhoria Da Qualidade Do Sistema De Transporte Coletivo Por Ônibus. XXV Encontro Nacional De Engenharia De Produção.
  • Davidavičienė, V., & Meidutė, I. (2011). Quality of e-Logistics in e-Commerce: Consumer Perception. 10th International Conference - Liberec Economic Forum.
  • De Albuquerque, A. P. G. (2019). Aplicação Do Modelo De Kano Em Companhias Aéreas: Discussão Da Satisfação Dos Clientes [Master’s Degree, Universidade Federal De Pernambuco].
  • De Barros, F. K. (2016). A Qualidade Em Serviços Logísticos Como Um Fator Relevante Para A Lealdade Do Cliente De Comércio Eletrônico [Dissertation, Universidade Federal do Espírito do Santo]
  • De Farias, B. L. A., & De Oliveira, L.A.B. (2020). Aplicação Do Modelo De Kano Para Avaliação Da Qualidade Em Serviços Prestados Por Um Restaurante Na Cidade Do Assú/RN [Trabalho de Conclusão de Curso, Universidade Federal Rural do Semi-Árido].
  • Deming, W. E. (1990). Qualidade: A Revolução Da Administração. Editora Saraiva.
  • Dias, J. E. G. (2018). Atributos de qualidade: aplicação do modelo de Kano em uma indústria especializada na produção e comercialização de artefatos de borracha localizada na região Sul do Brasil. XII EEPA - Encontro de Engenharia de Produção Agroindustrial, Paraná.
  • E-Commercebrasil (2021). 1 em cada 4 brasileiros querem manter compras online diárias após a pandemia. Retrieved November 17, 2021, from Retrieved November 17, 2021, from https://www.ecommercebrasil.com.br/noticias/brasileiros-compras-online-coronavirus/
    » https://www.ecommercebrasil.com.br/noticias/brasileiros-compras-online-coronavirus/
  • Fonseca, M. J., & Borges Jr., A. A. (2002). O Uso Da Pesquisa De Satisfação Do Consumidor Como Instrumento De Política Pública: O Potencial De Uso No Caso Do Transporte Coletivo De Porto Alegre. Revista Interdisciplinar De Marketing, 1(3), 38-50.
  • Gajewska, T., Zimon, D., Kaczor, G., & Madzík, P. (2020). The impact of the level of customer satisfaction on the quality of e-commerce services. International Journal of Productivity and Performance Management, 69(4), 666-684.
  • Guimaraes Junior, D. S., De Sant'anna, C. H. M., Soares, E. J. O., De Melo, F. J. C., & De Medeiros, D. D. (2020). Measurement of logistics service quality of e-commerce. International Journal of Logistics Systems and Management, 37(1), 1-17.
  • Hua, W., & Jing, Z. (2015). An Empirical Study on E-commerce Logistics Service Quality and Customer Satisfaction. The Fourteen Wuhan International Conference on E-Business - WHICEB.
  • Ibáñez, D. E. S. (2018). Problemas De Valores De Contorno Envolvendo Teoria De Conjuntos Fuzzy [Doutorado, Universidade Estadual De Campinas].
  • Lara, J. E., Afonso, T., Elias, R. K., Afonso, B. P. D., & Tissot-Lara, T. A. (2020). Marketing E Logística: Em Busca Da Satisfação E Lealdade Do Consumidor De Compras On-Line. Revista Horizontes Interdisciplinares da Gestão, 4(2), 80-103.
  • Lin, Y., Luo, J., Cai, S., Ma, S. & Rong, K. (2016). Exploring the service quality in the e-commerce context: a triadic view. Industrial Management & Data Systems, 116(3), 388-415.
  • Lopes, I. L., Santos, F. A. O., & Pinheiro, C. A. M. (2014) Inteligência Artificial (1st ed.). Elsevier.
  • Maia, L. C. de C., Souza Filho, R. G. de, & Oliveira, M. T. T. (2019). Avaliação Da Percepção Dos Atributos De Compra Relacionados Ao E-Commerce: Um Levantamento De Dados. XLIII Encontro da ANPAD - EnANPAD, São Paulo.
  • Marchesini, M. M. P., & Alcantara, R. L. C. (2012). Conceituando O Serviço Logístico E Seus Elementos. Revista de Ciência & Tecnologia, 17(33), 65-86.
  • Montevechi, J. A. B., & Pinho, A. F. (1999). De Incertezas Em Algoritmos De Programação De Operações. Encontro Nacional De Engenharia De Produção - ENEGEP.
  • Oliveira Jr., H. A. (1999). Lógica Difusa - Aspectos Práticos E Aplicações. Interciência.
  • Pereira, B. A., & Pereira, J. M. (2020). A Importância da Logística no E-Commerce. XI FATECLOG, São Paulo. Retrieved from, https://fateclog.com.br/anais/2020/v4/A%20IMPORTÂNCIA%20DA%20LOGÍSTICA%20NO%20ECOMMERCE.%20.BRUNO%20APARECIDO%20PEREIRA,%20JOSEANE%20MACIEL%20PEREIRA.pdf
    » https://fateclog.com.br/anais/2020/v4/A%20IMPORTÂNCIA%20DA%20LOGÍSTICA%20NO%20ECOMMERCE.%20.BRUNO%20APARECIDO%20PEREIRA,%20JOSEANE%20MACIEL%20PEREIRA.pdf
  • Pinho, A. F. de, Montevechi, J.A.B., & Pamplona, E. de O. (1997). Aplicação De Números Fuzzy Triangulares Em Análises De Investimentos Em Situações De Incerteza - Método Baseado Na Teoria Dos Jogos. Encontro Nacional De Engenharia De Produção - ENEGEP.
  • Porto, E. C., Machado, C. E., Souza, E. P. S., Pachá, F. R., & Kasaya, G. R. (2019). Atributos Logísticos Na Satisfação Do Consumidor De E-Commerce. Administração de Empresas em Revista, 1(14), 185-204.
  • Prodanov, C. C., & Freitas, E. C. (2013). Metodologia Do Trabalho Científico: Métodos E Técnicas Da Pesquisa E Do Trabalho Acadêmico (2nd ed.). Universidade Feevale.
  • Rachmawati, D. Z., & Agus, A.A. (2020). E-Service and Logistics Service Quality in E-Commerce, Study Case: Shopee Indonesia. 3rd International Conference on Computer and Informatics Engineering (IC2IE), Indonesia.
  • Rodrigues, M. O. (2006). Avaliação Da Qualidade Do Transporte Coletivo Da Cidade De São Carlos [Master’s degree, Universidade De São Paulo].
  • Ross, T. J. (1995). Fuzzy Logic With Engineering Applications. Mcgraw-Hill.
  • Sá, I. I. R. de, More, J. D., & Fernandes, C. A. (2007). Um Enfoque Fuzzy Para Avaliação Das Ações Empresariais Segundo A Percepção Do Consumidor Área Gestão Social E Ambiental. IV Simpósio De Excelência Em Gestão E Tecnologia.
  • Shaw, I. S., & Simões, M. G. (1999). Controle E Modelagem Fuzzy (1st ed.). Edgard Blucher-FAPESP.
  • Silva, M. B. (2020). Um Estudo Sobre Operações Aritméticas Com Números Fuzzy [Master’s degree, Universidade Federal De São Carlos].
  • Soares, R. A. D., & De Oliveira, L. A. B. (2019). Aplicação Do Modelo Kano Para Avaliação Da Qualidade Em Serviços De Veículos Motorizados [Trabalho de Conclusão de Curso, Universidade Federal Rural do Semi-Árido].
  • Sucena, M. P., & Andrade, T. B. (2021). Proposta de BSC com Modelo Neuro-Fuzzy: Um Estudo de Caso. Revista Engenharia e Tecnologia, 13(13), 110-122.
  • Tanaka, K. (1997). An Introduction To Fuzzy Logic For Practical Applications. Springer-Verlag.
  • Tontini, G., & Zanchett, R. (2010). Atributos de satisfação e lealdade em serviços logísticos.Gestão & Produção, 17(4), 801-816. https://doi.org/10.1590/S0104-530X2010000400013
    » https://doi.org/10.1590/S0104-530X2010000400013
  • Vasić, N., Kilibarda, M., Andrejić, M., & Jović, S. (2021). Satisfaction is a function of users of logistics services in e-commerce. Technology Analysis & Strategic Management 33(7), 813-828. https://doi.org/10.1080/09537325.2020.1849610
    » https://doi.org/10.1080/09537325.2020.1849610
  • Yang, Y., Humphreys, P., & McIvor, R. (2006). Business service quality in an e‐commerce environment. Supply Chain Management, 11(3), 195-201. https://doi.org/10.1108/13598540610662086
    » https://doi.org/10.1108/13598540610662086

Edited by

EDITOR-IN-CHIEF

Talles Vianna Brugni https://orcid.org/0000-0002-9025-9440

ASSOCIATE EDITOR

Emerson Mainardes https://orcid.org/0000-0003-2525-275X

Publication Dates

  • Publication in this collection
    08 Jan 2024
  • Date of issue
    2024

History

  • Received
    13 Dec 2021
  • Reviewed
    18 Feb 2022
  • Accepted
    22 Sept 2022
  • Published
    03 June 2023
Fucape Business School Av. Fernando Ferrari, 1358, Boa Vista, 29075-505, Vitória, Espírito Santo, Brasil, (27) 4009-4423 - Vitória - ES - Brazil
E-mail: bbronline@bbronline.com.br