Acessibilidade / Reportar erro

Clues for the Paradigmatic Development of Online Qualitative Methods

Pistas para o Desenvolvimento Paradigmático dos Métodos de Pesquisa Qualitativa On-Line

ABSTRACT

Objective:

in this paper, we problematize how online methods were reduced to mere adaptations from previous data collection techniques, and then discuss how some of the idiosyncratic properties of the online scope may drive the development of future, paradigmatic, online qualitative methods.

Proposition:

we identified five clues for the paradigmatic development of online qualitative methods: (1) the new socialities allowed by online interactions; (2) the processes involved in asserting identities and selves online; (3) the increasing difficulty in distinguishing what is private and what is public online, and what does privacy mean in this context; (4) the increase of participants’ agency in online qualitative research; and (5) the declining distinction between offline and online social phenomena.

Conclusion:

by using ontological and epistemological assumptions that do not consider the specificities of online experiences, and by focusing excessively on adapting known methods to the new settings, we researchers are bound to conceive the online experience and operate in it using offline categories. This way, we might be missing the opportunity to develop native, paradigmatic, online qualitative methods that, ultimately, would allow for a better understanding of the phenomena we investigate.

Keywords:
qualitative methods; online research; data collection; data analysis; methods development

RESUMO

Objetivo:

neste artigo, problematizamos como os métodos de pesquisa on-line foram reduzidos a adaptações de técnicas anteriores de coleta de dados e discutimos como as propriedades idiossincráticas dos ambientes on-line podem impulsionar o desenvolvimento paradigmático de métodos qualitativos on-line.

Proposta:

identificamos cinco pistas para o desenvolvimento paradigmático de métodos de pesquisa qualitativa on-line: (1) as novas socialidades que emergem das interações on-line; (2) os processos envolvidos na afirmação de identidades e selves on-line; (3) a crescente dificuldade na distinção entre privado e público no ambiente on-line, e o que a privacidade significa nesse contexto; (4) o aumento da agência dos participantes em pesquisas qualitativas on-line; e (5) a crescente indistinção entre os fenômenos sociais em seus contextos on-line e off-line.

Conclusão:

ao utilizar ontologias e epistemologias que não consideram as especificidades da experiência on-line, e ao focar excessivamente na adaptação de métodos conhecidos aos novos ambientes, nós pesquisadores ficamos limitados a conceber a experiência on-line e a operar nela através de categorias off-line. Dessa maneira, perdemos a oportunidade de desenvolver métodos nativos e paradigmáticos de pesquisa qualitativa on-line, que poderiam proporcionar um melhor entendimento dos fenômenos que investigamos.

Palavras-chave:
métodos qualitativos; pesquisa on-line; coleta de dados; análise de dados; desenvolvimento de métodos

Someone who discovers a new world cannot in one glance know all its properties.

- Voltaire (1734/2007).

INTRODUCTION

Online research has been part of the academic landscape since the 1990s. From then on, it has been used, by and large, to reduce costs; automate data collection; contact hard-to-reach participants; spread samples geographically; reduce participants’ inhibitions; facilitate the use of artwork, images, audio, etc.; among other conveniences (Genoe, Liechty, Marston, & Sutherland, 2016Genoe, M. R., Liechty, T., Marston, H. R., & Sutherland, V. (2016). Blogging into retirement: Using qualitative online research methods to understand leisure among baby boomers. Journal of Leisure Research, 48(1), 15-34. https://doi.org/10.18666/jlr-2016-v48-i1-6257
https://doi.org/10.18666/jlr-2016-v48-i1...
; Krantz & Reips, 2017Krantz, J. H., & Reips, U. D. (2017). The state of web-based research: A survey and call for inclusion in curricula. Behavior Research Methods, 49(5), 1621-1629. https://doi.org/10.3758/s13428-017-0882-x
https://doi.org/10.3758/s13428-017-0882-...
; Wood, Griffiths, & Eatough, 2004Wood, R. T., Griffiths, M. D., & Eatough, V. (2004). Online data collection from video game players: Methodological issues. CyberPsychology & Behavior, 7(5), 511-518. https://doi.org/10.1089/cpb.2004.7.511
https://doi.org/10.1089/cpb.2004.7.511...
). More recently, as the COVID-19 pandemic limited or even shut researchers’ physical access to the field, online research has also helped contact participants remotely. Countless studies around the world moved online with significant changes in their initial objectives, and it is not unreasonable to believe that the ways in which participants engage with researchers “are, and will continue to be, implicated going forward” (Howllett, 2021, p. 2) (see also Weissman, Klump, & Rose, 2020Weissman, R., Klump, K., & Rose, J. (2020). Conducting eating disorders research in the time of COVID-19: A survey of researchers in the field. International Journal of Eating Disorders, 53(7), 1171-1181. https://doi.org/10.1002/eat.23303
https://doi.org/10.1002/eat.23303...
for a localized example of how the pandemic affected a research field). More than ever before, reflecting on the ontological and epistemological issues concerning online research methods has become a pressing issue.

Methodological discussions about online research go back to its very beginning, in the 1990s (e.g., Coomber, 1997Coomber, R. (1997). Using the internet for survey research. Sociological Research Online, 2(2), 49-58. https://doi.org/10.5153/sro.73
https://doi.org/10.5153/sro.73...
; Hewson, Laurent, & Vogel, 1996Hewson, C., Laurent, D., & Vogel, C. (1996). Proper methodologies for psychological and sociological studies conducted via the internet. Behavior Research Methods, Instruments, & Computers, 28(2), 186-191. https://doi.org/10.3758/BF03204763
https://doi.org/10.3758/BF03204763...
; Michalak & Szabo, 1998Michalak, E., & Szabo, A. (1998). Guidelines for internet research: An update. European Psychologist, 3(1), 70-75. https://doi.org/10.1027/1016-9040.3.1.70
https://doi.org/10.1027/1016-9040.3.1.70...
; Robbin, 1992Robbin, A. (1992). Social scientists at work on electronic research networks. Internet Research, 2(2), 6-30. https://doi.org/10.1108/eb047257
https://doi.org/10.1108/eb047257...
; Schrum, 1995Schrum, L. (1995). Framing the debate: Ethical research in the information age. Qualitative Inquiry, 1(3), 311-326. https://doi.org/10.1177/107780049500100303
https://doi.org/10.1177/1077800495001003...
). Understandably, these early concerns regarded credibility. Because access to the web was limited in the 1990s, bias and generalizability were prime issues back then, and reviewers and editors needed to be convinced that online studies were rigorous (Stanton & Rogelberg, 2001Stanton, J. M., & Rogelberg, S. G. (2001). Using internet/intranet web pages to collect organizational research data. Organizational Research Methods 4(3), 200-217. https://doi.org/10.1177/109442810143002
https://doi.org/10.1177/109442810143002...
). In this context, online researchers had few incentives to develop paradigmatic methods, that is, methods tailored for the new (online) scope. Instead, they held on to traditional and accredited methods, simply transposing them to the new research environment. Online research methods, then, came to be, often and to a large extent, mere adaptations of previous methods (Mawer, 2016Mawer, M. (2016). Observational practice in virtual worlds: Revisiting and expanding the methodological discussion. International Journal of Social Research Methodology, 19(2), 161-176. https://doi.org/10.1080/13645579.2014.936738
https://doi.org/10.1080/13645579.2014.93...
), with these adaptations focusing almost exclusively on data collection techniques. The value of online research was reduced to its convenience and its methodological discussion narrowed to the ethical ambiguities of the new scope (for more on the reducing the methodological debate to ethical issues, see: Battles, 2010Battles, H. T. (2010). Exploring ethical and methodological issues in internet-based research with adolescents. International Journal of Qualitative Methods, 9(1), 27-39. https://doi.org/10.1177/160940691000900104
https://doi.org/10.1177/1609406910009001...
; Morison, Gibson, Wigginton, & Crabb, 2015Morison, T., Gibson, A. F., Wigginton, B., & Crabb, S. (2015). Online research methods in psychology: Methodological opportunities for critical qualitative research. Qualitative Research in Psychology, 12(3), 223-232. https://doi.org/10.1080/14780887.2015.1008899
https://doi.org/10.1080/14780887.2015.10...
).

Yet, the lack of paradigmatic development of online methods struck quantitative and qualitative research differently. The nature of quantitative research, with its sharp distinction between collecting and analyzing the data, and its abstract and standardized analyses (Creswell, 2009Creswell, J. (2009). Research design: Qualitative, quantitative and mixed methods approaches (3 ed.). Thousand Oaks, CA: Sage Publications.), asserted the use of online research simply as a convenient medium for collecting data. Although quantitative researchers might speculate about fundamental changes in their methods (e.g., Jank & Shmueli, 2006Jank, W., & Shmueli, G. (2006). Functional data analysis in electronic commerce research. Statistical Science, 21(2), 155-166. https://doi.org/10.1214/088342306000000132
https://doi.org/10.1214/0883423060000001...
), their methodological concerns regarding online research have not changed much since the 1990s. The bulk of their discussion, even the most recent, centers on issues such as biases, reliability, validity, transferability, variability, data integrity, and accuracy (e.g., Anwyl-Irvine, Massonnié, Flitton, Kirkham, & Evershed, 2020Anwyl-Irvine, A., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. (2020). Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods, 52, 388-407. https://doi.org/10.3758/s13428-019-01237-x
https://doi.org/10.3758/s13428-019-01237...
; Klein, Tyler-Parker, & Bastian, 2020Klein, J., Tyler-Parker, G., & Bastian, B. (2020). Measuring psychological distress among Australians using an online survey. Australian Journal of Psychology, 72(3), 276-282. https://doi.org/10.1111/ajpy.12283
https://doi.org/10.1111/ajpy.12283...
; Man, Campbell, Tabana, & Wouters, 2021Man, J. D., Campbell, L., Tabana, H., & Wouters, E. (2021). The pandemic of online research in times of COVID-19. BMJ Open, 11(2), e043866. https://doi.org/10.1136/bmjopen-2020-043866
https://doi.org/10.1136/bmjopen-2020-043...
; Miller, Guidry, Dahman, & Thomson, 2020Miller, C., Guidry, J., Dahman, B., & Thomson, M. (2020). A tale of two diverse qualtrics samples: Information for online survey researchers. Cancer Epidemiology, Biomarkers & Prevention, 29(4), 731-735. https://doi.org/10.1158/1055-9965.EPI-19-0846
https://doi.org/10.1158/1055-9965.EPI-19...
; Pozzar et al., 2020Pozzar, R., Hammer, M., Underhill-Blazey, M., Wright, A., Tulsky, J., Hong, F., Gundersen, D., & Berry, D. (2020). Threats of bots and other bad actors to data quality following research participant recruitment through social media: cross-sectional questionnaire. Journal of Medical Internet Research, 22(10), e23021. https://doi.org/10.2196/23021
https://doi.org/10.2196/23021...
; Pronk, Wiers, Molenkamp, & Murre, 2020Pronk, T., Wiers, R., Molenkamp, B., & Murre, J. (2020). Mental chronometry in the pocket? Timing accuracy of web applications on touchscreen and keyboard devices. Behavior Research Methods, 52, 1371-1382. https://doi.org/10.3758/s13428-019-01321-2
https://doi.org/10.3758/s13428-019-01321...
; Upadhyay & Lipkovich, 2020Upadhyay, U., & Lipkovich, H. (2020). Using online technologies to improve diversity and inclusion in cognitive interviews with young people. BMC Medical Research Methodology, 20, 159. https://doi.org/10.1186/s12874-020-01024-9
https://doi.org/10.1186/s12874-020-01024...
; Welch, 2020Welch, T. (2020). Is Facebook a viable recruitment tool? Nurse Researcher, 28(2), 9-13. https://doi.org/10.7748/nr.2019.e1682
https://doi.org/10.7748/nr.2019.e1682...
).

This is not to say that online technology does not affect participant selection in qualitative research. Crowdsourcing platforms, such as Amazon’s Mturk (or even social networks such as Instagram, Facebook, Twitter, etc.), which are now ubiquitously used for quantitative studies, can also be used to advertise qualitative research and recruit participants, triggering all the concerns related to the algorithm-managed social life. However, qualitative researchers, who collect and analyze their data in parallel, quickly saw their concerns growing well beyond ethical and sampling issues. They realized they needed different skills to operate online (e.g., O’Connor & Madge, 2001O’Connor, H., & Madge, C. (2001). Cyber-mothers: Online synchronous interviewing using conferencing software. Sociological Research Online, 5(4), 102-117. https://doi.org/10.5153/sro.543
https://doi.org/10.5153/sro.543...
), that they should use “online methods as a distinct methodological practice, rather than as a reproduction of traditional techniques using the Internet” (Bouchard, 2016Bouchard, K. L. (2016). Anonymity as a double-edge sword: Reflecting on the implications of online qualitative research in studying sensitive topics. The Qualitative Report, 21(1), 59-67. https://doi.org/10.46743/2160-3715/2016.2455
https://doi.org/10.46743/2160-3715/2016....
, p. 59). Online research strategies based on previous, face-to-face methods should not be employed in an insensitive way (Riley, Evans, Griffin, Morey, & Murphy, 2015Riley, S., Evans, A., Griffin, C., Morey, Y., & Murphy, H. (2015). Crossing into the digital realm. The Psychologist, 28(8), 652-655. Retrieved from http://eprints.uwe.ac.uk/26595
http://eprints.uwe.ac.uk/26595...
) because “a tool kit of qualitative methods cannot simply be transposed onto an online setting” (Gregory, 2018Gregory, K. (2018). Online communication settings and the qualitative research process: Acclimating students and novice researchers. Qualitative Health Research, 28(10), 1610-1620. https://doi.org/10.1177/1049732318776625
https://doi.org/10.1177/1049732318776625...
, p. 1611) (see also Kaun, 2010Kaun, A. (2010). Open-ended online diaries: Capturing life as it is narrated. International Journal of Qualitative Methods, 9(2), 133-148. https://doi.org/10.1177/160940691000900202
https://doi.org/10.1177/1609406910009002...
). Instead, researchers should consider the opportunities and limitations that are specific to online research (Willis, 2012Willis, P. (2012). Talking sexuality online-technical, methodological and ethical considerations of online research with sexual minority youth. Qualitative Social Work, 11(2), 141-155. https://doi.org/10.1177/1473325011400488
https://doi.org/10.1177/1473325011400488...
), let go of the tradition and adapt (Kozinets, Scaraboto, & Parmentier, 2018Kozinets, R., Scaraboto, D., & Parmentier, M. (2018). Evolving netnography: How brand auto-netnography, a netnographic sensibility, and more-than-human netnography can transform your research. Journal of Marketing Management, 34(3-4), 231-242. https://doi.org/ 10.1080/0267257X.2018.1446488
https://doi.org/ 10.1080/0267257X.2018.1...
). Ultimately, doing online qualitative research would require shifting basic epistemological assumptions (Murthy, 2008Murthy, D. (2008). Digital ethnography: An examination of the use of new technologies for social research. Sociology, 42(5), 837-855. https://doi.org/10.1177/0038038508094565
https://doi.org/10.1177/0038038508094565...
, p. 838) and questioning “a priori methodological certainties” (Baym & Markham, 2009Baym, N., & Markham, A. (2009). Making smart choices on shifting ground. In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 7-19). Thousand Oaks, CA: Sage Publications., p. 8).

Claims like these sprout the fundamental assumption of this paper: if the online scope is substantially distinct than those which originated traditional qualitative methods, if it has specific properties, operates by its own rules, allows for different interaction patterns, etc., then it would require equally distinct ways of conducting qualitative research in order to realize all of its potential, to tackle it using its own terms. Mere new data collection techniques would not suffice. We should also be looking for new analyzing techniques and even new methods per se. The challenge, though, as Marres (2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
) posits, is to identify the possible ingredients of these novel online methods and techniques. What are the ‘clues’ for this paradigmatic development of online qualitative research methods? Where to find them?

In this paper, we explore five of these ‘clues’ to the paradigmatic development of online qualitative methods, resulting from a systematic review of the literature. Each ‘clue’ reveals an idiosyncratic attribute of the online scope that might support future developments of online qualitative methods. The clues were found in: (1) the new socialities allowed by online interactions; (2) the processes involved in asserting identities and selves online; (3) the increasing difficulty in distinguishing what is private and what is public online, and what does privacy mean in this context; (4) the increase of participants’ agency in online qualitative research; and (5) the declining distinction between offline and online social phenomena.

THE LITERATURE REVIEW

To identify in the literature what could be the most fertile topics for this methodological discussion, we searched the Web of Science Core Collection (WoS) for any English-written journal article discussing online qualitative methods. Our search argument, which returned 281 articles published between 1997 and 2021, was

(TS=(“online research” AND method)) AND LANGUAGE: (English) AND DOCUMENT TYPES: (Article).

We then screened these articles in two rounds. In the first screening, after reading titles and abstracts, we excluded 187 articles using the following criteria: (a) articles in which the expression “online research” meant a simple internet search (11 articles); (b) articles reporting researches ‘about’ the online scope (63 articles); (c) articles simply reporting an online research per se, featuring no methodological discussion (110 articles); and (d) spurious results from our query (three articles).

For the second screening, we downloaded and read 89 of the 94 remaining articles (we could not access four of them, and one was duplicate). We, then, selected out those articles exclusively addressing quantitative methods (35 articles). Because of the deeper contact with the articles, we found eight additional articles that did not address any methodological issue whatsoever. We ended the second screening with 46 articles. A schematic account of the screenings is presented in Figure 1.

Figure 1
The literature review sampling process.

Identifying the clues

By reviewing the literature, we found that scholars first assumed that their challenge was to mimic previous forms of interaction. They were still based in the erroneous “physiognomic notion that the face and the body are the only ‘true’ sources which can reveal the character of a person” (Featherstone & Burrows, 1995Featherstone, M., & Burrows, R. (1995). Cultures of technological embodiment: An introduction. Body & Society, 1(3-4), 1-19. https://doi.org/10.1177/1357034X95001003001
https://doi.org/10.1177/1357034X95001003...
, p. 5), which meant a sharp distinction between the online scope and the ‘real world.’

However, the online scope is not a surrogate reality. It is a legitimate part of ‘real world’ and online interactions are an authentic form of human interaction. Online research is not a poor reproduction of other research strategies. In fact, it offers new opportunities. Untied from the old assumptions, researchers are discovering that “mediated approaches can be immersive in ways not typically discussed or even previously realized” (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 5) (see also CohenMiller, Schnackenberg, & Demers, 2020Miller, C., Guidry, J., Dahman, B., & Thomson, M. (2020). A tale of two diverse qualtrics samples: Information for online survey researchers. Cancer Epidemiology, Biomarkers & Prevention, 29(4), 731-735. https://doi.org/10.1158/1055-9965.EPI-19-0846
https://doi.org/10.1158/1055-9965.EPI-19...
), that “an oral culture is different from a written culture, and the culture of the Internet is different from both” (Holge-Hazelton, 2002Holge-Hazelton, B. (2002). The internet: A new field for qualitative inquiry?. Forum Qualitative Sozialforschung, 3(2). https://doi.org/10.17169/fqs-3.2.854
https://doi.org/10.17169/fqs-3.2.854...
, p. 4), and that asynchronous communication occurring in a non-physical space “should not be seen as inferior data, rather it is different” (Wood et al., 2004Wood, R. T., Griffiths, M. D., & Eatough, V. (2004). Online data collection from video game players: Methodological issues. CyberPsychology & Behavior, 7(5), 511-518. https://doi.org/10.1089/cpb.2004.7.511
https://doi.org/10.1089/cpb.2004.7.511...
, p. 515). Ultimately, they are concluding that, in order to enact traditional methods online, they need to rely on entities that are not those for which these methods were designed, thus, they conclude, the difference between online and offline research includes not only material conditions but also its ‘substance’ (Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
).

Now, researchers are being challenged to move forward by asking questions that could only be answered using online research (Griffiths, 2012Griffiths, M. D. (2012). The use of online methodologies in studying paraphilias-A review. Journal of Behavioral Addictions, 1(4), 143-150. https://doi.org/10.1556/JBA.1.2012.4.1
https://doi.org/10.1556/JBA.1.2012.4.1...
); making use of “new technologies for data collection, analysis and visualization enable[ing] the further elaboration of existing methods and the development of new ones” (Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
, p. 141); and eventually “know[ing] the world in ways not previously possible with tools still to be envisaged … [a prospect] that will have widespread methodological implications for social research” (Lee, Fielding, & Blank, 2017Lee, R., Fielding, N., & Blank, G. (2017). Online research methods in the social sciences: An editorial introduction. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 3-16). Thousand Oaks, CA: Sage Publications., p. 13) (see also Kozinets, 2002Kozinets, R. (2002). The field behind the screen: Using netnography for marketing research in online communities. Journal of Marketing Research, 39(1), 61-72. https://doi.org/10.1509/jmkr.39.1.61.18935
https://doi.org/10.1509/jmkr.39.1.61.189...
).

Next, we discuss five ways to ‘know the world in ways not previously possible,’ that is, five idiosyncrasies of the online scope, retrieved from the literature review, that might foster the paradigmatic development of online qualitative methods.

New socialities

One of the greatest challenges that online qualitative researchers face is the ‘ontological complexity’ of the online scope (Corti & Fielding, 2016Corti, L., & Fielding, N. (2016). Opportunities from the digital revolution: Implications for researching, publishing, and consuming qualitative research. SAGE Open, 6(4). https://doi.org/10.1177/2158244016678912
https://doi.org/10.1177/2158244016678912...
). The intrinsic capacities of online technology, such as its ubiquity, and its innumerable alternative uses not only “shift how people make sense of and live their everyday lives” (Baym & Markham, 2009Baym, N., & Markham, A. (2009). Making smart choices on shifting ground. In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 7-19). Thousand Oaks, CA: Sage Publications., p. 7), but also enable the creation of new social phenomena. “Each technological development enables new means for forming and maintaining social relationships, while rendering some types of social relationship less critical or obsolete” (Fischer, Lyon, & Zeitlyn, 2017Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
https://doi.org/10.4135/9781473957992.n3...
, p. 614). Researchers are increasingly convinced that the online scope constitutes a different kind of sociality, hence the need for methodological development.

For example, participants tend to consider online conversations more reserved than face-to-face interviews (which are normally conducted in public spaces). Because of this, online conversations tend to be longer than in-person interviews and participants tend to expose more intimate details about themselves (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 7). Researchers’ experience shows that by using online conversations it is easier to address sensitive or personal issues that would otherwise be difficult to discuss face-to-face, especially if anonymity is granted (Genoe et al., 2016Genoe, M. R., Liechty, T., Marston, H. R., & Sutherland, V. (2016). Blogging into retirement: Using qualitative online research methods to understand leisure among baby boomers. Journal of Leisure Research, 48(1), 15-34. https://doi.org/10.18666/jlr-2016-v48-i1-6257
https://doi.org/10.18666/jlr-2016-v48-i1...
; Wood et al., 2004Wood, R. T., Griffiths, M. D., & Eatough, V. (2004). Online data collection from video game players: Methodological issues. CyberPsychology & Behavior, 7(5), 511-518. https://doi.org/10.1089/cpb.2004.7.511
https://doi.org/10.1089/cpb.2004.7.511...
).

The former assumption that online interactions could never attain the same richness of in-person meetings is being replaced with the discovery of new ways to embed in the field remotely and to access previously unobserved angles of these fields. Researchers detected that mediated approaches can, ‘paradoxically,’ yield a fuller picture of their participants who, in a more casual environment such as those of online research, are prone to show particular aspects of their lives and identities, aspects that they would not disclose in a typical face-to-face setting (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
).

But online qualitative data is not only richer. Researchers’ immersion in the field should be carefully considered because data collected online might demand additional or even new techniques for its analysis. Besides, the dynamics of interaction between researchers and participants are likely to also occur when people interact online outside of research contexts. Online interactions might change the way social relations operate.

Another interesting assertion is made by Schiek and Ullrich (2017Schiek, D., & Ullrich, C. G. (2017). Using asynchronous written online communications for qualitative inquiries: A research note. Qualitative Research, 17(5), 589-597. https://doi.org/10.1177/1468794117690216
https://doi.org/10.1177/1468794117690216...
). They demonstrate how the exam of asynchronous online communication offers the opportunity to inspect early stages of social constitution of meaning. This would provide researchers - especially qualitative researcher, who are usually interested in understanding meaning and experience - with a window to the boundaries of sociality, enabling them to grasp processes lying between subjectivity (internal dialogue) and objectivity (public discourse), that is, experience that is not socially consolidated. Think, for instance, of the reflexive tone employed in social media posts. And, again, the appearance of an ‘observable internal dialogue’ is not just about researchers’ access to a new kind of data. It is also a new and complex social phenomenon.

New phenomena and new methods elicited by technology “will, of course, co-occur and will quickly converge” (Fischer et al., 2017Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
https://doi.org/10.4135/9781473957992.n3...
, p. 612). Ontological changes demand epistemological and methodological changes, for what else but ontological changes could “bring into sharp relief previously assumed and invisible epistemologies and practices of inquiry”? (Baym & Markham, 2009Baym, N., & Markham, A. (2009). Making smart choices on shifting ground. In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 7-19). Thousand Oaks, CA: Sage Publications., p. 7).

Identity, self, personas, and avatars

One of the reasons for the early distrust of online research is the fact that people may falsify their identities online. Behind screen names and avatars, people could very easily present false selves. This ‘license,’ granted by technology, would allow people not to ‘be themselves,’ if such thing could ever be possible.

At the same time, though, researchers are using the internet to observe participants in informal settings - at home, for example - and access aspects of their identities not easily disclosed anywhere else. That became especially clear in the COVID-19 pandemic when “more of our ‘real lives’ (including both our work and social engagements) are happening virtually” (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 9). These new windows to participants’ lives help researchers explore the intersections of their identities, which can be meaningful (Craig et al., 2020Craig, S., Eaton, A., Pascoe, R., Egag, E., McInroy, L., Fang, L., Austin, A., & Dentato, M. (2020). QueerVIEW: Protocol for a technology-mediated qualitative photo elicitation study with sexual and gender minority youth in ontario, Canada. JMIR Research Protocols, 9(11), e20547. https://doi.org/10.2196/20547
https://doi.org/10.2196/20547...
).

Deeper developments, though, come when researchers become aware that the notion of identity in the online scope may not be univocal. For example, multiple aliases, personas, and avatars may all be performed by a single person. Conversely, a single persona or avatar may be managed by several people (not to mention the internet bots, which also shape, sometimes decisively, the online landscape - for more on bots and fraudulent behavior in surveys, see Pozzar et al., 2020Pozzar, R., Hammer, M., Underhill-Blazey, M., Wright, A., Tulsky, J., Hong, F., Gundersen, D., & Berry, D. (2020). Threats of bots and other bad actors to data quality following research participant recruitment through social media: cross-sectional questionnaire. Journal of Medical Internet Research, 22(10), e23021. https://doi.org/10.2196/23021
https://doi.org/10.2196/23021...
). However, the aliases, personas, and avatars do not function simply as pointers to an external identity or self, nor do they function only as local representations. They are more than pointers and representations; they are something akin to what is called identity. That is why online researchers must provide anonymity not only to the participants’ actual names but also, in many cases, to their screen names.

Thus, researchers had to replace their assumptions that people use the online scope to create false selves, to forge identities different from whom they really are. Identity has been displaced and cannot be “grounded [anymore] in the assumption that one’s self is located in the physical body that exists as an essential and classifiable object in a state of nature” (Broad & Joos, 2004Broad, K. L., & Joos, K. E. (2004). Online inquiry of public selves: Methodological considerations. Qualitative Inquiry, 10(6), 923-946. https://doi.org/10.1177/1077800404265720
https://doi.org/10.1177/1077800404265720...
, p. 924). It is possible that the masks worn in ‘real-life’ (even to ourselves, psychologically speaking) have their effects enhanced online. However, that would not be a misleading feature of the online scope. It would be a real feature of the world, which includes our experience online. Because of the inherent characteristics of technology, we exert more freedom regarding our self-assertion online, and the evolution of online interacting tools is a testimony to that. Are not they increasingly centered on identity assertion? Methodologically speaking, deploying avatars can be used to explore the possibilities of pushing the boundaries of one’s own self, an opportunity provided by the online scope (Gregory, 2018Gregory, K. (2018). Online communication settings and the qualitative research process: Acclimating students and novice researchers. Qualitative Health Research, 28(10), 1610-1620. https://doi.org/10.1177/1049732318776625
https://doi.org/10.1177/1049732318776625...
, p. 1613).

Furthermore, one might reason that if the online scope is where online selves (which are real selves) are produced, and if that production occurs under the terms of cultural contingencies (Broad & Joos, 2004Broad, K. L., & Joos, K. E. (2004). Online inquiry of public selves: Methodological considerations. Qualitative Inquiry, 10(6), 923-946. https://doi.org/10.1177/1077800404265720
https://doi.org/10.1177/1077800404265720...
), then online identities may be indexes of (cyber)culture. More broadly and abstractly, it means that researchers would not need to rely on offline concepts to understand the online scope, but could use immanent particularities of the online phenomena to accomplish that. “At heart, the production of online selves in simulated communities must continue to return to the question of what cyberspace is and how it is constituted” (Broad & Joos, 2004, p. 943).

Public, private, and privacy

Working online, researchers have access to a tremendous amount of private interactions and private stages of the construction of selves and identities. However, many times, this is possible only because these private processes are publicly disclosed. The ambiguous character of a sizeable portion of online data, sitting somewhere between private and public, both enhances the online research potential and, at the same time, causes most of the ethical concerns of online researchers (Broad & Joos, 2004Broad, K. L., & Joos, K. E. (2004). Online inquiry of public selves: Methodological considerations. Qualitative Inquiry, 10(6), 923-946. https://doi.org/10.1177/1077800404265720
https://doi.org/10.1177/1077800404265720...
).

The way we interact online is forcing us to reconsider the notions of ‘public’, ‘private’, and ‘privacy’. Our notions of public and private are extensions of spatialized metaphors into other domains, such as communication, behavior, emotion, and ethics. But metaphors can only go so far, especially because their ability to convey certain meanings is very context-sensitive. When the context changes, the metaphor supporting the notion may not function properly, rendering the notion imprecise and anachronistic. That is why the use of public and private as methodological, analytic, or ethical categories need to be reexamined in the online context (Giaxoglou, 2017Giaxoglou, K. (2017). Reflections on internet research ethics from language-focused research on web-based mourning: Revisiting the private/public distinction as a language ideology of differentiation. Applied Linguistics Review, 8(2-3), 229-250. https://doi.org/10.1515/applirev-2016-1037
https://doi.org/10.1515/applirev-2016-10...
).

Online and physical contexts are different and those differences demand new considerations. For example, researchers are finding that, as the limits between private and public are being blurred, the notion of research field is also compromised (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 10). In addition, new social practices allowed by the internet reinforce its distinctiveness. For example, “in such contexts we imagine and stage forms of public selves in semi-public contexts where known and unknown audiences merge, blurring the boundaries between what would have been conceived as private and public” (Giaxoglou, 2017Giaxoglou, K. (2017). Reflections on internet research ethics from language-focused research on web-based mourning: Revisiting the private/public distinction as a language ideology of differentiation. Applied Linguistics Review, 8(2-3), 229-250. https://doi.org/10.1515/applirev-2016-1037
https://doi.org/10.1515/applirev-2016-10...
, p. 242).

Problematic definitions of public and private have also consequences for the notion of privacy. The lack of a sharp contrast between what is public and what is private online shifts the understanding of privacy and its social value. For example, there is evidence that people accept digital surveillance and restrictions in their privacy rights for the sake of prosocial responsibility, especially for the sake of public health such as during the COVID-19 pandemic (Kokkoris & Kamleitner, 2020Kokkoris, M., & Kamleitner, B. (2020). Would you sacrifice your privacy to protect public health? Prosocial responsibility in a pandemic paves the way for digital surveillance. Frontiers in Psychology, 11, 578618. https://doi.org/10.3389/fpsyg.2020.578618
https://doi.org/10.3389/fpsyg.2020.57861...
). More evidence that the notions of public, private, and privacy are changing across society is found in the “subdued reactions to increasingly regular cases of personal data being lost, stolen or leaked from financial organizations, insurers and government, which are regarded more as inconveniences than major scandals” (Fischer et al., 2017Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
https://doi.org/10.4135/9781473957992.n3...
, p. 616).

Once more, not only ethical issues concerning the access of online data are at stake here. The issues regarding the notions of public and private within the online context have also to do with new interaction patterns that ensue when a whole generation tends to consider that all major aspects of their lives are public (Fischer et al., 2017Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
https://doi.org/10.4135/9781473957992.n3...
), and with the psychological, sociological, and methodological effects of dissolving the boundaries of one’s privacy.

Participants’ agency and power balance

This topic appears in the literature in many contexts and under many expressions. Some call it “[participants’] active engagement” (Kenny, 2005Kenny, A. J. (2005). Interaction in cyberspace: An online focus group. Journal of Advanced Nursing, 49(4), 414-422. https://doi.org/10.1111/j.1365-2648.2004.03305.x
https://doi.org/10.1111/j.1365-2648.2004...
, p. 416), others prefer “active strategies of inquiry” (Broad & Joos, 2004Broad, K. L., & Joos, K. E. (2004). Online inquiry of public selves: Methodological considerations. Qualitative Inquiry, 10(6), 923-946. https://doi.org/10.1177/1077800404265720
https://doi.org/10.1177/1077800404265720...
, p. 929), “participatory research methods” (Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
, p. 161), or a “more symmetrical relationship with [the] participants” (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 8). Regardless of the chosen words, we are talking about the “active role [of participants] in the enactment of social methods” (Marres, 2012, p. 160) and their “greater agency and power in [online research] exchanges” (Howlett, 2021, p. 8).

A fundamental premise behind this topic is that online qualitative research methods and tools might be used to foster and better capture participants’ active engagement and group interaction (Kenny, 2005Kenny, A. J. (2005). Interaction in cyberspace: An online focus group. Journal of Advanced Nursing, 49(4), 414-422. https://doi.org/10.1111/j.1365-2648.2004.03305.x
https://doi.org/10.1111/j.1365-2648.2004...
). For example, compared to traditional (in-person) focus groups, their online counterparts allow a larger number of participants to engage in asynchronous, multi-threaded, and multi-sited discussions that can endure for weeks or even months, which is unpractical otherwise. Online settings also dilute the pressure to conform to the group. At the same time, using multimedia (text, audio, images, videos, drawings, etc.) facilitates self-expression. Activity logs provide detailed data about participation and interaction patterns while, by offering the option of participating anonymously, researchers should reasonably expect even more sincere statements, especially while researching sensitive matters. In sum, online methods facilitate the enactment of participants’ selves and ideas.

Online research also brings more symmetry to the traditional power balance in research situations (which used, in the past, to favor researchers). For example, as we saw in the topic concerning identities, remote interviews granted researchers an entry visa to participants’ personal lives and to their less apparent identities. However, in this case, technology works both ways. Many times, researchers’ personal lives and spaces are also exposed, implying they need now to think more carefully about how they want to be seen (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
). Additionally, technology increases participants’ control over when and how researchers access the “field” (Howlett, 2021, p. 8) and over what they (participants) want to disclose (Craig et al., 2020Craig, S., Eaton, A., Pascoe, R., Egag, E., McInroy, L., Fang, L., Austin, A., & Dentato, M. (2020). QueerVIEW: Protocol for a technology-mediated qualitative photo elicitation study with sexual and gender minority youth in ontario, Canada. JMIR Research Protocols, 9(11), e20547. https://doi.org/10.2196/20547
https://doi.org/10.2196/20547...
). It is easier (and more socially acceptable) not answering a call than skipping an in-person interview. In addition, by using online settings, one could always select more carefully what to show and not to show, blurring the background or even turning the camera off, for example.

But changes are not restricted to data collection. Online qualitative methods allow a broader range of actors interfering with data analyses and presentation, opening a space of intervention that might lead to a redistribution of methods (Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
). Such redistribution would mean that data is not simply ‘extracted’ from participants. Instead, researchers could develop more “collaborative spaces where data and analysis can be volunteered, discussed, coproduced, and shared [among participants and researchers]” (Morrow, Hawkins, & Kern, 2015Morrow, O., Hawkins, R., & Kern, L. (2015). Feminist research in online spaces. Gender, Place & Culture, 22(4), 526-543. https://doi.org/10.1080/0966369X.2013.879108
https://doi.org/10.1080/0966369X.2013.87...
, p. 539). In other words, online qualitative research methods allow researchers and participants to interact in such a way that the whole research community “meaningfully becomes invested in the researcher’s work through consultation and critique” (Murthy, 2008Murthy, D. (2008). Digital ethnography: An examination of the use of new technologies for social research. Sociology, 42(5), 837-855. https://doi.org/10.1177/0038038508094565
https://doi.org/10.1177/0038038508094565...
, p. 847). That is, in an online research, the whole data set, if not the research process itself, may be put within participants’ reach. This may evolve into collaborative researches, in which participants become partners (Giaxoglou, 2017Giaxoglou, K. (2017). Reflections on internet research ethics from language-focused research on web-based mourning: Revisiting the private/public distinction as a language ideology of differentiation. Applied Linguistics Review, 8(2-3), 229-250. https://doi.org/10.1515/applirev-2016-1037
https://doi.org/10.1515/applirev-2016-10...
, p. 247). In a concrete example, Meredith, Galpin, and Robinson (2020Meredith, J., Galpin, A., & Robinson, L. (2020). Examining the management of stake and interest in a participatory design Facebook group. Qualitative Research in Psychology. https://doi.org/10.1080/14780887.2020.1780354
https://doi.org/10.1080/14780887.2020.17...
) reported on the attention required when scholars, professionals, and lay people are put together in an online forum for a research. The research team had to manage discussions so that all participants were equally treated as co-researchers, avoiding lay people shying from debating with professionals or professionals felling patronized by scholars.

However, those are not simple moves. Increasing participation and redistributing the roles in research “can be taken as an invitation to move beyond ‘proprietary’ concepts of methods, that is, beyond the entrenched use of method as a way to monopolize the representation of a given field or aspect of social reality” (Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
, p. 161). This would mean, at the very basic level, for example, that insights about how to treat the data and even about the very research subject might come from any participant. In such scenario, researchers would find themselves decentered from commanding knowledge creation. New online qualitative methods can unsettle the well-established division of labor within the knowledge production system. Suddenly, we would not know for sure who can define what is and what is not research, and we would have to learn a new set of relations between ‘researchers’ and ‘participants’ - expressions we might even find useless to describe new roles -, which should emerge from research practices themselves (Marres, 2012). Researchers would then need to develop a working relationship with their participants, rather than merely rapport (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
) and, by dissolving the notion of what is to be a researcher, online research can ultimately break academia’s monopoly of scientific discovery in favor of a more popular science (Corti & Fielding, 2016Corti, L., & Fielding, N. (2016). Opportunities from the digital revolution: Implications for researching, publishing, and consuming qualitative research. SAGE Open, 6(4). https://doi.org/10.1177/2158244016678912
https://doi.org/10.1177/2158244016678912...
).

The offline-online breach

As we have shown, for some time, scholars implicitly treated online social experiences and interactions as reproductions of their ‘real’ counterparts. Nevertheless, there is no ‘pure’ or ‘genuine’ social landscape to be contrasted with the online scope. Online experiences and interactions are real and part of the whole. Epistemologically speaking, any attempt to confine social research to online or to offline scopes is somewhat arbitrary because social phenomena occur ‘across’ them (Hallett & Barber, 2014Hallett, R. E., & Barber, K. (2014). Ethnographic research in a cyber era. Journal of Contemporary Ethnography, 43(3), 306-330. https://doi.org/10.1177/0891241613497749
https://doi.org/10.1177/0891241613497749...
; Hine, 2009Hine, C. (2009). Question one: How can qualitative internet researchers define the boundaries of their projects? In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 1-20). Thousand Oaks, CA: Sage Publications. https://www.doi.org/10.4135/9781483329086.n1
https://www.doi.org/10.4135/978148332908...
; Ignacio, 2012Ignacio, E. N. (2012). Online methods and analyzing knowledge-production: A cautionary tale. Qualitative Inquiry, 18(3), 237-246. https://doi.org/10.1177/1077800411431558
https://doi.org/10.1177/1077800411431558...
). In that sense, developing online qualitative methods would require ‘overcoming’ this artificial offline-online breach.

Circumscribing the online or the offline portions of social phenomena is an analytical tool and not the result of an empirical duality of ontological statuses (Numerato, 2016Numerato, D. (2016). Behind the digital curtain: Ethnography, football fan activism and social change. Qualitative Research, 16(5), 575-591. https://doi.org/10.1177/1468794115611207
https://doi.org/10.1177/1468794115611207...
). That is why we chose to use the expression online ‘scope’ in this paper, to denote the intentional (although not always conscious) character of the concept extension. Online experiences are not disconnected from other experiences of life. They are simply mediated through a specific technology that shapes our interactions by enabling certain actions and restricting others (Morrow et al., 2015Morrow, O., Hawkins, R., & Kern, L. (2015). Feminist research in online spaces. Gender, Place & Culture, 22(4), 526-543. https://doi.org/10.1080/0966369X.2013.879108
https://doi.org/10.1080/0966369X.2013.87...
). We, online researchers, must consider this and “be open to continually reflect on our research process as we conduct our research as well as develop new techniques if faced with new situations” (Ignacio, 2012Ignacio, E. N. (2012). Online methods and analyzing knowledge-production: A cautionary tale. Qualitative Inquiry, 18(3), 237-246. https://doi.org/10.1177/1077800411431558
https://doi.org/10.1177/1077800411431558...
, p. 239).

What could be some of these new situations and what consequences they entail for online qualitative research? First that, despite the differences, it is pointless to favor in-person collected data based on its superior authenticity - even more as the boundaries between offline and online scopes become more and more blurred (Morrow et al., 2015Morrow, O., Hawkins, R., & Kern, L. (2015). Feminist research in online spaces. Gender, Place & Culture, 22(4), 526-543. https://doi.org/10.1080/0966369X.2013.879108
https://doi.org/10.1080/0966369X.2013.87...
). Seeking authentic data by staying outside the internet should now be considered an immigrant - as opposed to a native - way of thinking, or, to use a cherished distinction for qualitative researchers, an etic way of thinking, instead of an emic one.

For example, written data collected online may have - and often has - an oral nature (e.g., O’Connor & Madge, 2001O’Connor, H., & Madge, C. (2001). Cyber-mothers: Online synchronous interviewing using conferencing software. Sociological Research Online, 5(4), 102-117. https://doi.org/10.5153/sro.543
https://doi.org/10.5153/sro.543...
; Williams, Clausen, Robertson, Peacock, & McPherson, 2012Williams, S., Clausen, M. G., Robertson, A., Peacock, S., & McPherson, K. (2012). Methodological reflections on the use of asynchronous online focus groups in health research. International Journal of Qualitative Methods, 11(4), 368-383. https://doi.org/10.1177/160940691201100405
https://doi.org/10.1177/1609406912011004...
). However, what does this imply for its analysis? Should researchers use techniques developed to analyze oral speech or the ones developed to analyze written texts? How should they use other non-verbal communication modes such as chronemics (pacing and timing of speech, length of silences, etc.), paralinguistic (variations in volume, pitch, and quality of voice), kinetic (facial expressions, eye contact, body positioning, etc.), and proxemic (use of interpersonal space) (Salmons, 2016Salmons, J. (2016). Doing qualitative research online. Thousand Oaks, CA: Sage Publications.) to analyze online interactions? What about ethical concerns? Verbatim quotes of online data should be avoided in order to maintain anonymity, since the excerpt could be easily searched online (see Battles, 2010Battles, H. T. (2010). Exploring ethical and methodological issues in internet-based research with adolescents. International Journal of Qualitative Methods, 9(1), 27-39. https://doi.org/10.1177/160940691000900104
https://doi.org/10.1177/1609406910009001...
), whereas qualitative reports traditionally presented many of these excerpts from interviews and observations in order to enhance its authenticity and contextual disclosure.

Another distinct consequence of the offline-online breach is that “the virtual-material interface itself was not problematized and the researcher’s position was assumed to be largely that of a disembodied, outside observer” (Morrow et al., 2015Morrow, O., Hawkins, R., & Kern, L. (2015). Feminist research in online spaces. Gender, Place & Culture, 22(4), 526-543. https://doi.org/10.1080/0966369X.2013.879108
https://doi.org/10.1080/0966369X.2013.87...
, p. 534). ‘Real’ researchers observing a (reified) online space might easily assume that they hold a neutral and potentially omniscient position. However, “there is no way to avoid how the mechanics of a technological platform can elicit some forms of engagement, negate other types of interaction, and not have some influence on the qualitative research process” (Gregory, 2018Gregory, K. (2018). Online communication settings and the qualitative research process: Acclimating students and novice researchers. Qualitative Health Research, 28(10), 1610-1620. https://doi.org/10.1177/1049732318776625
https://doi.org/10.1177/1049732318776625...
, p. 1612). Conceiving hermetically sealed categories does not work either for online research particularly or for social research in general. Against this offline-online breach, there is the evidence of the “reverse influence” exerted by the online scope on the broader social landscape (Morrow et al., 2015, p. 532) and on the broader methodological universe (Hallett & Barber, 2014Hallett, R. E., & Barber, K. (2014). Ethnographic research in a cyber era. Journal of Contemporary Ethnography, 43(3), 306-330. https://doi.org/10.1177/0891241613497749
https://doi.org/10.1177/0891241613497749...
; Marres, 2012Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
https://doi.org/10.1111/j.1467-954X.2012...
). Researchers can overcome these apparent oppositions by changing their approach to the field and the categories used to understand it, seeking methodological solutions such as “shifting the interaction from offline ‘co-location’ to online ‘co-presence’ through the use of communicative technologies … actively constructing a new digital and socially meaningful space for interactions that was neither our present locations, nor a common physical setting” (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
, p. 7) (see also Beaulieu, 2010Beaulieu, A. (2010). From co-location to co-presence: Shifts in the use of ethnography for the study of knowledge. Social Studies of Science, 40(3), 453-470. https://doi.org/10.1177/0306312709359219
https://doi.org/10.1177/0306312709359219...
).

CONCLUDING REMARKS

The online social landscape is a compelling reality. Take social media, for example, “an undisputed game-changer, a massive global social experiment, blamed for altering the outcome of elections and redirecting the course of history,” which is, at once, “a mess of fake news and misinformation, the future of advertising and earned media and the basis of some of the world’s most powerful and profitable companies” (Kozinets et al., 2018Kozinets, R., Scaraboto, D., & Parmentier, M. (2018). Evolving netnography: How brand auto-netnography, a netnographic sensibility, and more-than-human netnography can transform your research. Journal of Marketing Management, 34(3-4), 231-242. https://doi.org/ 10.1080/0267257X.2018.1446488
https://doi.org/ 10.1080/0267257X.2018.1...
, p. 232).

Such words do not describe a partial or incomplete social experience (at least not more than any other particular social experience). Au contraire! As more and more of our lives are being lived online and “online social phenomena is becom[ing] integrated into wider social and cultural life” (Fischer et al., 2017Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
https://doi.org/10.4135/9781473957992.n3...
, p. 612), it is pointless to consider online research partial or incomplete. In fact, it may now be more generalizable than before (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
).

Yet, there are scholars who still believe that mediated approaches are second choice (Howlett, 2021Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
https://doi.org/10.1177/1468794120985691...
). Claims for “careful crafting” and “methodological, procedural, technical and ethical considerations” (Reips, 2002Reips, U.-D. (2002). Internet-based psychological experimenting: Five dos and five don’ts. Social Science Computer Review, 20(3), 241-249. https://doi.org/10.1177/089443930202000302
https://doi.org/10.1177/0894439302020003...
, p. 244) were responded with adaptations of traditional methods, not designed with the online scope in mind. However, no researcher needs to think of a blog as an online diary anymore (for more on diaries and weblogs, see Kaun, 2010Kaun, A. (2010). Open-ended online diaries: Capturing life as it is narrated. International Journal of Qualitative Methods, 9(2), 133-148. https://doi.org/10.1177/160940691000900202
https://doi.org/10.1177/1609406910009002...
). And there is no point asking if online communication is as expressive as face to face communication. The point is that online experience is a reality in its own right and “mediated approaches can generate valuable insight not otherwise available through the use of in-person methods which may actually be richer and more insightful” (Howlett, 2021, p. 12).

Exceeding the scope of this paper, we might use some methodological imagination to envision how researchers’ practices would be immediately affected by the onto-epistemological shifts we propose. For example, because social dynamics are rarely centered on individuals, its investigation corresponds, often and to a large degree, to the investigation of (any form of) public discourses. Considering what was discussed here about online sociality and identity, researchers might focus on public online ‘profiles’ and ‘voices’ rather than this or that individual, provided theses voices do represent important aspects of the social dynamic. New paths to the development of online qualitative research would also ensue from the new and particular uses of language to which online qualitative researchers must become acquainted, be it to interact in an online interview or to analyze data from any online session (which can be compared to an observation). This would allow researchers not only to understand and adhere to a ‘netiquette’ but, ultimately, to develop an emic standpoint from which real paradigmatic development of online qualitative methods would ensue.

Restating Kuhn, while the critical elements of a current paradigm have not yet pointed to its alternatives, they are already implied. When there are many of these signs, “a decision between alternate ways of practicing science is called for, and in the circumstances that decision must be based less on past achievement than on future promise” (Kuhn, 1970, pp. 157-158).

ACKNOWLEDGEMENTS

The authors would like to thank Professor André Luiz Maranhão de Souza-Leão (PROPAD/UFPE, Brazil) for his extensive contribution to this research.

REFERENCES

  • Anwyl-Irvine, A., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. (2020). Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods, 52, 388-407. https://doi.org/10.3758/s13428-019-01237-x
    » https://doi.org/10.3758/s13428-019-01237-x
  • Battles, H. T. (2010). Exploring ethical and methodological issues in internet-based research with adolescents. International Journal of Qualitative Methods, 9(1), 27-39. https://doi.org/10.1177/160940691000900104
    » https://doi.org/10.1177/160940691000900104
  • Baym, N., & Markham, A. (2009). Making smart choices on shifting ground. In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 7-19). Thousand Oaks, CA: Sage Publications.
  • Beaulieu, A. (2010). From co-location to co-presence: Shifts in the use of ethnography for the study of knowledge. Social Studies of Science, 40(3), 453-470. https://doi.org/10.1177/0306312709359219
    » https://doi.org/10.1177/0306312709359219
  • Bouchard, K. L. (2016). Anonymity as a double-edge sword: Reflecting on the implications of online qualitative research in studying sensitive topics. The Qualitative Report, 21(1), 59-67. https://doi.org/10.46743/2160-3715/2016.2455
    » https://doi.org/10.46743/2160-3715/2016.2455
  • Broad, K. L., & Joos, K. E. (2004). Online inquiry of public selves: Methodological considerations. Qualitative Inquiry, 10(6), 923-946. https://doi.org/10.1177/1077800404265720
    » https://doi.org/10.1177/1077800404265720
  • CohenMiller, A., Schnackenberg, H., & Demers, D. (2020). Rigid flexibility: Seeing the opportunities in ‘failed’ qualitative research. International Journal of Qualitative Methods 19. https://doi.org/10.1177/1609406920963782
    » https://doi.org/10.1177/1609406920963782
  • Coomber, R. (1997). Using the internet for survey research. Sociological Research Online, 2(2), 49-58. https://doi.org/10.5153/sro.73
    » https://doi.org/10.5153/sro.73
  • Corti, L., & Fielding, N. (2016). Opportunities from the digital revolution: Implications for researching, publishing, and consuming qualitative research. SAGE Open, 6(4). https://doi.org/10.1177/2158244016678912
    » https://doi.org/10.1177/2158244016678912
  • Craig, S., Eaton, A., Pascoe, R., Egag, E., McInroy, L., Fang, L., Austin, A., & Dentato, M. (2020). QueerVIEW: Protocol for a technology-mediated qualitative photo elicitation study with sexual and gender minority youth in ontario, Canada. JMIR Research Protocols, 9(11), e20547. https://doi.org/10.2196/20547
    » https://doi.org/10.2196/20547
  • Creswell, J. (2009). Research design: Qualitative, quantitative and mixed methods approaches (3 ed.). Thousand Oaks, CA: Sage Publications.
  • Featherstone, M., & Burrows, R. (1995). Cultures of technological embodiment: An introduction. Body & Society, 1(3-4), 1-19. https://doi.org/10.1177/1357034X95001003001
    » https://doi.org/10.1177/1357034X95001003001
  • Fischer, M., Lyon, S., & Zeitlyn, D. (2017). Online environments and the future of social science research. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 611-627). Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781473957992.n35
    » https://doi.org/10.4135/9781473957992.n35
  • Genoe, M. R., Liechty, T., Marston, H. R., & Sutherland, V. (2016). Blogging into retirement: Using qualitative online research methods to understand leisure among baby boomers. Journal of Leisure Research, 48(1), 15-34. https://doi.org/10.18666/jlr-2016-v48-i1-6257
    » https://doi.org/10.18666/jlr-2016-v48-i1-6257
  • Giaxoglou, K. (2017). Reflections on internet research ethics from language-focused research on web-based mourning: Revisiting the private/public distinction as a language ideology of differentiation. Applied Linguistics Review, 8(2-3), 229-250. https://doi.org/10.1515/applirev-2016-1037
    » https://doi.org/10.1515/applirev-2016-1037
  • Gregory, K. (2018). Online communication settings and the qualitative research process: Acclimating students and novice researchers. Qualitative Health Research, 28(10), 1610-1620. https://doi.org/10.1177/1049732318776625
    » https://doi.org/10.1177/1049732318776625
  • Griffiths, M. D. (2012). The use of online methodologies in studying paraphilias-A review. Journal of Behavioral Addictions, 1(4), 143-150. https://doi.org/10.1556/JBA.1.2012.4.1
    » https://doi.org/10.1556/JBA.1.2012.4.1
  • Hallett, R. E., & Barber, K. (2014). Ethnographic research in a cyber era. Journal of Contemporary Ethnography, 43(3), 306-330. https://doi.org/10.1177/0891241613497749
    » https://doi.org/10.1177/0891241613497749
  • Hewson, C., Laurent, D., & Vogel, C. (1996). Proper methodologies for psychological and sociological studies conducted via the internet. Behavior Research Methods, Instruments, & Computers, 28(2), 186-191. https://doi.org/10.3758/BF03204763
    » https://doi.org/10.3758/BF03204763
  • Hine, C. (2009). Question one: How can qualitative internet researchers define the boundaries of their projects? In A. Markham, N. Baym (Eds.), Internet inquiry: Conversations about method (pp. 1-20). Thousand Oaks, CA: Sage Publications. https://www.doi.org/10.4135/9781483329086.n1
    » https://www.doi.org/10.4135/9781483329086.n1
  • Holge-Hazelton, B. (2002). The internet: A new field for qualitative inquiry?. Forum Qualitative Sozialforschung, 3(2). https://doi.org/10.17169/fqs-3.2.854
    » https://doi.org/10.17169/fqs-3.2.854
  • Howlett, M. (2021). Looking and the ‘field’ through a Zoom lens: Methodological reflections on conducting online research during a global pandemic. Qualitative Research, Online First. https://doi.org/10.1177/1468794120985691
    » https://doi.org/10.1177/1468794120985691
  • Ignacio, E. N. (2012). Online methods and analyzing knowledge-production: A cautionary tale. Qualitative Inquiry, 18(3), 237-246. https://doi.org/10.1177/1077800411431558
    » https://doi.org/10.1177/1077800411431558
  • Jank, W., & Shmueli, G. (2006). Functional data analysis in electronic commerce research. Statistical Science, 21(2), 155-166. https://doi.org/10.1214/088342306000000132
    » https://doi.org/10.1214/088342306000000132
  • Kaun, A. (2010). Open-ended online diaries: Capturing life as it is narrated. International Journal of Qualitative Methods, 9(2), 133-148. https://doi.org/10.1177/160940691000900202
    » https://doi.org/10.1177/160940691000900202
  • Kenny, A. J. (2005). Interaction in cyberspace: An online focus group. Journal of Advanced Nursing, 49(4), 414-422. https://doi.org/10.1111/j.1365-2648.2004.03305.x
    » https://doi.org/10.1111/j.1365-2648.2004.03305.x
  • Klein, J., Tyler-Parker, G., & Bastian, B. (2020). Measuring psychological distress among Australians using an online survey. Australian Journal of Psychology, 72(3), 276-282. https://doi.org/10.1111/ajpy.12283
    » https://doi.org/10.1111/ajpy.12283
  • Kokkoris, M., & Kamleitner, B. (2020). Would you sacrifice your privacy to protect public health? Prosocial responsibility in a pandemic paves the way for digital surveillance. Frontiers in Psychology, 11, 578618. https://doi.org/10.3389/fpsyg.2020.578618
    » https://doi.org/10.3389/fpsyg.2020.578618
  • Kozinets, R. (2002). The field behind the screen: Using netnography for marketing research in online communities. Journal of Marketing Research, 39(1), 61-72. https://doi.org/10.1509/jmkr.39.1.61.18935
    » https://doi.org/10.1509/jmkr.39.1.61.18935
  • Kozinets, R., Scaraboto, D., & Parmentier, M. (2018). Evolving netnography: How brand auto-netnography, a netnographic sensibility, and more-than-human netnography can transform your research. Journal of Marketing Management, 34(3-4), 231-242. https://doi.org/ 10.1080/0267257X.2018.1446488
    » https://doi.org/ 10.1080/0267257X.2018.1446488
  • Krantz, J. H., & Reips, U. D. (2017). The state of web-based research: A survey and call for inclusion in curricula. Behavior Research Methods, 49(5), 1621-1629. https://doi.org/10.3758/s13428-017-0882-x
    » https://doi.org/10.3758/s13428-017-0882-x
  • Kuhn, T. (1970). The structure of scientific revolutions (2 ed.). Chicago: The University of Chicago Press.
  • Lee, R., Fielding, N., & Blank, G. (2017). Online research methods in the social sciences: An editorial introduction. In N. Fielding, R. Lee & G. Blank. (Eds.), The SAGE handbook of online research methods (2nd ed., pp. 3-16). Thousand Oaks, CA: Sage Publications.
  • Man, J. D., Campbell, L., Tabana, H., & Wouters, E. (2021). The pandemic of online research in times of COVID-19. BMJ Open, 11(2), e043866. https://doi.org/10.1136/bmjopen-2020-043866
    » https://doi.org/10.1136/bmjopen-2020-043866
  • Marres, N. (2012). The redistribution of methods: On intervention in digital social research, broadly conceived. The Sociological Review, 60(1 Suppl.), 139-165. https://doi.org/10.1111/j.1467-954X.2012.02121.x
    » https://doi.org/10.1111/j.1467-954X.2012.02121.x
  • Mawer, M. (2016). Observational practice in virtual worlds: Revisiting and expanding the methodological discussion. International Journal of Social Research Methodology, 19(2), 161-176. https://doi.org/10.1080/13645579.2014.936738
    » https://doi.org/10.1080/13645579.2014.936738
  • Meredith, J., Galpin, A., & Robinson, L. (2020). Examining the management of stake and interest in a participatory design Facebook group. Qualitative Research in Psychology. https://doi.org/10.1080/14780887.2020.1780354
    » https://doi.org/10.1080/14780887.2020.1780354
  • Michalak, E., & Szabo, A. (1998). Guidelines for internet research: An update. European Psychologist, 3(1), 70-75. https://doi.org/10.1027/1016-9040.3.1.70
    » https://doi.org/10.1027/1016-9040.3.1.70
  • Miller, C., Guidry, J., Dahman, B., & Thomson, M. (2020). A tale of two diverse qualtrics samples: Information for online survey researchers. Cancer Epidemiology, Biomarkers & Prevention, 29(4), 731-735. https://doi.org/10.1158/1055-9965.EPI-19-0846
    » https://doi.org/10.1158/1055-9965.EPI-19-0846
  • Morison, T., Gibson, A. F., Wigginton, B., & Crabb, S. (2015). Online research methods in psychology: Methodological opportunities for critical qualitative research. Qualitative Research in Psychology, 12(3), 223-232. https://doi.org/10.1080/14780887.2015.1008899
    » https://doi.org/10.1080/14780887.2015.1008899
  • Morrow, O., Hawkins, R., & Kern, L. (2015). Feminist research in online spaces. Gender, Place & Culture, 22(4), 526-543. https://doi.org/10.1080/0966369X.2013.879108
    » https://doi.org/10.1080/0966369X.2013.879108
  • Murthy, D. (2008). Digital ethnography: An examination of the use of new technologies for social research. Sociology, 42(5), 837-855. https://doi.org/10.1177/0038038508094565
    » https://doi.org/10.1177/0038038508094565
  • Numerato, D. (2016). Behind the digital curtain: Ethnography, football fan activism and social change. Qualitative Research, 16(5), 575-591. https://doi.org/10.1177/1468794115611207
    » https://doi.org/10.1177/1468794115611207
  • O’Connor, H., & Madge, C. (2001). Cyber-mothers: Online synchronous interviewing using conferencing software. Sociological Research Online, 5(4), 102-117. https://doi.org/10.5153/sro.543
    » https://doi.org/10.5153/sro.543
  • Pozzar, R., Hammer, M., Underhill-Blazey, M., Wright, A., Tulsky, J., Hong, F., Gundersen, D., & Berry, D. (2020). Threats of bots and other bad actors to data quality following research participant recruitment through social media: cross-sectional questionnaire. Journal of Medical Internet Research, 22(10), e23021. https://doi.org/10.2196/23021
    » https://doi.org/10.2196/23021
  • Pronk, T., Wiers, R., Molenkamp, B., & Murre, J. (2020). Mental chronometry in the pocket? Timing accuracy of web applications on touchscreen and keyboard devices. Behavior Research Methods, 52, 1371-1382. https://doi.org/10.3758/s13428-019-01321-2
    » https://doi.org/10.3758/s13428-019-01321-2
  • Reips, U.-D. (2002). Internet-based psychological experimenting: Five dos and five don’ts. Social Science Computer Review, 20(3), 241-249. https://doi.org/10.1177/089443930202000302
    » https://doi.org/10.1177/089443930202000302
  • Riley, S., Evans, A., Griffin, C., Morey, Y., & Murphy, H. (2015). Crossing into the digital realm. The Psychologist, 28(8), 652-655. Retrieved from http://eprints.uwe.ac.uk/26595
    » http://eprints.uwe.ac.uk/26595
  • Robbin, A. (1992). Social scientists at work on electronic research networks. Internet Research, 2(2), 6-30. https://doi.org/10.1108/eb047257
    » https://doi.org/10.1108/eb047257
  • Salmons, J. (2016). Doing qualitative research online. Thousand Oaks, CA: Sage Publications.
  • Schiek, D., & Ullrich, C. G. (2017). Using asynchronous written online communications for qualitative inquiries: A research note. Qualitative Research, 17(5), 589-597. https://doi.org/10.1177/1468794117690216
    » https://doi.org/10.1177/1468794117690216
  • Schrum, L. (1995). Framing the debate: Ethical research in the information age. Qualitative Inquiry, 1(3), 311-326. https://doi.org/10.1177/107780049500100303
    » https://doi.org/10.1177/107780049500100303
  • Stanton, J. M., & Rogelberg, S. G. (2001). Using internet/intranet web pages to collect organizational research data. Organizational Research Methods 4(3), 200-217. https://doi.org/10.1177/109442810143002
    » https://doi.org/10.1177/109442810143002
  • Upadhyay, U., & Lipkovich, H. (2020). Using online technologies to improve diversity and inclusion in cognitive interviews with young people. BMC Medical Research Methodology, 20, 159. https://doi.org/10.1186/s12874-020-01024-9
    » https://doi.org/10.1186/s12874-020-01024-9
  • Voltaire (2007). Philosophical letters or Letters regarding the English nation. Indianapolis, IN: Hackett Publishing Company. (Original work published 1734)
  • Weissman, R., Klump, K., & Rose, J. (2020). Conducting eating disorders research in the time of COVID-19: A survey of researchers in the field. International Journal of Eating Disorders, 53(7), 1171-1181. https://doi.org/10.1002/eat.23303
    » https://doi.org/10.1002/eat.23303
  • Welch, T. (2020). Is Facebook a viable recruitment tool? Nurse Researcher, 28(2), 9-13. https://doi.org/10.7748/nr.2019.e1682
    » https://doi.org/10.7748/nr.2019.e1682
  • Williams, S., Clausen, M. G., Robertson, A., Peacock, S., & McPherson, K. (2012). Methodological reflections on the use of asynchronous online focus groups in health research. International Journal of Qualitative Methods, 11(4), 368-383. https://doi.org/10.1177/160940691201100405
    » https://doi.org/10.1177/160940691201100405
  • Willis, P. (2012). Talking sexuality online-technical, methodological and ethical considerations of online research with sexual minority youth. Qualitative Social Work, 11(2), 141-155. https://doi.org/10.1177/1473325011400488
    » https://doi.org/10.1177/1473325011400488
  • Wood, R. T., Griffiths, M. D., & Eatough, V. (2004). Online data collection from video game players: Methodological issues. CyberPsychology & Behavior, 7(5), 511-518. https://doi.org/10.1089/cpb.2004.7.511
    » https://doi.org/10.1089/cpb.2004.7.511
  • JEL Code:

    Y9.
  • Reviewers:

    Paulo Marzionna (Fundação Getulio Vargas, EAESP, Brazil)
    One of the reviewers chose not to disclose his/her identity.
  • Peer Review Report:

    The Peer Review Report is available at this external URL.
  • Funding

    This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Process 88882.380020/2019-01.
  • Copyrights

    RAC owns the copyright to this content.
  • Plagiarism Check

    The RAC maintains the practice of submitting all documents approved for publication to the plagiarism check, using specific tools, e.g.: iThenticate.
  • Peer Review Method

    This content was evaluated using the double-blind peer review process. The disclosure of the reviewers’ information on the first page, as well as the Peer Review Report, is made only after concluding the evaluation process, and with the voluntary consent of the respective reviewers and authors.
  • Data Availability

    RAC encourages data sharing but, in compliance with ethical principles, it does not demand the disclosure of any means of identifying research subjects, preserving the privacy of research subjects. The practice of open data is to enable the reproducibility of results, and to ensure the unrestricted transparency of the results of the published research, without requiring the identity of research subjects.

Edited by

Editors-in-chief:

Wesley Mendes-da-Silva (Fundação Getulio Vargas, EAESP, Brazil)
Marcelo de Souza Bispo (Universidade Federal da Paraíba, PPGA, Brazil)

Guest Editors:

Evelyn Lanka (Cranfield School of Management, United Kingdom)
Sanjay Lanka (Fundação Getulio Vargas, EAESP, Brazil)
Ali Rostron (University of Liverpool, United Kingdom)
Pallavi Singh (Sheffield Hallam University, United Kingdom)

Publication Dates

  • Publication in this collection
    25 Feb 2022
  • Date of issue
    2022

History

  • Received
    14 Jan 2021
  • Reviewed
    17 Aug 2021
  • Accepted
    29 Sept 2021
Associação Nacional de Pós-Graduação e Pesquisa em Administração Av. Pedro Taques, 294,, 87030-008, Maringá/PR, Brasil, Tel. (55 44) 98826-2467 - Curitiba - PR - Brazil
E-mail: rac@anpad.org.br