Acessibilidade / Reportar erro

AUTHORSHIP CONCENTRATION IN HEALTH SCIENCES JOURNALS FROM LATIN AMERICA AND THE CARIBBEAN

Concentração de autoria em revistas em ciências da saúde da América Latina e do Caribe

ABSTRACT

Objective:

to describe authorship concentration indexes (proportion of articles by the most prolific author [PPMP]; Gini coefficient) among health sciences journals indexed in LILACS, and to compare them to what a previous study found in MEDLINE.

Methods:

bibliographic data were obtained from LILACS for systematically indexed journals with at least 50 signed articles (that is, with at least one individual author) from 2015 to 2019. Authors were identified by their name or, when possible, ORCID id. The PPMP was the number articles by the journal’s most prolific author, divided by the number of signed articles. The Gini coefficient counted more than once articles with multiple authors. For comparison purposes, MEDLINE data were reweighted to have the same distribution of journal size (number of signed articles) as LILACS journals.

Results:

the study included 568 journals, with a median size of 166 signed articles. The median PPMP was 4.5% (95th percentile 12.9%), and the median Gini coefficient was 0.149 (95th percentile 0.310). The PPMP increased with journal size, while the Gini coefficient decreased. MEDLINE journals had lower PPMP and higher Gini coefficients, but this difference disappeared after the data were reweighted.

Conclusions:

LILACS inclusion criteria are effectively countering any pro-endogeneity effect ownership by universities might have on regional journals. Journal evaluation should mind journal size when examining authorship concentration indexes. Formal derivation of their relationship with journal size would allow more precise interpretation of such indexes.

KEYWORDS:
Periodicals as Topic; Bibliometrics; Authorship; Universities; Latin America; Caribbean Region; Developing Countries; LILACS; Ciências da Saúde

RESUMO

Objetivo:

descrever índices de concentração de autoria (proporção de artigos do autor mais prolífico [PPMP]; coeficiente de Gini) entre as revistas de ciências da saúde indexadas na LILACS, e compará-las com o que um estudo anterior encontrou na MEDLINE.

Métodos:

foram obtidos dados bibliográficos da LILACS para periódicos indexados sistematicamente com pelo menos 50 artigos assinados (ou seja, com pelo menos um autor individual) de 2015 a 2019. Os autores foram identificados pelo nome ou, quando possível, pela identificação ORCID. A PPMP foi o número de artigos do autor mais prolífico da revista, dividido pelo número de artigos assinados. O coeficiente de Gini contava mais de uma vez os artigos com vários autores. Para fins de comparação, os dados MEDLINE foram reponderados para ter a mesma distribuição de tamanho de revista (número de artigos assinados) que as revistas da LILACS.

Resultados:

o estudo incluiu 568 revistas, com um tamanho mediano de 166 artigos assinados. A mediana da PPMP foi de 4,5% (percentil 95 12,9%), e a mediana do coeficiente de Gini foi de 0,149 (percentil 95 0,310). A PPMP aumentou com o tamanho do periódico, enquanto o coeficiente de Gini diminuiu. As revistas da MEDLINE tinham menores PPMP e maiores coeficientes de Gini, mas esta diferença desapareceu depois que os dados foram reponderados.

Conclusões:

os critérios de inclusão da LILACS estão efetivamente neutralizando qualquer efeito pró-endogeneidade atribuível às revistas regionais serem publicadas por universidades. A avaliação das revistas deve levar em conta o tamanho do periódico ao examinar os índices de concentração de autoria. A derivação formal de sua relação com o tamanho da revista permitiria uma interpretação mais precisa de tais índices.

PALAVRAS-CHAVE:
Publicações Periódicas como Assunto; Bibliometria; Autoria; Universidades; América Latina; Região do Caribe; Países em Desenvolvimento; LILACS; Health Sciences

INTRODUCTION

As dictated by the Council of Science Editors (2018), the World Association of Medical Editors (2009) and the International Committee of Medical Journal Editors (2021), editorial decisions should depend solely on the work’s validity and interest to readers, not on any competing interests the editors might have, or the journal owner’s commercial interests. Journals owned by universities and other research institutions can be particularly challenging in this regard, because editors may even have the same competing interests as the journal owners. Such journals’ scope can be expected to substantially overlap the parent organization’s research activities, and some of the journal editors, reviewers and authors can be expected to be affiliated with said organization. As reviewed by Barradas and Pinheiro (2016BARRADAS, J. S.; PINHEIRO, L. V. R. Produtividade científica em defesa nacional. Tendências da Pesquisa Brasileira em Ciência da Informação, [s. l.] v. 9, n. 2, p. 1-21, set./dez., 2016. Disponível em: https://revistas.ancib.org/index.php/tpbci/article/view/394/394. Acesso em: 17 ago. 2021
https://revistas.ancib.org/index.php/tpb...
), such endogeneity may bias the peer review process to be more lenient and to incorporate less diverse points of view, undermining the journal’s contribution to the scientific record; also see Sarigöl et al. (2017SARIGÖL, E. et al. Quantifying the effect of editor-author relations on manuscript handling times. Scientometrics, [s. l.], v. 113, n. 1, p. 609-631, 2017. Disponível em: https://doi.org/10.1007/s11192-017-2309-y. Acesso em: 18 maio 2023.
https://doi.org/10.1007/s11192-017-2309-...
).

Recently, a high-profile scandal involving editors affiliated to the same institution as the authors motivated Locher et al. (2021LOCHER, C. et al. Publication by association: how the COVID-19 pandemic has shown relationships between authors and editorial board members in the field of infectious diseases. BMJ Evidence-Based Medicine, [S. l.], p. bmjebm-2021-111670, 2021. Disponível em: https://ebm.bmj.com/content/27/3/133. Acesso em: 18 maio. 2023.
https://ebm.bmj.com/content/27/3/133...
) to propose an authorship concentration index (proportion of articles by the most prolific author) as an indicator of endogeneity. The same indicator had been explored previously by Bishop (2016BISHOP, D. V. M. Editorial integrity: Publishers on the front line. BishopBlog, 11 jun. 2016. Disponível em: http://deevybee.blogspot.com/2016/06/editorial-integrity-publishers-on-front.html. Acesso em: 18 maio 2023
http://deevybee.blogspot.com/2016/06/edi...
, 2020), motivated by other cases of apparent editorial malpractice. A second index (the Gini coefficient of inequality) was soon proposed by Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
), who validated both indexes in a representative sample of journals indexed in MEDLINE. When either index was above its 95th percentile, the journal’s most prolific author was more likely than not to participate in the journal’s editorial board. Furthermore, the most prolific authors were more likely to have their articles accepted in less than three weeks, and this publication lag was even shorter in journals with a larger number of articles by their most prolific author. As discussed by Scanff et al. (2021), both authorship concentration indexes can be used for flagging journals as potentially endogenous, “self-promotion journals” (as in Locher et al. (2021)), or “nepotistic journals” (as in Scanff et al. (2021)).

As noted by Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
), about one third of the journals suspected of endogeneity were published in at least one language other than English, even if MEDLINE is skewed towards journals in English. This skewness also means the proposed 95th cutoffs may not generalize to health sciences journals in other languages, which are often not indexed in MEDLINE. Such journals are more likely to be included in the World Health Organization’s Global Index Medicus, which comprises five regional bibliographic indexes targeting low- and middle-income countries. The first and foremost of such regional indexes is the Latin American and the Caribbean Literature on Health Sciences (LILACS), which is maintained by the Pan American Health Organization’s Latin American and Caribbean Center on Health Sciences Information (BIREME, from its original name in Portuguese) (CLARK; CASTRO, 2002CLARK, O. A. C.; CASTRO, A. A. Searching the Literatura Latino Americana e do Caribe em Ciências da Saúde (LILACS) database improves systematic reviews. International Journal of Epidemiology, [s. l.] v. 31, n. 1, p. 112-114, fev. 2002. Disponível em: https://doi.org/10.1093/ije/31.1.112. Acesso em: 18 maio 2023.
https://doi.org/10.1093/ije/31.1.112...
).

Most scientific journals in the region are owned by universities (BEIGEL et al., [2021BEIGEL, F. et al. OLIVA: una mirada transversal a la producción científica indexada en América Latina. Diversidad disciplinar, colaboración institucional y multilingüismo en SciELO y Redalyc. [S. l.: s.n.], [2021]. Disponível em: https://preprints.scielo.org/index.php/scielo/preprint/view/2653/version/2808. Acesso em: 17 ago. 2021.
https://preprints.scielo.org/index.php/s...
]; FISCHMAN; ALPERIN; WILLINSKY, 2010FISCHMAN, G. E.; ALPERIN, J. P.; WILLINSKY, J. Visibility and Quality in Spanish-Language Latin American Scholarly Publishing. Information Technologies & International Development, [S. l.], v. 6, n. 4, p. 1-21, dez. 2010. Disponível em: https://itidjournal.org/index.php/itid/article/view/639.html. Acesso em: 18 maio 2023.
https://itidjournal.org/index.php/itid/a...
), raising the possibility of journals in LILACS being even more endogenous than those in MEDLINE. On the other hand, the region has a longstanding tradition of including endogeneity in journal evaluations (AMORIM et al., 2015AMORIM, K. M. DE O. et al. Evaluation Systems of Scientific Journals in Latin America. In: ALPERÍN, J. P.; FISCHMAN, G. (ed.). Made in Latin America: open access, scholarly journals, and regional innovations. Ciudad Autónoma de Buenos Aires: CLACSO, 2015. p. 61-74.; BOAS; CAMPOS; AMARO, 2021BOAS, R. F. F.; CAMPOS, F. DE F.; AMARO, B. Análise dos critérios formais de qualidade editorial: a política de classificação de periódicos científicos a partir do Qualis Periódicos. Informação & Informação, Londrina, v. 26, n. 1, p. 28-52, 2021. Disponível em: https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/39985. Acesso em: 18 maio 2023.
https://ojs.uel.br/revistas/uel/index.ph...
; PAZ ENRIQUE; PERALTA GONZÁLEZ; HERNÁNDEZ ALFONSO, 2016PAZ ENRIQUE, L. E.; PERALTA GONZÁLEZ, M. J.; HERNÁNDEZ ALFONSO, E. A. Estudio bibliométrico de la Revista Centro Agrícola, Cuba. e-Ciencias de la Información, [s. l.], v. 6, n. 2, p. 1, jun. 2016. Disponível em: https://www.redalyc.org/journal/4768/476852098002/html/. Acesso em: 18 maio. 2023.
https://www.redalyc.org/journal/4768/476...
; ROZEMBLUM et al., 2015ROZEMBLUM, C. et al. Calidad editorial y calidad científica en los parámetros para inclusión de revistas científicas en bases de datos en Acceso Abierto y comerciales. Palabra Clave (La Plata), La Plata, v. 4, n. 2, p. 64-80, abr. 2015. Disponível em: https://www.redalyc.org/pdf/3505/350539940001.pdf. Acesso em: 18 maio 2023.
https://www.redalyc.org/pdf/3505/3505399...
), and the lack of significant endogeneity is one of criteria for journal selection in LILACS (LATIN AMERICAN AND CARIBBEAN CENTER ON HEALTH SCIENCES INFORMATION, 2020, 2021). The overall endogeneity of LILACS-indexed journals should, thus, result from the tension between these two factors. The objective of this study was, then, to describe both authorship concentration indexes among health sciences journals indexed in LILACS, and to compare them to what Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) found in MEDLINE.

METHODS

This bibliographic study covered LILACS from years 2015 to 2019, and included journals with at least 50 articles with at least one identified individual author (“signed articles”). In January 2022, the iAH (Interface for Access on Health Information) search interface in the BIREME’s Virtual Health Library was used to search for any documents indexed as journal articles in that study period. In May 2022, BIREME provided a database listing journal data such as (abbreviated) journal title, LILACS indexing, and subjects (described as Health Sciences Descriptors (DeCS)). All data were downloaded in the ISO 2709 format, imported into the R statistical environment 4.2.1 (R CORE TEAM, 2022) with its package stringi 1.7.8 (GAGOLEWSKI, 2022GAGOLEWSKI, M. Stringi: Fast and Portable Character String Processing in R. Journal of Statistical Software, [s. l.], v. 103, n. 2, 2022. Disponível em: https://www.jstatsoft.org/article/view/v103i02. Acesso em: 28 set. 2022.
https://www.jstatsoft.org/article/view/v...
) and code written for this purpose (FONTENELLE, 2022FONTENELLE, L. F. leofontenelle/authorship-concentration: Improved analytic code for “Authorship concentration in health sciences journals from Latin America and the Caribbean”. Zenodo, 28 set. 2022. Disponível em: https://zenodo.org/record/7121200. Acesso em: 28 set. 2022.
https://zenodo.org/record/7121200...
), and then filtered to include only signed articles from systematically indexed journals with at least 50 of those.

The ORCID (Open Researcher and Contributor ID) identifier was used to disambiguate authors whenever possible; it was available for 7.2% of the “authorships” (authors per article times number of articles). After minimal processing of author names (such as removing extraneous elements), the ORCID id was used instead of author names when such names occurred with one and only one ORCID id. The procedure was repeated after author names had their diacritics removed (names were encoded in ASCII) and hyphens replaced with white space (because Spanish-language authors sometimes introduce such hyphens to ensure indexing by their first family name). In the end, there were 148 (0.5%) unique author names associated with more than one ORCID id while also sometimes occurring with no ORCID id. Because it was not clear which ORCID id to impute, these authors (and those with no ORCID id author) were identified by the author name, as in Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
).

Authorship concentration at the journal level, aggregating all five years, was indicated by the proportion (or rather percentage) of articles published by the most prolific author and the Gini coefficient. Each journal’s most prolific author was whoever had published more articles in that journal, and the proportion of articles was simply the ratio between the number of these articles and the journal size (total amount of signed articles in that journal). The Gini coefficient (zero meaning complete equality and one meaning complete inequality) was calculated following Jasso (1979JASSO, G. On Gini’s Mean Difference and Gini’s Index of Concentration. American Sociological Review, [s. l.], v. 44, n. 5, p. 867-870, 1979. Disponível em: https://www.jstor.org/stable/2094535. Acesso em: 11 fev. 2022.
https://www.jstor.org/stable/2094535...
). See Davidson (2009DAVIDSON, R. Reliable inference for the Gini index. Journal of Econometrics, [s. l.], v. 150, n. 1, p. 30-40, maio 2009. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S0304407609000323. Acesso em: 18 maio 2023.
https://www.sciencedirect.com/science/ar...
) for a discussion of the relative merits of each way of calculating the Gini coefficient.

Both indexes were described by their median, interquartile range, total range and 95th percentile. The relationship between the indexes and journal size was described using scatter plots drawn with ggplot2, version 3.3.5 (WICKHAM, 2016WICKHAM, H. Ggplot2: Elegant Graphics for Data Analysis. 2 nd. [S.l.]: Springer-Verlag New York, 2016.). The relationship of journal subjects and countries with these variables was described by overlaying the same scatter plots with one smoothing spline for each subject or country with 20 or more journals.

For better comparison, data from Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) were reweighted so that journal sizes would have the same distribution as among LILACS journals. The present study did not include a sensitivity analysis restricting data to the research articles, because the former study found the results to be largely the same, and because in the present study’s data only 244 journals had at least 50 signed articles with an explicit publication type; there would be even fewer journals with at least 50 research articles.

RESULTS AND DISCUSSION

The search retrieved 148,667 articles, distributed across at least 933 journals (some rare entries didn’t have an ISSN). Of these, 130,312 articles were published in 698 journals systematically indexed by LILACS in the period. Finally, 126,774 of these were signed articles published in 568 journals with at least 50 signed articles during years 2015 to 2019.

The median journal size was 166 signed articles (Table 1). Meanwhile, MEDLINE journals studied by Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) had a median size of 500 signed articles (IQR, 262 to 964). After reweighting, MEDLINE journals had the same size as those in LILACS (Table 1).

Table 1
Authorship concentration indexes in LILACS journals, 2015 to 2019, compared to MEDLINE journals

The journals’ most prolific author had a median of 8 articles, or 4.5% of the signed articles, with a 95th percentile of 12.9% (Table 1). One quarter of the journals had more than one author tied as the most prolific one. The largest percentage (61.7%, more than twice the next largest percentage) was observed in a journal (Universitas Scientiarum, with 81 signed articles) which identifies the editor in the articles’ first page; often its articles in SciELO (and records in LILACS) make it seem like the editor is one of the authors. (This journal was not included in panels A and C of Figure 1 for better visualization.) As in Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
), the proportion of articles by the most prolific author was lower and less varying in journals with more articles (panel A in Figure 1).

Figure 1
Pairwise scatter plot for journal size, percentage of articles by most prolific authors and Gini coefficient for LILACS journals, 2015 to 2019. One outlier journal was excluded from panels A and C for better visualization

The median Gini coefficient was 0.149, with a 95th percentile of 0.310 (Table 1). No journal had an outstandingly high Gini coefficeint (panel B from Figure 1), but one journal (Ágora, with 91 signed articles) had a coefficient of zero. The journal had an average of two authors per article, and no author published more than one article during the study period. As in Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
), the coefficient was higher on average but somewhat less varying for journals with more articles (panel B in Figure 1).

The covariance between the Gini coefficient and the proportion of articles by the most prolific author depended on the number of articles (panel C in Figure 1), as expected from the relationship between each index and the number of articles. Journals with more articles had a low proportion, independently of the Gini coefficient, while journals with fewer articles had larger proportions if they had larger Gini coefficients.

In comparison to journals indexed in LILACS, those indexed in MEDLINE had a lower proportion of articles by the most prolific author (median 2.9%, 95th percentile 10.6%) and a higher Gini coefficient (median 0.183, 95th percentile 0.355), as described by Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
). However, after reweighting MEDLINE journals, both authorship concentration indexes in MEDLINE became virtually identical to those in LILACS (Table 1).

The importance of journal size appeared again when the LILACS journals were grouped by subject or country of publication. Figure 2 shows the average of each concentration index, by journal size, for the six countries with at least 20 journals (out of the 18 countries in the database).

Figure 2
Scatter plot of the percentage of articles by the most prolific author and Gini coefficient, both by journal size and country. Each overlaid smoothing spline represents one country with 20 or more journals

Likewise, Figure 3 shows the average of each concentration index, by journal size, for the six subjects with at least 20 journals (of the 183 subjects in the database). For each country and each subject, the proportion of articles by the most prolific author was lower and the Gini coefficient was higher for larger journals.

Figure 3
Scatter plot of the percentage of articles by the most prolific author and Gini coefficient, both by journal size and subject. Each overlaid smoothing spline represents one subject with 20 or more journals

CONCLUTIONS

This study described the distribution, among health science journals indexed in LILACS, of two recently proposed indicators of endogeny. One indicator (the proportion of articles by the most prolific author) was higher and another (the Gini coefficient) was lower in LILACS journals than in MEDLINE ones. Both differences disappeared after adjustment for journal size. In other words, if ownership by university does conduce to endogeneity in scientific journals, this effect is being countered by LILACS’ inclusion criteria.

This is likely to apply not only to health sciences journals from Latin America and the Caribbean, but also to those from other regions. If journals indexed in MEDLINE can have similar authorship concentration indexes as those indexed in LILACS, adjusting for journal size, then these indexes can be reasonably expected to have a similar distribution in other reputable bibliographic databases, at least in the health sciences. Perhaps even the relative abundance of non English-language journals in the outliers of Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) can also be explained by larger journals publishing in English, although verifying this is not within the scope of the present study. It remains an open question whether the distribution of authorship concentration indexes is the same (in Latin America in comparison to Western countries) in disciplines other than the health sciences.

It should be noted that the endogeneity of a scientific journal is a multifaceted concept. According to Barradas and Pinheiro (2016BARRADAS, J. S.; PINHEIRO, L. V. R. Produtividade científica em defesa nacional. Tendências da Pesquisa Brasileira em Ciência da Informação, [s. l.] v. 9, n. 2, p. 1-21, set./dez., 2016. Disponível em: https://revistas.ancib.org/index.php/tpbci/article/view/394/394. Acesso em: 17 ago. 2021
https://revistas.ancib.org/index.php/tpb...
), endogeneity would be defined by authors being from the same institution as the editors of a journal, which would lead to a more lenient evaluation and incorporating less diverse points of view. Empirically, the effect of this endogeneity at the journal level has been little studied, perhaps because these journals are usually excluded from bibliographic databases. What has been studied is mainly endogeneity at the individual level, when an author belongs to or has close relations with the editorial board. As exposed earlier, this proximity is associated with shorter evaluation times (BISHOP, 2016BISHOP, D. V. M. Editorial integrity: Publishers on the front line. BishopBlog, 11 jun. 2016. Disponível em: http://deevybee.blogspot.com/2016/06/editorial-integrity-publishers-on-front.html. Acesso em: 18 maio 2023
http://deevybee.blogspot.com/2016/06/edi...
, 2020), excessive concentration of the author's articles in the journal in question (LOCHER et al., 2021LOCHER, C. et al. Publication by association: how the COVID-19 pandemic has shown relationships between authors and editorial board members in the field of infectious diseases. BMJ Evidence-Based Medicine, [S. l.], p. bmjebm-2021-111670, 2021. Disponível em: https://ebm.bmj.com/content/27/3/133. Acesso em: 18 maio. 2023.
https://ebm.bmj.com/content/27/3/133...
; SCANFF et al., 2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) and even cases of editorial malpractice (BISHOP, 2016, 2020). In the specific case of editors publishing in their own journal, it is feared that they might influence peer review, but this does not seem to be happening, at least on a large scale (HELGESSON et al., 2022HELGESSON, G. et al. Editors publishing in their own journals: A systematic review of prevalence and a discussion of normative aspects. Learned Publishing, [s. l.], v. 35, n. 2, p. 229-240, 2022. Disponível em: https://onlinelibrary.wiley.com/doi/full/10.1002/leap.1449. Acesso em: 28 set. 2022.
https://onlinelibrary.wiley.com/doi/full...
).

Similarly, the presence of endogeneity can be verified in different ways, implying different interpretations. In the criteria for selection and permanence of journals in LILACS, BIREME (2020, 2021) emphasizes the diversity of institutional affiliations of authors, reviewers and editors. This indicator is transparent and reproducible and, perhaps for this very reason, relatively free of judgment on the quality of editorial practices. At the other extreme, one can look at the conduct of the editorial board in the event of problematic articles. This approach may more directly highlight bad editorial practices, but it is not practical on a large scale, nor before a journal achieves high visibility. Authorship concentration indices can be calculated on a large scale, even before a journal is indexed, but atypical values are only red flags, pointing to the possibility that one or more authors are being favored.

Both the coincidence of institutional affiliation and the concentration of authorship can arise from benign reasons. As Barradas and Pinheiro (2016BARRADAS, J. S.; PINHEIRO, L. V. R. Produtividade científica em defesa nacional. Tendências da Pesquisa Brasileira em Ciência da Informação, [s. l.] v. 9, n. 2, p. 1-21, set./dez., 2016. Disponível em: https://revistas.ancib.org/index.php/tpbci/article/view/394/394. Acesso em: 17 ago. 2021
https://revistas.ancib.org/index.php/tpb...
) remind us, researchers can publish in their institution's journal if the associate editor and reviewers are affiliated with another institution. Diversity of the editorial board is also important for editors at large to publish in their own journal, because then another editor without conflicts of interest can make the decisions. In the case of editors-in-chief, it is more difficult to guarantee the absence of conflicts of interest, but Moussa (2022MOUSSA, S. Should editors-in-chief publish in their own journals? “Publish elsewhere” is not a solution. European Science Editing, [S. l.], v. 48, p. e90552, 2022. Disponível em: https://ese.arphahub.com/article/90552/. Acesso em: 18 maio. 2023.
https://ese.arphahub.com/article/90552...
) proposes transparency in peer review as a way to ensure that due editorial process is being followed.

With respect to authorship concentration, an editor could be a prolific author in the same journal precisely because his or her productivity in the journal motivated the invitation to the editorial board. Moreover, Scanff et al. (2021SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133. Acesso em: 18 maio 2023.
https://journals.plos.org/plosbiology/ar...
) highlight a number of reasons why an author could account for a large portion of the articles in a journal without any editorial malpractice taking place. It may be that the author is in a particularly productive phase, not only in the journal in question but also in others. It may also be that the author has a more specific role in a series of articles within the scope of the journal, such as data analysis or general oversight of a broad research project. In addition, articles from more established authors could be easier to review or for reviewers to accept the invitation.

Beyond answering its objective, this study has implications for both research and journal evaluation. One implication for research is that qualitative studies on the relationship between university publishing and endogeneity would benefit from focusing their efforts on journals not yet included in LILACS, at least in the health sciences. Another implication is the need for a mathematical formalization of the relationship between journal size and authorship concentration indexes. If an ideally non-endogenous journal increased or decreased in number of signed articles, how would that affect the indexes? Such knowledge would enable more precise interpretation of the indexes, and allow one to confidently compare countries or subjects, as well as to investigate whether larger journals are generally less or more endogenous than smaller ones.

An implication for practice is that journal evaluations, both internal and external, should always mind the journal size when interpreting the authorship concentration indexes. While a journal publishing a thousand articles can be expected to have its most prolific author signing only 1% of them (ten articles), journals publishing fifty articles have a lower bound of at least 2% for even the least prolific authors. Likewise, larger journals can attend to larger and more heterogeneous scientific communities than smaller journals, and the Gini coefficient (or any other inequality measurement, really) for aggregate populations is larger than the Gini coefficient of their sub-populations, if there’s any inequality among said sub-populations (PYATT, 1976PYATT, G. On the Interpretation and Disaggregation of Gini Coefficients. The Economic Journal, [s. l.], v. 86, n. 342, p. 243-255, 1976. Disponível em: https://www.jstor.org/stable/2230745. Acesso em: 18 maio 2023.
https://www.jstor.org/stable/2230745...
).

In summary, journals indexed in LILACS seem to be as (little) endogenous as those indexed in MEDLINE. Recently proposed as indicators of endogeneity, indexes of authorship concentration are particularly sensitive to journal size, but the extent to which this is an artifact of the indicators remains unclear. Until more sophisticated indicators of endogeneity are produced, journal evaluation should consider the size of journals if it is to employ measures of authorship concentration.

AGRADECIMENTOS

The research question was chosen in collaboration with Bruna Erlandsson and Ana Marlene Morais, from Linceu Editorial.

This study relied on bibliographic open data curated by the Pan American Health Organization’s Latin American and Caribbean Center on Health Sciences Information (BIREME), as well as open data which Scanff and colleagues (2021) derived from bibliographic data provided by the United States National Library of Medicine. None of them bear any responsibility for any errors this manuscript might have.

REFERENCES

  • AMORIM, K. M. DE O. et al. Evaluation Systems of Scientific Journals in Latin America. In: ALPERÍN, J. P.; FISCHMAN, G. (ed.). Made in Latin America: open access, scholarly journals, and regional innovations. Ciudad Autónoma de Buenos Aires: CLACSO, 2015. p. 61-74.
  • BARRADAS, J. S.; PINHEIRO, L. V. R. Produtividade científica em defesa nacional. Tendências da Pesquisa Brasileira em Ciência da Informação, [s. l.] v. 9, n. 2, p. 1-21, set./dez., 2016. Disponível em: https://revistas.ancib.org/index.php/tpbci/article/view/394/394 Acesso em: 17 ago. 2021
    » https://revistas.ancib.org/index.php/tpbci/article/view/394/394
  • BEIGEL, F. et al. OLIVA: una mirada transversal a la producción científica indexada en América Latina. Diversidad disciplinar, colaboración institucional y multilingüismo en SciELO y Redalyc. [S. l.: s.n.], [2021]. Disponível em: https://preprints.scielo.org/index.php/scielo/preprint/view/2653/version/2808 Acesso em: 17 ago. 2021.
    » https://preprints.scielo.org/index.php/scielo/preprint/view/2653/version/2808
  • BISHOP, D. V. M. Editorial integrity: Publishers on the front line. BishopBlog, 11 jun. 2016. Disponível em: http://deevybee.blogspot.com/2016/06/editorial-integrity-publishers-on-front.html Acesso em: 18 maio 2023
    » http://deevybee.blogspot.com/2016/06/editorial-integrity-publishers-on-front.html
  • BISHOP, D. V. M. “Percent by most prolific” author score: a red flag for possible editorial bias. BishopBlog, 12 jul. 2020. Disponível em: http://deevybee.blogspot.com/2020/07/percent-by-most-prolific-author-score.html Acesso em: 18 maio. 2023
    » http://deevybee.blogspot.com/2020/07/percent-by-most-prolific-author-score.html
  • BOAS, R. F. F.; CAMPOS, F. DE F.; AMARO, B. Análise dos critérios formais de qualidade editorial: a política de classificação de periódicos científicos a partir do Qualis Periódicos. Informação & Informação, Londrina, v. 26, n. 1, p. 28-52, 2021. Disponível em: https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/39985 Acesso em: 18 maio 2023.
    » https://ojs.uel.br/revistas/uel/index.php/informacao/article/view/39985
  • CLARK, O. A. C.; CASTRO, A. A. Searching the Literatura Latino Americana e do Caribe em Ciências da Saúde (LILACS) database improves systematic reviews. International Journal of Epidemiology, [s. l.] v. 31, n. 1, p. 112-114, fev. 2002. Disponível em: https://doi.org/10.1093/ije/31.1.112 Acesso em: 18 maio 2023.
    » https://doi.org/10.1093/ije/31.1.112
  • COUNCIL OF SCIENCE EDITORS. CSE’s White Paper on Promoting Integrity in Scientific Journal Publications. Wheat Ridge: Council of Science Editors, 2018. Disponível em: http://www.seaairweb.info/journal/3.CouncilofScientific-Editors-White-Paper.pdf Acesso em: 18 maio 2023.
    » http://www.seaairweb.info/journal/3.CouncilofScientific-Editors-White-Paper.pdf
  • DAVIDSON, R. Reliable inference for the Gini index. Journal of Econometrics, [s. l.], v. 150, n. 1, p. 30-40, maio 2009. Disponível em: https://www.sciencedirect.com/science/article/abs/pii/S0304407609000323 Acesso em: 18 maio 2023.
    » https://www.sciencedirect.com/science/article/abs/pii/S0304407609000323
  • FISCHMAN, G. E.; ALPERIN, J. P.; WILLINSKY, J. Visibility and Quality in Spanish-Language Latin American Scholarly Publishing. Information Technologies & International Development, [S. l.], v. 6, n. 4, p. 1-21, dez. 2010. Disponível em: https://itidjournal.org/index.php/itid/article/view/639.html Acesso em: 18 maio 2023.
    » https://itidjournal.org/index.php/itid/article/view/639.html
  • FONTENELLE, L. F. leofontenelle/authorship-concentration: Improved analytic code for “Authorship concentration in health sciences journals from Latin America and the Caribbean”. Zenodo, 28 set. 2022. Disponível em: https://zenodo.org/record/7121200 Acesso em: 28 set. 2022.
    » https://zenodo.org/record/7121200
  • GAGOLEWSKI, M. Stringi: Fast and Portable Character String Processing in R. Journal of Statistical Software, [s. l.], v. 103, n. 2, 2022. Disponível em: https://www.jstatsoft.org/article/view/v103i02 Acesso em: 28 set. 2022.
    » https://www.jstatsoft.org/article/view/v103i02
  • HELGESSON, G. et al. Editors publishing in their own journals: A systematic review of prevalence and a discussion of normative aspects. Learned Publishing, [s. l.], v. 35, n. 2, p. 229-240, 2022. Disponível em: https://onlinelibrary.wiley.com/doi/full/10.1002/leap.1449 Acesso em: 28 set. 2022.
    » https://onlinelibrary.wiley.com/doi/full/10.1002/leap.1449
  • INTERNATIONAL COMMITTEE OF MEDICAL JOURNAL EDITORS. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. [S. l.], dez. 2021. Disponível em: http://www.icmje.org/recommendations/. Acesso em: 11 fev. 2022
    » http://www.icmje.org/recommendations
  • JASSO, G. On Gini’s Mean Difference and Gini’s Index of Concentration. American Sociological Review, [s. l.], v. 44, n. 5, p. 867-870, 1979. Disponível em: https://www.jstor.org/stable/2094535 Acesso em: 11 fev. 2022.
    » https://www.jstor.org/stable/2094535
  • LATIN AMERICAN AND CARIBBEAN CENTER ON HEALTH SCIENCES INFORMATION. LILACS - Criterios de Selección y Permanencia de Revistas (2020). São Paulo, 2020. Disponível em: https://lilacs.bvsalud.org/es/revistas-lilacs/lilacs-criterios-de-seleccion-y-permanencia-de-revistas-2020/. Acesso em: 18 maio. 2023.
    » https://lilacs.bvsalud.org/es/revistas-lilacs/lilacs-criterios-de-seleccion-y-permanencia-de-revistas-2020
  • LATIN AMERICAN AND CARIBBEAN CENTER ON HEALTH SCIENCES INFORMATION. Criteria for Selection and Permanence of Journals LILACS Brazil (2021). São Paulo, 2021. Disponível em: https://lilacs.bvsalud.org/en/lilacs-journals/criteria-for-selection-and-permanence-of-journals-lilacs-brazil-2021/. Acesso em: 18 maio. 2023.
    » https://lilacs.bvsalud.org/en/lilacs-journals/criteria-for-selection-and-permanence-of-journals-lilacs-brazil-2021
  • LOCHER, C. et al. Publication by association: how the COVID-19 pandemic has shown relationships between authors and editorial board members in the field of infectious diseases. BMJ Evidence-Based Medicine, [S. l.], p. bmjebm-2021-111670, 2021. Disponível em: https://ebm.bmj.com/content/27/3/133 Acesso em: 18 maio. 2023.
    » https://ebm.bmj.com/content/27/3/133
  • MOUSSA, S. Should editors-in-chief publish in their own journals? “Publish elsewhere” is not a solution. European Science Editing, [S. l.], v. 48, p. e90552, 2022. Disponível em: https://ese.arphahub.com/article/90552/. Acesso em: 18 maio. 2023.
    » https://ese.arphahub.com/article/90552
  • PAZ ENRIQUE, L. E.; PERALTA GONZÁLEZ, M. J.; HERNÁNDEZ ALFONSO, E. A. Estudio bibliométrico de la Revista Centro Agrícola, Cuba. e-Ciencias de la Información, [s. l.], v. 6, n. 2, p. 1, jun. 2016. Disponível em: https://www.redalyc.org/journal/4768/476852098002/html/. Acesso em: 18 maio. 2023.
    » https://www.redalyc.org/journal/4768/476852098002/html
  • PYATT, G. On the Interpretation and Disaggregation of Gini Coefficients. The Economic Journal, [s. l.], v. 86, n. 342, p. 243-255, 1976. Disponível em: https://www.jstor.org/stable/2230745 Acesso em: 18 maio 2023.
    » https://www.jstor.org/stable/2230745
  • R CORE TEAM. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing, 2022.
  • ROZEMBLUM, C. et al. Calidad editorial y calidad científica en los parámetros para inclusión de revistas científicas en bases de datos en Acceso Abierto y comerciales. Palabra Clave (La Plata), La Plata, v. 4, n. 2, p. 64-80, abr. 2015. Disponível em: https://www.redalyc.org/pdf/3505/350539940001.pdf Acesso em: 18 maio 2023.
    » https://www.redalyc.org/pdf/3505/350539940001.pdf
  • SARIGÖL, E. et al. Quantifying the effect of editor-author relations on manuscript handling times. Scientometrics, [s. l.], v. 113, n. 1, p. 609-631, 2017. Disponível em: https://doi.org/10.1007/s11192-017-2309-y Acesso em: 18 maio 2023.
    » https://doi.org/10.1007/s11192-017-2309-y
  • SCANFF, A. et al. A survey of biomedical journals to detect editorial bias and nepotistic behavior. PLOS Biology, [s. l.], v. 19, n. 11, p. e3001133, nov. 2021. Disponível em: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133 Acesso em: 18 maio 2023.
    » https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001133
  • WICKHAM, H. Ggplot2: Elegant Graphics for Data Analysis. 2 nd. [S.l.]: Springer-Verlag New York, 2016.
  • WORLD ORGANIZATION OF MEDICAL EDITORS. The Relationship Between Journal Editors-in-Chief and Owners. [S. l.], 2009. Disponível em: https://wame.org/editorial-independence Acesso em: 11 fev. 2022.
    » https://wame.org/editorial-independence
  • CONJUNTO DE DADOS DE PESQUISA

    The original data were obtained from BIREME. The derived dataset was deposited at Zenodo: https://doi.org/10.5281/zenodo.7120989.
  • FINANCIAMENTO

    This study was performed as a part of the Council of Science Editors’ Publication Certificate Program / Associação Brasileira de Editores Científicos’ Programa para Capacitação em Publicação Científica. The author received support from Sociedade Brasileira de Medicina de Família to participate in previous activities in this program, but no specific support for this study.
  • LICENÇA DE USO

    Os autores cedem à Encontros Bibli os direitos exclusivos de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution (CC BY) 4.0 International. Estra licença permite que terceiros remixem, adaptem e criem a partir do trabalho publicado, atribuindo o devido crédito de autoria e publicação inicial neste periódico. Os autores têm autorização para assumir contratos adicionais separadamente, para distribuição não exclusiva da versão do trabalho publicada neste periódico (ex.: publicar em repositório institucional, em site pessoal, publicar uma tradução, ou como capítulo de livro), com reconhecimento de autoria e publicação inicial neste periódico.
  • PUBLISHER

    Universidade Federal de Santa Catarina. Programa de Pós-graduação em Ciência da Informação. Publicação no Portal de Periódicos UFSC. As ideias expressadas neste artigo são de responsabilidade de seus autores, não representando, necessariamente, a opinião dos editores ou da universidade.

Edited by

EDITORES

Edgar Bisset Alvarez, Ana Clara Cândido, Patrícia Neubert, Genilson Geraldo, Jônatas Edison da Silva, Mayara Madeira Trevisol, Camila Letícia Melo Furtado e Beatriz Tarré Alonso.

Data availability

The original data were obtained from BIREME. The derived dataset was deposited at Zenodo: https://doi.org/10.5281/zenodo.7120989.

Publication Dates

  • Publication in this collection
    20 Oct 2023
  • Date of issue
    2023

History

  • Received
    19 Oct 2022
  • Accepted
    13 Jan 2023
  • Published
    28 June 2023
Universidade Federal de Santa Catarina Campus Universitário Reitor João David Ferreira Lima - Trindade. CEP-88040-900, Telefone: +55 (48) 3721-2237 - Florianópolis - SC - Brazil
E-mail: encontrosbibli@contato.ufsc.br