Acessibilidade / Reportar erro
Articles • Rev. Col. Bras. Cir. 42 (Suppl 1) • 2015 • https://doi.org/10.1590/0100-69912015S01020   copy

QUALIS PERIODIC EVALUATION: ANALYSIS OF QUALIS UPGRADE IN MEDICINE III

Authorship SCIMAGO INSTITUTIONS RANKINGS

Abstracts

Objective:

To evaluate the preliminary results related to journals up-grade that was used by Medicine III, through opportunity offered by Capes to all agency areas programs.

Methods:

Were used area document of Medicine I, II and III, besides other relevant topics available online at Capes site, between 2009 and 2013. The research was focused to answer two questions: 1) the stratification of Qualis is similar in the three areas of medicine? and 2) the evolution of Qualis in Medicine III was higher?

Results:

Medicine III showed an increase in its Qualis classification and is publishing in journals with higher impact factors, virtually the same as the Medicine I and II.

Conclusion:

The area showed the strongest growth in recent three-year periods.

Educational measurement; Periodical index; Quality control

Objetivo:

Avaliar os resultados preliminares sobre a Medicina III do up-grade oportunizado pela Capes para todas as áreas.

Métodos:

Foram utilizados os documentos de áreas e os relevantes ao tema disponíveis online no site da Capes entre 2009 e 2013. Procurou-se focar a pesquisa em dois aspectos para responder duas perguntas: 1) a estratificação do Qualis é semelhante nas três áreas da medicina? e 2) a evolução do Qualis da Medicina III foi maior?

Resultados:

A Medicina III apresentou evolução em sua classificação Qualis e está publicando em revistas com maior fator de impacto e é praticamente igual ao da Medicina I e II.

Conclusão:

A área foi a que apresentou maior evolução nestes últimos triênios

Avaliação educacional; Índice de periódicos; Controle de qualidade

INTRODUCTION

The Qualis classification is used by Capes for stratification value of intellectual production of all postgraduate programs in different areas. It is designed to meet the needs of the evaluation system and is based on information provided through the Coleta/Sucupira Platform that lists all journals. As a result, provides a list of the classification of journals used by programs for the dissemination of its production.

The objective of this study was to evaluate the preliminary results of the up-grade implanted by Medicine III on journals, representative of the area, accepting this opportunity offered by Capes for all areas.

METHODS

The following documents available online in Capes website were used: assessment/support instruments and classification of intellectual production; area document of Medicine I, 2013; area document of Medicine II, 2009; area document of Medicine II, 2013; area document Medicine III 2009; and area document Medicine III, 2013. Was searched in these documents the relevant topics that were related to the up-grade subject and its relationship to the area.

Was tried to answer two questions: 1) the stratification of Qualis is similar in the three areas of medicine? and 2) the evolution of Medicine III Qualis was higher?

RESULTS

The stratification of the quality of the scientific production is based on qualitative and quantitative criteria. Thus, the Qualis assesses the quality of articles and other types of production from the analysis of the impact factor (IF) of the indexing databases ISI-Web of Science and cites/doc in Scimago base.

The classification is made for the areas of assessment and must undergo annual update process. These vehicles are framed in strata indicative of quality: A1 (the highest); A2; B1; B2; B3; B4; B5 and C (the lowest value). The distribution of periodicals classified into A1 + A2 must be less than or equal to 25%; A1 <A2 and A1 + A2 + B1 less than or equal to 50%.

The application that allows the classification and consulting the Qualis areas, as well as disclosure of the criteria used for classification, is the WebQualis. Since when the Qualis was imposed in this way, it is observed increase in FI references in all areas; however, Medicine III was considered to have the smallest FI.

To answer the asked questions (stratification of Qualis is similar in the three areas of medicine? and 2) the evolution of Medicine III Qualis was higher?) were compared the Qualis strata of the three medical areas, using documents the areas through 2009 to 2013, and assessed their evolution.

The Medicine I presented 2009 Qualis with IF of 3.8 for stratum A1; 2.5 to A2; and 1.3 to B1. In 2013, were A1-4, A2-2,8 and B1-1,6 respectively (Table 1).

Thumbnail
TABLE 1
- Stratification of journals in WebQualis of Medicine I

Medicine II presented in 2009 Qualis with IF from 3.8 to stratum A1; 2.36 to A2; and 1.1 to B1. In 2013, were A1-4, A2-2,8 and B1-1,6 respectively (Table 2), so with criteria similar to those of Medicine I.

Thumbnail
TABLE 2
- Stratification of journals in WebQualis of Medicine II

The two areas Medicine I and II, not published document area in 2012.

On the other hand, in Medicine III Qualis classification published in 2009 and 2012 area document, considered two types of journals: the ones of the area and the "out of area", considering that it was believed that the journals from the surgical area would lower impact factor.

Thus began the area document in 2009 with 2.96 IF to stratum A1, 2.29 to A2 and 1.35 to B1 for journals considered on surgical area, and evolved to 3.3, 2, 63 and 1.5 respectively in the area ​​document published in 2012 (Table 3).

Thumbnail
TABLE 3
- Stratification of journals in WebQualis of Medicine III

In 2013, the Evaluation Committee for reclassification of Qualis, verified and ranked 1923 journals, putting IF 4.0 to A1, 2.85 to A2 and 1.6 to B1 stratum, regardless of whether or not in surgical area, maintaining the definition of the classification of the Qualis, ie distribution of journals classified in A1 + A2 must be less than or equal to 25%, A1 <A2 and A1 + A2 + B1 less than or equal to 50% (Table 4).

Thumbnail
TABLE 4
- Journal distribution (absolute and relative value) in Medicine III according to the strata in WebQualis

This committee discussed the validity of considering whether a journal is in area or not, in view of the postgraduate interdisciplinary and how this fact was demonstrated when analyzing the journals in which the articles produced by the programs have been published.

Another fact to be taken into account is that Medicine III, after consultation and discussion involving all the coordinators of the programs in this area, decided for the last year of the past three years, to up-grade to A2 articles published in Acta Brazilian Cirurgica and B1 to the Journal of Brazilian College of Surgeons, because both are in general surgery - clinic and experimental - so, all Medicine III programs could be included on them. This classification only valued to a limited number of publications and had as objective the enhancement of national journals. It should be said, that in the recent 2013 evaluation it did not bring major changes to the program evaluations and it was considered only one year (2012) of the triennial assessment.

As can be seen in absolute numbers, the Qualis rating for the three areas is almost the same, except the A2 extract in Medicine III that is greater; when the percentage change in the three areas is considered, the data are described in Figures 1, 2 and 3.

FIGURE 1
- Percentage change in Medicine I Qualis

FIGURE 2
- Percentage change in Medicine II Qualis

FIGURE 3
- Percentage change in Medicine III Qualis

This evolution in Qualis, did not change the production, distribution on the evaluation process and number of postgraduate students, as shown in Tables 5, 6, 7 and 8.

Thumbnail
TABLE 5
- Evolution of the number of postgraduate programs notes 5, 6 and 7 of Medicines I, II and III in the triennial evaluations of 2007 and 2011

Thumbnail
TABLE 6
- Number of articles published in Qualis-Periodicals strata in the years 2007-2011 of Medicine III

Thumbnail
TABLE 7
- Distribution of the number of articles in Qualis Periodicals strata of joint production student/teacher in the years 2007-2011 of Medicine III

Thumbnail
TABLE 8
- Number of master and doctor graduates in 2007 to 2011 in Medicine III

These results demonstrate that the percentage change in Medicine III was greater than in other areas, especially in the strata A1 and A2.

DISCUSSION

Medicine III showed an increase in its Qualis classification and is publishing in journals with higher IF. Currently the Qualis is virtually the same as the Medicine I and II, and Medicine III was the area that had the highest evolution in recent three-year periods. Although the IF had increased, the distribution of publications remained the same, and the distribution of ratings improved.

CONCLUSION

The area showed the strongest growth in recent three-year periods.

REFERENCES

Publication Dates

  • Publication in this collection
    2015

History

  • Received
    19 Feb 2015
  • Accepted
    12 Sept 2015
Creative Common - by 4.0
This is an open-access article distributed under the terms of the Creative Commons Attribution License
Colégio Brasileiro de Cirurgiões Rua Visconde de Silva, 52 - 3º andar, 22271- 090 Rio de Janeiro - RJ, Tel.: +55 21 2138-0659, Fax: (55 21) 2286-2595 - Rio de Janeiro - RJ - Brazil
E-mail: revista@cbc.org.br
Acompanhe os números deste periódico no seu leitor de RSS