Brazilian scientific journals in Speech-language and hearing science: impact indicator

Abstracts

TEMA: valor global dos artigos científicos publicados em periódicos nacionais da Fonoaudiologia brasileira por meio do cálculo de Fator de Impacto (FI). OBJETIVO: conhecer parte da Fonoaudiologia brasileira à luz de seus periódicos científicos: caracterização de indicador de impacto - aqui, o FI. Foram analisados os sete periódicos nacionais de Fonoaudiologia (1986/2001) registrados no Instituto Brasileiro de Informação em Ciência e Tecnologia (Ibict) e, portanto, já possuidores do International Standard Serial Number (ISSN). Para se calcular o FI dos periódicos, as listas de referências bibliográficas dos artigos publicados foram consultadas e a fórmula original de Garfield foi aplicada nos sete periódicos pesquisados. Foram consideradas para esta contagem as referências bibliográficas constantes nos artigos de pesquisa, de relato de caso, de revisão de literatura e de atualização. Foram excluídos os trabalhos descritos nos sumários dos periódicos como cartas ao editor; editorial; resumos; comentários e outros. Desta forma, foram analisadas as 9.334 referências bibliográficas dos 549 artigos analisados nos sete periódicos, excluindo-se as autocitações de autores. Pela análise dos dados, observou-se que os FIs resultantes mostraram valores praticamente nulos. CONCLUSÕES: os resultados apresentados demonstram que a Fonoaudiologia brasileira precisa desenvolver alguns aspectos em seus processos de difusão científica - as pesquisas da Fonoaudiologia brasileira estão se perdendo, sendo necessário que os editores aumentem o acesso e a visibilidade de seus periódicos e os fonoaudiólogos brasileiros citem os trabalhos de seus antecessores e parceiros nacionais. De acordo com os dados encontrados, para a Fonoaudiologia brasileira faz-se necessária a publicação de 11,9 artigos para a citação de apenas um destes artigos. Observa-se que os FIs da Fonoaudiologia brasileira, entre estes sete periódicos, aumentaram a partir do ano de 1999, sugerindo um amadurecimento desta Ciência. A continuação desta pesquisa nos anos subseqüentes a 2001 é necessária para a possível verificação do real aumento do impacto destes artigos.

Fonoaudiologia; Revistas; Bases de Dados; Bibliometria; Fator de Impacto

UPDATE ARTICLES

Brazilian scientific journals in Speech-language and Hearing Science: impact indicator^*

Heliane Campanatti-Ostiz^I; Claudia Regina Furquim de Andrade^II

^IFonoaudióloga. Mestre em Semiótica e Lingüística Geral pela Faculdade de Filosofia, Letras e Ciências Humanas da Universidade de São Paulo. Presidente da Pró-Fono Produtos Especializados para Fonoaudiologia

^IIFonoaudióloga. Professora Titular. Departamento de Fisioterapia, Fonoaudiologia e Terapia Ocupacional da Faculdade de Medicina da Universidade de São Paulo

^{Endereço para correspondência}

ABSTRACT

BACKGROUND: global value of scientific papers published in national journals of the Brazilian Speech-language and Hearing Science analyzed through the Impact Factor (IF).

PURPOSE: to analyze part of the Brazilian Speech-Language and Hearing Science through its scientific journals: characterization of the impact indicator – in this case the Impact Factor (IF). Seven national Speech-language and Hearing Science journals (1986/2001) registered in the Brazilian Institute of Information in Science and Technology (Ibict) and with a given International Standard Serial Number (ISSN) were analyzed. In order to calculate the IF of the scientific journals, the lists of bibliographic references of the published papers were consulted and the original formula of Garfield was used, adapting it to the seven journals. Bibliographic references cited in the research papers, in the case studies, in the review and update articles were considered for analyses. Researches which were cited in the summaries like letters to the editors; editorial, abstracts, commentaries and others were excluded. A total of 9,334 bibliographic references of 549 papers were analyzed, excluding self-citations of authors. It was observed that the resulting IFs revealed practically null values. The obtained results demonstrate that the Brazilian Speech-language and Hearing Science needs to develop a few aspects of its editorial and scientific processes – the researches of the Brazilian Speech-language and Hearing Science are being lost, making it necessary for the editors to raise the access and visibility of their journals and for the speech-language and hearing scientists to cite the work of their antecessors and national partners. According to the obtained data, for the Brazilian Speech-language and Hearing Science, the publication of 11.9 papers is necessary for only one of these papers to be cited in another research. It is observed that the IFs of the Brazilian Speech-language and Hearing Science, among these seven journals, have risen since 1999, suggesting a development of this Science. The follow up of this research, analyzing the years subsequent to 2001, is necessary in order to verify the real raise of the impact of these articles.

Key Words: Speech-Language and Hearing Sciences; Periodicals - Statistics & Numerical Data; Databases; Bibliometrics; Impact Factor.

Introduction

Price in his book of 1976 makes considerations about the scientometric indicators. According to this author this indicators may help to measure each nation's contribution to the world's research corpora, geographically place them according to authors and subjects and measure the growth of science.

Scwartzman (1984) wrote that the History of Science can only be really understood if it is submitted to the same observation and interference methods that it applies to the study of natural and social phenomena. In other words, if it is constituted by an empirical Science of Science.

Nowadays there are several sciences devoted to the study of Science: the Philosophy of Science, the Sociology of Science, the Psychology of Science, the Economy of Science, the Political of Science, the Semiotics of Science, the Analysis of the Scientific Discourse and the Science of Science (Witter, 1987).

Velho (1990) mentions that despite these scientometric indicators were developed in core scientific countries they are also used in Latin-America.

Spinak (1998) refers that the scientific mediation in the basis of the scientometric indicators. The mediation techniques have just a little more than three decades of existence and are still not completely consolidated. There is still no consensus about how to measure and evaluate the scientific production. Even so, he divides the scientometric indicators in two large groups:

1. Publishing indicators: measure the amount and impact of scientific publications. Examples: number of papers per country, per discipline, rate of publication growth, authors' productivity, mean duration of publications, vocabulary use, and others.

2. Citation indicators: measure the amount and impact of links or relations between scientific publications. Examples: citation analysis, immediate responsiveness index, rate of self citations, impact factors, and others.

In order to consider the scientometric indicators Trzesniak (1998) points out to the existence of deterministic and estocastic indicators. The first are characterized by the direct link between cause and effect - its' value measure its own effect. The estocastic measure the effect's occurrence probability. This is the case of the Impact Factor (IF) when applied to evaluate the quality of a journal, an author or a field of knowledge.

Still according to Trzeniak, in the exact sciences the deterministic characteristics prevail. The phenomena in this area may be perfectly quantified in one singular value, as for example the notion of hot and cold. With the physic concept of "temperature" and the use of thermometers this notion can be transformed in a number that makes sense to the Men. To other areas of knowledge, specially the human sciences, predominantly estocastic, efforts to quantify phenomena are being made: the ecometry to economy, the sociometry to social sciences, the psychometry to personality and other human abilities, and the scientometrics, informetrics and bibliometrics sutudies to knowledge production and diffusion.

In another approach of scientometric indicators Bicas et al (2002) consider that they vary according to a series of variables as the publication language, nature of the subject, prestige publishing institution, immediate responsiveness, mean number of authors, authors', institutions' prestige, diffusion, number of published papers and journal's importance.

According to Elkis (1999), Bicas et al. (2002), Strehl and Santos (2002) the most used scientometric indicators nowadays are:

1. Productivity index: relation between the number of citations of one determined author and the number of papers corresponding to those citations.

2. Publication's half-life index: time (in years) corresponding to the appearance in scientific literature of 50% of the total of citations attributed to a journal in the first 6 years after the year of reference. This indicator provides a notion about how long the papers of a given journal continue to be cited.

3. Immediate responsiveness index: number of times a specific paper of a specific journal is cited (in all journals) during the year of its publication. This indicator provides a notion about the speed with which a production is referred.

4. Impact factor: the most used indicator.

In 1955 Eugene Garfield proposed the concept of Impact Factor (IF) in a paper published in the journal Science. In 1958 he founded the Institute for Scientific Information (ISI) in Philadelphia (USA), the first computerized data base to the study of the world's scientific production. This way, the IF was originally calculated only among the journals indexed in the ISI data base which, according to the same Institute (ISI, n.d.), covers approximately 7.000 journal (230 categories, 60 countries and 3000 publishers).

The Garfield formula to calculate the IF is:

It should be observed that the denominator in this formula withdraws the advantage of journals with greater number of papers.

The IF can be calculated to different periods of time, by increasing the number of considered years of which to count the number of papers and citations. This way, considering the years (X-1), (X-2) and (X-3) on the numerator and on the denominator, the three years IF is obtained. The five years IF is also usually calculated.

The IF account aims to determine a paper's global value. The number of times a journal is cited shows the visibility and accessibility of published research and how much they are influencing posterior works.

According to O'Neil (2000), the IF is a rate that shows the mean influence of a paper, published on a given year, influenced the work of other researchers on the second and third years after its publication.

In 1995 the IF creator warned about Latin-American science's the need of citation indexes in order to avoid injustices in several areas, as research funding, professional employment and qualification of journals, among others.

"...What the ISI database represents is the set of journals that constitute the internationally influential literature. It does not represent the science of any given country or region as a whole, but it does represent the portion of research that is published within and cited within the nternationally elite literature. Beyond that, it generally represents the best science performed in any nation ( ) Of course, key research is communicated in regional or local journals not indexed by ISI, which serve as important, even essential, vehicles for communication for members of a local or regional community ( ) Such a database does not yet exist, although I have suggested for some years that a Latin American Citation Index would be an interesting undertaking " (Garfield, 1995.p.88).

The Scientific Electronic Library On-Line (SciELO) appeared in the decade of 1990 to increase the visibility of the Science produced in Brazil. It is a model of cooperative electronic publication of scientific journals in the Web specially developed to answer to the scientific communication needs in developing countries and in Latin America and Caribbean specially. It contains integrated procedures to measure the use and impact of scientific journals (Biojone, 2001).

Since 2002 SciELO presents the IFs of the journals indexed in its data base. IFs referring to periods of two or three years are available (SciELO, n.d.).

In the researched literature (MEDLINE. Lilacs, SciELO, Capes, Dedalus, Probe, Bireme's central library) just one specific analysis of Audiology, Speech and Language journals was found, preformed by the American Speech and Hearing Association (ASHA, n.d.a.).

ASHA is an American professional and scientific association with more than 109 thousand speech and language pathologists and audiologists, with the mission of guarantee that all individuals with language, speech and auditory impairment may reach quality services that may help them obtain a more effective communication (ASHA, n.d.b.).

This association today is responsible for four scientific journals: Language, Speech and Hearing Services in Schools (LSHSS), American Journal of Audiology (AJA), American Journal of Speech-Language Pathology (AJSLP) and Journal of Speech, Language and Hearing Research (JSLHR). Its site provides the following data about their journals: creation, circulation rate, IF, total of published pages, acceptance and rejection rates, time between acceptance and publication of research, among other information (ASHA.n.d.a.).

ASHA journal's IFs in the year of 2000 can be observed in Chart 1, with the exception of AJA that is not included in ISI:

Objective

Once the scientific production is the materialization of produced knowledge and considering that bibliometrics and scientometrics analysis help to demonstrate the development of a science and its scientific production, the purpose of this paper in to determine the Impact Factor of the seven Brazilian journals on the area of Audiology, Speech and Language Pathology registered on the Brazilian Institute of Science and Technology Information (Ibict) and so having an International Standard Serial Number (ISSN) (Chart 2).

The Register Protocol of Journal Impact Indicator (Priip - ^Annex - Campanatti-Ostiz, 2004) was developed to this research.

Considering that, until march 2003 none of these journals was indexed in the Scientific Eletronic Library On-Line (SciELO) and thus having no IF rate on this data base and that the present research is related to Brazilian journals of Audiology, Speech and Hearing Pathology, we choose to calculate the IF as originally proposed by Garfiled.

To calculate the journal's IF the reference lists of each paper were analyzed. The references of research, case studies, literature review and update papers were considered. Letter to the editor, editorials, abstracts, commentaries and others were excluded. The following procedures were applied:

1. Register on the protocol the number of times the participating journals were cited in the papers' references (considering the two years prior to the publication of the analyzed journal).

2. Apply the original Garfiled formula to the IF calculus on the seven papers included in this research.

A given journal participates on the IF determination only after two complete years after its publication. This way, despite the journal Pró-Fono Revista de Atualização Científica has been first published in 1989, its IF started to be rated only in 1992, because during 1989 just one issue was published. The Jornal Brasileiro de Fonoaudiologia wasn't included since its first issue was published in the end of 1999 and thus could only participate in the 2002 rating and this year wasn't included in this study.

This way, to the IF ratings of the years between 1992 and 1998 the participating journals were: Distúrbios da Comunicação and Pró-Fono Revista de Atualização Científica. In 1999 were included the journals Fono Atual and Revista da Sociedade Brasileira de Fonoaudiologia. The journal Fonoaudiologia Brasil was included in the ratings of 2000. To the 2001 ratings the journal Revista Cefac Atualização Científica em Fonoaudiologia was included.

This research will present the estocastic indicators when isolated observations of the numbers presented don't provide any conclusions (Trzeniak, 1998). Results must be analyzed along with several other aspects to support consistent statements.

The 9.334 references of 549 papers from the seven journals were analyzed. To guarantee an impartial evaluation of each research the authors' self-citations were excluded, as recommended by Meadows (1999).

Table 1 presents the IF of 1992. To this analysis the 23 papers published in 1992 by the journals Distúrbios da Comunicação and Pró-Fono Revista de Atualização Científica were studied.

The search for references of papers published in these same journals on the two years immediately prior, on the 366 references of the 23 papers published in 1992, found just one reference of the first journal (Distúrbios da Comunicação) resulting in a IF of 0,050. This way 366 references were needed to find one reference of a paper published in the period of 1990-1991, meaning that just 0,3% of the references published in 1992 referred to papers published in both journals in the two years prior to the analysis.

Tables 2, 3, 4, 5, 6 and 7 show the IF of the years between 1993 and 1998.

The years of 1993, 1994, 1995, 1996 and 1998 presented IF equal zero (Tables 2, 3, 4, 5 and 7). To the ratings of these five years 151 papers were analyzed. This 151 papers published 2.499 references and none of them referred to papers published in the journals Distúrbios da Comunicação and Pró-Fono Revista de Atualização Científica in the two years prior to the considered year.

The Table 6 shows the IF of 1997. To this analysis 35 papers published in 1997 by the journals Distúrbios da Comunicação and Pró-Fono Revista de Atualização Científica were studied. The search for references of papers published two years before on the 640 references of these 1997 papers identified seven references, resulting on IFs of 0,100 for the first paper (Distúrbios da Comunicação) and 0,128 for the second (Pró-Fono Revista de Atualização Científica). This way 640 references were needed to find seven references of papers published in the period of 1995-1996, that means 91,4 references for each paper referred.

Just 1% of the references published in 1997 referred to papers published in these journals in the two years immediately before the analysis.

The correction effect produced by the denominator of the IF formula can be observed in Table 6. The journal Pró-Fono Revista de Atualização Científica was referred six times in 1997, considering papers published in 1995 and 1996. On the other hand the journal Distúrbios da Comunicação was cited just once. Even so the IF of the journal Pró-Fono Revista de Atualização Científica is just 0,028 higher than the IF of the journal Distúrbios da Comunicação in 1997. The reason the IFs are almost the same is that the journal Pró-Fono Revista de Atualização Científica published 47 papers in 1995 and 1996 while the journal Distúrbios da Comunicação published just 10 in the same period. If the correction factor was not used the IF of the journal Pró-Fono Revista de Atualização Científica would be significantly higher than the IF of the journal Distúrbios da Comunicação in the year of 1997.

Table 8 shows the IF of 1999. To the 1999 IF analysis, the 89 papers published buy the journals Pró-Fono Revista de Atualização Científica, Distúrbios da Comunicação, Fono Atual and Revista da Sociedade Brasileira de Fonoaudiologia were studied. The search for references to papers published in the two immediately prior years, in these journals, in the 1.363 references of the papers published in 1999, six citations were found. This way, 1.363 references were needed to find six references of papers published in the 1997-1998 period, it means 227,2 references to each citation found (1362 references divided by six citations).

Just 0,4% of the references published in 1999 referred to papers published in these four journal in the two years before the analysis.

Table 8 also shows the correction provided by the denominator of the IF formula. The IFs of the journals Pró-Fono Revista de Atualização Científica and Revista da Sociedade Brasileira de Fonoaudiologia are almost the same (0,073 and 0,047, respectively). The journal Pró-Fono Revista de Atualização Científica published 55 papers in 1997 and 1998 and received four citations in 1999 referring the two prior years. The journal Revista da Sociedade Brasileira de Fonoaudiologia published 43 papers in 1997 and 1998 and in 1999 received two citations of the two prior years.

Table 9 shows the IF of the year 2000. To the analysis of the IF of 2000, 112 papers published in 2000 by the journals Distúrbios da Comunicação, Pró-Fono Revista de Atualização Científica, Fono Atual, Revista da Sociedade Brasileira de Fonoaudiologia and Fonoaudiologia Brasil were studied. The search for references to papers published in the two immediately prior years, in these journals, in the 1.893 references of the papers published in 2000, 14 citations were found. It resulted on an IF of 0,009 to the first journal, 0,068 to the second, 0,022 to the third, 0,128 to the fourth and 0,077 to the fifth. This way, 1893 references were needed to find 14 citations of papers published in the 1998-1999 period, that means 135,2 references to each citation (1893 references divided by 14 citations).

Only 0,7% of the references published in 2000 referred to papers published in these five journals in the two years immediately prior to the analysis.

The Table 9 shows two citations of the journal Distúrbios da Comunicação. Further analysis show that both citations refer to one paper published by the journal Revista da Sociedade Brasileira de Fonoaudiologia with a total of just seven references. The Revista da Sociedade Brasileira de Fonoaudiologia presented the highest IF (0,128). This journal received five citations in 2000 referring to papers published in 1998. The analysis of these five citations shows that three of them mention the same paper: Chewing and swallowing habits in 3 to 5 years children by Meurer, B; Veiga, l; Capp, E. According to the research performed by Andrade (2001) the publishing productivity in the Speech and Language area is almost three times as large as that of Audiology and Hearing Sciences area, while in the third area, Educational and Professional Support the productivity was nears zero. When considering the research fields, the higher IF was observed in the field of oral miofunctional developmental disorders. These results may explain why just one paper represents 60% of the citations of a journal in two years.

The Table 10 shows the IF of 2001. To the analysis of the IF of 2001, 139 papers published in 2001 by the journals Distúrbios da Comunicação, Pró-Fono Revista de Atualização Científica, Fono Atual, Revista da Sociedade Brasileira de Fonoaudiologia, Fonoaudiologia Brasil and Revista Cefac Atualização Científica em Fonoaudiologia were studied. The search for references to papers published in the two immediately prior years, in these journals, in the 2.573 references of the papers published in 2001, 15 citations were found. It resulted on an IF of 0,138 to the first journal, 0,054 to the second, 0,036 to the third, 0,061 to the fourth, 0,067 to the fifth and 0,044 to the fifth. This way, 2573 references were needed to find 15 citations of papers published in the 1999-2000 period, that means 171,5 references to each citation (2573 references divided by 15 citations).

Just 0,6% of the references published in 2001 referred to papers in these six journals in the two years prior to the analysis.

It can be observed in Table 10 the existence of 15 citations of papers published in 1999 and in 2000. The highest IF was obtained by the journal Distúrbios da Comunicação (0,138).

In the Table 11 are presented the IF values of the analyzed journals in the period between 1992 and 2001.

Conclusions

Despite Brazilian Audiology, Speech and Language Pathology's IFs are close to zero, it is necessary to analyze which elements are the real reasons of these results. As Trzesniak (2001) pointed out it is very easy to count data and determine means and relations. The difficult part is to determine which are the information provided by the data and what they really mean.

Some hypothesis may be drawn from the results obtained in the ten years that were analyzed:

. low visibility of Lilacs data base, the indexer data base of the two journals that had IFs equal zero in some years;

. low accessibility of the journals;

. low interest by researchers in reading national journals;

. lack of reference to consulted papers;

. disparity between various available search tools in data bases (title, author, subject, key-words, among others) and searches based on subjects. Lilacs uses the DeCS (Describers in Social Sciences) in the indexation process and it doesn't properly address the terms of Brazilian Audiology, Speech and Language Pathology;

. absence of librarians that are experienced and familiarized with the peculiarities of Audiology, Speech and Language Pathology in the process of choosing the key words of a paper;

. combinations of the above items.

Considering the mean references needed to each citation in the years of 1992 (336 references to each citation), 1997 (91,4 references to each citation), 1999 (227,2 references to each citation), 2000 (135,2 references to each citation) and 2001 (171,5 references to each citation) the value obtained is 198,3 references needed to the citation of a paper published in the two prior years. According to the data presented the mean amount of references generated by a paper is 16,6 in Brazilian Audiology, Speech and Language Pathology. This way, it is necessary to publish 11,9 papers to obtain the citation of only one paper in Brazilian Audiology, Speech and Language Pathology.

It is possible to observe that the IFs of Brazilian Audiology, Speech and Language Pathology among the six journals with which it was possible to apply the formula increased since the year of 1999 suggesting a maturing process of this Science. The continuation of this research in the years after 2001 is necessary to verify if there really was an increase of the impact of these papers.

Sardemberg (2002), then the ministry of Sciences and Technology, wrote: "It is necessary that the international partners understand: the knowledge achieved in Brazilian territory must be presented hear first and just latter spread to and used by other countries". Amplifying this statement we add that not just the international partners but also our Brazilian authors must present their work first here. And that above all we Brazilians should thrive to know better the work of our fellow researchers.

The authors of this paper believe that the results presented here show that just the evaluation based solely in the journals' IFs is not conclusive, pointing to the necessity of other concurrent evaluations. Besides, the quality of a paper in inherent to itself and doesn't depend of its destination.

Despite that, some questions may be raised in the names of researchers, authors, reviewers and editors: to whom and with which purposes are we writing, evaluating, revising, editing, investing and publishing our scientific papers, spending so much effort and time?

Above all it is essential to ponder on what Andrade wrote in 2002:

" The impact index may be measured by calculating the n umber of studies were developed based on a given research (number of citations referring this research). The clinical impact of a research, how much that study contributed to improve the clinical practice, that is, the professional day-to-day work - it is impossible to measure ".

Acknowlegment: to professor Piotr Trzesniak for the elaboration of Table 11 and important contributions when revising this paper.

References

Recebido em 13.02.2005.

Revisado em 12.05.2005; 25.10.2005; 06.12.2005; 3.03.2006.

Aceito para Publicação em 3.03.2006.

Artigo de Atualização

Artigo Submetido a Avaliação por Pares

Conflito de Interesse: não

• BICAS, Harley E. A.; ROTHER, Edna Teresina; BRAGA, Maria Elisa Rangel. Fator de impacto, outros índices bibliométricos e desempenhos acadêmicos. Arq. Brás. Oftalmol., v. 65, p. 151-152, 2002.
• BIOJONE, Mariana Rocha. SciELO: modelo de publicação eletrônica para países em desenvolvimento. In: CURSO DE EDITORAÇÃO CIENTÍFICA, 10., 2001b, Atibaia (SP). Resumos... Rio de Janeiro: Associação Brasileira de Editores Científicos, 2001.
• CAMPANATTI-OSTIZ, Heliane. Periódicos nacionais em Fonoaudiologia: caracterização de termos, estrutural e de indicador de impacto. São Paulo, 2004. 423 p. Dissertação (Mestrado) - Faculdade de Filosofia, Letras e Ciências Humanas da Universidade de São Paulo. [corpus em CD]
• DISTÚRBIOS DA COMUNICAÇÃO. São Paulo: Pontifícia Universidade Católica de São Paulo, 1986-. Semestral. ISSN: 0102-762X
• ELKIS, H. Fatores de impacto de publicações psiquiátricas e produtividade científica. Revista Brasileira de Psiquiatria, v. 21, n. 4, dec. 1999. Disponível em: <www.scielo.org>. Acesso em: 14 fev. 2000.
• FONO ATUAL. São Paulo: Pancast, 1997- . Trimestral. ISSN: 1517-0632
• FONOAUDIOLOGIA BRASIL. Brasília (DF): Conselho Federal de Fonoaudiologia, 1998- . Semestral. ISSN 1516-8131
• GARFIELD, Eugene. Quantitative analysis of the scientific literature and its implications for science policymaking in latin america and the caribbean. Bulletin of the Pan American Health Organization. v. 29, n. 1, p. 87-95, 1995.
• JORNAL BRASILEIRO DE FONOAUDIOLOGIA. Curitiba (PR): Editora Maio, 1999- . Trimestral. ISSN 1517-5308
• MEADOWS, A. J. A comunicação científica. Tradução de Antonio Agenor Briquet de Lemos. Brasília (DF): Briquet de Lemos, 1999. 268 p. Título original: Communicating Research.
• O'NEILL, J. The significance of the impact factor: implications for the publishing community. Learned Publishing, v. 13, n. 2, p. 105-109, 2000.
• PRICE, Derek J. de Solla. O desenvolvimento da ciência: análise histórica, filosófica, sociológica e econômica. Tradução de Simão Mathias. Rio de Janeiro: Livros Técnicos e Científicos, 1976. 96 p. Título Original: Little Science, Big Science.
• PRÓ-FONO REVISTA DE ATUALIZAÇÃO CIENTÍFICA. Barueri (SP): Pró-Fono, 1989- . Trimestral até 2001. Quadrimestral a partir de 2002. ISSN 0104-5687
• REVISTA CEFAC ATUALIZAÇÃO CIENTÍFICA EM FONOAUDIOLOGIA. São Paulo: Revinter, 1999- . Semestral. ISSN 1516-1846.
• REVISTA DA SOCIEDADE BRASILEIRA DE FONOAUDIOLOGIA. São Paulo: SBFa, 1997- . Semestral. ISSN 1516-8034
• SARDEMBERG, Ronaldo. Conhecimento sobre o Brasil deve primeiro ser divulgado no Brasil. Jornal da Ciência, 14/02/2002. Disponível em . Acesso em 14 fev. 2002.
• SCHWARTZMAN, Simon. A ciência da ciência. Ciência Hoje (Revista de Divulgação Científica da Sociedade Brasileira para o Progresso da Ciência), v. 2, n. 11, p. 54-59, mar.-abr. 1984. Disponível em: <www.sul-sc.com.Br/afolha/pág/cienciaciência.htm>. Acesso em: 14 mar. 2003.
• SciELO. Relatórios de citações de revistas. São Paulo, s. d. Disponível em: <www.scielo.br>. Acesso em: 11 fev. 2003.
• SPINAK, Ernest. Indicadores cienciométricos. Ciência da Informação, Brasília (DF), v. 27, n. 2, p. 141-148, maio-ago. 1998.
• STREHL, Letícia; SANTOS, Carlos Alberto dos. Indicadores de qualidade da atividade científica. Ciência Hoje (Revista de Divulgação Científica da Sociedade Brasileira para o Progresso da Ciência), v. 31, n. 186, set. 2002.
• TRZESNIAK, Piotr. Indicadores quantitativos: reflexões que antecedem seu estabelecimento. Ciência da Informação, Brasília (DF), v. 27, n. 2, p. 159-164, 1998.
• VELHO, L. Indicadores científicos: em busca de uma teoria. Neurociência, v. 15, n. 3, p. 139-145, 1990.
• WITTER, Geraldina Porto (Org.)- Produção científica. Campinas: Átomo, 1997. cap. 3, 312 p.

Annex

*

Parte da Dissertação Apresentada ao Programa de Pós-Graduação na Área de Semiótica e Lingüística Geral, do Departamento de Lingüística da Faculdade de Filosofia, Letras e Ciências Humanas da Universidade de São Paulo, para Obtenção do Título de Mestre em Letras.

Publication Dates

• Publication in this collection
  15 May 2006
• Date of issue
  Jan 2006

History

• Accepted
  03 Mar 2006
• Reviewed
  12 May 2005
• Received
  13 Feb 2005