Correlation between Latin American And Caribbean Journals Impact Indicators

Heloisa Costa, Fabio Lorensi do Canto, Adilson Luiz Pinto, Marcos Talau

Resumen


Purpose – Identify the levels of correlation between impact indicators from Latin American and Caribbean journals indexed in databases.The selected indicators are the Impact Factor, 5-year Impact Factor, EigenFactor Score, Article Influence Score, Journal Citation Indicator, SJR, CiteScore, h-index (SJR), Source-normalized Impact per Paper, and h5-index Design/methodology/approach – Data were downloaded from Journal Citation Reports, SCimago, and Scopus. A Phyton script was used to search for journals titles and extract the h5-indexfrom Google Scholar Metrics. Pearson and Spearman coefficients tests were used to identify the level of correlation between pairs of indicators from the same set of journals. Data are analyzed in general, and according to the areas of Science, Technology and Medicine, and Arts, Humanities and Social Sciences. Findings – The correlation coefficients are positive moderate (0.40 < 0.69) and strong (0.70 < 0.89) in most pairings, with a very strong level (> 0.90) between Impact Factor, 5-year Impact Factor, and CiteScore (CS),Science, Technology and Medicine journals have stronger correlation levels than Arts, Humanities and Social Sciences journals. Considering the relationship between availability and average correlation, the CS and the h5-index are the most suitable indicators for journals assessment in the region. Originality/value – This paper provides a correlation analysis between impact indicators of all indexed Latin American and Caribbean journals. It is also innovative by using an automated technique of search and data extraction in Google Scholar Metrics.The results can contributeto the elaboration of journals evaluation policies in the countries of the region.


Palabras clave


Scientific journals – Latin America and Caribbean; Scholarly communication; Impact indicators; Pearson correlation; Spearman correlation

Texto completo:

PDF (English)

Referencias


Akoglu, H. (2018),“User’s guide to correlation coefficients”, Turkish Journal of Emergency Medicine, Vol. 18, No. 3, pp.91-93, available at: https://doi.org/10.1016/j.tjem.2018.08.001. (accessed 15 May 2021).

Amaral, R.E.S. & Araújo, R.F. (2022). “Comunicação científica rápida em tempos de pandemia: a atenção online de preprints sobre Covid-19”. En: T. M. R. Dias (Ed.), Informação, Dados e Tecnologia. Advanced Notes in Information Science, volume 2 (pp. 103-111). Tallinn, Estonia: ColNes Publishing. DOI: 10.47909/anis.978-9916-9760-3-6.114. (accessed 22 May 2021).

Bornmann, L. & Marx, W. (2015),“Methods for the generation of normalized citation impact scores in bibliometrics: which method best reflects the judgements of experts?”, Journal of Informetrics, Vol. 9, No. 2, pp.408-418, available at: https://doi.org/10.1016/j.joi.2015.01.006. (accessed 15 May 2021).

Bornmann, L. et al. (2012),“Diversity, value and limitations of the journal impact factor and alternative metrics”,Rheumatology International, Vol. 32, No. 7, pp.1861-1867, available at: https://doi.org/10.1007/s00296-011-2276-1. (accessed 11 Ago. 2021).

Chinchilla-Rodríguez, Z. et al. (2015),“Somes patterns of Cuban scientific publication in Scopus: the current situation and challenges”, Scientometrics, Vol. 103, No. 3, pp.779-794, available at: https://doi.org/10.1007/s11192-015-1568-8. (accessed 10 June. 2021).

Chinchilla-Rodríguez, Z. et al. (2015),“Latin American scientific output in public health: Combined analysis using bibliometric, socioeconomic and health indicators”,Scientometrics, Vol. 102, No. 1, pp.609-628, available at: https://doi.org/10.1007/s11192-014-1349-9. (accessed 25 Apr. 2021).

Cientí, D.D. et al. (2013), “Ranking de revistas científicas en Latinoamérica mediante el índice h: estudio de caso Colombia”, Revista Española de Documentación Científica, Vol. 36, No. 1, e003, pp.1-12. available at: https://doi.org/10.3989/redc.2013.1.876. (accessed 11 Ago. 2021).

Clarivate. Journal Citation reports Help, “Journal Profile”, 2021, available at: https://jcr.help.clarivate.com/Content/jcr3-journal-profile.htm (accessed 22 Jul. 2021).

Collazo-Reyes, F. (2014),“Growth of the number of indexed journals of Latin America and the Caribbean: the effect on the impact of each country”, Scientometrics, Vol. 98, No. 1, pp.197-209, available at: https://doi.org/10.1007/s11192-013-1036-2. (accessed 12 June 2021).

Costa, H. et al. (2020), “Google Scholar Metrics e a proposta do novo Qualis: impacto dos periódicos brasileiros de Ciência da Informação”, Informação & Sociedade: Estudos, João Pessoa, Vol. 30, No. 1, pp.1-16, available at: https://doi.org/10.22478/ufpb.1809-4783.2020v30n1.50676. (accessed 12 June 2021).

de Araújo Telmo, F., de Medeiros Matos Autran, M. & Araújo da Silva, A. K. (2021). “Scientific production on open science in Information Science: a study based on the ENANCIB event”. AWARI, Vol. 2, No. e027. available at: https://doi.org/10.47909/awari.127. (accessed 11 Jul 2022).

Dias, P. M.; Dias, T. M. R. & Moita, G. F. (2022). “Coleta e integração de dados científicos para análises sobre a produção científica brasileira em periódicos de acesso aberto”. En: T. M. R. Dias (Ed.), Informação, Dados e Tecnologia. Advanced Notes in Information Science, Vol. 2, pp. 34-42. Tallinn, Estonia: ColNes Publishing. available at: https://doi.org/10.47909/anis.978-9916-9760-3-6.105. (accessed 11 Jul 2022).

Ding, J. et al. (2020),“Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors”, Scientometrics, Vol. 122 No. 3, pp.303-1322, available at: https://doi.org/10.1007/s11192-020-03364-1 (accessed 12 June 2021).

Elkins, M.R. et al. (2010),“Correlation between the Journal Impact Factor and three other journal citation indices”,Scientometrics, Vol. 85, No. 1, pp.81-93, available at: https://doi.org/10.1007/s11192-010-0262-0. (accessed 12 June 2021).

Elsevier. “Measuring a journal’s impact”, 2021, available at: https://www.elsevier.com/authors/tools-and-resources/measuring-a-journals-impact (accessed 22 Jul. 2021).

González-Pereira, B., Guerrero-Bote, V.P. & Moya-Anegón, F. (2010), “A new approach to the metric of journals’ scientific prestige: The SJR indicator”, Journal of Informetrics, Vol. 4, No. 3, pp. 379-391.

Google Scholar Metrics. “Coverage of Publications”, 2021, available at: https://scholar.google.com.br/intl/pt-PT/scholar/metrics.html#coverage. (accessed 22 Jul. 2021).

Jacsó, P. (2012),“Google Scholar Metrics for publications: the software and content features of a new open access bibliometric service”, Online Information Review, Vol. 36, No. 4, pp.604-619, available at: https://doi.org/10.1108/14684521211254121. (accessed 30 Nov. 2020).

James, C. et al. (2019),“CiteScore metrics: Creating journal metrics from the Scopus citation index”, Learned Publishing, Vol. 32, No. 4, pp.367-374, available at: https://onlinelibrary.wiley.com/doi/abs/10.1002/leap.1246. (accessed 18 June 2021).

Kim, J.A. et al.(2014),“Correlation among the citation indices of Korean scientific journals listed in international databases”, Science Editing, Vol. 1, No. 1, pp. 27-36, available at: https://doi.org/10.6087/kcse.2014.1.27. (accessed 25 Apr. 2021).

Lancho-Barrantes, B.S. & Cantú-Ortiz, F.J. (2019),“Science in Mexico: a bibliometric analysis”,Scientometrics, Vol. 118, No. 2, pp.499-517, available at: https://doi.org/10.1007/s11192-018-2985-2. (accessed 29 March 2021).

López-Cózar, E. & Cabezas-Clavijo, Á. (2013),“Ranking journals: could Google Scholar Metrics be an alternative to Journal Citation Reports and Scimago Journal Rank?”, Learned Publishing, Vol. 26, No. 2, pp.101-113, available at: http://doi.wiley.com/10.1087/20130206. (accessed30Nov. 2020).

Machin-Mastromatteo, J.D. (2019), “Latin American triple-A journals 2: the Venezuelan case”, Information Development, Vol. 35, No. 5, pp.839-845, available at: https://doi.org/10.1177/0266666919877962. (accessed 28 Jan. 2021).

Machin-Mastromatteo, J.D. et al.(2017), “Latin American triple-A journals 1: a quality roadmap from the quality indicators and journals’ presence in Web of Science and Scopus”, Information Development, Vol. 33, No. 4, pp.436-441,available at: https://doi.org/10.1177/0266666917718138. (accessed 30 Nov. 2020).

Minniti, S., Santoro, V. & Belli, S. (2018). “Mapping the development of Open Access in Latin America and Caribbean countries: an analysis of Web of Science Core Collection and SciELO Citation Index (2005–2017)”. Scientometrics, Vol. 117, No. 3, pp.1905-1930., available at: https://doi.org/10.1007/s11192-018-2950-0. (accessed 24 Apr. 2021).

Okagbue, H. I. et al.(2019),“Curve estimation models for estimation and prediction of Impact Factor and CiteScoreusing the journal percentiles: a case study of Telecommunication Journals”, International Journal of Online and Biomedical Engineering (IJOE), Vol. 15, No. 14, pp.31-41, available at: https://doi.org/10.3991/ijoe.v15i14.11373. (accessed 24 Apr. 2021).

Okagbue, H. I. & Teixeira da Silva J. A. (2020),“Correlation between the CiteScore and Journal Impact Factor of top-ranked library and information science journals”, Scientometrics, 0123456789, pp.3-7, available at: https://doi.org/10.1007/s11192-020-03457-x. (accessed 24 Abr. 2021).

Palacios-Gómez, M. (2017),“The uncertainty of Colombian scientific journals with Publindex”, Colombia Médica, Vol. 48, No 4, pp.152-154, available at:https://doi.org/10.25100/cm.v48i4.3728. (accessed 25 June 2021).

Pinto A. L. et al. (2020),“Periódicoscientíficosbrasileirosindexados no Google Scholar Metrics”, Informação & Sociedade: Estudos, Vol. 30, No. 4, pp.1-18, available at: 10.22478/ufpb.1809-4783.2020v30n4.57048. (accessed 25 June 2021).

Prins A. A. et al. (2016),“Using Google Scholar in research evaluation of humanities and social science programs:a comparison with Web of Science data”, Research Evaluation, Vol. 25, No. 3, pp.264-270, available at: https://adprins.nl/wp-content/uploads/2019/08/Using-Google-Scholar-in-research-evaluation-of-social-science-programs.pdf. (accessed 24 Apr. 2021).

Salvador-Oliván, J.A. & Agustín-Lacruz, C. (2015), “Correlación entre indicadores bibliométricos en revistas de Web of Science y Scopus”, Revista General de Información y Documentación, Vol. 25, No. 2, pp. 341-359, available at: https://doi.org/10.5209/rev_RGID.2015.v25.n2.51241. (accessed25 Apr. 2021).

Vasen, F. & Vilchis, I.L. (2017), “Sistemas nacionales de clasificación de revistas científicas en América Latina: tendencias recientes e implicaciones para la evaluación académica en cienciassociales”, Revista Mexicana de Ciencias Políticas y Sociales, Vol. 62, No. 231, pp.199-228, available at: http://www.scielo.org.mx/pdf/rmcps/v62n231/0185-1918-rmcps-62-231-00199.pdf. (accessed22 Feb. 2021).

Vélez-Cuartas, G. et al. (2016), “Regional and global science: publications from Latin America and the Caribbean in the SciELO Citation Index and the Web of Science”, El Profesional de La Información, Vol. 25, No. 1, pp.35-46, available at: https://doi.org/10.3145/epi.2016.ene.05. (accessed 29 March 2021).

Vera-Baceta, M.A. et al.(2019),“Web of Science and Scopus language coverage”,Scientometrics, Vol. 121 No. 3, pp.1803-1813, available at: http://link.springer.com/10.1007/s11192-019-03264-z. (accessed 28 Jun. 2021).

Vladimir Chuchco, N. (2020). "Measuring institutional respect and State capacities in South America. A relational analysis on four dimensions of the Worldwide Governance Indicators (2017-2018)". AWARI, Vol. 1, No. 1, e012. available at: https://doi.org/10.47909/awari.66. (accessed 25 jul. 2022).

Waltman, L. (2016),“A review of the literature on citation impact indicators”, Journal of Informetrics, Vol. 10, No. 2, pp.365-391, available at: http://dx.doi.org/10.1016/j.joi.2016.02.007. (accessed 11 Ago. 2021).

Waltman L. & Jan van Eck, N. (2013),“A systematic empirical comparison of different approaches for normalizing citation impact indicators”,Journal of Informetrics, Vol. 7, No. 4, pp.833-849, available at: https://doi.org/10.1016/j.joi.2013.08.002. (accessed 22 Jul. 2021).

Yang, S. & Wang, F. (2015),“Visualizing information science: author direct citation analysis in China and around the world”, Journal of Informetrics, Vol. 9, No. 1, pp.208-225, available at: https://doi.org/10.1016/j.joi.2015.01.001. (accessed 25 June 2021).




Licencia de Creative Commons
Esta obra está bajo una licencia de Creative Commons Reconocimiento-NoComercial-CompartirIgual 4.0 Internacional.

 Revista indizada en: Scopus, Web of Science (Emerging Sources Citation Index), DIALNET, EBSCO (Academic Search Complete, 
Academic Search Premier, Academic Search Ultimate, Fuente Académica Plus), PROQUEST (Library and Information Science
Abstracts, Library Science), REDIB, CLASE, BIBLAT, INFOBILA, Ulrichs Web, Latindex, DOAJ, Index Copernicus, JournalsTOC,
ERIH Plus, E-LIS, MIAR, e-Libros, BASE,
Google Scholar, y otros.


                           Redes Sociales
 
              
  
Indicadores de impacto según Google Scholar:
Índice h: 8; Índice i10: 3
Revista certificada por el CITMA

 

           Revista. Bibliotecas. Anales de investigación by Biblioteca Nacional de Cuba José Martí is licensed under aCreative Commons Reconocimiento-NoComercial-CompartirIgual 4.0 Internacional License.  

Creado a partir de la obra en anales.bnjm.cu

 ISSN: 0006-176X, EISSN: 1683-8947   
                               Licencia de Creative Commons