Open and closed citations' indexes results: a comparative study


Published: Dec 31, 2023
Keywords:
Citation Indexes linked open data FAIR Metrics LOD
Stefano Sorrentino
https://orcid.org/0009-0001-9166-9396
Abstract

Purpose - The following paper is a comparative study of the differences in the results provided by different academic and scholar indexes regarding a sample of DOI-identified articles and papers: with citation metrics being more and more relevant for the evaluation of scholars and their works, it is crucial to understand the differences between different indexes, their results and their functioning, digging into both open and close scenarios.


Design - The results of four different indexes (Elsevier’s Scopus, Google Scholar, Dimensions, OpenCitations) have been compared through the provided REST APIs, when possible, and Python web scraping libraries. Different features have been considered for drawing the results, such as the easiness for the user to retrieve such metrics and their metadata and the reasons behind the differences in the results.


Findings - Τhe study highlights the advantages of open citation metrics indexes and Linked Open Data for the final user. Still, at the same time, it points out how, when it comes to the completeness of the results, traditional indexes still provide more in-depth coverage of the academic literature, identifying the need to keep working to integrate more indexes and sources in the open ecosystem.


Originality/value - Τhis study aims to call attention to the strengths and advantages of FAIR approaches in the field of citation metrics, providing a successful example of an open alternative to traditional indexes.

Article Details
  • Section
  • Research Articles
References
I4OC, “Initiative for Open Citations,” https://i4oc.org/
Silvio Peroni and David Shotton, “OpenCitations, an Infrastructure Organization for Open Scholarship,” Quantitative Science Studies 1, no. 1 (February 2020): 428–44, https://doi.org/10.1162/qss_a_00023
Silvio Peroni and David Shotton, “OpenCitations: Present Status and Future Plans,” July 29, 2022, https://doi.org/10.5281/ZENODO.6940918
“OpenCitations - OpenCitations Index,”, https://opencitations.net/index
“OpenCitations - OpenCitations Meta,”, https://opencitations.net/meta
“Opencitations/Ramose,” Python (2018; repr., OpenCitations, June 7, 2023), https://github.com/opencitations/ramose
“SerpAPI”, https://serpapi.com
Elsevier Developer Portal”, https://dev.elsevier.com
Dmitiry Zub, “Dimitryzub/Scrape-Google-Scholar-Py,” Python, January 8, 2024, https://github.com/dimitryzub/scrape-google-scholar-py
“Scopus Content Policy and Selection | Elsevier,”, https://www.elsevier.com/products/scopus/content/content-policy-and-selection
Ivan Heibi, Silvio Peroni, and David Shotton, “Software Review: COCI, the OpenCitations Index of Crossref Open DOI-to-DOI Citations,” Scientometrics 121, no. 2 (November 2019): 1213–28, https://doi.org/10.1007/s11192-019- 03217-6
Martijn Visser, Nees Jan van Eck, and Ludo Waltman, “Large-Scale Comparison of Bibliographic Data Sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic,” Quantitative Science Studies 2, no. 1 (April 8, 2021): 20–41, https://doi.org/10.1162/qss_a_00112
“Altmetrics: A Manifesto – Altmetrics.Org,”, 2024, http://altmetrics.org/manifesto/