Massive covidization of research citations and the citation elite

This article has been Reviewed by the following groups

Read the full article See related articles

Abstract

Massive scientific productivity accompanied the COVID-19 pandemic. We evaluated the citation impact of COVID-19 publications relative to all scientific work published in 2020 to 2021 and assessed the impact on scientist citation profiles. Using Scopus data until August 1, 2021, COVID-19 items accounted for 4% of papers published, 20% of citations received to papers published in 2020 to 2021, and >30% of citations received in 36 of the 174 disciplines of science (up to 79.3% in general and internal medicine). Across science, 98 of the 100 most-cited papers published in 2020 to 2021 were related to COVID-19; 110 scientists received ≥10,000 citations for COVID-19 work, but none received ≥10,000 citations for non–COVID-19 work published in 2020 to 2021. For many scientists, citations to their COVID-19 work already accounted for more than half of their total career citation count. Overall, these data show a strong covidization of research citations across science, with major impact on shaping the citation elite.

Article activity feed

  1. SciScore for 10.1101/2022.01.24.22269775: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    NIH rigor criteria are not applicable to paper type.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    As many publications related to COVID-19 have been first disseminated using pre-print servers, we also included preprint publications from ArXiv, SSRN, BioRxiv, ChemRxiv and medRxiv [2].
    ArXiv
    suggested: (arXiv, RRID:SCR_006500)
    BioRxiv
    suggested: (bioRxiv, RRID:SCR_003933)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    There are several limitations to our work. First, the classification into COVID-19 versus non-COVID-19 work may not be perfect. However, it is unlikely that the existence of a border zone of difficult to classify papers and of papers misclassified by our search algorithm would change the big picture of the results. Second, some scientists may have their publications split into two or more Scopus ID files and some Scopus ID files may include papers by more than one author. Nevertheless, Scopus data have high precision and recall (98.1% and 94.4%, respectively) [4], therefore this is unlikely to be a source of major error. Third, we could not evaluate whether the massive advent of the COVID-19 literature and of its citation footprint affected (negatively) the non-COVID-19 literature and its citations. This is very difficult to evaluate since there are dynamic changes in the volume of the Scopus-indexed literature over time, irrespective of COVID-19. Some of these changes are genuine (e.g. due to emergence of some new hot research areas) and others are artifacts of indexing (e.g. more journals are indexed in Scopus over time). By design, we opted to focus on authors with at least 5 full papers, conference papers or reviews under their belt by August 21, 2021. This choice has been adopted also in previous work [2]. This design probably excluded from the evaluation a substantial number of early career scientists who have not published that many papers yet, but who may have already...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    Results from scite Reference Check: We found no unreliable references.


    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.