Social Media and Research Publication Activity During Early Stages of the COVID-19 Pandemic: Longitudinal Trend Analysis

This article has been Reviewed by the following groups

Read the full article

Abstract

The COVID-19 pandemic has highlighted the importance of rapid dissemination of scientific and medical discoveries. Current platforms available for the distribution of scientific and clinical research data and information include preprint repositories and traditional peer-reviewed journals. In recent times, social media has emerged as a helpful platform to share scientific and medical discoveries.

Objective

This study aimed to comparatively analyze activity on social media (specifically, Twitter) and that related to publications in the form of preprint and peer-reviewed journal articles in the context of COVID-19 and gastroenterology during the early stages of the COVID-19 pandemic.

Methods

COVID-19–related data from Twitter (tweets and user data) and articles published in preprint servers (bioRxiv and medRxiv) as well as in the PubMed database were collected and analyzed during the first 6 months of the pandemic, from December 2019 through May 2020. Global and regional geographic and gastrointestinal organ–specific social media trends were compared to preprint and publication activity. Any relationship between Twitter activity and preprint articles published and that between Twitter activity and PubMed articles published overall, by organ system, and by geographic location were identified using Spearman’s rank-order correlation.

Results

Over the 6-month period, 73,079 tweets from 44,609 users, 7164 journal publications, and 4702 preprint publications were retrieved. Twitter activity (ie, number of tweets) peaked in March 2020, whereas preprint and publication activity (ie, number of articles published) peaked in April 2020. Overall, strong correlations were identified between trends in Twitter activity and preprint and publication activity (P<.001 for both). COVID-19 data across the three platforms mainly concentrated on pulmonology or critical care, but when analyzing the field of gastroenterology specifically, most tweets pertained to pancreatology, most publications focused on hepatology, and most preprints covered hepatology and luminal gastroenterology. Furthermore, there were significant positive associations between trends in Twitter and publication activity for all gastroenterology topics (luminal gastroenterology: P=.009; hepatology and inflammatory bowel disease: P=.006; gastrointestinal endoscopy: P=.007), except pancreatology (P=.20), suggesting that Twitter activity did not correlate with publication activity for this topic. Finally, Twitter activity was the highest in the United States (7331 tweets), whereas PubMed activity was the highest in China (1768 publications).

Conclusions

The COVID-19 pandemic has highlighted the potential of social media as a vehicle for disseminating scientific information during a public health crisis. Sharing and spreading information on COVID-19 in a timely manner during the pandemic has been paramount; this was achieved at a much faster pace on social media, particularly on Twitter. Future investigation could demonstrate how social media can be used to augment and promote scholarly activity, especially as the world begins to increasingly rely on digital or virtual platforms. Scientists and clinicians should consider the use of social media in augmenting public awareness regarding their scholarly pursuits.

Article activity feed

  1. SciScore for 10.1101/2020.12.20.20248517: (What is this?)

    Please note, not all rigor criteria are appropriate for all manuscripts.

    Table 1: Rigor

    Institutional Review Board Statementnot detected.
    Randomizationnot detected.
    Blindingnot detected.
    Power Analysisnot detected.
    Sex as a biological variablenot detected.

    Table 2: Resources

    Software and Algorithms
    SentencesResources
    Preprint articles related to COVID-19 were identified using two popular preprint servers for coronavirus biomedical research: MedRxiv (https://www.medrxiv.org/) and BioRxiv (https://www.biorxiv.org/).
    BioRxiv
    suggested: (bioRxiv, RRID:SCR_003933)
    Spearman’s rank-order correlation was performed to determine the relationships between Twitter activity (tweets and impressions) and PubMed publications overall, by organ system and geographical location as well as Twitter activity and preprint articles overall and by organ system.
    PubMed
    suggested: (PubMed, RRID:SCR_004846)
    Analysis was performed using STATA 15 (StataCorp, LLC) (College Station, TX).
    STATA
    suggested: (Stata, RRID:SCR_012763)
    StataCorp
    suggested: (Stata, RRID:SCR_012763)

    Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


    Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
    There are several limitations to our study worth noting. The first major limitation is that social media, such as Twitter, is not available in several countries, including China. This could help to explain China’s lead in publication activity as compared with other regions, as this is likely one of the primary modalities used in this country for disseminating information. Other social media platforms, including WeChat and Sina Weibo, are used in China, however information regarding the use of these other social media platforms within China is limited to date. Future studies are needed to assess SoMe activity on these alternative platforms and their association with publications as well as how they compared to the use of Twitter in other nations, such as the US, where Twitter is not banned. Secondly, although we were able to account for and re-assign duplicate publications for the various categorizations performed, the same was not able to be guaranteed for Twitter data. The very nature of tweets allows for other users to publish an original tweet to their account generating additional impressions (also known as a “retweet”). Therefore, limiting duplicate tweets may artificially decrease activity. More importantly, certain tweets, or even retweets, may have been assigned to more than one topic area by the Symplur software. Due to limitations with Symplur, we were unable to limit tweets to a single topic, and as such, this may have artificially boosted the overall number in cer...

    Results from TrialIdentifier: No clinical trial numbers were referenced.


    Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


    Results from JetFighter: We did not find any issues relating to colormaps.


    Results from rtransparent:
    • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
    • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
    • No protocol registration statement was detected.

    About SciScore

    SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.