The Online Misinformation Susceptibility Scale: Development and Initial Validation

Background/Objectives: Although it is known that widespread online misinformation has negative consequences, there is no scale to measure susceptibility to online misinformation. Thus, our aim was to develop and validate a tool for measuring susceptibility to online misinformation: the Online Misinformation Susceptibility Scale (OMISS). Methods: A comprehensive literature review was conducted to generate a preliminary pool of items. Subsequently, a multidisciplinary panel of experts assessed the content validity of these items. To establish face validity, cognitive interviews were performed. Both exploratory and confirmatory factor analyses were performed to verify the underlying construct structure of the OMISS. We examined the concurrent validity of the OMISS by using a fake news detection scale, the Trust in Scientists Scale, a single-item trust in scientists scale, the Conspiracy Mentality Questionnaire, and a single-item conspiracy belief scale. Reliability was rigorously examined using multiple indices, including Cronbach’s alpha, McDonald’s Omega, Cohen’s kappa, and intraclass correlation coefficient. Results: The psychometric evaluation using both exploratory and confirmatory factor analyses supported a one-factor nine-item model for the OMISS. The OMISS demonstrated strong concurrent validity, evidenced by statistically significant correlations with the five scales mentioned above. Cronbach’s alpha and McDonald’s Omega were 0.920 and 0.921, respectively. The intraclass correlation coefficient for the OMISS was 0.994. Conclusions: Our comprehensive psychometric evaluations confirmed the OMISS as a valid tool for measuring online misinformation susceptibility. The OMISS holds promise as an effective tool for identifying susceptibility to misinformation and could support policymakers, health educators, healthcare professionals, and stakeholders in pinpointing high-risk groups.