Cohen’s kappa statistics as a convenient means to identify accurate SARS-CoV-2 rapid antibody tests
This article has been Reviewed by the following groups
Listed in
- Evaluated articles (ScreenIT)
Abstract
There are many available rapid antibody tests, but the performance of such tests remains unclear. Moreover, it is difficult to compare among the various devices regarding their sensitivity & specificity.
In order to compare the performance of such devices, we used Cohen’ kappa statistics to assess the level of agreement between RT-PCR and rapid antibody tests. In doing this study, we considered the term of validity after symptom-onset to compare two tests. It takes more than a week to produce antibodies in the body, and RT-PCR thus gives negative result in the convalescent period. On ELISA data from the literature kappa statistics was calculated as 1.0 beyond 10 days after symptom-onset. By taking these factors into consideration, we evaluated agreement with samples collected beyond 10 days of symptom-onset during the active period.
We calculated the data from 9 devices, and the kappa statistics for English data were calculated as 0.64 on average. The same finding was 0.75 for Chinese data. These results corresponded with the values from sensitivity & specificity of their reports. Both reports had no details about the collection procedures. Kappa statistics might become even more accurate, if samples could be restricted to ones collected beyond 10 days. Regarding the data from our hospital’, the kappa statistics was 0.97 when restricted to samples collected beyond 10 days, which thus showed excellent agreement.
By using kappa statistics, the performances of rapid antibody tests can be shown as one figure, so that their comparison becomes easy to carry out.
Highlights
Using kappa statistics, agreement between PCR and ELISA was perfect from the data beyond 10 days of symptom-onset.
The results of kappa statistics corresponded with the values from sensitivity & specificity of the English and the Chinese literatures.
Kappa statistics was calculated as 0.97 from the data beyond 10 days of symptom-onset, and sensitivity & specificity were 95.2% and 100% in our hospital.
Kappa statistics is a convenient means to identify accurate rapid antibody tests.
Article activity feed
-
SciScore for 10.1101/2020.06.13.20130070: (What is this?)
Please note, not all rigor criteria are appropriate for all manuscripts.
Table 1: Rigor
Institutional Review Board Statement not detected. Randomization not detected. Blinding not detected. Power Analysis not detected. Sex as a biological variable not detected. Table 2: Resources
No key resources detected.
Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).
Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:Regarding limitations associated with this study, our positive data could not be collected as well as expected because SARS-CoV-2 infection rate has recently decreased, and we could not collect as many samples as we had …
SciScore for 10.1101/2020.06.13.20130070: (What is this?)
Please note, not all rigor criteria are appropriate for all manuscripts.
Table 1: Rigor
Institutional Review Board Statement not detected. Randomization not detected. Blinding not detected. Power Analysis not detected. Sex as a biological variable not detected. Table 2: Resources
No key resources detected.
Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).
Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:Regarding limitations associated with this study, our positive data could not be collected as well as expected because SARS-CoV-2 infection rate has recently decreased, and we could not collect as many samples as we had expected. From our study, however, we believe the proper antibody test kits can be identified using kappa statistics.
Results from TrialIdentifier: No clinical trial numbers were referenced.
Results from Barzooka: We did not find any issues relating to the usage of bar graphs.
Results from JetFighter: We did not find any issues relating to colormaps.
Results from rtransparent:- Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
- Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
- No protocol registration statement was detected.
-