Assessing the Stability of Cognitive and Attentional Computerized Tests: A Test-Retest Reliability Study

This study aims to evaluate the test-retest reliability of four computerized cognitive tests designed to measure selective attention, sustained attention, visual search, and visual scanning. Given the growing use of computerized cognitive assessments in clinical, educational, and research settings, ensuring their reliability is crucial. The sample consisted of 39 young adults who completed computerized versions of the Trail Making Test, Visual Search Test, Sustained Attention to Response Test, and Selective Attention Test developed by CogniFit Inc. (San Francisco, US) across three sessions. The study included two key comparisons – test-retest on different days and immediate test-retest on the same day – analyzed using repeated measures ANOVA, Pearson’s correlation and Intraclass correlation. Results indicated consistent outcomes across sessions for all tests, except for certain variables where immediate repetition likely induced practice or learning effects and for variables that are not crucial for the task. It also showed correlations in all the tests in at least one measure. These findings support the reliability of these tests over short intervals, aligning with previous research on traditional and computerized cognitive assessments. The study highlights the utility of these computerized tests as a reliable and accessible tool for cognitive evaluation, with potential for broad application in various settings. Future research should explore longer test-retest intervals and diverse populations to further validate these tools' reliability and applicability.