Creating Online Cognitive Assessment Platform for Children’s Literacy and Math Skills: Illustrated with the ACE Kids Platform

Computerized versions of paper-and-pencil tests have made children’s behavioral assessments more automatic and precise. The COVID-19 pandemic further demonstrated the need for computerized assessments to be offered online to allow for remote data collection. However, the design and implementation of computerized tests in an online environment comes with various challenges. This article probes the issues, needs and challenges for the development and validation of online assessment of reading and math, and related cognitive abilities. The paper aims to inform researchers about some of the logistical and technical considerations of developing a customized platform for online data collection, including (a) technical considerations, (b) interface design, (c) data management, and (d) validation measures for comparability with paper-and-pencil measures. These issues are illustrated with experiences gleaned from the development of an assessment platform (ACE Kids platform), designed to deliver over 40 tests and questionnaires related to children’s Chinese and English literacy, as well as mathematics abilities. Furthermore, we discuss features that improve the ease of use, clear instructions, and attention retention. This discussion is punctuated by pilot test results, including both qualitative and quantitative data about child usage experience. Finally, we discuss important considerations at the planning, development and data collection stages for a customized assessment platform.