Identification of the optimal scoring algorithm for a closed-format Faux Pas Recognition Test

The Faux Pas Recognition Test (FPT) is a popular Theory of Mind (ToM) measure, which has previously been used with an open-answer format. The scoring and interpretation of this format is time-consuming and challenging. Additionally, there is currently no consensus on the correct scoring algorithm. We developed a closed answer format and compared various scoring algorithms to optimize this ToM measure. To assess the convergent and divergent validity, we compared correlations between the improved FPT and another ToM measure (the Movie for the Assessment of Social Cognition; MASC) and an emotion recognition test (the Reading the Mind in the Eyes Test; RMET). Further, we used a ROC analysis, to test which scoring algorithms could best differentiate between a community sample and three clinical samples. The results indicated that the empathy score suggested by Stone et al. (1998a) showed the highest convergent validity and lowest divergent validity. Further, it optimally differentiated between clinical and community samples. Thus, this scoring algorithm showed good construct validity, while at the same time identifying ToM impairments. Based on theoretical considerations, we also suggest to include the intention score. The study emphasizes the importance of selecting validated algorithms for more reliable and valid results.