Quantification choices for individual differences: An example of mapping self-report to psychophysiological responses

A popular focus in affective neuroscience research has been to map the relationships between individual differences (e.g. personality and environmental experiences) and psychophysiological responses, in order to further understand the effect of individual differences upon neurobehavioral systems that support affect and arousal. Despite this trend, there have been a lack of practical examples demonstrating how the quantification of individual differences (e.g. categorical or continuous) impacts the observed relationships between different units of analysis (e.g. self-report > psychophysiological responses). To address this gap, we reanalyzed an existing data set of self-reported intolerance of uncertainty (IU) and skin conductance responses during threat extinction (k = 18, n = 1006) using different quantification choices for individual differences in self-reported intolerance of uncertainty (continuous, categorical via median split, and categorical via extremes – one standard deviation above/below). Results from the meta-analyses revealed that the different quantification techniques produced some consistent (e.g. higher IU was significantly associated with skin conductance responding during late extinction training) and inconsistent IU-related effects. Furthermore, the number of statistically significant effects and effect sizes varied based on the quantification of individual differences in IU (e.g. categorical, compared to continuous was associated with more statistically significant effects, and larger effect sizes). The current study highlights how conducting a multiverse analysis for the quantification of individual differences may help researchers understand the individual difference construct of interest (e.g. characterisation, measurement), as well as examine the stability and reliability of individual difference-based effects and correspondence between various units of analysis.