Comparing Likert and Visual Analogue Scales in Ecological Momentary Assessment

Measuring subjective experiences in Ecological Momentary Assessment (EMA) studies has become a popular approach. A design choice in such studies is the response scale of the survey questions. Typically, researchers choose between a Likert scale and a visual analog scale (VAS). However, there is little guidance on this choice. We conducted a between-person experiment comparing a 7-point Likert scale (n=63) with a VAS (n=56) in an EMA study measuring affective states over 14 days. Using Bayesian multilevel models, we found that the VAS resulted in moderately higher within-person item means, lag-0 correlations, lag-1 autocorrelations, as well as lower within-person skewnesses and response frequencies of exact zeros. We found the largest difference in correlations with external criteria related to psychopathology, where correlations for the VAS were much higher. We did not observe reliable differences in within-person item variances, root mean squared successive differences, missing data, duration of measurements, and ratings about the experiences with the EMA survey. Apart from higher within-person means and higher correlations with external criteria in the VAS group, the differences were relatively small. While more research on response scales in EMA is needed, based on our results we conclude that the VAS should be preferred in studies aiming at capturing affective states relating to general psychopathology, as well as for items whose variation occurs close to scale limits. We conclude by discussing how our findings may contribute to a larger research agenda that addresses the fit of different response scales for different research aims.