k 2024

Video-administered questionnaire : Psychometric properties and comparison with a text-based format

STROJIL, Adam and Hynek CÍGLER

Basic information

Original name

Video-administered questionnaire : Psychometric properties and comparison with a text-based format

Authors

STROJIL, Adam and Hynek CÍGLER

Edition

International Meeting of the Psychometric Society, 2024

Other information

Language

English

Type of outcome

Presentations at conferences

Country of publisher

Czech Republic

Confidentiality degree

is not subject to a state or trade secret

References:

Organization

Fakulta sociálních studií – Repository – Repository

Keywords in English

measurement invariance; measurement; methodology; psychometrics

Links

GA23-06924S, research and development project.
Changed: 29/3/2025 00:50, RNDr. Daniel Jakubík

Abstract

In the original language

Short videos have become popular online content, especially among young adults. Moreover, most respondents use mobile devices with relatively small displays in online questionnaires, worsening the possibility of reading longer items and questions. This study examines the feasibility of administering an online psychological questionnaire with items presented as short video recordings of an interviewer (VQ). We compare this format to a traditional text-based administration (TQ) using a between-subject design (N = 321). VQ was administered either by a male or a female using two different psychological inventories. Strict (residual) measurement invariance was established in both employed psychological scales; moreover, even population hyperparameters (latent means and variances) did not differ across conditions. No significant differences were observed in the methods’ drop-off rate, reliability, or criterion validity. We found no evidence that the social desirability or the interviewer had any notable influence on VQ. On the other hand, we observed significant but mixed differences in reaction times. One of the interviewers in VQ led to a faster completion time than the TQ, while the other was slower, suggesting that VQ is not necessarily more time-consuming than traditional online questionnaires. Finally, respondents rated VQ as the more enjoyable method. It appears that VQ may be a valid, reliable, and potentially more engaging alternative method of questionnaire administration, even though our findings require replication. The possibilities and difficulties of using VQ to collect data based on AI‘s ability to generate videos will be discussed.

Files attached