Validating Factorial Survey Experiments: Response to Comment
In Forster and Neugebauer (2024), we examine to what extent a factorial survey (FS) on invitations of fictitious applicants can replicate the findings of a nearly identical field experiment conducted with the same employers. In addition to exploring the conditions under which FSs provide valid beha...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Society for Sociological Science
2025-01-01
|
| Series: | Sociological Science |
| Online Access: | https://sociologicalscience.com/articles-v12-6-106/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832590502723059712 |
|---|---|
| author | Andrea G. Forster Martin Neugebauer |
| author_facet | Andrea G. Forster Martin Neugebauer |
| author_sort | Andrea G. Forster |
| collection | DOAJ |
| description | In Forster and Neugebauer (2024), we examine to what extent a factorial survey (FS) on invitations of fictitious applicants can replicate the findings of a nearly identical field experiment conducted with the same employers. In addition to exploring the conditions under which FSs provide valid behavioral predictions, we varied the topic sensitivity and tested whether behavioral predictions were more accurate after filtering out respondents who provided socially desirable answers or did not exert sufficient effort in responding to FS vignettes. Across these conditions, the FS results did not align well with the real-world benchmark. We conclude that researchers must exercise caution when using FSs to study (hiring) behavior. In this rejoinder, we respond to the critique of our study by Pickett (2025). |
| format | Article |
| id | doaj-art-ea0b5d15398b4d1eae2e81ab55b443ff |
| institution | Kabale University |
| issn | 2330-6696 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Society for Sociological Science |
| record_format | Article |
| series | Sociological Science |
| spelling | doaj-art-ea0b5d15398b4d1eae2e81ab55b443ff2025-01-23T17:00:35ZengSociety for Sociological ScienceSociological Science2330-66962025-01-0112610611410.15195/v12.a6Validating Factorial Survey Experiments: Response to CommentAndrea G. Forster0Martin Neugebauer1Utrecht UniversityKarlsruhe University of EducationIn Forster and Neugebauer (2024), we examine to what extent a factorial survey (FS) on invitations of fictitious applicants can replicate the findings of a nearly identical field experiment conducted with the same employers. In addition to exploring the conditions under which FSs provide valid behavioral predictions, we varied the topic sensitivity and tested whether behavioral predictions were more accurate after filtering out respondents who provided socially desirable answers or did not exert sufficient effort in responding to FS vignettes. Across these conditions, the FS results did not align well with the real-world benchmark. We conclude that researchers must exercise caution when using FSs to study (hiring) behavior. In this rejoinder, we respond to the critique of our study by Pickett (2025).https://sociologicalscience.com/articles-v12-6-106/ |
| spellingShingle | Andrea G. Forster Martin Neugebauer Validating Factorial Survey Experiments: Response to Comment Sociological Science |
| title | Validating Factorial Survey Experiments: Response to Comment |
| title_full | Validating Factorial Survey Experiments: Response to Comment |
| title_fullStr | Validating Factorial Survey Experiments: Response to Comment |
| title_full_unstemmed | Validating Factorial Survey Experiments: Response to Comment |
| title_short | Validating Factorial Survey Experiments: Response to Comment |
| title_sort | validating factorial survey experiments response to comment |
| url | https://sociologicalscience.com/articles-v12-6-106/ |
| work_keys_str_mv | AT andreagforster validatingfactorialsurveyexperimentsresponsetocomment AT martinneugebauer validatingfactorialsurveyexperimentsresponsetocomment |