Given that surveys tend to overestimate belief in #conspiracyTheories (https://osf.io/preprints/psyarxiv/zsncr_v1) and support for #politicalViolence (https://doi.org/10.1073/pnas.2116870119), I wonder how much of the correlation between such variables remains after accounting for such measurement error.
New #surveyMethods paper replicates and extends differences in #dataQuality, attention, naivety, decision style, etc. by
- online #research recruitment platform (#mTurk, #Prolific, #Qualtrics, #Pollfish)
- device (#mobile v. #desktop)
- person's incentive
Thankful to get a copy of Reflection and Intuition in A Crisis-Ridden World: https://doi.org/10.4324/978100330036
Hoping for a digital copy to annotate!
Can't access the #book? Some free papers cover similar work:
- https://doi.org/10.1111/meta.12534
- https://doi.org/10.3390/jintelligence11040076
- https://doi.org/10.31234/osf.io/y8sdm
I've only been able to glance at a few sections, but this seems like a book I would want to write:
- broad range of topics that interest more than academics
- situated in the history of ideas
- attention to replicability of results
- anticipation of future directions
Bravo! 
Excited for 2025 presentations in #NYC at the #APA (January 8 to 11): apaonline.org/mpage/2025eastern?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
The talk: https://researchgate.net/publication/370132037?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
The poster: https://researchgate.net/publication/371248872?utm_source=mastodon&utm_medium=social&utm_campaign=fedica-Text-posts
Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 #APA in #NewYorkCity (January 8 to 11): https://www.apaonline.org/mpage/2025eastern
Can't make it?
- More about my talk: https://researchgate.net/publication/370132037
- More about my poster: https://researchgate.net/publication/371248872
Thanks to the #APA, James Beebe, and the Experimental Philosophy Society for the opportunity!
In a new paper, I simulate the consequences of combining survey data without proper harmonization techniques.
I demonstrate that there is a plausible risk of biased correlative analyses based on the integrated data, if we do not harmonize measurement units across different survey sources and instruments first.
Moral comparisons of utilitarian tradeoffs depended on the rating protocol?
Participants rated pairs of utilitarian tradeoffs. Relative differences for each pair depended on
- whether participants saw both tradeoffs at the same time or separately.
- whether the rating was comparative or quantitative.
Sometimes (although not most of the time), the average relative difference for one protocol reversed in the other protocol!
Will people reason less reflectively when primed to think about threats to their health or resources?
Multiple pre-registered experiments (N > 3000) didn't detect any such reflection-suppressing effect of threat primes (compared to controls) — and this didn't seem to be a result of a failed manipulation.
If cognitive reflection tests measure a reasoning style that generalizes beyond the test itself, we should see test performance predicting many forms of good reasoning.
Yet another example of this: better reflection test performance predicts more (logically) consistent responses across opposing psychological test items (that is, reversed and non-reversed items on a scale): https://doi.org/10.1016/j.paid.2024.112811
I recently found think-aloud research from 15 years ago, which may have revealed that expert entrepreneurs thought more reflectively than novices (MBA students).
I also like that this paper seems to relay some of the reasons that concurrent think-aloud protocols can outperform retrospective verbal report protocols.
People designing questionnaires for a German sample will find the just published new version of the "Demographische Standards" helpful. It offers guidance on how to collect varios socio-demographic variables (e.g., education, citizenship, employment) in a comprehensive manner.
"We conclude that potential utility of NPSs [nonprobability samples from commercial survey organizations] will remain out of reach unless scholars confront the tension between the operation of online survey organizations and the goals of transparent research." https://academic.oup.com/poq/article-abstract/87/3/816/7275175 #surveymethodology #surveymethods #nonprob @surveystatisticsandmethodology @surveystatsandmethodology
Interesting review paper on applied survey methods in Annual Reviews of Economics https://www.annualreviews.org/doi/pdf/10.1146/annurev-economics-091622-010157 @surveystatisticsandmethodology @surveystatsandmethodology #surveymethodology #surveymethods
SHARE Nutzerworkshop & Survey Lifecycle Operators Workshop (SLOW) vom 27. bis 29. September http://blog.surveydata.org/share-nutzerworkshop-survey-lifecycle-operators-workshop-slow-vom-27-bis-29-september/ @surveystatisticsandmethodology @surveystatsandmethodology #surveymethods
Very excited about the two great sessions on data donation with many amazing presentations at #esra23. You can find the abstracts here:
https://www.europeansurveyresearch.org/conf2023/prog.php?sess=54#main
https://www.europeansurveyresearch.org/conf2023/prog.php?sess=178#main
#datadonation #surveymethods #computationalsocialscience #digitaltracedata
Interesting theory-based paper on participation on prob-based online panels https://academic.oup.com/ijpor/article/35/2/edad012/7143700 @surveystatisticsandmethodology @surveystatsandmethodology #survey #surveymethods #surveymethodology
Nice, very hands-on paper on how to run surveys in market-research panels "Using Market-Research Panels for Behavioral Science: An Overview and Tutorial" https://journals.sagepub.com/doi/full/10.1177/25152459221140388 @surveystatisticsandmethodology #surveymethods #survey #surveymethodology
Interested in a bit of #WeekendListening around surveys, polling, and opinions?
If you have access to the #BBC's material, how about listen first to this episode from "The Forum",
From Straw Poll to Opinion Poll
https://www.bbc.co.uk/sounds/play/w3cswprr
And then, for a bit of comic relief, to this from "Stand-up Specials"
Geoff Norcott: #Geofferendum
https://www.bbc.co.uk/sounds/play/m001cx2s
Julia Rohrer posted about the pron-nonprob-debate.
https://www.the100.ci/2023/03/07/non-representative-samples-what-could-possibly-go-wrong/
This symbolic depiction of Missingness Completely at Random makes me faint.
#surveymethods #surveymethodology
The #ASA / #NSF / #BLS Senior Research Fellowship Program is searching for two fellows. One position is focused on #statistics, #economics, or #BehavioralScience research, and the other is focused on #DataScience. Applicants must work at a college/university or a 501(c)(3) #nonprofit.
Applications are due January 9, 2023. See the full details at https://www.bls.gov/osmr/asa_nsf_bls_fellowship_info.htm
