Replicability in Online Research

At the GOR conference in Cologne two weeks ago, I had the opportunity to give a talk on replicability in Online Research. As a PhD student researching this topic and working as a data scientist in market research, I was very happy to have the opportunity to give my thoughts on how the debate in psychological science might transfer to online and market research.

The GOR conference is quite unique since the audience is about half academics and half commercial practitioners from market research. I noticed my filter bubble, when only about a third of the audience knew about the “replicability crisis in psychology” (Pashler & Wagenmakers, 2012; Pashler & Harris, 2012).

Continue reading “Replicability in Online Research”

Research is messy: Two cases of pre-registrations

Pre-registrations are becoming increasingly important for studies in psychological research. This is a much needed change since part of the “replication crisis” has to do with too much flexibility in data analysis and interpretation (p-hacking, HARK’ing and the like). Pre-registering a study with planned sample size and planned analyses allows other researchers to understand what the initial thinking of the authors was, how the data fits to the initial hypothesis and where are differences between the study protocol and study results. In theory, it looks very simple: you think about a problem, you conceive a study, lay out the plan, register it, collect data, analyse and publish.  Continue reading “Research is messy: Two cases of pre-registrations”

Good Science – Bad Science? Panel Discussion at the University of Cologne

After I found out about the panel discussion on Good Scientific Practice at the University of Cologne via Twitter, I joined yesterday to watch the discussion as it was closely related to my thesis’ topic.

The panel was filled with five professors and one junior professors from different faculties1, whose positions were related to “good vs bad science” in some way.

Continue reading “Good Science – Bad Science? Panel Discussion at the University of Cologne”