![]() When reproducing a study procedure as closely as possible in a replication attempt, we often speak of a direct replication attempt. In the following, we will discuss this argument and propose an easy solution to document one’s experimental procedure in order to empower replication studies to mimic the original procedure as closely as possible. Second, a finding might be based on a genuine phenomenon, but the effect was not replicated because essential details from the original experimental 1 procedure were altered (assuming that the replication attempt had sufficient statistical power). Possible reasons for such a finding could be false positive statistical findings (which were potentially increased by p-hacking or other means of data massaging, Simmons, Nelson, & Simonsohn, 2011). ![]() ![]() Generally, one could propose two main reasons why a published finding cannot be replicated: First, the initial finding was merely a coincidence and the reported effect was not describing a natural phenomenon. The term “replication crisis” even has its own Wikipedia page ( ) and has been covered by popular media outlets (e.g., Resnick, 2018 Yong, 2018). These results have led some to speak of a “replication crisis” in the psychological sciences ( Schooler, 2014). Additional (large-scale) replication attempts in psychology have confirmed initial findings that many published findings could not be replicated independently (e.g., Hagger et al., 2016 R. Famously, in a large replication project in psychology only approximately 40 % of the selected 100 studies were replicated by independent researchers ( Open Science Collaboration, 2015). Replication studies are discussed in sport science ( Halperin, Vigotsky, Foster, & Pyne, 2018), economics ( Camerer et al., 2016), and marketing ( Hunter, 2001). In recent years, many scientific fields have re-discovered the need for replication of scientific studies. 13.Īs the quote by Fisher demonstrates, in the empirical sciences, we need to replicate findings (i.e., repeat a study) in order to gain certainty about the existence of natural phenomena. we thereby admit that no isolated experiment, however significant in itself, can suffice for the experimental demonstration of any natural phenomenon – Fisher ( 1974), p. With this information, individual researchers should be able to record their experimental procedures and we hope to facilitate the use of screen recordings in computer assisted data collection procedures. We therefore provide a brief tutorial on screen recordings using an open source screen recording software. ![]() We argue that there is a simple solution to these problems when an experiment is conducted using computers: recording an example procedure with a screen capture software and providing the video in an online repository. However, we believe that merely providing the materials of an experimental procedure is not sufficient, as many software solutions are not freely available, software solutions might change, and it is time consuming to set up the procedure. One proposed solution to facilitate the empirical reproducibility of the experimental procedures in psychology is to upload the experimental script and materials to a public repository. Therefore any replication attempt that does not replicate the original effect is most informative when the original procedure is closely adhered to. ![]() However, it could also mean that a specific detail of the experimental procedure is essential for the effect to emerge, which might not have been included in the replication attempt. A non-replication could indicate that a previous finding might have been a false positive statistical result and the effect does not exist. Recently in psychological science and many related fields, a surprisingly large amount of experiments could not be replicated by independent researchers. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |