|
1 | 1 | --- |
2 | | -# Section metadata |
3 | | -title: "FORRT Replication Hub" |
4 | | -date: 2023-09-09 |
5 | | -type: plain_page |
| 2 | +title: "FORRT Replication Hub — Transforming Research" |
| 3 | +heading_title: "FORRT's Replication Hub" |
| 4 | +description: "Support for every level of replication and reproduction — tracking, exploring, conducting, and disseminating replication studies across all research disciplines." |
| 5 | +type: replication_hub |
| 6 | +image: "replication_hub.webp" |
| 7 | +image_alt: "FORRT Replication Hub diagram showing four areas: Track, Explore, Conduct, Disseminate" |
| 8 | +sharing_image_resource: "replication_hub.webp" |
| 9 | +sharing_image_alt: "FORRT Replication Hub diagram showing four areas: Track, Explore, Conduct, Disseminate" |
| 10 | + |
| 11 | +intro: > |
| 12 | + With the FORRT Replication Hub, our mission is to support reproduction and |
| 13 | + replication studies across all stages of the research process as well as all |
| 14 | + research disciplines. It consists of a comprehensive collection of resources |
| 15 | + and tools designed to assist researchers in the *tracking*, *finding & |
| 16 | + exploring*, *conducting*, and *publishing & dissemination* of reproduction and |
| 17 | + replication studies. |
| 18 | +
|
| 19 | +cards: |
| 20 | + - key: track |
| 21 | + title: Track |
| 22 | + description: > |
| 23 | + Reproductions and replications are often published in preprints, as part |
| 24 | + of meta-papers that can include over one hundred studies, and in different |
| 25 | + journals than the respective target studies. At the FORRT Replication Hub, |
| 26 | + we track them in multiple ways by linking original and target studies. |
| 27 | + links: |
| 28 | + - text: "FORRT Library of Reproduction and Replication Attempts (FLoRA)" |
| 29 | + url: "/replication-hub/flora/" |
| 30 | + - text: "FLoRA Submission Form" |
| 31 | + url: "/replication-hub/submit/" |
| 32 | + - text: "Positive Changes from the Replication Crisis" |
| 33 | + url: "https://doi.org/10.1038/s44271-023-00003-2" |
| 34 | + |
| 35 | + - key: explore |
| 36 | + title: Explore |
| 37 | + description: > |
| 38 | + *Gotta catch 'em all!* Researchers who are looking to incorporate hundreds |
| 39 | + of replication attempts into their research and teaching can make use of |
| 40 | + our free and open-source tools. These are mostly based on FLoRA and FReD. |
| 41 | + links: |
| 42 | + - text: "FLoRA Annotator" |
| 43 | + url: "/annotator" |
| 44 | + - text: "FReD Explorer" |
| 45 | + url: "/explorer" |
| 46 | + - text: "FReD R Package" |
| 47 | + url: "/FReD" |
| 48 | + |
| 49 | + - key: conduct |
| 50 | + title: Conduct |
| 51 | + description: > |
| 52 | + Since failures to replicate a large proportion of seminal findings across |
| 53 | + many disciplines, interest in reproduction and replication has surged and |
| 54 | + given rise to new techniques and methods. Our resources help students, |
| 55 | + ECRs, and experienced researchers to take up newly developed methods and |
| 56 | + conduct high-quality replication research. |
| 57 | + links: |
| 58 | + - text: "Handbook for Reproduction and Replication Studies (WIP)" |
| 59 | + url: "/replication_handbook" |
| 60 | + - text: "Manuscript Templates" |
| 61 | + url: "https://osf.io/brxtd/" |
| 62 | + - text: "Love Replications Week" |
| 63 | + url: "/LoveReplicationsWeek" |
| 64 | + - text: "ReplicateThis Nomination Portal (WIP)" |
| 65 | + url: "/replicatethis" |
| 66 | + |
| 67 | + - key: disseminate |
| 68 | + title: Disseminate |
| 69 | + description: > |
| 70 | + Research is meant to be shared. While many areas of academic culture value |
| 71 | + innovation for the sake of robustness and repetition, we strive for |
| 72 | + equality. With a dedicated and community-owned diamond open access journal |
| 73 | + led by a group of experts, FORRT supports all researchers in publishing |
| 74 | + high-quality repetitions. |
| 75 | + links: |
| 76 | + - text: "Replication Research (R2) Diamond Open Access Journal" |
| 77 | + url: "http://replicationresearch.org" |
| 78 | + - text: "R2 Mentorship Program" |
| 79 | + url: "https://ejournals.uni-muenster.de/replicationresearch/mentorshipprogram" |
| 80 | + - text: "Replication Journal Federation" |
| 81 | + url: "/rjf" |
| 82 | + - text: "Replication Bot" |
| 83 | + url: "https://bsky.app/profile/replicationbot.bsky.social" |
| 84 | + - text: "Journal Replicability Tracker" |
| 85 | + url: "/journalranking" |
6 | 86 | --- |
7 | | - |
8 | | -<br> |
9 | | - |
10 | | -<img src="https://github.com/user-attachments/assets/f09dbbc0-9fe1-4261-aaa4-4df948ad9be0" /> |
11 | | - |
12 | | - |
13 | | -### **Transforming Research: Support for Every Level of Replication and Reproduction** |
14 | | - |
15 | | -The FORRT Replication Hub provides a comprehensive collection of resources and tools designed to assist researchers in the identification, evaluation, execution, and publication of replication studies. |
16 | | - |
17 | | -### **Projects** |
18 | | - |
19 | | -1. FORRT’s Replication Database (FReD) serves as a centralized repository where researchers can access information about past replication efforts, including methodologies and outcomes. This database is intended to facilitate easier access to replication study data, promote transparency, and encourage the conduct of further replications by providing researchers with a clear view of what has been previously attempted and achieved. |
20 | | - <img src="fred.webp" /> |
21 | | - |
22 | | - |
23 | | - - [FReD Explorer](/explorer) is an interactive tool within the FORRT Replication Database designed to facilitate the navigation and discovery of replication studies. It allows researchers and educators to explore a wide array of replication projects easily, filtering them based on various criteria. The Explorer helps users identify trends and gaps in replication research, offering a user-friendly interface to access detailed information on past studies. |
24 | | - |
25 | | -2. [FLoRA Annotator](/annotator) is a tool aimed at enhancing the quality and accessibility of data within the FORRT Replication Database. It allows users to check a list of references for potential replication attempts and returns a reading list that includes replication attempts and outcomes of the replication studies. |
26 | | - |
27 | | -3. [Replication Research](http://replicationresearch.org) is a diamond open access journal for reproductions, replications, and conceptual articles from multiple fields. It is being developed by FORRT and the Münster Center for Open Science and will be launched in fall 2025\. |
28 | | - |
29 | | - <a href="http://replicationresearch.org" target="_blank"> |
30 | | - <img src="rep_research.webp" alt="Replication Research"> |
31 | | - </a> |
32 | | - |
33 | | -4. [FORRT’s Replications and Reversals](/reversals/) is a crowdsourced list of studies that have been replicated, not replicated, or reversed (i.e., replication results were the opposite of original results) for pedagogical purposes. It stopped updating in late 2023 as we are merging it into FReD. An updated version of the list will be available shortly. |
34 | | - |
35 | | -### **Partner Projects** |
36 | | - |
37 | | -* The [Scaling Machine Assessments of Research Trustworthiness](https://www.cos.io/about/news/cos-expands-score-program-efforts) (SMART) competition explores innovative methods to predict the replicability of scientific findings using algorithms. FORRT has [partnered](https://www.cos.io/blog/cos-and-forrt-partner-to-increase-discoverability-and-usability-of-replication-evidence) with the COS to provide a large training dataset. |
38 | | -* The [Collaborative Replication and Education Project (CREP)](https://forrt.org/glossary/vbeta/collaborative-replication-and-educa/) is an initiative designed to organize and structure replication efforts of highly-cited empirical studies in psychology to satisfy the dual needs for more high-quality direct replications and more training in empirical research techniques for psychology students. CREP aims to address the need for replications of highly cited studies, and to provide training, support and professional growth opportunities for academics completing replication projects. |
39 | | -* The [Institute for Replication (I4R)](https://i4replication.org) organizes replication games to conduct replications and reproductions. It provides replication and teaching resources and helps researchers disseminate and publish replications and reproductions. |
40 | | -* The Center for Open Science’s projects to [Systematizing Confidence in Open Research and Evidence (SCORE)](https://www.cos.io/score) and , the [Scaling Machine Assessments of Research Trustworthiness (SMART)](https://www.cos.io/about/news/cos-expands-score-program-efforts) include prediction markets, machine-learning, and replication efforts. |
41 | | -* The project [Improving Reproducibility in Science (iRise)](https://camarades.shinyapps.io/dev-irise-soles/) identifies, tracks, and evaluates discipline-wide open science interventions and develops tools to improve reproducibility. |
42 | | -* The [Replication Wiki](https://replication.uni-goettingen.de/wiki/index.php/Main_Page) provides teaching resources for replication research and a database with reproductions and replications from the social sciences (particularly economics). |
43 | | -* The [Journal of Comments and Replications in Economics](http://jcr-econ.org) is the go-to outlet for reproductions and replications from the field of economics. |
44 | | -* We are also very grateful to everyone who contributed to the many large-scale replication efforts in recent years that we drew on in compiling our data. A list of large replication projects can be found [here](/replication-hub/large-scale-replication-projects/). |
45 | | - |
46 | | -**Publications and Pre-prints** |
47 | | - |
48 | | -Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. *Communications Psychology*, 1(1), 3\. [https://doi.org/10.1038/s44271-023-00003-2](https://doi.org/10.1038/s44271-023-00003-2) |
49 | | - |
50 | | -Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., Schütz, A., ... & Zhang, Y. (2024). The replication database: documenting the replicability of psychological science. Journal of Open Psychology Data, 12(8), 1-23. [https://doi.org/10.5334/jopd.101](https://doi.org/10.5334/jopd.101) |
51 | | - |
52 | | -Röseler, L., Gendlina, T., Krapp, J., Labusch, N., & Schütz, A. (2022). Successes and Failures of Replications: A Meta-Analysis of Independent Replication Studies Based on the OSF Registries. *MetaArXiv Preprints*. [https://doi.org/10.31222/osf.io/8psw2](https://doi.org/10.31222/osf.io/8psw2) |
53 | | - |
54 | | -### **Support Us** |
55 | | - |
56 | | -[https://opencollective.com/forrt](https://opencollective.com/forrt) |
57 | | - |
58 | | - |
|
0 commit comments