New Tools and Services for Reproducibility
InstructionsNew Tools and Services for Reproducibility
Pilot 1 - Decision Aid
TIER2's Decision Aid provides clarity on the meaning, relevance, and feasibility of ‘reproducibility’ for researchers to aid them in identifying what type of reproducibility is relevant for their research and indicate what they must consider regarding how feasible such ‘reproducibility’ would be for them.
Pilot 2 - Reproducibility Management Plan (RMP)
The Reproducibility Management Plan (RMP) Pilot aims to create a prototype of key thematic subjects and questions that will serve as the starting point to support reproducibility at the planning stage of research. Work involves defining what an RMP is, integrating it into the ARGOS service, and testing its effectiveness with feedback from the community. The pilot addresses researchers, beneficiaries and funders for its adoption.
Pilot 3 - Reproducible Workflows
Reproducible Workflows has adapted the SCHEMA open-source platform for reproducible workflows in life and computer sciences by leveraging software containerisation, workflow description languages (CWL, Snakemake), and experiment packaging specifications (RO-crate), particularly emphasising machine learning in computer science.
Pilot 4 - The Reproducibility Checklist
The Reproducibility Checklist for Computational Social Science Research provides a structure of well-defined checklists and templates that can help review data and code reproducibility for computational social scientists. The checklists and review templates cater for the specific needs of the three research phases, i.e., planning and data collection, process and analysis and finally sharing and archiving the research resources. It results in building trust and authority in the social science research community.
Pilot 5 - The Reproducibility Promotion Plan for Funders (RPP)
The Reproducibility Promotion Plan for Funders (RPP) has developed a policy template with recommendations for funders to foster reproducible practices both in the research they fund across three key areas of funding work: evaluation and monitoring, policy and definitions, and incentives. The RPP provides actionable recommendations and best practice examples that funders and funding institutions can adapt to meet their specific needs.
Pilot 6 - The Reproducibility Monitoring Dashboard
The Reproducibility Monitoring Dashboard hosts tools that enable funding agencies to track and monitor the reusability of research artifacts across various projects, programs, topics, and disciplines. This auto-generated dashboard assesses the impacts of policies related to data and code sharing.
Pilot 7 - Editorial Workflows to Increase Data Sharing
This tool is aimed at increasing data sharing in published work. Data sharing is an important building block for increased reproducibility & transparency, but current rates of sharing are low.
Pilot 8- An Editorial Reference Handbook for Reproducibility and FAIRness
The Editorial Reference Handbook contributes towards a common understanding and what is required to assist reproducibility and FAIRness. The Handbook includes two components. A structured section includes an educational and practical set of checks, defined by reviewing existing material, harmonising and operationalising them. Some journals have internal checks, but the type, richness and stringency vary, and there is little/no consensus among publishers. A narrative component with a general framework helps improve internal processes, defined by describing an ideal process where checks should be applied. There are a variety of internal processes, and how, when and by whom these checks are done vary, and this can also affect the results.
