You do not have permission to edit this page, for the following reason:

Only users who are logged in using ORCID can make a change or add a contribution. Please login here.

Back

Edit a theme

We invite you to share your knowledge and write about a theme which you find relevant, interesting or controversial. You can share your own expertise, present your new initiative, write a commentary about one of the resources hosted on The Embassy, or simply describe a topic that you think should be shared with the research community.

Before you submit, please be aware of our community guidelines.

Theme

The social sciences and humanities are, in part, characterized by significant epistemological and methodological differences both within and between their disciplines <ref name=":0">Derrick G, Ross-Hellauer T. Peer Review in SSH: In Need of Development? In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 10-14 p.</ref>. As a result, various publication outputs such as books and journal articles require different and multiple evaluation criteria <ref name=":1">Kancewicz-Hoffman N, Ochsner M, Hołowiecki M, Holm J. Introduction: Aim and scope of the report. In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 6-9 p. Available from: https://enressh.eu/wp-content/uploads/2017/09/OverviewPeerReviewENRESSH-1.pdf.</ref>. Due to a lack of “a mainstream approach” to the evaluation of research in these disciplines <ref name=":1" />, multiple and diverse guidelines for peer review exist. Some argue that a holistic approach would introduce biases. Nevertheless, it is argued that there should be “a catalogue of explicit criteria” and “each criterion should be rated separately” <ref>Ochsner M. Evaluation Criteria and Methodology. In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 15-22 p. Available from: https://enressh.eu/wp-content/uploads/2017/09/OverviewPeerReviewENRESSH-1.pdf.</ref>.

Since the traditional peer review system in SSH has been criticized for its risk of bias, delay and unreliability <ref name=":0" />, some suggest that SSH disciplines would benefit from the appropriation of certain practices already present in STEM disciplines, such as open or post-publication peer review. According to the Publishing Research Consortium, 50-70% of the SSH researchers would support open peer review. However, that support would decrease to 35-55% if open peer review were to include signed reviews published with the associated article <ref name=":2">Butchard D, Rowberry S, Squire C, Tasker G. Peer Review in Practice. London: UCL Press; 2016. Available from: https://ucldigitalpress.co.uk/BOOC/Article/1/57/.</ref>. When it comes to post-publication review, the majority of SSH researchers are comfortable with it only as an addition to the pre-publication, double-blind review process. Most researchers consider the pre-publication, double-blind review model to be the ideal <ref name=":2" />.
<references />

Shortcomings in the current system have led to discussions in the SSH community with the aim of addressing the challenges and implementing some changes. In February 2020, the European Network for Research Evaluation in the Social Sciences and the Humanities (ENRESSH) provided a report, an “[https://enressh.eu/wp-content/uploads/2017/09/Hoffman-Holowiecki-Holm-Ochsner-Overview-of-Peer-Review-Practices-in-the-SSH.pdf Overview of Peer Review Practices in the SSH]” <ref>Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer review practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. Available from:

https://dx.doi.org/10.6084/m9.figshare.12032589. </ref>. The report stressed that, in contrast to STEM, SSH disciplines are more heterogeneous in their publication outputs. This makes it difficult to define and evaluate research methodologies, which, subsequently, leads to a lack of consensus when it comes to the criteria for assessing the quality of research outputs <ref name=":0">Kancewicz-Hoffman N, Ochsner M, Hołowiecki M, Holm J. Introduction: Aim and scope of the report. In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 6-9 p. Available from: https://enressh.eu/wp-content/uploads/2017/09/OverviewPeerReviewENRESSH-1.pdf.</ref>. The report states that copying the evaluation models that exist for STEM disciplines is not the best response <ref name=":0" />. However, some argue that certain practices, such as open peer review, could apply to SSH. The advantages of open peer review are that it would speed up the publication process and enable dialogue between authors and readers <ref name=":1">Kancewicz-Hoffman N. Review of guidelines and recommendations for evaluation. In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 42-29 p. Available from:

https://enressh.eu/wp-content/uploads/2017/09/OverviewPeerReviewENRESSH-1.pdf.</ref>.

In order to speed up the review process, the report offers other suggestions, including, limiting the length of manuscripts, limiting the number of publications per researcher or institution and recruiting more reviewers <ref name=":1" />. In addition, the SSH community could learn from new peer review models in STEM subjects, and seek to apply them if possible <ref name=":0" />. Although SSH disciplines are heterogeneous, there is a call for general standards and principles for peer review <ref>Ochsner M. Evaluation Criteria and Methodology. In: Ochsner M, Kancewicz-Hoffman N, Hołowiecki M, Holm J, eds. Overview of peer practices in the SSH. ENRESSH Report. European Network of Research Evaluation in the Social Sciences and Humanities. 2020. 15-22 p. Available from: https://enressh.eu/wp-content/uploads/2017/09/OverviewPeerReviewENRESSH-1.pdf.</ref>, in order to ensure “timeliness, transparency and verifiability” <ref>Butchard D, Rowberry S, Squire C, Tasker G. Peer Review in Practice. London: UCL Press; 2016. Available from: https://ucldigitalpress.co.uk/BOOC/Article/1/57/.</ref>.

Even though the SSH tend to be slower to respond to calls for change when compared with STEM disciplines, some journals and platforms have been adapting to recent developments in peer review systems, including 1) Kairos, which adopted a three-stage review process <ref>Kairos. A Journal of Rhetoric, Technology, and Pedagogy. [cited 2020 Sept 10]. Available from: http://kairos.technorhetoric.net/board.html. </ref>, 2) Palgrave Macmillian, which has trialed open peer review trial <ref>Palgrave Macmillan. [cited 2020 Sept 10]. Available from:

https://palgraveopenreview.wordpress.com/. </ref> and open publishing <ref>F1000Research. [cited 2020 Sept 10]. Available from: https://f1000research.com/about. </ref>, and 3) Wellcome Open Research, which provides post-publication peer review <ref>Welcome Open Research. [cited 2020 Sept 10]. Available from:

https://wellcomeopenresearch.org/. </ref>.
<references />

Related To

Edit Theme: Theme:050a1a18-4a5f-4260-9850-3b7b7e486f73

Edit a theme