We are pleased to announce that this month AGU is implementing a new way to review manuscripts across all our journals: hypothes.is. Hypothes.is is a non-profit organization working to build open source software that enables annotation on digital documents. It is already being used in diverse fields including education, research, journalism and publishing.
In a traditional review, a reviewer might provide a long, itemized list of comments tied to pages and paragraphs or line numbers in a manuscript. Some also mark up a manuscript using track changes in Word or use the editing features in a PDF document while also providing other comments and a summary separately. Multiple reviews yield separate markups that cannot easily be merged.
Why not have all the comments in one document for the author, organized by who created them and tagged by the type and importance of a comment? Even better, also have the comments in list form that can be exported, filtered and sorted, and allow the authors to respond either in line, or using the list.
We are implementing this solution for our journals by incorporating the hypothes.is annotation tool into GEMS, our editorial system. This work is a cooperative effort by EjournalPress, which provides GEMS, and Hypothes.is, with initial support from the Alfred P. Sloan Foundation, and some extensive work and testing by the publications staff at AGU.
The hypothes.is software allows each reviewer to make inline comments and organizes these by reviewers, editors, authors and importance all in one file. Confidential comments for the editor can also be included.
Currently, each reviewer will only see their annotations while the editor can see the full collection, and the authors can see all non-confidential annotations. Thus, anonymity and viewing rights are preserved.
Each annotation is labeled to help organize the review. Current labels include a summary comment, major issue, minor issue, text edit, comment on a figure, and comment regarding a reference, and these can be filtered for ease of viewing. The annotations can also be collated separately and formed into a “traditional” review.
Authors can respond inline to reviewers’ comments on the same file, providing a means for a more effective dialog among the participants in the peer review process.
Using annotations in a review does require online access (although annotations are saved immediately) but online availability has expanded greatly in the past few years. Some instructions are available here.
Conducting a review using annotations is entirely optional—a reviewer can still choose the traditional way if they wish. For those that do wish to try it, we welcome feedback. Feedback is important to refine and improve the experience and provide broader familiarity with this development.
We appreciate that any changes and innovations may take some time to get used to; however, this approach opens up some additional opportunities for collaboration and improvement in the peer review process.
—Brooks Hanson, Senior Vice President; Jeanette Panning, Director; Randy Townsend, Senior Program Manager; Paige Wooden, Senior Program Manager, Publications, American Geophysical Union; email: bhanson@agu.org
Citation:
Hanson, B.,Panning, J.,Townsend, R., and Wooden, P. (2017), Annotation tool facilitates peer review, Eos, 98, https://doi.org/10.1029/2018EO082145. Published on 14 September 2017.
Text © 2017. The authors. CC BY-NC-ND 3.0
Except where otherwise noted, images are subject to copyright. Any reuse without express permission from the copyright owner is prohibited.