Double-Anonymous Review for Robotics

TL;DR

This paper reviews the benefits and challenges of double-anonymous review in robotics, summarizing prior research and offering recommendations for its implementation in the field.

Contribution

It provides a comprehensive summary of existing peer review research relevant to robotics and suggests future directions for review practices.

Findings

Double-anonymous review can reduce bias in peer review.

Prior studies show mixed results on review quality differences.

Recommendations for adopting DAR in robotics are discussed.

Abstract

Prior research has investigated the benefits and costs of double-anonymous review (DAR, also known as double-blind review) in comparison to single-anonymous review (SAR) and open review (OR). Several review papers have attempted to compile experimental results in peer review research both broadly and in engineering and computer science. This document summarizes prior research in peer review that may inform decisions about the format of peer review in the field of robotics and makes some recommendations for potential next steps for robotics publication.