Invited: Toward Sustainable and Transparent Benchmarking for Academic Physical Design Research

TL;DR

This paper introduces RosettaStone 2.0, an open, comprehensive benchmarking framework for physical design research that ensures transparency, reproducibility, and fair comparison across 2D and 3D design methodologies.

Contribution

It provides a complete RTL-to-GDS reference flow for both planar and 3D designs, integrated with continuous testing and a community leaderboard for transparent benchmarking.

Findings

Enables apples-to-apples comparison of 2D and 3D designs.

Supports transparent, reproducible benchmarking with community governance.

Automates evaluation with standardized metrics and reports.

Abstract

This paper presents RosettaStone 2.0, an open benchmark translation and evaluation framework built on OpenROAD-Research. RosettaStone 2.0 provides complete RTL-to-GDS reference flows for both conventional 2D designs and Pin-3D-style face-to-face (F2F) hybrid-bonded 3D designs, enabling rigorous apples-to-apples comparison across planar and three-dimensional implementation settings. The framework is integrated within OpenROAD-flow-scripts (ORFS)-Research; it incorporates continuous integration (CI)-based regression testing and provides a standardized evaluation pipeline based on the METRICS2.1 convention, with structured logs and reports generated by ORFS-Research. To support transparent and reproducible research, RosettaStone 2.0 further provides a community-facing leaderboard, which is governed by verified pull requests and enforced through Developer Certificate of Origin (DCO) compliance.