REVERSIM: An Open-Source Environment for the Controlled Study of Human Aspects in Hardware Reverse Engineering

TL;DR

ReverSim is an open-source software environment designed to facilitate controlled studies of human cognitive factors in hardware reverse engineering, enabling research with non-experts and improving understanding of HRE processes.

Contribution

This work introduces ReverSim, a novel open-source platform that models HRE subprocesses and integrates cognitive tests for empirical research.

Findings

ReverSim's processes are comparable to real-world HRE as confirmed by professionals.

It effectively differentiates participant performance across difficulty levels.

Cognitive processing speed correlates with task performance.

Abstract

Hardware Reverse Engineering (HRE) is a technique for analyzing integrated circuits. Experts employ HRE for security-critical tasks, like detecting Trojans or intellectual property violations, relying not only on their experience and customized tools but also on their cognitive abilities. In this work, we introduce ReverSim, a software environment that models key HRE subprocesses and integrates standardized cognitive tests. ReverSim enables quantitative studies with easier-to-recruit non-experts to uncover cognitive factors relevant to HRE. We empirically evaluated ReverSim in three studies. Semi-structured interviews with 14 HRE professionals confirmed its comparability to real-world HRE processes. Two online user studies with 170 novices and intermediates revealed effective differentiation of participant performance across a spectrum of difficulties, and correlations between participants' cognitive processing speed and task performance. ReverSim is available as open-source software, providing a robust platform for controlled experiments to assess cognitive processes in HRE, potentially opening new avenues for hardware protection.