Hiding in Plain Sight: Reframing Hardware Trojan Benchmarking as a Hide&Seek Modification

TL;DR

This paper introduces a new benchmark for hardware Trojan detection that models the real-world uncertainty faced by defenders, using a 'Hide&Seek' approach to evaluate detection tools more realistically.

Contribution

It formulates HT detection as a Seeker's Dilemma, creates a benchmark with mixed HT-infected and clean circuits, and evaluates detection tools within this realistic framework.

Findings

Some HT-infected circuits are indistinguishable from clean circuits.

The benchmark reveals limitations of current detection tools.

Principal Component Analysis shows overlaps between infected and clean circuits.

Abstract

This work focuses on advancing security research in the hardware design space by formally defining the realistic problem of Hardware Trojan (HT) detection. The goal is to model HT detection more closely to the real world, i.e., describing the problem as The Seeker's Dilemma where a detecting agent is unaware of whether circuits are infected by HTs or not. Using this theoretical problem formulation, we create a benchmark that consists of a mixture of HT-free and HT-infected restructured circuits while preserving their original functionalities. The restructured circuits are randomly infected by HTs, causing a situation where the defender is uncertain if a circuit is infected or not. We believe that our innovative benchmark and methodology of creating benchmarks will help the community judge the detection quality of different methods by comparing their success rates in circuit classification. We use our developed benchmark to evaluate three state-of-the-art HT detection tools to show baseline results for this approach. We use Principal Component Analysis to assess the strength of our benchmark, where we observe that some restructured HT-infected circuits are mapped closely to HT-free circuits, leading to significant label misclassification by detectors.