Critical Design Strategy: a Method for Heuristically Evaluating Visualisation Designs

TL;DR

The paper introduces the Critical Design Strategy (CDS), a structured heuristic method for evaluating visualisation designs through reflection, critique, and synthesis, aiding designers in making informed improvements.

Contribution

It presents the CDS framework, detailing its three-stage process and six perspectives, and demonstrates its application in educational settings for visualisation design evaluation.

Findings

CDS effectively guides critical evaluation of visualisation designs.

Application in educational modules improved students' design reflection skills.

Refinement of the method over time enhanced its usability and impact.

Abstract

We present the Critical Design Strategy (CDS) - a structured method designed to facilitate the examination of visualisation designs through reflection and critical thought. The CDS helps designers think critically and make informed improvements using heuristic evaluation. When developing a visual tool or pioneering a novel visualisation approach, identifying areas for enhancement can be challenging. Critical thinking is particularly crucial for visualisation designers and tool developers, especially those new to the field, such as studying visualisation in higher education. The CDS consists of three stages across six perspectives: Stage 1 captures the essence of the idea by assigning an indicative title and selecting five adjectives (from twenty options) to form initial impressions of the design. Stage 2 involves an in-depth critique using 30 heuristic questions spanning six key perspectives - user, environment, interface, components, design, and visual marks. Stage 3 focuses on synthesising insights, reflecting on design decisions, and determining the next steps forward. We introduce the CDS and explore its use across three visualisation modules in both undergraduate and postgraduate courses. Our longstanding experience with the CDS has allowed us to refine and develop it over time: from its initial creation through workshops in 2017/18 to improvements in wording and the development of two applications by 2020, followed by the expansion of support notes and refinement of heuristics through 2023; while using it in our teaching each year. This sustained use allows us to reflect on its practical application and offer guidance on how others can incorporate it into their own work.