Contextualising and Aligning Security Metrics and Business Objectives: a GQM-based Methodology

TL;DR

This paper introduces SYMBIOSIS, a systematic methodology based on GQM, to align security metrics with business objectives by considering organizational context, enabling better decision-making and addressing previous pitfalls in security metrics development.

Contribution

The paper presents a novel, well-defined process for goal elicitation and refinement that explicitly links security metrics to business objectives through systematic templates.

Findings

SYMBIOSIS effectively aligned security metrics with business goals in case studies.

Application of SYMBIOSIS revealed insights into security incident outcomes.

The methodology improved understanding of security metrics' impact on organizational objectives.

Abstract

Pre-defined security metrics suffer from the problem of contextualisation, i.e. a lack of adaptability to particular organisational contexts - domain, technical infrastructure, stakeholders, business process, etc. Adapting metrics to an organisational context is essential (1) for the metrics to align with business requirements (2) for decision makers to maintain relevant security goals based on measurements from the field. In this paper we propose SYMBIOSIS, a methodology that defines a goal elicitation and refinement process mapping business objectives to security measurement goals via the use of systematic templates that capture relevant context elements (business goals, purpose, stakeholders, system scope). The novel contribution of SYMBIOSIS is the well-defined process, which enforces that (1) metrics align with business objectives via a top-down derivation that refines top-level business objectives to a manageable granularity (2) the impact of metrics on business objectives is explicitly traced via a bottom-up feedback mechanism, allowing an incremental approach where feedback from metrics influences business goals, and vice-versa. In this paper, we discuss the findings from applying SYMBIOSIS to three case studies of known security incidents. Our analysis shows how the aforementioned pitfalls of security metrics development processes affected the outcome of these high-profile security incidents and how SYMBIOSIS addresses such issues.