# Treatment recommendations based on network meta-analysis: Rules for risk-averse decision-makers

## TL;DR

This paper introduces a new method for treatment recommendations in network meta-analysis that accounts for uncertainty, making it suitable for risk-averse decision-makers.

## Contribution

The paper introduces loss-adjusted expected value (LaEV) as a novel decision rule for treatment recommendations under uncertainty.

## Key findings

- LaEV reliably delivers valid rankings under uncertainty and has all desirable properties.
- LaEV recommends fewer treatments than expected value-based methods, aligning with risk-averse preferences.
- GRADE rules and probability-based rankings show anomalies and depend on arbitrary cutoffs.

## Abstract

The treatment recommendation based on a network meta-analysis (NMA) is usually the single treatment with the highest expected value (EV) on an evaluative function. We explore approaches that recommend multiple treatments and that penalise uncertainty, making them suitable for risk-averse decision-makers. We introduce loss-adjusted EV (LaEV) and compare it to GRADE and three probability-based rankings. We define properties of a valid ranking under uncertainty and other desirable properties of ranking systems. A two-stage process is proposed: the first identifies treatments superior to the reference treatment; the second identifies those that are also within a minimal clinically important difference (MCID) of the best treatment. Decision rules and ranking systems are compared on stylised examples and 10 NMAs used in NICE (National Institute of Health and Care Excellence) guidelines. Only LaEV reliably delivers valid rankings under uncertainty and has all the desirable properties. In 10 NMAs comparing between 5 and 41 treatments, an EV decision maker would recommend 4–14 treatments, and LaEV 0–3 (median 2) fewer. GRADE rules give rise to anomalies, and, like the probability-based rankings, the number of treatments recommended depends on arbitrary probability cutoffs. Among treatments that are superior to the reference, GRADE privileges the more uncertain ones, and in 3/10 cases, GRADE failed to recommend the treatment with the highest EV and LaEV. A two-stage approach based on MCID ensures that EV- and LaEV-based rules recommend a clinically appropriate number of treatments. For a risk-averse decision maker, LaEV is conservative, simple to implement, and has an independent theoretical foundation.