Uncovering simultaneous breakthroughs with a robust measure of disruptiveness

TL;DR

This paper introduces a new neural embedding-based measure of disruptiveness that overcomes limitations of previous metrics, enabling better identification of disruptive innovations and simultaneous breakthroughs in science and technology.

Contribution

The authors develop a continuous, neural embedding framework for measuring disruptiveness, improving accuracy and enabling detection of simultaneous discoveries compared to the traditional disruption index.

Findings

The new measure better distinguishes disruptive works like Nobel papers.

It reveals simultaneous disruptions by identifying similar future contexts.

It provides a more robust and equitable evaluation of scientific breakthroughs.

Abstract

Progress in science and technology is punctuated by disruptive innovation and breakthroughs. Researchers have characterized these disruptions to explore the factors that spark such innovations and to assess their long-term trends. However, although understanding disruptive breakthroughs and their drivers hinges upon accurately quantifying disruptiveness, the core metric used in previous studies -- the disruption index -- remains insufficiently understood and tested. Here, after demonstrating the critical shortcomings of the disruption index, including its conflicting evaluations for simultaneous discoveries, we propose a new, continuous measure of disruptiveness based on a neural embedding framework that addresses these limitations. Our measure not only better distinguishes disruptive works, such as Nobel Prize-winning papers, from others, but also reveals simultaneous disruptions by allowing us to identify the "twins" that have the most similar future context. By offering a more robust and precise lens for identifying disruptive innovations and simultaneous discoveries, our study provides a foundation for deepening insights into the mechanisms driving scientific breakthroughs while establishing a more equitable basis for evaluating transformative contributions.