The extreme upper tail of Japan's citation distribution reveals its research success

TL;DR

This study reveals that analyzing Japan's scientific impact through the extreme upper tail of citation distribution shows its true research success, contrasting with standard bibliometric indicators.

Contribution

It introduces a novel approach focusing on the extreme upper tail of citation data to better assess a country's scientific excellence, highlighting Japan's true research standing.

Findings

Japan's high-impact papers place it among scientifically advanced countries.

Standard bibliometric indicators underestimate Japan's scientific level.

High citation metrics like Clarivate Citation laureates support the findings.

Abstract

A number of indications, such as the number of Nobel Prize winners, show Japan to be a scientifically advanced country. However, standard bibliometric indicators place Japan as a scientifically developing country. The present study is based on the conjecture that scientific publications from Japan belong to two different populations: one originates from studies that advance science and includes highly cited papers, while the other is formed by poorly cited papers with almost zero probability of being highly cited. Although these two categories of papers cannot be easily identified and separated, the scientific level of Japan can be tested by studying the extreme upper tail of the citation distribution of all scientific articles. In contrast to standard bibliometric indicators, which are calculated from the total number of papers or from sets of papers in which the two categories of papers are mixed, in the extreme upper tail, only papers that are addressed to the advance of science will be present. Based on the extreme upper tail, Japan belongs to the group of scientifically advanced countries and is significantly different from countries with a low scientific level. The number of Clarivate Citation laureates also supports our hypothesis that some citation-based metrics do not reveal the high scientific level of Japan. Our findings suggest that Japan is an extreme case of inaccuracy of some citation metrics; the same drawback might affect other countries, although to a lesser degree.