The h-index is a popular bibliometric indicator for assessing individual
scientists. We criticize the h-index from a theoretical point of view. We argue
that for the purpose of measuring the overall scientific impact of a scientist
(or some other unit of analysis) the h-index behaves in a counterintuitive way.
In certain cases, the mechanism used by the h-index to aggregate publication
and citation statistics into a single number leads to inconsistencies in the
way in which scientists are ranked.
Two commonly used ideas in the development of citation-based research
performance indicators are the idea of normalizing citation counts based on a
field classification scheme and the idea of recursive citation weighing (like
in PageRank-inspired indicators). We combine these two ideas in a single
indicator, referred to as the recursive mean normalized citation score
indicator, and we study the validity of this indicator. Our empirical analysis
shows that the proposed indicator is highly sensitive to the field
classification scheme that is used.
Radicchi, Fortunato, and Castellano [arXiv:0806.0974, PNAS 105(45), 17268]
claim that, apart from a scaling factor, all fields of science are
characterized by the same citation distribution. We present a large-scale
validation study of this universality-of-citation-distributions claim. Our
analysis shows that claiming citation distributions to be universal for all
fields of science is not warranted.
We present an empirical comparison between two normalization mechanisms for
citation-based indicators of research performance. These mechanisms aim to
correct for the field and the year in which a publication was published. One
mechanism is applied in the current crown indicator of our institute. The other
mechanism is applied in the new crown indicator that our institute is planning
to adopt. We find that at high aggregation levels, such as at the level of
large institutes or at the level of countries, the differences between the two
mechanisms are very small.
VOS is a new mapping technique that can serve as an alternative to the
well-known technique of multidimensional scaling. We present an extensive
comparison between the use of multidimensional scaling and the use of VOS for
constructing bibliometric maps. In our theoretical analysis, we show the
mathematical relation between the two techniques.
We present a theoretical and empirical analysis of a number of bibliometric
indicators of journal performance. We focus on three indicators in particular,
namely the Eigenfactor indicator, the audience factor, and the influence weight
indicator. Our main finding is that the last two indicators can be regarded as
a kind of special cases of the first indicator. We also find that the three
indicators can be nicely characterized in terms of two properties.
The crown indicator is a well-known bibliometric indicator of research
performance developed by our institute. The indicator aims to normalize
citation counts for differences among fields. We critically examine the
theoretical basis of the normalization mechanism applied in the crown
indicator. We also make a comparison with an alternative normalization
mechanism. The alternative mechanism turns out to have more satisfactory
properties than the mechanism applied in the crown indicator. In particular,
the alternative mechanism has a so-called consistency property.
We reply to the criticism of Opthof and Leydesdorff [arXiv:1002.2769] on the
way in which our institute applies journal and field normalizations to citation
counts. We point out why we believe most of the criticism is unjustified, but
we also indicate where we think Opthof and Leydesdorff raise a valid point.