Seven Numeric Properties of Effectiveness Metrics
Department of Computing and Information Systems,
The University of Melbourne,
Victoria 3010, Australia.
Proc. 9th Asian Information Retrieval Societies Conf.,
December 2013, pages 1-12, LNCS volume 8281.
Search effectiveness metrics quantify the relevance of the ranked
document lists returned by retrieval systems.
In this paper we characterize metrics according to seven numeric
properties -- boundedness, monotonicity, convergence,
top-weightedness, localization, completeness, and realizability.
We demonstrate that these properties partition the
commonly-used evaluation metrics, and hence provide a framework in
which the relationships between effectiveness metrics can be better
understood, including their relative merits for different