A Fast Algorithm for Learning a Ranking Function from Large-Scale Data Sets
Title | A Fast Algorithm for Learning a Ranking Function from Large-Scale Data Sets |
Publication Type | Journal Articles |
Year of Publication | 2008 |
Authors | Raykar VC, Duraiswami R, Krishnapuram B |
Journal | Pattern Analysis and Machine Intelligence, IEEE Transactions on |
Volume | 30 |
Issue | 7 |
Pagination | 1158 - 1170 |
Date Published | 2008/07// |
ISBN Number | 0162-8828 |
Keywords | Automated;, Factual;Information Storage and Retrieval;Likelihood Functions;Models, Statistical;Pattern Recognition, Wilcoxon-Mann-Whitney statistics;collaborative filtering;error function;gradient algorithm;large-scale data sets;learning ranking functions;ranking function;training data;computational complexity;error analysis;learning (artificial intelligence);regressio |
Abstract | We consider the problem of learning a ranking function that maximizes a generalization of the Wilcoxon-Mann-Whitney statistic on the training data. Relying on an e-accurate approximation for the error function, we reduce the computational complexity of each iteration of a conjugate gradient algorithm for learning ranking functions from O(m2) to O(m), where m is the number of training samples. Experiments on public benchmarks for ordinal regression and collaborative filtering indicate that the proposed algorithm is as accurate as the best available methods in terms of ranking accuracy, when the algorithms are trained on the same data. However, since it is several orders of magnitude faster than the current state-of-the-art approaches, it is able to leverage much larger training data sets. |
DOI | 10.1109/TPAMI.2007.70776 |