2013 | OriginalPaper | Chapter
Variational Bayesian PCA versus k-NN on a Very Sparse Reddit Voting Dataset
Authors : Jussa Klapuri, Ilari Nieminen, Tapani Raiko, Krista Lagus
Published in: Advances in Intelligent Data Analysis XII
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
We present vote estimation results on the largely unexplored Reddit voting dataset that contains 23M votes from 43k users on 3.4M links. This problem is approached using Variational Bayesian Principal Component Analysis (VBPCA) and a novel algorithm for
k
-Nearest Neighbors (
k
-NN) optimized for high dimensional sparse datasets without using any approximations. We also explore the scalability of the algorithms for extremely sparse problems with up to 99.99% missing values. Our experiments show that
k
-NN works well for the standard Reddit vote prediction. The performance of VBPCA with the full preprocessed Reddit data was not as good as
k
-NN’s, but it was more resilient to further sparsification of the problem.