Advertisement
Published in:
2005 | OriginalPaper | Chapter
Learning and Classifying Under Hard Budgets
Authors : Aloak Kapoor, Russell Greiner
Published in: Machine Learning: ECML 2005
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
Since resources for data acquisition are seldom infinite, both learners and classifiers must act intelligently under hard budgets. In this paper, we consider problems in which feature values are unknown to both the learner and classifier, but can be acquired at a cost. Our goal is a learner that spends its fixed learning budget
b
L
acquiring training data, to produce the most accurate “active classifier” that spends at most
b
C
per instance. To produce this fixed-budget classifier, the fixed-budget learner must sequentially decide which feature values to collect to learn the relevant information about the distribution. We explore several approaches the learner can take, including the standard “round robin” policy (purchasing every feature of every instance until the
b
L
budget is exhausted). We demonstrate empirically that round robin is problematic (especially for small
b
L
), and provide alternate learning strategies that achieve superior performance on a variety of datasets.