Nicolas Cebron
Michael R. Berthold
ABSTRACT
This work addresses two challenges in combination: learning with a very limited number of labeled training examples (active learning) and learning in the presence of multiple views for each object where the global model to be learned is spread out over some or all of these views (learning in parallel universes). We propose a new active learning approach which selects the best samples to query the label with the goal of improving overall model accuracy and determining which universe contributes most to the local model. The resulting combination and class-specific weighting of universes provides a significantly better classification accuracy than traditional active learning methods.
- A. Frank and A. Asuncion. UCI machine learning repository, 2010. http://archive.ics.uci.edu/mlGoogle Scholar
- R. Bellman. Adaptive Control Processes: A Guided Tour. Princeton University Press, 1961.Google Scholar
- D. A. Cohn, L. Atlas, and R. E. Ladner. Improving generalization with active learning. Machine Learning, 15(2):201--221, 1994. Google ScholarDigital Library
- Y. Freund, H. S. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 28(2--3):133--168, 1997. Google ScholarDigital Library
- H. Liu and H. Motoda. Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic Publishers, Norwell, MA, USA, 1998. Google ScholarDigital Library
- T. M. Mitchell. Machine Learning. McGraw-Hill, New York, 1997. Google ScholarDigital Library
- I. Muslea, S. Minton, and C. A. Knoblock. Active learning with multiple views. J. Artif. Intell. Res. (JAIR), 27:203--233, 2006. Google ScholarDigital Library
- S. Rueping and T. Scheffer, editors. Proceedings of the ICML 2005 Workshop on Learning with Multiple Views, 2005.Google Scholar
- M. van Breukelen, R. P. W. Duin, D. M. J. Tax, and J. E. den Hartog. Combining classifiers for the recognition of handwritten digits. 1st IAPR TC1 Workshop on Statistical Techniques in Pattern Recognition, pages 13--18, 1997.Google Scholar
- B. Wiswedel, F. Höppner, and M. R. Berthold. Learning in parallel universes. Data Mining and Knowledge Discovery, 21(1):130--152, July 2010. Google ScholarDigital Library
Index Terms
- Active learning in parallel universes
Recommendations
Multiple-view multiple-learner active learning
Generally, collecting a large quantity of unlabeled examples is feasible, but labeling them all is not. Active learning can reduce the number of labeled examples needed to train a good classifier. Existing active learning algorithms can be roughly ...
On the application of active learning for efficient and effective IoT botnet detection
AbstractThe active learning approach for machine learning can greatly benefit those environments where a wealth of unlabeled data is available, and the labeling cost of the data can be restrictive. In this regard, security operations centers (...
Highlights- Provides a comprehensive benchmark of active learning strategies within the context of IoT botnet detection in SOC environments.
Active deep Q-learning with demonstration
AbstractReinforcement learning (RL) is a machine learning technique aiming to learn how to take actions in an environment to maximize some kind of reward. Recent research has shown that although the learning efficiency of RL can be improved with expert ...
Comments