Skip to content
BY-NC-ND 4.0 license Open Access Published by De Gruyter October 18, 2016

Improving imbalanced scientific text classification using sampling strategies and dictionaries

  • L. Borrajo , R. Romero , E. L. Iglesias EMAIL logo and C. M. Redondo Marey

Summary

Many real applications have the imbalanced class distribution problem, where one of the classes is represented by a very small number of cases compared to the other classes. One of the systems affected are those related to the recovery and classification of scientific documentation.

Sampling strategies such as Oversampling and Subsampling are popular in tackling the problem of class imbalance. In this work, we study their effects on three types of classifiers (Knn, SVM and Naive-Bayes) when they are applied to search on the PubMed scientific database.

Another purpose of this paper is to study the use of dictionaries in the classification of biomedical texts. Experiments are conducted with three different dictionaries (BioCreative, NLPBA, and an ad-hoc subset of the UniProt database named Protein) using the mentioned classifiers and sampling strategies.

Best results were obtained with NLPBA and Protein dictionaries and the SVM classifier using the Subsampling balancing technique. These results were compared with those ob- tained by other authors using the TREC Genomics 2005 public corpus.

Published Online: 2016-10-18
Published in Print: 2011-12-1

© 2011 The Author(s). Published by Journal of Integrative Bioinformatics.

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Downloaded on 29.4.2024 from https://www.degruyter.com/document/doi/10.1515/jib-2011-176/html
Scroll to top button