Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 1/2015

01-01-2015

Visualizing multi-dimensional decision boundaries in 2D

Authors: M. A. Migut, M. Worring, C. J. Veenman

Published in: Data Mining and Knowledge Discovery | Issue 1/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In many applications experts need to make decisions based on the analysis of multi-dimensional data. Various classification models can support the decision making process. To obtain an intuitive understanding of the classification model, interactive visualizations are essential. We argue that this is best done by a series of interactive 2D scatterplots. In this paper, we define a set of characteristics of the multi-dimensional classification model that have to be visually represented in those scatterplots. Our proposed method presents those characteristics in a uniform manner for both linear and non-linear classification methods. We combine a visualization of a Voronoi based representation of multi-dimensional decision boundaries with visualization of the distances of the data elements to these boundaries. To allow the developer of the model to refine the threshold of the classification model and instantly observe the results, we use interactive decision point selection on a performance curve. Finally, we show how the combination of those techniques allows exploration of multi-dimensional decision boundaries in 2D.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Aurenhammer F (1991) Voronoi diagrams—a survey of a fundamental geometric data structure. ACM Comput Surv 23(3):345–405CrossRef Aurenhammer F (1991) Voronoi diagrams—a survey of a fundamental geometric data structure. ACM Comput Surv 23(3):345–405CrossRef
go back to reference Bendix F, Kosara R, Hauser H (2005) Parallel sets: visual analysis of categorical data. In: Proceedings of the 2005 IEEE Symposium on Information Visualization, pp 133–140 Bendix F, Kosara R, Hauser H (2005) Parallel sets: visual analysis of categorical data. In: Proceedings of the 2005 IEEE Symposium on Information Visualization, pp 133–140
go back to reference Bostock M, Heer J (2009) Protovis: a graphical toolkit for visualization. IEEE Trans Vis Comput Graph (Proc InfoVis) 15(6):1121–1128CrossRef Bostock M, Heer J (2009) Protovis: a graphical toolkit for visualization. IEEE Trans Vis Comput Graph (Proc InfoVis) 15(6):1121–1128CrossRef
go back to reference Brown ET, Liu J, Brodley CE, Chang R (2012) Dis-function: learning distance functions interactively. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology, (VAST), pp 83–92 Brown ET, Liu J, Brodley CE, Chang R (2012) Dis-function: learning distance functions interactively. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology, (VAST), pp 83–92
go back to reference Caragea D, Cook D, Honavar VG (2001) Gaining insights into support vector machine pattern classifiers using projection-based tour methods. In: Proceedings of the seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 251–256 Caragea D, Cook D, Honavar VG (2001) Gaining insights into support vector machine pattern classifiers using projection-based tour methods. In: Proceedings of the seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 251–256
go back to reference Choo J, Lee H, Kihm J, Park H (2010) iVisClassifier: an interactive visual analytics system for classification based on supervised dimension reduction. In: Proceedings of the IEEE Symposium on Visual Analytics, Science and Technology, pp 27–34 Choo J, Lee H, Kihm J, Park H (2010) iVisClassifier: an interactive visual analytics system for classification based on supervised dimension reduction. In: Proceedings of the IEEE Symposium on Visual Analytics, Science and Technology, pp 27–34
go back to reference Cleveland W, McGill ME (1988) Dynamic graphics for statistics. Statistics/Probability Series Cleveland W, McGill ME (1988) Dynamic graphics for statistics. Statistics/Probability Series
go back to reference Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley-Interscience, Berlin Duda RO, Hart PE, Stork DG (2000) Pattern classification. Wiley-Interscience, Berlin
go back to reference Elmqvist N, Dragicevic P, Fekete JD (2008) Rolling the dice: multidimensional visual exploration using scatterplot matrix navigation. IEEE Trans Vis Comput Graph (Proc InfoVis 2008) 14(6):1141–1148 Elmqvist N, Dragicevic P, Fekete JD (2008) Rolling the dice: multidimensional visual exploration using scatterplot matrix navigation. IEEE Trans Vis Comput Graph (Proc InfoVis 2008) 14(6):1141–1148
go back to reference Endert A, Han C, Maiti D, House L, Leman S, North C (2011) Observation-level interaction with statistical models for visual analytics. In: Proceedings of the IEEE Conference on Visual Analytics, Science and Technology, pp 121–130 Endert A, Han C, Maiti D, House L, Leman S, North C (2011) Observation-level interaction with statistical models for visual analytics. In: Proceedings of the IEEE Conference on Visual Analytics, Science and Technology, pp 121–130
go back to reference Hamel L (2006) Visualization of support vector machines with unsupervised learning. In: Proceedings of 2006 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, pp 1–8 Hamel L (2006) Visualization of support vector machines with unsupervised learning. In: Proceedings of 2006 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, pp 1–8
go back to reference Heimerl F, Koch S, Bosch H, Ertl T (2012) Visual classifier training for text document retrieval. IEEE Transactions on Visualization and Computer Graphics (TVCG), pp 2839–2848 Heimerl F, Koch S, Bosch H, Ertl T (2012) Visual classifier training for text document retrieval. IEEE Transactions on Visualization and Computer Graphics (TVCG), pp 2839–2848
go back to reference Hoferlin B, Netzel R, Hoferlin M, Weiskopf D, Heidemann G (2012) Inter-active learning of ad-hoc classifiers for video visual analytics. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), pp 23–32 Hoferlin B, Netzel R, Hoferlin M, Weiskopf D, Heidemann G (2012) Inter-active learning of ad-hoc classifiers for video visual analytics. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), pp 23–32
go back to reference Jeong DH, Ziemkiewicz C, Fisher B, Ribarsky W, Chang R (2009) iPCA: an interactive system for PCA-based visual analytics. Comput Graph Forum 28(3):767–774CrossRef Jeong DH, Ziemkiewicz C, Fisher B, Ribarsky W, Chang R (2009) iPCA: an interactive system for PCA-based visual analytics. Comput Graph Forum 28(3):767–774CrossRef
go back to reference Keim DA, Mansmann F, Schneidewind J, Thomas J, Ziegler H (2008) Visual analytics: scope and challenges. Springer, Berlin Keim DA, Mansmann F, Schneidewind J, Thomas J, Ziegler H (2008) Visual analytics: scope and challenges. Springer, Berlin
go back to reference Malik A, Maciejewski R, Elmqvist N, Jang Y, Ebert D, Huang W (2012) A correlative analysis process in a visual analytics environment. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), pp 33–42 Malik A, Maciejewski R, Elmqvist N, Jang Y, Ebert D, Huang W (2012) A correlative analysis process in a visual analytics environment. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), pp 33–42
go back to reference McClish DK (1989) Analyzing a portion of the ROC curve. Med Decis Mak 9(3):190–195CrossRef McClish DK (1989) Analyzing a portion of the ROC curve. Med Decis Mak 9(3):190–195CrossRef
go back to reference Migut M, Worring M (2012) Visual exploration of classification models for various data types in risk assessment. Inf Vis J (IVS) 11(3):237–251CrossRef Migut M, Worring M (2012) Visual exploration of classification models for various data types in risk assessment. Inf Vis J (IVS) 11(3):237–251CrossRef
go back to reference Migut M, van Gemert J, Worring M (2011) Interactive decision making using dissimilarity to visually represented prototypes. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (IEEE VAST), pp 141–149 Migut M, van Gemert J, Worring M (2011) Interactive decision making using dissimilarity to visually represented prototypes. In: Proceedings of the IEEE Conference on Visual Analytics Science and Technology (IEEE VAST), pp 141–149
go back to reference Pekalska E, Duin RPW, Paclík P (2006) Prototype selection for dissimilarity-based classifiers. Pattern Recognit 39(2):189–208CrossRefMATH Pekalska E, Duin RPW, Paclík P (2006) Prototype selection for dissimilarity-based classifiers. Pattern Recognit 39(2):189–208CrossRefMATH
go back to reference Poulet F (2008) Towards effective visual mining with cooperative approaches. Springer, Berlin Poulet F (2008) Towards effective visual mining with cooperative approaches. Springer, Berlin
go back to reference Provost F, Fawcett T (1997) Analysis and visualization of classifier performance: Comparison under imprecise class and cost distributions. In: Proceedings of the Third International Conference on Knowledge Discovery and Data Mining, AAAI Press, pp 43–48 Provost F, Fawcett T (1997) Analysis and visualization of classifier performance: Comparison under imprecise class and cost distributions. In: Proceedings of the Third International Conference on Knowledge Discovery and Data Mining, AAAI Press, pp 43–48
go back to reference Stolte C, Tang D, Hanrahan P (2002) Polaris: a system for query, analysis, and visualization of multidimensional relational databases. IEEE Trans Vis Comput Graph 8(1):52–65CrossRef Stolte C, Tang D, Hanrahan P (2002) Polaris: a system for query, analysis, and visualization of multidimensional relational databases. IEEE Trans Vis Comput Graph 8(1):52–65CrossRef
go back to reference Swayne DF, Lang DT, Buja A, Cook D (2003) GGobi: evolving from xgobi into an extensible framework for interactive data visualization. Comput Stat Data Anal 43(4):423–444CrossRefMATHMathSciNet Swayne DF, Lang DT, Buja A, Cook D (2003) GGobi: evolving from xgobi into an extensible framework for interactive data visualization. Comput Stat Data Anal 43(4):423–444CrossRefMATHMathSciNet
go back to reference Thomas J, Cook K (2005) Illuminating the path: the research and development agenda for visual analytics. IEEE CS Press, Silver Spring Thomas J, Cook K (2005) Illuminating the path: the research and development agenda for visual analytics. IEEE CS Press, Silver Spring
go back to reference Ward MO (1994) Xmdvtool: Integrating multiple methods for visualizing multivariate data. In: Proceedings of the Conference on Visualization ’94, pp 326–333 Ward MO (1994) Xmdvtool: Integrating multiple methods for visualizing multivariate data. In: Proceedings of the Conference on Visualization ’94, pp 326–333
go back to reference Yan Z, Xu C (2008) Using decision boundary to analyze classifiers. 3rd International Conference on Intelligent System and Knowledge, Engineering 1:302–307 Yan Z, Xu C (2008) Using decision boundary to analyze classifiers. 3rd International Conference on Intelligent System and Knowledge, Engineering 1:302–307
go back to reference Yi J, Kang J, Stasko J, Jacko J (2007) Toward a deeper understanding of the role of interaction in information visualization. IEEE Trans Vis Comput Graph 13(6):1224–1231CrossRef Yi J, Kang J, Stasko J, Jacko J (2007) Toward a deeper understanding of the role of interaction in information visualization. IEEE Trans Vis Comput Graph 13(6):1224–1231CrossRef
Metadata
Title
Visualizing multi-dimensional decision boundaries in 2D
Authors
M. A. Migut
M. Worring
C. J. Veenman
Publication date
01-01-2015
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 1/2015
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-013-0342-x

Other articles of this Issue 1/2015

Data Mining and Knowledge Discovery 1/2015 Go to the issue

Editorial

Editorial

Premium Partner