Skip to main content

2018 | OriginalPaper | Buchkapitel

Performance Assessment Framework for Computational Models of Visual Attention

verfasst von : Bharathi Murugaraj, J. Amudha

Erschienen in: Intelligent Systems Technologies and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents performance framework for computational model of visual attention, a software package, written using python scripting language, developed for the real-time comparison of computational model with human fixations. The performance framework was developed for real-time processing of eye trackers recorded data, analyzing them to generate fixation map, and comparing the fixation map to a saliency model got by running a configured computational model either in bottom-up or top-down mode. The framework is designed such that added modules can be extended for various experiment processing as required by the researcher. The framework encompasses the main connection to eye tracker to collect the raw data that will have observers eye coordinates and duration, it has analysis model to analyze the model and providing methods of visualization like fixation, heatmap and scanpath, it also has a computational model that predicts the fixation on the given image stimulus, finally the platform compares the fixation and saliency map to assess the accuracy of the prediction. All the functions of the framework can be controlled by using the graphical user interfaces.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tafaj, E., Kubler, T.C., Peter, J., Rosenstiel, W., Bogdan, M.: Vishnoo-an open-source software for vision research. In: 2011 24th International Symposium on Computer-Based Medical Systems (CBMS) (2011) Tafaj, E., Kubler, T.C., Peter, J., Rosenstiel, W., Bogdan, M.: Vishnoo-an open-source software for vision research. In: 2011 24th International Symposium on Computer-Based Medical Systems (CBMS) (2011)
2.
Zurück zum Zitat Berger, C., Winkeles, M., Lischke, A., Hoppner, J.: GazeAlyze: a MATLAB toolbox for the analysis of eye movement data. Behav. Res. Methods 44, 404–419 (2012)CrossRef Berger, C., Winkeles, M., Lischke, A., Hoppner, J.: GazeAlyze: a MATLAB toolbox for the analysis of eye movement data. Behav. Res. Methods 44, 404–419 (2012)CrossRef
3.
Zurück zum Zitat Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. MIT Technical report (2012) Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. MIT Technical report (2012)
4.
Zurück zum Zitat Riche, N., Duvinage, M., Mancas, M., Gosseling, B., Dutoit, T.: Saliency and human fixations: state-of-the-art and study of comparison metrics. In: 2013 IEEE International Conference on Computer Vision (2013) Riche, N., Duvinage, M., Mancas, M., Gosseling, B., Dutoit, T.: Saliency and human fixations: state-of-the-art and study of comparison metrics. In: 2013 IEEE International Conference on Computer Vision (2013)
5.
Zurück zum Zitat Amudha, J.: Performance evaluation of bottom-up and top-down approaches in computational visual attention system, Coimbatore (2012) Amudha, J.: Performance evaluation of bottom-up and top-down approaches in computational visual attention system, Coimbatore (2012)
7.
Zurück zum Zitat Radha, D., Amudha, J., Jyotsna, C.: Study of measuring dissimilarity between nodes to optimize the saliency map. Int. J. Comput. Technol. Appl. 5(3), 993–1000 (2014) Radha, D., Amudha, J., Jyotsna, C.: Study of measuring dissimilarity between nodes to optimize the saliency map. Int. J. Comput. Technol. Appl. 5(3), 993–1000 (2014)
8.
Zurück zum Zitat Dalmaijer, E.S., Mathot, S., Van der Stigchel, S.: PyGaze: an open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behav. Res. Methods 46, 913–921 (2014)CrossRef Dalmaijer, E.S., Mathot, S., Van der Stigchel, S.: PyGaze: an open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behav. Res. Methods 46, 913–921 (2014)CrossRef
11.
Zurück zum Zitat Brainard, D.H.: The psychophysics toolbox. Spat. Vis. 10(4), 433–436 (1997)CrossRef Brainard, D.H.: The psychophysics toolbox. Spat. Vis. 10(4), 433–436 (1997)CrossRef
12.
Zurück zum Zitat Peirce, J.W.: PsychoPy-psychophysics software in Python. J. Neurosci. Methods 162(1–2), 8–13 (2007)CrossRef Peirce, J.W.: PsychoPy-psychophysics software in Python. J. Neurosci. Methods 162(1–2), 8–13 (2007)CrossRef
13.
Zurück zum Zitat Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219–227 (1985) Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219–227 (1985)
15.
Zurück zum Zitat Amudha, J., Radha, D., Deepa, A.S.: Comparative study of visual attention models with human eye gaze in remote sensing images. In: Proceedings of the Third International Symposium on Women in Computing and Informatics (2015) Amudha, J., Radha, D., Deepa, A.S.: Comparative study of visual attention models with human eye gaze in remote sensing images. In: Proceedings of the Third International Symposium on Women in Computing and Informatics (2015)
16.
Zurück zum Zitat Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Advances in Neural Information Processing Systems (NIPS), vol. 19, pp. 545–552 (2007) Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Advances in Neural Information Processing Systems (NIPS), vol. 19, pp. 545–552 (2007)
Metadaten
Titel
Performance Assessment Framework for Computational Models of Visual Attention
verfasst von
Bharathi Murugaraj
J. Amudha
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-68385-0_29