Eva Mohedano
Xavier Giró-i-Nieto
ABSTRACT
This paper explores the potential for using Brain Computer Interfaces (BCI) as a relevance feedback mechanism in content-based image retrieval. Several experiments are performed using a rapid serial visual presentation (RSVP) of images at different rates (5Hz and 10Hz) on 8 users with different degrees of familiarization with BCI and the dataset. We compare the feedback from the BCI and mouse-based interfaces in a subset of TRECVid images, finding that, when users have limited time to annotate the images, both interfaces are comparable in performance. Comparing our best users in a retrieval task, we found that EEG-based relevance feedback can outperform mouse-based feedback.
- A. Amir, M. Berg, and H. Permuter. Mutual relevance feedback for multimodal query formulation in video retrieval. In Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, MIR '05, pages 17--24, 2005. Google Scholar
Digital Library
- N. Bigdely-Shamlo, A. Vankov, R. R. Ramirez, and S. Makeig. Brain activity-based image classification from rapid serial visual presentation. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 16(5):432--441, 2008.Google Scholar
- G. Healy and A. F. Smeaton. Optimising the number of channels in eeg-augmented image search. In Proceedings of the 25th BCS Conference on Human-Computer Interaction, pages 157--162. British Computer Society, 2011. Google ScholarDigital Library
- Y. Huang, D. Erdogmus, M. Pavel, S. Mathan, and K. E. Hild II. A framework for rapid visual image search using single-trial brain evoked responses. Neurocomputing, 74(12):2041--2051, 2011. Google ScholarDigital Library
- Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the ACM International Conference on Multimedia, pages 675--678, 2014. Google ScholarDigital Library
- K. McGuinness, E. Mohedano, Z. Zhang, F. Hu, R. Abatal, C. Gurrin, N. O'Connor, A. F. Smeaton, A. Salvador Aguilera, X. Giró Nieto, et al. Insight centre for data analytics (dcu) at trecvid 2014: instance search and semantic indexing tasks. 2014.Google Scholar
- O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge, 2014.Google Scholar
- J. Wang, E. Pohlmeyer, B. Hanna, Y.-G. Jiang, P. Sajda, and S.-F. Chang. Brain state decoding for rapid image retrieval. In Proceedings of the 17th ACM international conference on Multimedia, pages 945--954. ACM, 2009. Google ScholarDigital Library
- J. Yang. A general framework for classifier adaptation and its applications in multimedia. PhD thesis, Carnegie Mellon University, 2009. Google ScholarDigital Library
- X. S. Zhou and T. S. Huang. Relevance feedback in image retrieval: A comprehensive review. Multimedia systems, 8(6):536--544, 2003.Google ScholarCross Ref
Index Terms
- Exploring EEG for Object Detection and Retrieval
Recommendations
Object Segmentation in Images using EEG Signals
MM '14: Proceedings of the 22nd ACM international conference on MultimediaThis paper explores the potential of brain-computer interfaces in segmenting objects from images. Our approach is centered around designing an effective method for displaying the image parts to the users such that they generate measurable brain ...
On the Size of the Universal Dictionaries Used in EEG P300 Spelling Paradigm Based on Compressed Sensing
ICBBT '17: Proceedings of the 9th International Conference on Bioinformatics and Biomedical TechnologyIn this work we discuss, analyze and compare results regarding a new compression method for electroencephalographic signals aimed at P300 detection spelling paradigm based on the concept of compressed sensing (CS). The method uses a universal mega-...
Detection of focal epilepsy in brain maps through a novel pattern recognition technique
AbstractFocal epilepsy is a common neurological disorder of the brain. It is symbolized by recurring seizure activities in particular regions of the brain. Electroencephalogram (EEG) signals contain information about the brain activity that can be used to ...
Comments