nach oben

nächster Artikel SMARTINT: using mined attribute dependencies to...

Tipp

Intelligent video and audio applications for learning enhancement

Zeitschrift:: Journal of Intelligent Information Systems > Ausgabe 3/2012

Autoren:: Andrzej Czyzewski, Bozena Kostek

» Zum Volltext PDF-Version jetzt herunterladen

Abstract

The role of computers in school education is briefly discussed. Multimodal interfaces development history is shortly reviewed. Examples of applications of multimodal interfaces for learners with special educational needs are presented, including interactive electronic whiteboard based on video image analysis, application for controlling computers with facial expression and speech stretching audio interface representing audio modality. Intelligent and adaptive algorithms applications to the developed multimodal interfaces are discussed.

Unsere Produktempfehlungen

Premium-Abo der Gesellschaft für Informatik

Sie erhalten uneingeschränkten Vollzugriff auf alle acht Fachgebiete von Springer Professional und damit auf über 45.000 Fachbücher und ca. 300 Fachzeitschriften.

Jetzt informieren

Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library. Paris: O’Reilly.

Clausi, D. A. (2002). An analysis of co-occurrence texture statistics as a function of grey-level quantization. Canadian Journal of Remote Sensing, 28(1), 45–62. CrossRef

Dalka, P., & Czyzewski A. (2010a). Controlling computer by lip gestures employing neural network. In Proc. 7th international conference on rough sets and current trends in computing (RSCTC 2010) (pp. 80–89). Warsaw, Poland, 28–30 June 2010.

Dalka, P., & Czyzewski, A. (2010b). Human-computer interface based on visual lip movement and gesture recognition. International Journal of Computer Science and Applications, 7(3), 124–139.

Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics, 3(6), 610–621. CrossRef

Hu, M. K. (1962). Visual pattern recognition by moment invariants. IRE Transactions on Information Theory, 8(2), 179–187. CrossRef

Kalman, R. R. (1960). A new approach to linear filtering and prediction problems. Transaction of the ASME—Journal of Basic Engineering, 82(1), 35–45.

Kaszuba, K., Kopaczewski, K., Odya, P., & Kostek, B. (2010). Biofeedback-based brain hemispheric synchronizing employing man-machine interface. In G. A. Tsihrintzis, et al. (Eds.), Intelligent interactive multimedia systems and services, Springer Verlag. Proc. KES 2010, the 3rd international symposium on intelligent and interactive multimedia: Systems and services (pp. 59–69). Baltimore, USA, 28–30 July 2010.

Kotarski, M., Smulko, J., Czyzewski, A., & Melkonyan, S. (2011). Fluctuation-enhanced scent sensing using a single gas sensor. Sensors & Actuators: B. Chemical, 157 85–91.

Kosikowski, L., Dalka, P., & Czyzewski, A. (2010). Multimedia browser controlled by head movements. In 37 conf. and exhibition on computer graphics and interactive techniques. SIGGRAPH, Los Angeles, USA, 25–29 July 2010.

Kupryjanow, A., & Czyzewski, A. (2009). Time-scale modification of speech signals for supporting hearing impaired schoolchildren. In Proc. of international conference NTAV/SPA, new trends in audio and video, signal processing: Algorithms, architectures, arrangements and applications (pp. 159–162). Poznań, 24–25 September 2009.

Kupryjanow, A., & Czyzewski, A. (2010). Real-time speech-rate modification experiments. In Audio Engineering Society convention, preprint no. 8052, London, GB, 22–25 May 2010.

Kupryjanow, A., Kunka, B., & Kostek, B. (2010). UPDRS tests for diagnosis of Parkinson’s Disease employing virtual-touchpad. In 4th international workshop on management and interaction with multimodal information content—MIMIC ’10, Bilbao, Spain, 30 August–3 September 2010.

Lech, M., & Kostek, B. (2010a). Fuzzy rule-based dynamic gesture recognition employing camera & multimedia projector. In Advances in intelligent and soft computing: Multimedia & network information systems. New York: Springer.

Lech, M., & Kostek, B. (2010b). Gesture-based computer control system applied to the interactive whiteboard. In 2nd international conference on information technology ICIT’2010 Gdansk (pp. 75–78). 28–30 June 2010.

Leung, S., Wang, S., & Lau, W. (2004). Lip image segmentation using fuzzy clustering incorporating an elliptic shape function. IEEE Transactions on Image Processing, 13(1), 51–62. CrossRef

Maes, P., & Mistry, P. (2009). Unveiling the “Sixth Sense”, game-changing wearable tech. In TED 2009. Long Beach, CA, USA.

Mistry, P., & Maes, P. (2009). SixthSense—A wearable gestural interface. In SIGGRAPH Asia 2009, emerging technologies. Yokohama, Japan.

Moattar, M., Homayounpour, M., & Kalantari, N. (2010). A new approach for robust realtime voice activity detection using spectral pattern. In ICASSP conference, 14–19 March.

Moran, L. E. L., & Pinto, R. E. (2007). Automatic extraction of the lips shape via statistical lips modelling and chromatic feature. In Electronics, robotics and automotive mechanics conference, CERMA (pp. 241–246).

Odya, P., Czyzewski, A., Grabkowska, A., & Grabkowski, M. (2010). Smart Pen—New multimodal computer control tool for graphomotorical therapy. Intelligent Decision Technologies Journal, 4(3), 197–209.

Pesce, F. (2000). Realtime-stretching of speech signals. In Proceedings of the COST G-6 conference on digital audio effects (DAFX-00), Verona, Italy, 7–9 December.

Riedmiller, M., & Braun, H. (1993). A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proc. ICNN.

Sugeno, M. (1985). Industrial applications of fuzzy control. Amsterdam: Elsevier.

Verhelst, W., & Roelands, M. (1993). An overlap-add technique based on waveform similarity (WSOLA) for high quality time-scale modification of speech. In ICASSP-93 (Vol. 2). Minneapolis, USA, 27–30 April.

Xu, R., & Yi, D. (2008). A computer vision based whiteboard capture system. In WACV 2008, IEEE workshop on applications of computer vision (pp. 1–6).

Young, I., Gerbrands, J., & Vliet, L. (1998). Fundamentals of image processing. Delft: Delft University of Technology.

Zheng, J., Franco, H., Weng, F., Sankar, A., & Bratt, H. (2000). Word-level rate-of-speech modeling using rate-specific phones and pronunciations. In Proc. IEEE int. conf. acoust. speech signal process, Istanbul (Vol. 3, pp. 1775–1778).

Titel: Intelligent video and audio applications for learning enhancement
Autoren:: Andrzej Czyzewski
Bozena Kostek
Publikationsdatum: 01.06.2012
DOI: https://doi.org/10.1007/s10844-011-0167-2
Verlag: Springer US
Zeitschrift: Journal of Intelligent Information Systems Integrating Artificial Intelligence and Database Technologies
Ausgabe 3/2012
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675

Premium Partner

Bildnachweise

Springer Professional

Tipp

Weitere Artikel dieser Ausgabe durch Wischen aufrufen

Abstract

Unsere Produktempfehlungen

Premium-Abo der Gesellschaft für Informatik

Weitere Artikel der Ausgabe 3/2012

Temporal aggregation on user-defined granularities

The Semantic Service Search Engine (S3E)

WSM: a novel algorithm for subgraph matching in large weighted graphs

Aircraft interior failure pattern recognition utilizing text mining and neural networks

A new unsupervised feature selection method for text clustering based on genetic algorithms

In & out zooming on time-aware user/tag clusters

Premium Partner