Skip to main content

2013 | OriginalPaper | Buchkapitel

Multi-camera Skype: Enhancing the Quality of Experience of Video Conferencing

verfasst von : (Florence) Ying Wang, Prabhu Natarajan, Mohan Kankanhalli

Erschienen in: The Era of Interactive Media

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a novel approach towards real-time control, selection and transmission of the best view of human faces in Skype video conferencing. Our goal is to improve the Quality-of-Experience (QoE) of current video conferencing services by incorporating real-time multi-camera control and selection mechanism. Traditional 3D viewpoint selection algorithms rely on complex 3D-model computation and are not applicable for real-time applications. We define a new image-based metric, Viewpoint Saliency (VS), for evaluating the quality of views of human subject and a centralized multi-camera control mechanism to track and select the best view of human.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ahmad, S., VISIT: A Neural Model of Covert Attention. In Advances in Neural Information Processing Systems, 4, 420–427, 1991. Ahmad, S., VISIT: A Neural Model of Covert Attention. In Advances in Neural Information Processing Systems, 4, 420–427, 1991.
2.
Zurück zum Zitat Ang, K.H., Chong, G.C.Y., and Li, Y., PID Control System Analysis, Design, and Technology. In IEEE Trans. on Control Systems Technology, 13(4), 559–576, 2005.CrossRef Ang, K.H., Chong, G.C.Y., and Li, Y., PID Control System Analysis, Design, and Technology. In IEEE Trans. on Control Systems Technology, 13(4), 559–576, 2005.CrossRef
3.
Zurück zum Zitat Barral, P., Dorme, G., and Plemenos, D., Scene Understanding Techniques using a Virtual Camera. In Proc. of Eurographics, 2000. Barral, P., Dorme, G., and Plemenos, D., Scene Understanding Techniques using a Virtual Camera. In Proc. of Eurographics, 2000.
4.
Zurück zum Zitat Doubek, P., Nummiaro, K., Koller-Meier, E. and Gool, L. V., Face Tracking in a Multi-Camera Environment. 266, 2003. Doubek, P., Nummiaro, K., Koller-Meier, E. and Gool, L. V., Face Tracking in a Multi-Camera Environment. 266, 2003.
5.
Zurück zum Zitat Feixas, M., Sbert, M., and Gonzalez, F., A Unified Information-Theoretic Framework for Viewpoint Selection and Mesh Saliency. In ACM Trans. on Applied Perception, 6, 1–23, 2008.CrossRef Feixas, M., Sbert, M., and Gonzalez, F., A Unified Information-Theoretic Framework for Viewpoint Selection and Mesh Saliency. In ACM Trans. on Applied Perception, 6, 1–23, 2008.CrossRef
6.
Zurück zum Zitat Goldberg, K., Gentner, S., Sutter, C., and Wiegley, J., The Mercury Project: A feasibility study for internet robots. In IEEE Int. Conf. on Robotics and Automation, 1995. Goldberg, K., Gentner, S., Sutter, C., and Wiegley, J., The Mercury Project: A feasibility study for internet robots. In IEEE Int. Conf. on Robotics and Automation, 1995.
7.
Zurück zum Zitat Hornler, B., Arsic, D., Schuller, B., and Rigoll, G., Boosting multi-modal camera selection with semantic features. In Proc. of ICME, 1298–1301, 2009. Hornler, B., Arsic, D., Schuller, B., and Rigoll, G., Boosting multi-modal camera selection with semantic features. In Proc. of ICME, 1298–1301, 2009.
8.
Zurück zum Zitat Itti, L., Koch, C., and Niebur, E., A model of saliency based visual attention for rapid scene analysis. In IEEE Trans. on PAMI., 1254–1259, 1998. Itti, L., Koch, C., and Niebur, E., A model of saliency based visual attention for rapid scene analysis. In IEEE Trans. on PAMI., 1254–1259, 1998.
9.
Zurück zum Zitat Khwaja, A. A., Goecke, and R., Image reconstruction from contrast information. In Digital Image Computing: Techniques and Applications, 226–233, 2008. Khwaja, A. A., Goecke, and R., Image reconstruction from contrast information. In Digital Image Computing: Techniques and Applications, 226–233, 2008.
10.
Zurück zum Zitat Liu, Q., Kimber, D., Wilcox, L., Cooper, M., Foote, J., and Boreczky, J., Managing a camera system to serve different video requests. In Proc. of ICME, 13–16, 2002. Liu, Q., Kimber, D., Wilcox, L., Cooper, M., Foote, J., and Boreczky, J., Managing a camera system to serve different video requests. In Proc. of ICME, 13–16, 2002.
12.
Zurück zum Zitat Mosher, R. S., Industrial Manipulators. Scientific American, 211(4), 88–96, 1964.CrossRef Mosher, R. S., Industrial Manipulators. Scientific American, 211(4), 88–96, 1964.CrossRef
13.
Zurück zum Zitat Niebur, E., Koch, C., and Parasuraman, R., Computational architectures for attention. The attentive brain, Cambridge, MA: MIT Press, 163–186, 1998. Niebur, E., Koch, C., and Parasuraman, R., Computational architectures for attention. The attentive brain, Cambridge, MA: MIT Press, 163–186, 1998.
14.
Zurück zum Zitat Ranjan, A., Birnholtz, J. P., and Balakrishnan, R., Dynamic shared visual spaces: experimenting with automatic camera control in a remote repair task. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems., 1177–1186, 2007. Ranjan, A., Birnholtz, J. P., and Balakrishnan, R., Dynamic shared visual spaces: experimenting with automatic camera control in a remote repair task. In Proc. of SIGCHI Conf. on Human Factors in Computing Systems., 1177–1186, 2007.
15.
Zurück zum Zitat Schreer, O., Feldmann, I., Atzpadin, N., Eisert, P. Kauff, P., and Belt, H., 3D Presence -A System Concept for Multi-User and Multi-Party Immersive 3D Videoconferencing. In Proc. of European Conference on Visual Media Production, 1–8, 2008. Schreer, O., Feldmann, I., Atzpadin, N., Eisert, P. Kauff, P., and Belt, H., 3D Presence -A System Concept for Multi-User and Multi-Party Immersive 3D Videoconferencing. In Proc. of European Conference on Visual Media Production, 1–8, 2008.
16.
Zurück zum Zitat Song, D., Qin, N., and Goldberg, K., Systems, Control Models, and Codec for Collaborative Observation of Remote Environments with an Autonomous Networked Robotic Camera. In Autonomous Robots, 24(4), 435–449, 2008.CrossRef Song, D., Qin, N., and Goldberg, K., Systems, Control Models, and Codec for Collaborative Observation of Remote Environments with an Autonomous Networked Robotic Camera. In Autonomous Robots, 24(4), 435–449, 2008.CrossRef
17.
Zurück zum Zitat Vazquez, P. P., Feixas, M., Sbert, M., and Heidrich, W., Viewpoint selection using viewpoint entropy. In Proc. of Vision, Modeling and Visualization, 273–280, 2001. Vazquez, P. P., Feixas, M., Sbert, M., and Heidrich, W., Viewpoint selection using viewpoint entropy. In Proc. of Vision, Modeling and Visualization, 273–280, 2001.
18.
Zurück zum Zitat Vazquez, P. P., Feixas, M., Sbert, M., and Llobet, A., Viewpoint Entropy: A new tool for obtaining good views for molecules. Data Visualization 2002 (Eurographics /IEEE TCVG Symposium Proceedings), 27–29, 2002. Vazquez, P. P., Feixas, M., Sbert, M., and Llobet, A., Viewpoint Entropy: A new tool for obtaining good views for molecules. Data Visualization 2002 (Eurographics /IEEE TCVG Symposium Proceedings), 27–29, 2002.
19.
Zurück zum Zitat Wallhoff, F., Zobl, M., Rigoll, G.,and Potucek, I., Face tracking in meeting room scenarios using omnidirectional views. In Int. Conf. on Pattern Recognition, 933–936, 2004. Wallhoff, F., Zobl, M., Rigoll, G.,and Potucek, I., Face tracking in meeting room scenarios using omnidirectional views. In Int. Conf. on Pattern Recognition, 933–936, 2004.
20.
Zurück zum Zitat Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P., Image quality assessment: From error measurement to structural similarity. In IEEE Trans. on Image Processing, 13(4), 600–612, 2004.CrossRef Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P., Image quality assessment: From error measurement to structural similarity. In IEEE Trans. on Image Processing, 13(4), 600–612, 2004.CrossRef
21.
Zurück zum Zitat Wang, J., Kankanhalli, M.S., Yan, W.Q., and Jain, R., Experiential Sampling for Video Surveillance. In Proc. of First ACM Int. Workshop on Video Surveillance, 77–86, 2003. Wang, J., Kankanhalli, M.S., Yan, W.Q., and Jain, R., Experiential Sampling for Video Surveillance. In Proc. of First ACM Int. Workshop on Video Surveillance, 77–86, 2003.
22.
Zurück zum Zitat Wu, W., Arefin, A., Rivas, R., Nahrstedt, K., Sheppard, R. M. and Yang, Z., Quality of Experience in distributed interactive multimedia environments: toward a theoretical framework. In ACM Int. Conf. on Multimedia, 481–490, 2009. Wu, W., Arefin, A., Rivas, R., Nahrstedt, K., Sheppard, R. M. and Yang, Z., Quality of Experience in distributed interactive multimedia environments: toward a theoretical framework. In ACM Int. Conf. on Multimedia, 481–490, 2009.
23.
Zurück zum Zitat Zotkin, D., Duraiswami, R., Philomin, V., and Davis, L., Smart Videoconferencing. In Proc. of ICME, 1597–1600, 2000. Zotkin, D., Duraiswami, R., Philomin, V., and Davis, L., Smart Videoconferencing. In Proc. of ICME, 1597–1600, 2000.
Metadaten
Titel
Multi-camera Skype: Enhancing the Quality of Experience of Video Conferencing
verfasst von
(Florence) Ying Wang
Prabhu Natarajan
Mohan Kankanhalli
Copyright-Jahr
2013
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-3501-3_20

Neuer Inhalt