Simon Mayer
ABSTRACT
Keeping track of device interactions in smart environments is a challenging task for everyday users. Given the expected high number of communicating devices in future smart homes, it will become increasingly important to put users more in control of their smart environments by providing tools to monitor and control the interactions between smart objects and remote services. We present a system for collecting and visualizing interactions ofWeb-enabled smart things andWeb services in an intuitive and visually appealing way. Our tool displays device interactions both using a Web-based visualization application and in the form of a "magic lens" by augmenting the camera view of a tablet with relevant connections between recognized devices in the camera's field of view.
- Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. 2008. Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding 110, 3, 346--359. Google Scholar
Digital Library
- Beckel, C., Sadamori, L., and Santini, S. 2013. Automatic Socio-Economic Classification of Households Using Electricity Consumption Data. In Proceedings of the 4th International Conference on Future Energy Systems (ACM e-Energy 2013), ACM. Google ScholarDigital Library
- Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and Magic Lenses: The See-through Interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, ACM, SIGGRAPH '93, 73--80. Google ScholarDigital Library
- Brush, A. J., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., and Dixon, C. 2011. Home Automation in theWild: Challenges and Opportunities. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (Vancouver, Canada), ACM, 2115--2124. Google ScholarDigital Library
- Csurka, G., Dance, C. R., Fan, L., Willamowski, J., and Bray, C. 2004. Visual Categorization with Bags of Keypoints. In Proceedings of the Workshop on Statistical Learning in Computer Vision (SLCV).Google Scholar
- Dötzer, F. 2006. Privacy Issues in Vehicular Ad Hoc Networks. In Privacy Enhancing Technologies, G. Danezis and D. Martin, Eds., vol. 3856 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 197--209. Google ScholarDigital Library
- Ester, M., Kriegel, H.-P., Sander, J., and Xu, X. 1996. A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. In KDD, 226--231.Google Scholar
- Grinter, R. E., Edwards, W. K., Newman, M. W., and Ducheneaut, N. 2005. The Work to Make a Home Network Work. In Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work, 469--488. Google ScholarDigital Library
- Karavirta, V., Korhonen, A., Malmi, L., and Naps, T. L. 2010. A Comprehensive Taxonomy of Algorithm Animation Languages. J. Vis. Lang. Comput. 21, 1, 1--22. Google ScholarDigital Library
- Keith Mitchell, Nicholas J. P. Race, M. C. 2005. CANVIS: context-aware network visualization using smartphones. In Proceedings of the 7th Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2005). Google ScholarDigital Library
- Kleiminger, W., Beckel, C., and Santini, S. 2011. Opportunistic Sensing for Efficient Energy Usage in Private Households. In Proceedings of the Smart Energy Strategies Conference 2011.Google Scholar
- Kovatsch, M., Mayer, S., and Ostermaier, B. 2012. Moving Application Logic from the Firmware to the Cloud: Towards the Thin Server Architecture for the Internet of Things. In Proceedings of the 6th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS 2012). Google ScholarDigital Library
- Lastra, J. L. M., and Delamer, I. M. 2006. Semantic Web Services in Factory Automation: Fundamental Insights and Research Roadmap. IEEE Transactions on Industrial Informatics 2, 1, 1--11.Google ScholarCross Ref
- Mattern, F. 1989. Virtual Time and Global States of Distributed Systems. In Proc. Workshop on Parallel and Distributed Algorithms, North-Holland, C. M. et al., Ed., 215--226.Google Scholar
- Mayer, S., Beckel, C., Scheidegger, B., Barthels, C., and Sörös, G. 2012. Demo: Uncovering Device Whispers in Smart Homes. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM 2012). Google ScholarDigital Library
- Mayer, S., Guinard, D., and Trifa, V. 2012. Searching in a Web-based Infrastructure for Smart Things. In Proceedings of the 3rd International Conference on the Internet of Things (IoT), IEEE Computer Society, 119--126.Google Scholar
- Mayer, S., Inhelder, N., Verborgh, R., de Walle, R. V., and Mattern, F. 2014. Configuration of Smart Environments Made Simple - Combining Visual Modeling with Semantic Metadata and Reasoning. In Proceedings of the 4th IEEE International Conference on the Internet of Things (IoT 2014).Google Scholar
- Minarik, P., and Dymacek, T. 2008. NetFlow Data Visualization Based on Graphs. In Proceedings of the 5th International Workshop on Visualization for Computer Security, Springer, 144--151. Google ScholarDigital Library
- Poole, E. S., Chetty, M., Grinter, R. E., and Edwards, W. K. 2008. More Than Meets the Eye: Transforming the User Experience of Home Network Management. In Proceedings of the 7th ACM Conference on Designing Interactive Systems (DIS 2008), ACM, 455--464. Google ScholarDigital Library
- Price, B. A., Baecker, R. M., and Small, I. S. 1993. A Principled Taxonomy of Software Visualization. J. Vis. Lang. Comput. 4, 3, 211--266.Google ScholarCross Ref
- Randall, D. 2003. Living Inside a Smart Home: A Case Study. In Inside the Smart Home, R. Harper, Ed. Springer, 227--246.Google Scholar
- Rial, A., and Danezis, G. 2011. Privacy-preserving smart metering. In Proceedings of the 10th Annual ACM Workshop on Privacy in the Electronic Society (WPES 2011), ACM, 49--60. Google ScholarDigital Library
- Röcker, C., Janse, M. D., Portolan, N., and Streitz, N. 2005. User Requirements for Intelligent Home Environments: A Scenario-Driven Approach and Empirical Cross-Cultural Study. In Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-aware Services: Usages and Technologies, ACM, 111--116. Google ScholarDigital Library
- Rosten, E., and Drummond, T. 2006. Machine Learning for High-Speed Corner Detection. In Proceedings of the 9th European Conference on Computer Vision (ECCV 2006), Lecture Notes in Computer Science. Springer, May, 430--443. Google ScholarDigital Library
- Schall, G., Zollmann, S., and Reitmayr, G. 2013. Smart Vidente: advances in mobile augmented reality for interactive visualization of underground infrastructure. Personal and Ubiquitous Computing 17, 7, 1533--1549 Google ScholarDigital Library
Index Terms
- A magic lens for revealing device interactions in smart environments
Recommendations
Magic lenses for revealing device interactions in smart environments (demo abstract)
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive ApplicationsWe present a tool for visualizing device interactions in smart environments as a magic lens by augmenting the live camera view of a tablet with relevant connections between recognized devices in the camera's field of view.
Semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationFacilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this paper, we present a system that helps users control ...
Embedded semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationFacilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this poster contribution, we present an approach to support ...
Comments