Paul Marshall
ABSTRACT
Conceptual work on tangible interfaces has focused primarily on the production of descriptive frameworks. While this work has been successful in mapping out a space of technical possibilities and providing a terminology to ground discussion, it provides little guidance on the cognitive or social effects of using one type of interface or another. In this paper we look at the area of learning with tangible interfaces, suggesting that more empirically grounded research is needed to guide development. We provide an analytic framework of six perspectives, which describes latent trends and assumptions that might be used to motivate and guide this work, and makes links with existing research in cognitive science and education.
- Ackermann, E. Perspective-taking and object construction: two keys to learning. in Kafai, Y. and Resnick, M. eds. Constructionism in practice: designing, thinking, and learning in a digital world, Lawrence Erlbaum, Mahwah, NJ, 1996, 25--35.]]Google Scholar
- Ainsworth, S. DeFT: a conceptual framework for considering learning with multiple representations. Learning and Instruction, 16 (3). 183--198.]]Google ScholarCross Ref
- Ananny, M., Supporting Children's Collaborative Authoring: Practicing Written Literacy While Composing Oral Texts. In Proc. of CSCL 2002, 595--596.]]Google Scholar
- Barsalou, L. W., Niedenthal, P. M., Barbey, A. and Ruppert, J. A. Social embodiment. The Psychology of Learning and Motivation, 43. 43--92.]]Google Scholar
- Barsalou, L. W. and Wiemer-Hastings, K. Situating abstract concepts. in Pecher, D. and Zwaan, R. eds. Grounding Cognition: The Role of Perception and Action in Memory, Language, and Thought, Cambridge University Press, New York, 2005.]]Google Scholar
- Bassok, M. and Holyoak, K. J. Interdomain transfer between isomorphic topics in algebra and physics. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15 (1). 153--166.]]Google Scholar
- Blackwell, A. F., Cognitive dimensions of tangible programming techniques. In Proc. of PPIG 2003, 391--405.]]Google Scholar
- Chalmers, M. Book review: Where the Action Is: The Foundations of Embodied Interaction. Computer Supported Cooperative Work, 14 (1). 69--77.]] Google ScholarDigital Library
- Cheng, P. C.-H. Unlocking conceptual learning in mathematics and science with effective representational systems. Computers and Education, 33 (2--3). 109--130.]] Google ScholarDigital Library
- Chi, M. Why is self explaining an effective domain general learning activity? in Glaser, R. ed. Advances in Instructional Psychology, Lawrence Erlbaum Associates, 1997.]]Google Scholar
- Clements, D. H. 'Concrete' manipulatives, concrete ideas. Contemporary Issues in Early Childhood, 1 (1). 45--60.]]Google Scholar
- Colella, V., Borovoy, R. and Resnick, M., Participatory simulations: using computational objects to learn about dynamic systems. In Proc. of CHI '98, 9--10.]] Google ScholarDigital Library
- Crease, M., Kids as data: using tangible interaction in a science exhibit. In Proc. of CHI '06, 670--675.]] Google ScholarDigital Library
- de Jong, T. and van Joolingen, W. R. Scientific discovery learning with computer simulations of conceptual domains. Review of Educational Research, 68 (2). 179--201.]]Google ScholarCross Ref
- Dourish, P. Where the action is: the foundations of embodied interaction. MIT Press, 2001.]] Google ScholarDigital Library
- Fails, J. A., Druin, A., Guha, M. L., Chipman, G., Simms, S. and Churaman, W., Child's play: a comparison of desktop and physical interactive environments. In Proc. of IDC 2005, 48--55.]] Google ScholarDigital Library
- Fernaeus, Y. and Tholander, J., Finding design qualities in a tangible programming space. In Proc. of CHI '06, 447--456.]] Google ScholarDigital Library
- Fernaeus, Y. and Tholander, J., "Looking at the computer but doing it on land": children's interactions in a tangible programming space. In Proc. of HCI 2005, 3--18.]]Google Scholar
- Fishkin, K. P. A taxonomy for and analysis of tangible interfaces. Pers. and Ubiq. Comp., 8 (5). 347--358.]] Google ScholarDigital Library
- Fjeld, M., Hobi, D., Winterhaler, L., Voegtli, B. and Juchli, P., Teaching Electronegativity and dipole moment in a TUI. In Proc. of ICALT '04, 792--794.]] Google ScholarDigital Library
- Gillet, A., Sanner, M., Stoffler, D. and Olson, A. Tangible interfaces for structural molecular biology. Structure, 13. 483--491.]]Google Scholar
- Goldstone, R. L. and Son, J. Y. The transfer of scientific principles using concrete and idealized simulations. The Journal of the Learning Sciences, 14 (1). 69--110.]]Google ScholarCross Ref
- Holmquist, L. E., Redström, J. and Ljungstrand, P. Token-Based Access to Digital Information. Proc. of HUC '99, 234--245]] Google ScholarDigital Library
- Hornecker, E. and Buur, J., Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proc. of CHI '06, ACM Press, 437--446.]] Google ScholarDigital Library
- isee systems. STELLA: Systems thinking for Education and Research, isee systems, Inc., Lebanon, NH, USA, 2006.]]Google Scholar
- Ishii, H. and Ullmer, B., Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of CHI '97, ACM Press, 234--241.]] Google ScholarDigital Library
- Jackson, S., Stratford, S., Krajcik, J. and Soloway, E., Model-It: A case study of learner-centered software for supporting model building. In Proc. of WCTASC.]]Google Scholar
- Jacob, R. J. K., Ishii, H., Pangaro, G. and Patten, J., A tangible interface for organizing information using a grid. In Proc. of CHI '02, ACM Press, 339--346.]] Google ScholarDigital Library
- Kahn, K. ToonTalk#8482; -- an animated programming environment for children. Journal of Visual Languages and Computing, 7. 197--217.]]Google Scholar
- Klahr, D., Triona, L. M. and Williams, C. Hands on what? The relative effectiveness of physical vs. virtual materials in an engineering design project by middle school children. Journal of Research in Science Teaching (in press).]]Google Scholar
- Klemmer, S. R., Hartmann, B. and Takayama, L., How bodies matter: five themes for interaction design. In Proc. of DIS '06, 140--149.]] Google ScholarDigital Library
- Koleva, B., Benford, S., Ng, K. H. and Rodden, T., A Framework for Tangible User Interfaces. In Proceedings of PI03 workshop at Mobile HCI '03.]]Google Scholar
- Lakoff, G. and Johnson, M. Philosophy in the flesh: the embodied mind and its challenge to western thought. Basic Books, New York, 1999.]]Google Scholar
- Marshall, P., Price, S. and Rogers, Y., Conceptualising tangibles to support learning. In Proc. of IDC '03, ACM Press, 101--109.]] Google ScholarDigital Library
- Mellar, H. and Bliss, J. Introduction: modelling and education. in Mellar, H., Bliss, J., Boohan, R., Ogborn, J. and Tompsett, C. eds. Learning with artificial worlds: computer-based modelling in the curriculum, The Falmer Press, London, 1994, 1--7.]]Google Scholar
- Montessori, M. The Montessori method: scientific pedagogy as applied to child education in the "children's houses". R. Bentley, Cambridge, Mass, 1912.]]Google Scholar
- O'Hara, K. P. and Payne, S. J. The effects of operator implementation cost on planfulness of problem solving and learning. Cognitive Psychology, 35 (1). 34--70.]]Google ScholarCross Ref
- Papert, S. Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, New York, 1980.]] Google ScholarDigital Library
- Price, S., Rogers, Y., Scaife, M., Stanton, D. and Neale, H. Using 'tangibles' to promote novel forms of playful learning. Interacting with Computers, 15 (2). 169--185.]]Google ScholarCross Ref
- Raffle, H. S., Parkes, A. J. and Ishii, H., Topobo: a constructive assembly system with kinetic memory. In Proc. of CHI '04, 647--654.]] Google ScholarDigital Library
- Resnick, M., Martin, F., Berg, R., Borovoy, R., Colella, V., Kramer, K. and Silverman, B., Digital manipulatives: new toys to think with. In Proc. of CHI '98, 281--287.]] Google ScholarDigital Library
- Rogers, Y., Scaife, M., Gabrielli, S., Smith, H. and Harris, E. A Conceptual Framework for Mixed Reality Environments: Designing Novel Learning Activities for Young Children. Presence: Teleoperators & Virtual Environments, 11 (6). 677--686.]] Google ScholarDigital Library
- Scaife, M. and Rogers, Y. External Cognition: how do graphical representations work? International Journal of Human-Computer Studies, 45. 185--213.]] Google ScholarDigital Library
- Sedig, K., Klawe, M. and Westrom, M. Role of interface manipulation style and scaffolding on cognition and concept learning in learnware. ACM Trans. on Computer-Human Int., 8 (1). 34--59.]] Google ScholarDigital Library
- Sluis, R. J. W., Weevers, I., van Schijndel, C. H. G. J., Kolos-Mazuryk, L., Fitrianie, S. and Martens, J. B. O. S., Read-It: five-to-seven-year-old children learn to read in a tabletop environment. In Proc. of IDC '04, 73--80.]] Google ScholarDigital Library
- Stanton, D., Bayon, V., Neale, H., Ghali, A., Benford, S., Cobb, S., Ingram, R., O'Malley, C., Wilson, J. and Pridmore, T., Classroom collaboration in the design of tangible interfaces for stroytelling. In Proc. of CHI '01, 482--489.]] Google ScholarDigital Library
- Stanton, D. and Neale, H. R. The effects of multiple mice on children's talk and interaction. Journal of Computer Assisted Learning, 19. 229--238.]]Google Scholar
- Suzuki, H. and Kato, H., Algoblocks: an open programming language. In Proc. of CSCL '95, 349--355.]] Google ScholarDigital Library
- Svendsen, G. B. The influence of interface style on problem solving. International Journal of Man-Machine Studies, 35 (3). 379--397.]] Google ScholarDigital Library
- Terrenghi, L., Kranz, M., Holleis, P. and Schmidt, A. A cube to learn: a tangible user interface for the design of a learning appliance. Personal and Ubiquitous Computing, 10 (2). 153--158.]] Google ScholarDigital Library
- Triona, L. M., Klahr, D. and Williams, C. Point and click or build by hand: comparing the effects of physical vs. virtual materials on middle school students' ability to optimize an engineering design In Proc. of CogSci2005.]]Google Scholar
- Trudel, C.-I. and Payne, S. J. Reflection and goal management in exploratory learning. International Journal of Human-Computer Studies, 42 (3). 307--339.]] Google ScholarDigital Library
- Ullmer, B. and Ishii, H. Emerging frameworks for tangible user interfaces. IBM Systems Journal, 39 (3--4). 915--931.]] Google ScholarDigital Library
- Underkoffler, J. and Ishii, H., Illuminating light: an optical design tool with a luminous-tangible interface. In Proc. of CHI '98, ACM Press, 542--549.]] Google ScholarDigital Library
- Uttal, D. H., Scudder, K. V. and DeLoache, J. S. Manipulatives as symbols: a new perspective on the use of concrete objects to teach mathematics. Journal of Applied Developmental Psychology, 18. 37--54.]]Google Scholar
- Zuckerman, O., Arida, S. and Resnick, M., Extending tangible interfaces for education: digital montessori-inspired manipulatives. In Proc. of CHI '05, ACM Press, 859--868.]] Google ScholarDigital Library
Index Terms
- Do tangible interfaces enhance learning?
Recommendations
Tangible Interfaces: An Analysis of User Experience Using the AR Sandbox Project
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing SystemsThe desire to make the human-computer interaction more natural, and the limitation between real and virtual became practically imperceptible, resulted in the development of Tangible Interfaces (TUI). In TUI physical objects are interpreted by the system ...
Tangible User Interfaces: Technology You Can Touch
To make computer and communications technology easier to work with, vendors are beginning to release products utilizing tangible user interfaces, in which users interact with physical objects that both represent and control digital information.
A comparison of spatial organization strategies in graphical and tangible user interfaces
DARE '00: Proceedings of DARE 2000 on Designing augmented reality environmentsWe present a study comparing how people use space in a Tangible User Interface (TUI) and in a Graphical User Interface (GUI). We asked subjects to read ten summaries of recent news articles and to think about the relationships between them. In our TUI ...
Comments