Abstract
This paper provides rating norms for a set of symbols and icons selected from a wide variety of sources. These ratings enable the effects of symbol characteristics on user performance to be systematically investigated. The symbol characteristics that have been quantified are considered to be of central relevance to symbol usability research and include concreteness, complexity, meaningfulness, familiarity, and semantic distance. The interrelationships between each of these dimensions is examined and the importance of using normative ratings for experimental research is discussed.
Article PDF
Similar content being viewed by others
References
American Institute of Graphic Arts (1982).Symbol signs. New York: Hastings House.
Arend, U., Muthig, K.-P., &Wandmacher, J. (1987). Evidence for global feature superiority in menu selection by icons.Behaviour & Information Technology,6, 411–426.
Arnstein, J. (1983).The international directory of graphic symbols. London: Kogan Page.
Benjafield, J., Frommhold, K., Keenan, T., Muckenheim, R., &Mueller, D. (1993). Imagery, concreteness, goodness, and familiarity ratings for 500 proverbs sampled from theOxford Dictionary of English Proverbs.Behavior Research Methods, Instruments, & Computers,25, 27–40.
Benjafield, J., &Muckenheim, R. (1989). Dates of entry and measures of imagery, concreteness, goodness, and familiarity for 1,046 words sampled from theOxford English Dictionary.Behavior Research Methods, Instruments, & Computers,21, 31–52.
Blattner, M. M., Sumikawa, D. A., &Greenberg, R. M. (1989). Earcons and icons: Their structure and common design principles.Human-Computer Interaction,4, 11–44.
Bocker, M. (1993, May). A multiple index approach for the evaluation of pictograms.Proceedings of the Fourteenth International Symposium of Human Factors in Telecommunication (pp. 73–84). Heidelberg: R v Deckers Verlag, G. Schenck GmBH.
Brems, D. J., &Whitten, W. B. (1987). Learning and preference for icon-based interface. InProceedings of the Human Factors Society Thirty-first Annual Meeting (pp. 125–129). Santa Monica, CA: Human Factors Society.
British Standards Institution (1989).5817-8 specification for audio-visual, video and television equipment and systems. London: BSI
Byrne, M. D. (1993). Using icons to find documents: Simplicity is critical. In S. Ashlund, K. Mullet, A. Henderson, E. Hollnagel, & T. White (Eds.),INTERCHI ’93-Bridges between worlds: Proceedings of the Conference on Human Factors in Computing Systems (pp. 446–453). Reading, MA: Addison-Wesley.
Cahill, M. (1975). The interpretability of graphic symbols as a function of context and experience factors.Journal of Applied Psychology,60, 360–380.
Christ, R. E., &Corso, G. (1982). The effects of extended practice on the evaluation of visual display codes.Human Factors,25, 71–84.
Deaton, J. E., Barnes, M., Kern, J., &Wright, D. (1990). An evaluation of the augie arrow HUD symbology as an aid to recovery from unusual attitudes. InProceedings of the Human Factors Society Thirty-Fourth Annual Meeting (pp. 31–35). Santa Monica, CA: Human Factors Society.
Easterby, R. S. (1970). The perception of symbols for machine displays.Ergonomics,13, 149–158.
Ells, J. G., &Dewar, R. E. (1979). Rapid comprehension of verbal and symbolic traffic sign messages.Human Factors,21, 161–168.
Familant, E. M., &Detweiler, M. C. (1993). Iconic reference: Evolving perspectives and an organising framework.International Journal of Man-Machine Studies,39, 705–728.
Flach, J. M., &Vicente, K. J. (1989).Complexity, difficulty, direct manipulation and direct perception (Tech. Rep. EPRL-89-03). Urbana-Champaign: University of Illinois, Engineering Psychology Research Laboratory.
Friendly, M., Franklin, P. E., Hoffman, D. &Rubin, D. C. (1982). The Toronto Word Pool: Norms for imagery, concreteness, orthographic variables, and grammatical usage for 1,080 words.Behavior Research Methods & Instrumentation,14, 375–399.
Garcia, M., Badre, A. N., &Stasko, J. T. (1994). Development and validation of icons varying in their abstractness.Interacting with Computers,6, 191–211.
Gilhooly, K. J., &Logie, R. H. (1980). Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words.Behavior Research Methods & Instrumentation,12, 395–427.
Gittins, D. (1986). Icon-based human-computer interaction.International Journal of Man-Machine Studies,24, 519–543.
Green, A. J. K., &Barnard, P. J. (1990). Iconic interfacing: The role of icon distinctiveness and fixed or variable screen locations. In D. Diaper et al. (Eds.),Human-computer interaction—Interact ’90 (pp. 457–462). Amsterdam: Elsevier.
Green, P. (1993). Design and evaluation of symbols for automobile controls and displays. In B. Peacock & W. Karwowski (Eds.),Automotive ergonomics (pp. 237–268). Washington, DC: Taylor & Francis.
Hartshorne, D. Weiss, P., &Burks, A. (Eds.) (1958).The collected papers of Charles Sanders Peirce. Cambridge, MA: Harvard University Press.
Horton, W. (1994).The icon book: Visual symbols for computer systems and documentation. New York: Wiley.
Howell, W. E. &Fuchs, A. F. (1968). Population stereotype in code design.Organisational Behavior & Human Performance,3, 310–339.
International Electrotechnical Commission (1973).IEC 417: Graphical symbols for use on equipment. Geneva: Author.
International Standards Organisation (1982).Benefits of standardisation: Methods of assessing the effects of standardisation. Geneva: Author.
International Standards Organisation (1989). ISO 7000:Graphical symbols for use on equipment—Index and synopsis. Geneva: Author.
International Standards Organisation (1990).ISO 7001: Specification for public information symbols. Geneva: Author.
International Standards Organisation (1994).ISO brochure: Compatible technology world-wide. Geneva: Author.
International Standards Organisation (1995).ISO 2575: Road vehicles— Symbols for controls, indicators and tell-tales. Geneva: Author.
Jones, S. (1983). Stereotypy in pictograms of abstract concepts.Ergonomics,26, 605–611.
Kirkpatrick, M., Dutra, L. A., Lyons, R. A., Osga, G. A., &Pucci, J. J. (1992). Tactical symbology standards. InProceedings of the Human Factors Society Thirty-Sixth Annual Meeting (pp. 1087–1091). Santa Monica, CA: Human Factors Society.
Lachman, R., &Lachman, J. L. (1980). Picture naming: Retrieval and activation of long-term memory. In L. W. Poon, J. L. Fozard, L. S. Cermak, D. Arenberg, & L. W. Thompson (Eds.),New directions in memory and ageing (pp. 313–343). Hillsdale, NJ: Erlbaum.
Margono, S., &Shneiderman, B. (1987). A study of file manipulation by novices using commands vs direct manipulation. In B. Shneiderman (Ed.),Sparks of innovation in the human-computer interface (pp. 39–50). Norwood, NJ: Ablex.
Martein, R. (1995). Norms for name and concept agreement, familiarity, visual complexity and image agreement on a set of 216 pictures.Psychologica Belgica,35, 205–225.
McDougall, S. J. P.,Curry, M., &de Bruijn, O. (1996).A review of symbol characteristics and their effects on usability (Document D1, British Aerospace Effective Symbology Project).
Microsoft Corporation (1989).Microsoft Access 2.0. Redmond, WA: Author.
Microsoft Corporation (1995).Microsoft Word for Windows ’95, Version 7. Redmond, WA: Author.
Moyes, J., &Jordan, P. W. (1993). Icon design and its effect on guessability, learnability and experienced user performance. In J. L. Alty, D. Diaper, & S. Guest (Eds.),People and computers VIII (pp. 49–59). Cambridge: Cambridge University Press.
Muter, P., &Mayson, C. (1986). The role of graphics in item selection from menus.Behaviour & Information Technology,5, 89–95.
North Atlantic Treaty Organization (1989).STANAG 4420: Display symbology and colors for NATO maritime units. Brussels: Author.
Paivio, A., Yuille, J. C., &Madigan, S. A. (1968). Concreteness, imagery, and meaningfulness values for 925 nouns.Journal of Experimental Psychology Monograph Supplement,76, 1–25.
Quinlan, P. (1992).The MRC psycholinguistic database. Cambridge: Cambridge University Press.
Rogers, Y. (1986). Evaluating the meaningfulness of icon sets to represent command operations. In M. D. Harrison & A. F. Monk (Eds.),People and computers: Designing for usability (pp. 586–603). Cambridge: Cambridge University Press.
Rogers, Y. (1988).Pictorial representations of abstract concepts in relation to human computer interaction. Unpublished doctoral dissertation thesis, University of Wales Swansea.
Rogers, Y. (1989). Icon design for the user interface.International Review of Ergonomics,2, 129–154.
Rogers, Y., &Oborne, D. J. (1987). Pictorial communication of abstract verbs in relation to human-computer interaction.British Journal of Psychology,78, 99–112.
Rohr, G., &Keppel, E. (1985). Iconic interfaces: Where to use and how to construct. In H. W. Hendrick & O. Brown (Eds.),Human factors in organization design and management (pp. 269–275). Amsterdam: Elsevier.
Sanfeliu, M. C., &Fernandez, A. (1996). A set of 254 Snodgrass-Vanderwart pictures standardized for Spanish: Norms for name agreement, image agreement, familiarity, and visual complexity.Behavior Research Methods, Instruments, & Computers,28, 537–555.
Snodgrass, J. G., &Vanderwart, M. (1980). A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity and visual complexity.Journal of Experimental Psychology: Human Learning & Memory,6, 174–215.
Snodgrass, J. G., &Yuditsky, T. (1996). Naming times for the Snodgrass and Vanderwart pictures.Behavior Research Methods, Instruments, & Computers,28, 516–536.
Spreen, O., &Schulz, R. W. (1966). Parameters of abstraction, meaningfulness, and pronounceability for 329 nouns.Journal of Verbal Learning & Verbal Behavior,5, 459–468.
Stammers, R. B., George, D. A., &Carey, M. S. (1989). An evaluation of abstract and concrete icons for a CAD package. In E. D. Megaw (Ed.),Contemporary ergonomics 1989 (pp. 416–421). London: Taylor & Francis.
Stammers, R. B., &Hoffman, J. (1991). Transfer between icon sets and ratings of icon concreteness and appropriateness. InProceedings of the Human Factors Society Thirty-Fifth Annual Meeting (pp. 354–358). Santa Monica, CA: Human Factors Society.
Toglia, M. P., &Battig W. F. (1978).Handbook of semantic word norms. Hillsdale, NJ: Erlbaum.
Tullis, T. S. (1983). The formatting of alphanumeric displays: A review and analysis.Human Factors,25, 657–682.
van Schagen, I., Tamsma, N., Bruggemann, F., Jackson, J. L. &Michon, J. A. (1983). Namen en normen voor plaatje [Names and norms for pictures].Nederlands Tijdschrift voor de Psychologie,38, 236–241.
W3C (1996).HTML predefined icon-like symbols [On-line]. Available HTML: http://www.w3.org/pub/www/tr/wd-wwwicn
Zwaga, H., &Easterby, R. (1984). Developing effective symbols for public information. In R. Easterby & H. Zwaga (Eds.),Information design: The design and evaluation of signs and printed material (pp. 277–298). New York: Wiley.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was part of the Effective Symbology Project, which is ongoing research supported by a grant from British Aerospace plc (Grant SRC/UOS/060495).
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Mcdougall, S.J.P., Curry, M.B. & de Bruijn, O. Measuring symbol and icon characteristics: Norms for concreteness, complexity, meaningfulness, familiarity, and semantic distance for 239 symbols. Behavior Research Methods, Instruments, & Computers 31, 487–519 (1999). https://doi.org/10.3758/BF03200730
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03200730