Lynne Hall
ABSTRACT
This paper focuses on achieving optimal responses through supporting children's judgements, using Smiley Face Likert scales as a rating scale for quantitative questions in evaluations. It highlights the need to provide appropriate methods for children to communicate judgements, highlighting that the traditional Smiley Face Likert scale does not provide an appropriate method. The paper outlines a range of studies, identifying that to achieve differentiated data and full use of rating scales by children that faces with positive emotions should be used within Smiley Face Likert scales. The proposed rating method, the Five Degrees of Happiness Smiley Face Likert scale, was used in a large-scale summative evaluation of a Serious Game resulting in variance within and between children, with all points of the scale used.
- Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. Cultural Intelligence: Its Measurement and Effects on Cultural Judgment and Decision Making, Cultural Adaptation and Task Performance. Management and Organization Review 3, 3 (2007), 335--371.Google Scholar
Cross Ref
- Bell, A. Designing and testing questionnaires for children. Journal of Research in Nursing 12, 5 (2007) 461--469.Google ScholarCross Ref
- Buckleitner, W. The State of Children's Software Evaluation---Yesterday, Today, and in the 21st Century. Information Technology in Childhood Education Annual 1999, 1 (1999), 211--220.Google Scholar
- Chambers, C. T., & Johnston, C. Developmental differences in children's use of rating scales. Journal of Pediatric Psychology 27 (2002) 27--36.Google ScholarCross Ref
- Cole, J. S., Mccormick, A. C., & Gonyea, R. M. Respondent use of straight-lining as a response strategy in education survey research: Prevalence and implications. Annual meeting of the American Educational Research Association, (2012) 1--18.Google Scholar
- Danner, D., Aichholzer, J., & Rammstedt, B. Acquiescence in personality questionnaires: Relevance, domain specificity and stability. Journal of Research in Personality 57, August (2015), 119--130Google ScholarCross Ref
- Dowrick, A., Wootten, A., Murphy, D., & A, C. "We used a validated Questionnaire": What Does This Mean and is it an Accurate Statment in Urologic Research. Urology, 85,6 (2014) 1304--10Google Scholar
- Endrass, B., Hall, L., Hume, C., Tazzyman, S., & Andre, E. A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters. In 16th International Conference on Human Interaction (2014) 532--543).Google Scholar
- Endrass, B., Hall, L., Hume, C., Tazzyman, S., Andre, E., & Aylett, R. (2014). Engaging with virtual characters using a pictorial interaction language. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 531--534) Google ScholarDigital Library
- Guinard, J.X. Sensory and consumer testing with children. Trends in Food Science and Technology 11, (2000) 273--283.Google ScholarCross Ref
- Haddad, S., King, S., Osmond, P., & Heidari, S. Questionnaire design to determine children's thermal sensation, preference and acceptability in the classroom. Proceedings - 28th International PLEA Conference on Sustainable Architecture + Urban Design: Opportunities, Limits and Needs - Towards an Environmentally Responsible Architecture (2012).Google Scholar
- Hall, L. and Hume, C. Why Numbers, Invites and Visits are not Enough: Evaluating the User Experience in Social Eco-Systems. SOTICS 2011, The First International Conference on Social Eco-Informatics, (2011) 8--13.Google Scholar
- Hall, L., Tazzyman, S., Hume, C., Endrass, B., Lim, M-Y., Hofstede, G., Paiva, A., Andre, E., Kappas, A. and Aylett, R. Learning to overcome cultural conflict through engaging with intelligent agents in synthetic cultures. Journal of Artificial Intelligence and Education: Special Issue on Culturally-Aware Educational Technologies 25, 2 (2015) 291--317.Google Scholar
- Hall, L., Jones, S., Aylett, R., Hall, M., Tazzyman, S., Paiva, A., & Humphries, L. Serious Game Evaluation as a Metagame. Journal of Interactive Technology and Smart Education. 10, 2 (2013) 130--146.Google ScholarCross Ref
- Krosnick, J. A.The threat of satisficing in surveys: the shortcuts respondents take in answering questions. Survey Methods Newsletter 20 (2000) 4--8.Google Scholar
- van Laerhoven, H., van der Zaag-Loonen, H. J., & Derkx, B. H. F. A comparison of Likert scale and visual analogue scales as response options in children's questionnaires. Acta paediatrica, 93, 6 (2004) 830--835Google Scholar
- Markopoulos, P., Read, J. C., MacFarlane, S., & Hööysniemi, J. Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers. Morgan Kaufmann Publishers Inc. San Francisco (CA), US. (2008) Google ScholarDigital Library
- Matson, J. L., Neal, D., Fodstad, J. C., Hess, J. a, Mahan, S., & Rivet, T. T. Reliability and validity of the Matson Evaluation of Social Skills with Youngsters. Behavior modification 34, 6 (2010) 539--58.Google Scholar
- McCambridge, J., De Bruin, M., & Witton, J. The effects of demand characteristics on research participant behaviours in non-laboratory settings: a systematic review. PloS one 7, 6 (2012) e39116.Google Scholar
- Mellor, D., & Moore, K. A. The use of likert scales with children. Journal of Pediatric Psychology 39 (2014) 369--379.Google ScholarCross Ref
- Millen, L., Cobb, S., Patel, H., & Glover, T. Collaborative virtual environment for conducting design sessions with students with autism spectrum conditions. Proc. 9th International Conf. on Disability, Virtual Reality and Assoc. Technologies, (2012) 269--278.Google Scholar
- Nijs, L. and Leman, M. Interactive technologies in the instrumental music classroom: A longitudinal study with the Music Paint Machine. Computers and Education 73 (2014) 40--59. Google ScholarDigital Library
- Oerke, B. and Bogner, F.X. Social Desirability, Environmental Attitudes, and General Ecological Behaviour in Children. International Journal of Science Education 35, 5 (2013) 713--730.Google ScholarCross Ref
- Ólafsson, K., Livingstone, S., & Haddon, L. Children's use of online technologies in Europe: a review of the European evidence base. EU Kids Online, London, UK (2013)Google Scholar
- Orne, M.T. On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American psychologist 17, 11 (1962) 776.Google Scholar
- Read, J. MESS Days: Working with Children to Design and Deliver Worthwhile Mobile Experiences. UPA User Experience Magazine, 9, 2 (2010)Google Scholar
- Read, J. and Markopoulos, P. Evaluating children's interactive products. Extended abstracts of the 32nd annual ACM Conference on Human Factors in Computing Systems, (2014)1043--1044. Google ScholarDigital Library
- Read, J. and Fine, K. Using survey methods for design and evaluation in child computer interaction. Workshop on Child Computer Interaction: Methodological Research at Interact. (2005).Google Scholar
- Read, J., MacFarlane, S., & Casey, C. Endurability, engagement and expectations: Measuring children's fun. Proceedings of Interaction Design and Children, (2002) 189--198.Google Scholar
- Reynolds-Keefer, L., Johnson, R., & Carolina, S. Is a picture worth a thousand words? Creating effective questionnaires with pictures. Practical Assessment, Research & Evaluation 16 (2011) 1--7.Google Scholar
- Reynolds-Keefer, L., Johnson, R., Dickenson, T., & McFadden, L.Validity issues in the use of pictorial Likert scales. Studies in Learning, Evaluation Innovation and Development 6 (2009) 15--24.Google Scholar
- Roberto, C. A., Baik, J., Harris, J. L., & Brownell, K. D.Influence of licensed characters on children's taste and snack preferences. Pediatrics 126 (2010) 88--93.Google ScholarCross Ref
- Rubie-Davies, C. M., & Hattie, J. A. C. The dangers of extreme positive responses in Likert scales administered to young children. The International Journal of Educational and Psychological Assessment 11 (2012) 75--89.Google Scholar
- Salvador-Herranz, G., Perez-Lopez, D., Ortega, M., Soto, E., Alcaliz, M., & Contero, M. Manipulating virtual objects with your hands: A case study on applying desktop Augmented Reality at the primary school. Proceedings of the Annual Hawaii International Conference on System Sciences (2013) 31--39. Google ScholarDigital Library
- Sluis, F. Van Der, Dijk, E. M. a G. Van, & Perloy, L. M. Measuring Fun and Enjoyment of Children in a Museum: Evaluating the Smileyometer Study One: Prototype. In Proceding of Measuring (2012) 86--89.Google Scholar
- Tatla. 2014, S.K. The development of the Pediatric Motivation Scale for children in rehabilitation: a pilot study. Retrieved from http://elk.library.ubc.ca/bitstream/handle/2429/45920/ubc_2014_spring_tatla_sandeep.pdf?sequence=27Google Scholar
- Tourangeau, R. and Rasinkski, K.A. Cognitive processes underlying context effects in attitude measurement. Psychological Bulletin 103 (2008) 299--314.Google ScholarCross Ref
- Vannette, D. and Krosnick, J. A comparison of Survey Satisficing and Mindlessness. In The Willey Blackwell Handbook of Mindfullness. (2014) 312.Google Scholar
- Zaman, B., Vanden Abeele, V., & De Grooff, D. Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods. International Journal of Child-Computer Interaction 1 (2013) 61--70.Google ScholarCross Ref
- Zaman, B., Vanden Abeele, V., Markopoulos, P., & Marshall, P. Editorial: The evolving field of tangible interaction for children: The challenge of empirical validation. Personal and Ubiquitous Computing 16, (2012) 367--378. Google ScholarDigital Library
- Zarins, B. Are validated questionnaires valid? The Journal of Bone & Joint Surgery 87, 8 (2005) 1671--1672.Google ScholarCross Ref
Index Terms
- Five Degrees of Happiness: Effective Smiley Face Likert Scales for Evaluating with Children
Recommendations
A Smiley Face Icon Creator for Evaluating Emotion with Children
AsianCHI '20: Proceedings of the 2020 Symposium on Emerging Research from Asia and on Asian Contexts and CulturesIn designing an interactive system for children, it is imperative to hear the opinions and emotions of children themselves. However, it can be challenging to investigate their emotions because of their limited abilities of expression. Children are still ...
“Instant Happiness”: Smartphones as tools for everyday emotion regulation
Highlights- We investigated smartphone-based emotion regulation in daily life and its associated psychological consequences using experience sampling and qualitative ...
AbstractSmartphone use has become an indispensable aspect of daily life for billions of people. Increasingly, researchers are examining the impact of smartphone use upon psychological well-being. However, little research has investigated how ...
Exploring how children express feelings and emotions in an online support group
The emotional content of children's online messages is explored.Children found similar others online and often shared intimate emotional concerns.Children revealed difficulties in coping with conflicting emotions.Emotions confided included feeling hurt, ...
Comments