Abstract
Design integrates concepts and solves problems. Crowdsourcing design imports vast knowledge and produces creative ideas. It publishes design tasks, collects dozens of contributors’ ideas and reward the best. Contributors in crowdsourcing design work individually when generating ideas. However, those who collaborate could make better use of crowd’s knowledge, which might produce ideas of higher quality. By analyzing the advantages and disadvantages of crowdsourcing design, this article proposes a collaborative crowdsourcing design method that integrates crowd’s sketching processes. This method uses a tree to arrange crowd’s ideas and enable flexible modifications of prior ideas. A demonstration system named Sketchfans is developed, and the results of a crowdsourcing sketching experiment using this system are presented. The experimental results validate that this method is effective; participants rely heavily on the idea tree for inspiration, and the best ideas appear around the ends of branches on the idea tree. Moreover, participants displayed unique development patterns. They often developed high-quality ideas from initial ideas that were regarded as poor quality. The demonstration system Sketchfans, supports this method well. Finally, we optimize Sketchfans based on analysis of participants’ activities and feedback.
Similar content being viewed by others
References
Bayus, B. L. (2013). Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Science, 59(1), 226–244.
Bogers, M., & West, J. (2012). Managing distributed innovation: Strategic utilization of open and user innovation. Creativity and Innovation Management, 21(1), 61–75.
Cross, N. (2006). Designerly ways of knowing (1st ed.). London: Springer.
Dean, D. L., Hender, J. M., Rodgers, T. L., & Santanen, E. L. (2006). Identifying quality, novel, and creative Ideas: Constructs and scales for idea evaluation. Journal of the Association for Information Systems, 7(10), 646–698.
Doan, A., Ramakrishnan, R., & Halevy, A. Y. (2011). Crowdsourcing systems on the world-wide web. Communications of the ACM, 54(4), 86–96.
Dontcheva, M., Gerber, E., & Lewis, S. (2011). Crowdsourcing and creativity. In The ACM CHI conference on human factors in computing systems: Workshop on crowdsourcing and human computation, Vancouver, Canada, May 7–12 2011.
Erickson, T. (2011) Some thoughts on a framework for crowdsourcing. In The ACM CHI conference on human factors in computing systems: Workshop on crowdsourcing and human computation, Vancouver, Canada, May 7–12 2011.
Geiger, D., Rosemann, M., Fielt, E., & Schader, M. (2012) Crowdsourcing information systems-definition, typology, and design. In International conference on information systems, Orlando, USA December 16–19 2012 (Paper 53).
Geiger, D., Seedorf, S., Schulze, T., Nickerson, R. C., & Schader, M. (2011) Managing the crowd: Towards a taxonomy of crowdsourcing processes. In Americas conference on information systems, Detroit, Michigan, August 4–8 2011 (Paper 430).
Goldschmidt, G. (1997). Capturing indeterminism: Representation in the design problem space. Design Studies, 18(4), 441–455. doi:10.1016/S0142-694X(97)00011-2.
Haymaker, J., Keel, P., Ackermann, E., & Porter, W. (2000). Filter mediated design: Generating coherence in collaborative design. Design Studies, 21(2), 205–220.
Howe, J. (2006a). Crowdsourcing: A definition. Crowdsourcing: Tracking the rise of the amateur. http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html.
Howe, J. (2006b). The rise of crowdsourcing. Wired Magazine, 14(6), 1–4.
Jain, R. (2010). Investigation of governance mechanisms for crowdsourcing initiatives. In Americas conference on information systems, Lima, Peru, August 12–15 2010 (Paper 557).
Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., et al. (2013). The future of crowd work. Paper presented at the the 16th ACM conference on computer supported cooperative work and social computing, San Antonio, USA, February 23–27.
Kudrowitz, B., Te, P., & Wallace, D. (2012). The influence of sketch quality on perception of product-idea creativity. AI EDAM, 26(Special Issue 03), 267–279. doi:10.1017/S0890060412000145.
Kudrowitz, B., & Wallace, D. (2013). Assessing the quality of ideas from prolific, early-stage product ideation. Journal of Engineering Design, 24(2), 120–139.
Lehoux, P., Hivon, M., Williams-Jones, B., & Urbach, D. (2011). The worlds and modalities of engagement of design participants: A qualitative case study of three medical innovations. Design Studies, 32(4), 313–332.
Linsey, J. S., Clauss, E. F., Kurtoglu, T., Murphy, J. T., Wood, K. L., & Markman, A. B. (2011). An experimental study of group idea generation techniques: Understanding the roles of idea representation and viewing methods. Journal of Mechanical Design, 133(3). doi:10.1115/1.4003498.
Malone, T., Laubacher, R., & Dellarocas, C. (2009). Harnessing crowds: Mapping the genome of collective intelligence. Research Paper No. 4732-09, MIT.
Morris, R. R., Dontcheva, M., Finkelstein, A., & Gerber, E. (2013). Affect and creative performance on crowdsourcing platforms. In Affective computing and intelligent interaction (ACII), 2013 humaine association conference on, 2013 (pp. 67–72), IEEE.
Nelson, B. A., Wilson, J. O., Rosen, D., & Yen, J. (2009). Refined metrics for measuring ideation effectiveness. Design Studies, 30(6), 737–743. doi:10.1016/j.destud.2009.07.002.
Nickerson, J., & Sakamoto, Y. (2010). Crowdsourcing creativity: Combining ideas in networks. In Workshop on information in networks, New York, USA, September 24–25 2010.
Oman, S. K., Tumer, I. Y., Wood, K., & Seepersad, C. (2013). A comparison of creativity and innovation metrics and sample validation through in-class design projects. Research in Engineering Design, 24(1), 65–92.
Pache, M. W. (2005). Sketching for conceptual design. Empirical results and future tools. Munich: Technischen Universität München.
Pahl, G., Wallace, K., & Blessing, L. T. M. (2007). Engineering design: A systematic approach. Berlin: Springer.
Pei, E. (2009). Building a common language of design representations for industrial designers & engineering designers. Loughborough: Loughborough University.
Raaijmakers, J. G., & Shiffrin, R. M. (1981). Search of associative memory. Psychological Review, 88(2), 93–134. doi:10.1037/0033-295X.88.2.93.
Restrepo, J., & Christiaans, H. (2004). Problem structuring and information access in design. Journal of Design Research, 4(2), 1551–1569.
Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003). Metrics for measuring ideation effectiveness. Design Studies, 24(2), 111–134. doi:10.1016/S0142-694X(02)00034-0.
Shah, J. J., Vargas-Hernandez, N., Summers, J. D., & Kulkarni, S. (2001). Collaborative sketching (C-Sketch)—An idea generation technique for engineering design. The Journal of Creative Behavior, 35(3), 168–198.
Sim, S. K., & Duffy, A. H. (2003). Towards an ontology of generic engineering design activities. Research in Engineering Design, 14(4), 200–223.
Sun, L., Xiang, W., Chai, C., Wang, C., & Huang, Q. (2014). Creative segment: A descriptive theory applied to computer-aided sketching. Design Studies, 35(1), 54–79. doi:10.1016/j.destud.2013.10.003.
Suwa, M., Gero, J. S., & Purcell, T. A. (1998). The roles of sketches in early conceptual design processes In Proceedings of the twentieth annual conference of the Cognitive Science Society.
Suwa, M., Gero, J., & Purcell, T. (2000). Unexpected discoveries and S-invention of design requirements: Important vehicles for a design process. Design Studies, 21(6), 539–567.
Taura, T., Yamamoto, E., Fasiha, M. Y. N., Goka, M., Mukai, F., Nagai, Y., et al. (2012). Constructive simulation of creative concept generation process in design: A research method for difficult-to-observe design-thinking processes. Journal of Engineering Design, 23(4), 297–321.
Temple, S. (1994). Thought made visible: The value of sketching. Co-Design Journal, 1, 16–25.
Tidball, B., Mulder, I., & Stappers, P. J. (2011). Online design contests: A network of inspiration for designers. Paper presented at the proceedings of the 4th world conference on design research, IASDR, 2011, Delft, The Netherlands, October 31–November 4.
Wooten, J., & Ulrich, K. (2011). Idea generation and the role of feedback: Evidence from field experiments with innovation tournaments. Available at SSRN 1838733.
Yu, L., & Nickerson, J. V. (2011). Cooks or cobblers? Crowd creativity through combination. In Proceedings of the SIGCHI conference on human factors in computing systems, 2011 (pp. 1393–1402), ACM.
Acknowledgments
This paper is supported by the National Natural Science Foundation of China (61004116) and the Zhejiang Provincial Natural Science Foundation of China (LY13E050005, LY13F030002).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sun, L., Xiang, W., Chen, S. et al. Collaborative sketching in crowdsourcing design: a new method for idea generation. Int J Technol Des Educ 25, 409–427 (2015). https://doi.org/10.1007/s10798-014-9283-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10798-014-9283-y