Skip to main content
Log in

Collaborative sketching in crowdsourcing design: a new method for idea generation

  • Published:
International Journal of Technology and Design Education Aims and scope Submit manuscript

Abstract

Design integrates concepts and solves problems. Crowdsourcing design imports vast knowledge and produces creative ideas. It publishes design tasks, collects dozens of contributors’ ideas and reward the best. Contributors in crowdsourcing design work individually when generating ideas. However, those who collaborate could make better use of crowd’s knowledge, which might produce ideas of higher quality. By analyzing the advantages and disadvantages of crowdsourcing design, this article proposes a collaborative crowdsourcing design method that integrates crowd’s sketching processes. This method uses a tree to arrange crowd’s ideas and enable flexible modifications of prior ideas. A demonstration system named Sketchfans is developed, and the results of a crowdsourcing sketching experiment using this system are presented. The experimental results validate that this method is effective; participants rely heavily on the idea tree for inspiration, and the best ideas appear around the ends of branches on the idea tree. Moreover, participants displayed unique development patterns. They often developed high-quality ideas from initial ideas that were regarded as poor quality. The demonstration system Sketchfans, supports this method well. Finally, we optimize Sketchfans based on analysis of participants’ activities and feedback.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Bayus, B. L. (2013). Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Science, 59(1), 226–244.

    Article  Google Scholar 

  • Bogers, M., & West, J. (2012). Managing distributed innovation: Strategic utilization of open and user innovation. Creativity and Innovation Management, 21(1), 61–75.

    Article  Google Scholar 

  • Cross, N. (2006). Designerly ways of knowing (1st ed.). London: Springer.

    Google Scholar 

  • Dean, D. L., Hender, J. M., Rodgers, T. L., & Santanen, E. L. (2006). Identifying quality, novel, and creative Ideas: Constructs and scales for idea evaluation. Journal of the Association for Information Systems, 7(10), 646–698.

    Google Scholar 

  • Doan, A., Ramakrishnan, R., & Halevy, A. Y. (2011). Crowdsourcing systems on the world-wide web. Communications of the ACM, 54(4), 86–96.

    Article  Google Scholar 

  • Dontcheva, M., Gerber, E., & Lewis, S. (2011). Crowdsourcing and creativity. In The ACM CHI conference on human factors in computing systems: Workshop on crowdsourcing and human computation, Vancouver, Canada, May 7–12 2011.

  • Erickson, T. (2011) Some thoughts on a framework for crowdsourcing. In The ACM CHI conference on human factors in computing systems: Workshop on crowdsourcing and human computation, Vancouver, Canada, May 7–12 2011.

  • Geiger, D., Rosemann, M., Fielt, E., & Schader, M. (2012) Crowdsourcing information systems-definition, typology, and design. In International conference on information systems, Orlando, USA December 16–19 2012 (Paper 53).

  • Geiger, D., Seedorf, S., Schulze, T., Nickerson, R. C., & Schader, M. (2011) Managing the crowd: Towards a taxonomy of crowdsourcing processes. In Americas conference on information systems, Detroit, Michigan, August 4–8 2011 (Paper 430).

  • Goldschmidt, G. (1997). Capturing indeterminism: Representation in the design problem space. Design Studies, 18(4), 441–455. doi:10.1016/S0142-694X(97)00011-2.

    Article  Google Scholar 

  • Haymaker, J., Keel, P., Ackermann, E., & Porter, W. (2000). Filter mediated design: Generating coherence in collaborative design. Design Studies, 21(2), 205–220.

    Article  Google Scholar 

  • Howe, J. (2006a). Crowdsourcing: A definition. Crowdsourcing: Tracking the rise of the amateur. http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html.

  • Howe, J. (2006b). The rise of crowdsourcing. Wired Magazine, 14(6), 1–4.

    Google Scholar 

  • Jain, R. (2010). Investigation of governance mechanisms for crowdsourcing initiatives. In Americas conference on information systems, Lima, Peru, August 12–15 2010 (Paper 557).

  • Kittur, A., Nickerson, J. V., Bernstein, M., Gerber, E., Shaw, A., Zimmerman, J., et al. (2013). The future of crowd work. Paper presented at the the 16th ACM conference on computer supported cooperative work and social computing, San Antonio, USA, February 23–27.

  • Kudrowitz, B., Te, P., & Wallace, D. (2012). The influence of sketch quality on perception of product-idea creativity. AI EDAM, 26(Special Issue 03), 267–279. doi:10.1017/S0890060412000145.

  • Kudrowitz, B., & Wallace, D. (2013). Assessing the quality of ideas from prolific, early-stage product ideation. Journal of Engineering Design, 24(2), 120–139.

    Article  Google Scholar 

  • Lehoux, P., Hivon, M., Williams-Jones, B., & Urbach, D. (2011). The worlds and modalities of engagement of design participants: A qualitative case study of three medical innovations. Design Studies, 32(4), 313–332.

    Article  Google Scholar 

  • Linsey, J. S., Clauss, E. F., Kurtoglu, T., Murphy, J. T., Wood, K. L., & Markman, A. B. (2011). An experimental study of group idea generation techniques: Understanding the roles of idea representation and viewing methods. Journal of Mechanical Design, 133(3). doi:10.1115/1.4003498.

  • Malone, T., Laubacher, R., & Dellarocas, C. (2009). Harnessing crowds: Mapping the genome of collective intelligence. Research Paper No. 4732-09, MIT.

  • Morris, R. R., Dontcheva, M., Finkelstein, A., & Gerber, E. (2013). Affect and creative performance on crowdsourcing platforms. In Affective computing and intelligent interaction (ACII), 2013 humaine association conference on, 2013 (pp. 67–72), IEEE.

  • Nelson, B. A., Wilson, J. O., Rosen, D., & Yen, J. (2009). Refined metrics for measuring ideation effectiveness. Design Studies, 30(6), 737–743. doi:10.1016/j.destud.2009.07.002.

    Article  Google Scholar 

  • Nickerson, J., & Sakamoto, Y. (2010). Crowdsourcing creativity: Combining ideas in networks. In Workshop on information in networks, New York, USA, September 24–25 2010.

  • Oman, S. K., Tumer, I. Y., Wood, K., & Seepersad, C. (2013). A comparison of creativity and innovation metrics and sample validation through in-class design projects. Research in Engineering Design, 24(1), 65–92.

    Article  Google Scholar 

  • Pache, M. W. (2005). Sketching for conceptual design. Empirical results and future tools. Munich: Technischen Universität München.

    Google Scholar 

  • Pahl, G., Wallace, K., & Blessing, L. T. M. (2007). Engineering design: A systematic approach. Berlin: Springer.

    Book  Google Scholar 

  • Pei, E. (2009). Building a common language of design representations for industrial designers & engineering designers. Loughborough: Loughborough University.

    Google Scholar 

  • Raaijmakers, J. G., & Shiffrin, R. M. (1981). Search of associative memory. Psychological Review, 88(2), 93–134. doi:10.1037/0033-295X.88.2.93.

    Article  Google Scholar 

  • Restrepo, J., & Christiaans, H. (2004). Problem structuring and information access in design. Journal of Design Research, 4(2), 1551–1569.

    Article  Google Scholar 

  • Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003). Metrics for measuring ideation effectiveness. Design Studies, 24(2), 111–134. doi:10.1016/S0142-694X(02)00034-0.

    Article  Google Scholar 

  • Shah, J. J., Vargas-Hernandez, N., Summers, J. D., & Kulkarni, S. (2001). Collaborative sketching (C-Sketch)—An idea generation technique for engineering design. The Journal of Creative Behavior, 35(3), 168–198.

    Article  Google Scholar 

  • Sim, S. K., & Duffy, A. H. (2003). Towards an ontology of generic engineering design activities. Research in Engineering Design, 14(4), 200–223.

    Article  Google Scholar 

  • Sun, L., Xiang, W., Chai, C., Wang, C., & Huang, Q. (2014). Creative segment: A descriptive theory applied to computer-aided sketching. Design Studies, 35(1), 54–79. doi:10.1016/j.destud.2013.10.003.

    Article  Google Scholar 

  • Suwa, M., Gero, J. S., & Purcell, T. A. (1998). The roles of sketches in early conceptual design processes In Proceedings of the twentieth annual conference of the Cognitive Science Society.

  • Suwa, M., Gero, J., & Purcell, T. (2000). Unexpected discoveries and S-invention of design requirements: Important vehicles for a design process. Design Studies, 21(6), 539–567.

    Article  Google Scholar 

  • Taura, T., Yamamoto, E., Fasiha, M. Y. N., Goka, M., Mukai, F., Nagai, Y., et al. (2012). Constructive simulation of creative concept generation process in design: A research method for difficult-to-observe design-thinking processes. Journal of Engineering Design, 23(4), 297–321.

    Article  Google Scholar 

  • Temple, S. (1994). Thought made visible: The value of sketching. Co-Design Journal, 1, 16–25.

    Google Scholar 

  • Tidball, B., Mulder, I., & Stappers, P. J. (2011). Online design contests: A network of inspiration for designers. Paper presented at the proceedings of the 4th world conference on design research, IASDR, 2011, Delft, The Netherlands, October 31–November 4.

  • Wooten, J., & Ulrich, K. (2011). Idea generation and the role of feedback: Evidence from field experiments with innovation tournaments. Available at SSRN 1838733.

  • Yu, L., & Nickerson, J. V. (2011). Cooks or cobblers? Crowd creativity through combination. In Proceedings of the SIGCHI conference on human factors in computing systems, 2011 (pp. 1393–1402), ACM.

Download references

Acknowledgments

This paper is supported by the National Natural Science Foundation of China (61004116) and the Zhejiang Provincial Natural Science Foundation of China (LY13E050005, LY13F030002).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shi Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, L., Xiang, W., Chen, S. et al. Collaborative sketching in crowdsourcing design: a new method for idea generation. Int J Technol Des Educ 25, 409–427 (2015). https://doi.org/10.1007/s10798-014-9283-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10798-014-9283-y

Keywords

Navigation