Skip to main content

2018 | OriginalPaper | Buchkapitel

CrowdSheet: An Easy-To-Use One-Stop Tool for Writing and Executing Complex Crowdsourcing

verfasst von : Rikuya Suzuki, Tetsuo Sakaguchi, Masaki Matsubara, Hiroyuki Kitagawa, Atsuyuki Morishima

Erschienen in: Advanced Information Systems Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Developing crowdsourcing applications with dataflows among tasks requires requesters to submit tasks to crowdsourcing services, obtain results, write programs to process the results, and often repeat this process. This paper proposes CrowdSheet, an application that provides a spreadsheet interface to easily write and execute such complex crowdsourcing applications. We prove that a natural extension to existing spreadsheets, with only two types of new spreadsheet functions, allows us to write a fairly wide range of real-world applications. Our experimental results indicate that many spreadsheet users can easily write complex crowdsourcing applications with CrowdSheet.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In our current implementation, TI-functions cannot be combined with other functions in the same cell. However, this is not an essential limitation because expressions in the cell can refer to the results of TI-functions in other cells.
 
2
Each task template is also associated with the payment information for workers.
 
3
CyLog adopts the named perspective [3], which means that the variables and values in each atom are associated with attributes by explicit attribute names, not by their positions.
 
4
Tasks can return more than one value with composite values (omitted owing to lack of space).
 
Literatur
3.
Zurück zum Zitat Abiteboul, S., et al.: Foundations of Databases: The Logical Level, 1st edn. Addison-Wesley Longman Publishing Co., Inc., Boston (1995) Abiteboul, S., et al.: Foundations of Databases: The Logical Level, 1st edn. Addison-Wesley Longman Publishing Co., Inc., Boston (1995)
4.
Zurück zum Zitat von Ahn, L., et al.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004) von Ahn, L., et al.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004)
5.
Zurück zum Zitat Akiki, P., et al.: Crowdsourcing user interface adaptations for minimizing the bloat in enterprise applications. In: Proceedings of ACM SIGCHI 2013, pp. 121–126 (2013) Akiki, P., et al.: Crowdsourcing user interface adaptations for minimizing the bloat in enterprise applications. In: Proceedings of ACM SIGCHI 2013, pp. 121–126 (2013)
6.
Zurück zum Zitat Allahbakhsh, M., et al.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76–81 (2013)CrossRef Allahbakhsh, M., et al.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76–81 (2013)CrossRef
7.
Zurück zum Zitat Artikis, A., et al.: Heterogeneous stream processing and crowdsourcing for urban traffic management. In: Proceedings of EDBT 2014, vol. 14, pp. 712–723 (2014) Artikis, A., et al.: Heterogeneous stream processing and crowdsourcing for urban traffic management. In: Proceedings of EDBT 2014, vol. 14, pp. 712–723 (2014)
8.
Zurück zum Zitat Bernstein, M.S., et al.: Soylent: a word processor with a crowd inside. Commun. ACM 58(8), 85–94 (2015)CrossRef Bernstein, M.S., et al.: Soylent: a word processor with a crowd inside. Commun. ACM 58(8), 85–94 (2015)CrossRef
10.
Zurück zum Zitat Franklin, M., et al.: Crowddb: answering queries with crowdsourcing. In: Proceedings of ACM SIGMOD 2011, pp. 61–72. ACM (2011) Franklin, M., et al.: Crowddb: answering queries with crowdsourcing. In: Proceedings of ACM SIGMOD 2011, pp. 61–72. ACM (2011)
12.
Zurück zum Zitat Hung, N.Q.V., et al.: Erica: expert guidance in validating crowd answers. In: Proceedings of ACM SIGIR 2015, pp. 1037–1038. ACM (2015) Hung, N.Q.V., et al.: Erica: expert guidance in validating crowd answers. In: Proceedings of ACM SIGIR 2015, pp. 1037–1038. ACM (2015)
13.
Zurück zum Zitat Ikeda, K., et al.: Collaborative crowdsourcing with crowd4u. PVLDB 9(13), 1497–1500 (2016) Ikeda, K., et al.: Collaborative crowdsourcing with crowd4u. PVLDB 9(13), 1497–1500 (2016)
14.
Zurück zum Zitat Kittur, A., et al.: Crowdforge: crowdsourcing complex work. In: Proceedings of the 24th Annual ACM UIST, pp. 43–52. ACM (2011) Kittur, A., et al.: Crowdforge: crowdsourcing complex work. In: Proceedings of the 24th Annual ACM UIST, pp. 43–52. ACM (2011)
15.
Zurück zum Zitat Kongdenfha, W., et al.: Rapid development of spreadsheet-based web mashups. In: Proceedings of WWW 2009, pp. 851–860. ACM (2009) Kongdenfha, W., et al.: Rapid development of spreadsheet-based web mashups. In: Proceedings of WWW 2009, pp. 851–860. ACM (2009)
16.
Zurück zum Zitat Lukyanenko, R., et al.: Conceptual modeling principles for crowdsourcing. In: Proceedings of the 1st International Workshop on Multimodal Crowd Sensing, pp. 3–6. ACM (2012) Lukyanenko, R., et al.: Conceptual modeling principles for crowdsourcing. In: Proceedings of the 1st International Workshop on Multimodal Crowd Sensing, pp. 3–6. ACM (2012)
17.
Zurück zum Zitat Lukyanenko, R., et al.: The IQ of the crowd: understanding and improving information quality in structured user-generated content. Inf. Syst. Res. 25(4), 669–689 (2014)MathSciNetCrossRef Lukyanenko, R., et al.: The IQ of the crowd: understanding and improving information quality in structured user-generated content. Inf. Syst. Res. 25(4), 669–689 (2014)MathSciNetCrossRef
19.
20.
Zurück zum Zitat Morishima, A., et al.: Cylog/Game aspect: an approach to separation of concerns in crowdsourced data management. Inf. Syst. 62, 170–184 (2016)CrossRef Morishima, A., et al.: Cylog/Game aspect: an approach to separation of concerns in crowdsourced data management. Inf. Syst. 62, 170–184 (2016)CrossRef
21.
Zurück zum Zitat Park, H., et al.: Deco: a system for declarative crowdsourcing. Proc. VLDB Endow. 5(12), 1990–1993 (2012)CrossRef Park, H., et al.: Deco: a system for declarative crowdsourcing. Proc. VLDB Endow. 5(12), 1990–1993 (2012)CrossRef
22.
Zurück zum Zitat Park, H., et al.: Crowdfill: collecting structured data from the crowd. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, pp. 577–588. ACM (2014) Park, H., et al.: Crowdfill: collecting structured data from the crowd. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, pp. 577–588. ACM (2014)
23.
Zurück zum Zitat Quinn, A.J., et al.: AskSheet: efficient human computation for decision making with spreadsheets. In: Proceedings of CSCW 2014, pp. 1456–1466. ACM (2014) Quinn, A.J., et al.: AskSheet: efficient human computation for decision making with spreadsheets. In: Proceedings of CSCW 2014, pp. 1456–1466. ACM (2014)
24.
Zurück zum Zitat Suzuki, R., et al.: Crowdsheet: instant implementation and out-of-hand execution of complex crowdsourcing. In: Proceedings of ICDE 2018 (2018) Suzuki, R., et al.: Crowdsheet: instant implementation and out-of-hand execution of complex crowdsourcing. In: Proceedings of ICDE 2018 (2018)
25.
Zurück zum Zitat Tyszkiewicz, J.: Spreadsheet as a relational database engine. In: Proceedings of ACM SIGMOD 2010, pp. 195–206. ACM, New York (2010) Tyszkiewicz, J.: Spreadsheet as a relational database engine. In: Proceedings of ACM SIGMOD 2010, pp. 195–206. ACM, New York (2010)
26.
Zurück zum Zitat Yuen, M.C., et al.: A survey of crowdsourcing systems. In: 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), pp. 766–773. IEEE (2011) Yuen, M.C., et al.: A survey of crowdsourcing systems. In: 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), pp. 766–773. IEEE (2011)
Metadaten
Titel
CrowdSheet: An Easy-To-Use One-Stop Tool for Writing and Executing Complex Crowdsourcing
verfasst von
Rikuya Suzuki
Tetsuo Sakaguchi
Masaki Matsubara
Hiroyuki Kitagawa
Atsuyuki Morishima
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91563-0_9