Top

Published in:

2021 | OriginalPaper | Chapter

Co-creative Drawing with One-Shot Generative Models

Authors : Sabine Wieluch, Friedhelm Schwenker

Published in: Artificial Intelligence in Music, Sound, Art and Design

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper presents and evaluates co-creative drawing scenarios in which a user is asked to provide a small hand-drawn pattern which then is interactively extended with the support of a trained neural model. We show that it is possible to use one-shot trained Transformer Neural Networks to generate stroke-based images and that these trained models can successfully be used for design assisting tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter A Swarm Grammar-Based Approach to Virtual World Generation

Carlier, A., Danelljan, M., Alahi, A., Timofte, R.: Deepsvg: A hierarchical generative network for vector graphics animation (2020)

Carroll, E.A., Latulipe, C.: The creativity support index. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. p. 4009–4014. CHI EA ’09, Association for Computing Machinery, New York, NY, USA (2009). https://doi.org/10.1145/1520340.1520609

Davis, N., Hsiao, C.P., Yashraj Singh, K., Li, L., Magerko, B.: Empirically studying participatory sense-making in abstract drawing with a co-creative cognitive agent. In: Proceedings of the 21st International Conference on Intelligent User Interfaces. p. 196–207. IUI ’16, Association for Computing Machinery, New York, NY, USA (2016). https://doi.org/10.1145/2856767.2856795

Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

Fan, J.E., Dinculescu, M., Ha, D.: Collabdraw: An environment for collaborative sketching with an artificial agent. In: Proceedings of the 2019 on Creativity and Cognition. p. 556–561. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3325480.3326578

Fish, J., Scrivener, S.: Amplifying the mind’s eye: sketching and visual cognition. Leonardo 23(1), 117–126 (1990)CrossRef

Ha, D., Eck, D.: A neural representation of sketch drawings. arXiv preprint arXiv:1704.03477 (2017)

Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

Levy, O., Goldberg, Y.: Neural word embedding as implicit matrix factorization. In: Advances in neural information processing systems. pp. 2177–2185 (2014)

10.

Lin, Y., Guo, J., Chen, Y., Yao, C., Ying, F.: It is your turn: Collaborative ideation with a co-creative robot through sketch. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. p. 1–14. CHI ’20, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3313831.3376258

11.

Macedo, L., Cardoso, A.: Assessing creativity: the importance of unexpected novelty. Structure 1(C2), C3 (2002)

12.

Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I.: Language models are unsupervised multitask learners. OpenAI Blog 1(8), 9 (2019)

13.

Salomon, D.: Curves and surfaces for computer graphics. Springer Science & Business Media (2007)

14.

Schneider, P.J.: An algorithm for automatically fitting digitized curves. In: Graphics gems. pp. 612–626. Academic Press Professional, Inc. (1990)

15.

Serban, I.V., Sordoni, A., Lowe, R., Charlin, L., Pineau, J., Courville, A., Bengio, Y.: A hierarchical latent variable encoder-decoder model for generating dialogues. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)

16.

Shaham, T.R., Dekel, T., Michaeli, T.: Singan: Learning a generative model from a single natural image. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 4570–4580 (2019)

17.

Shneiderman, B.: Creativity support tools: Accelerating discovery and innovation. Communications of the ACM 50(12), 20–32 (2007)CrossRef

18.

Suwa, M., Gero, J.S., Purcell, T.: The roles of sketches in early conceptual design processes. In: Proceedings of Twentieth Annual Meeting of the Cognitive Science Society. pp. 1043–1048. Lawrence Erlbaum Hillsdale, New Jersey (1998)

19.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. In: Advances in neural information processing systems. pp. 5998–6008 (2017)

20.

Voita, E., Talbot, D., Moiseev, F., Sennrich, R., Titov, I.: Analyzing multi-head self-attention: Specialized heads do the heavy lifting, the rest can be pruned. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. pp. 5797–5808. Association for Computational Linguistics, Florence, Italy (Jul 2019). https://doi.org/10.18653/v1/P19-1580, https://www.aclweb.org/anthology/P19-1580

21.

Wang, J., He, Y., Tian, H., Cai, H.: Retrieving 3d cad model by freehand sketches for design reuse. Advanced Engineering Informatics 22(3), 385–392 (2008)CrossRef

22.

Wieluch, S., Schwenker, F.: Strokecoder: Path-based image generation from single examples using transformers (2020)

23.

Xu, P., Joshi, C.K., Bresson, X.: Multi-graph transformer for free-hand sketch recognition. arXiv preprint arXiv:1912.11258 (2019)

24.

Xu, P., Song, Z., Yin, Q., Song, Y.Z., Wang, L.: Deep self-supervised representation learning for free-hand sketch. arXiv preprint arXiv:2002.00867 (2020)

Title: Co-creative Drawing with One-Shot Generative Models
Authors: Sabine Wieluch
Friedhelm Schwenker
Publisher: Springer International Publishing
Book: Artificial Intelligence in Music, Sound, Art and Design
Print ISBN: 978-3-030-72913-4

Electronic ISBN: 978-3-030-72914-1

Copyright Year: 2021
DOI: https://doi.org/10.1007/978-3-030-72914-1_31

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner