Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 4/2022

26.08.2022 | Regular Paper

Similar interior coordination image retrieval with multi-view features

verfasst von: Ren Togo, Yuki Honma, Maiku Abe, Takahiro Ogawa, Miki Haseyama

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a novel similar image retrieval method for interior coordination. Interior coordination is very familiar; however, it is still an abstract and difficult concept. Even if we are involved in coordination every day, it does not mean we can become professional coordinators. By realizing the retrieval that can provide similar interior coordination images from a query room image, inspiring users’ ideas for interior coordination becomes feasible. In the proposed method, we extract image features specialized for interior coordination and realize similar interior coordination image retrieval. We employ multi-view features: object-based, color-based, and semantic-based features, in the feature extraction phase. The extracted features are used to calculate similarity between the query image and the database images for the retrieval. We conducted experiments using a sophisticated real-world interior coordination image dataset. Furthermore, we qualitatively and quantitatively evaluated the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lu Y (2019) Artificial intelligence: a survey on evolution, models, applications and future trends. J Manag Anal 6(1):1–29 Lu Y (2019) Artificial intelligence: a survey on evolution, models, applications and future trends. J Manag Anal 6(1):1–29
2.
Zurück zum Zitat ur Rehman MH, Yaqoob I, Salah K, Imran M, Jayaraman PP, Perera C (2019) The role of big data analytics in industrial internet of things. Future Gener Comput Syst 99:247–259CrossRef ur Rehman MH, Yaqoob I, Salah K, Imran M, Jayaraman PP, Perera C (2019) The role of big data analytics in industrial internet of things. Future Gener Comput Syst 99:247–259CrossRef
3.
Zurück zum Zitat Marjani M, Nasaruddin F, Gani A, Karim A, Hashem IAT, Siddiqa A, Yaqoob I (2017) Big iot data analytics: architecture, opportunities, and open research challenges. IEEE Access 5:5247–5261CrossRef Marjani M, Nasaruddin F, Gani A, Karim A, Hashem IAT, Siddiqa A, Yaqoob I (2017) Big iot data analytics: architecture, opportunities, and open research challenges. IEEE Access 5:5247–5261CrossRef
4.
Zurück zum Zitat Greco L, Percannella G, Ritrovato P, Tortorella F, Vento M (2020) Trends in iot based solutions for health care: Moving ai to the edge. Pattern Recogn Lett 135:346–353CrossRef Greco L, Percannella G, Ritrovato P, Tortorella F, Vento M (2020) Trends in iot based solutions for health care: Moving ai to the edge. Pattern Recogn Lett 135:346–353CrossRef
5.
Zurück zum Zitat Li S, Da Xu L, Zhao S (2015) The internet of things: a survey. Inf Syst Front 17(2):243–259CrossRef Li S, Da Xu L, Zhao S (2015) The internet of things: a survey. Inf Syst Front 17(2):243–259CrossRef
6.
Zurück zum Zitat Al-Emran M, Malik SI, Al-Kabi MN (2020) A survey of internet of things (iot) in education: opportunities and challenges. Toward social internet of things (SIoT): Enabling technologies, architectures and applications, 197–209 Al-Emran M, Malik SI, Al-Kabi MN (2020) A survey of internet of things (iot) in education: opportunities and challenges. Toward social internet of things (SIoT): Enabling technologies, architectures and applications, 197–209
7.
Zurück zum Zitat Savolainen R (1995) Everyday life information seeking: Approaching information seeking in the context of “way of life.’’. Library Inf Sci Res 17(3):259–294CrossRef Savolainen R (1995) Everyday life information seeking: Approaching information seeking in the context of “way of life.’’. Library Inf Sci Res 17(3):259–294CrossRef
8.
Zurück zum Zitat Gibbs J (2005) Interior design. Laurence King Publishing Gibbs J (2005) Interior design. Laurence King Publishing
9.
Zurück zum Zitat Khanam S, Jang S-W, Paik W (2011) Shape retrieval combining interior and contour descriptors. In: International conference on future generation communication and networking, pp. 120–128 Khanam S, Jang S-W, Paik W (2011) Shape retrieval combining interior and contour descriptors. In: International conference on future generation communication and networking, pp. 120–128
10.
Zurück zum Zitat Liu M, Fang Y, Choulos AG, Park DH, Hu X (2017) Product review summarization through question retrieval and diversification. Inf Retrieval J 20(6):575–605CrossRef Liu M, Fang Y, Choulos AG, Park DH, Hu X (2017) Product review summarization through question retrieval and diversification. Inf Retrieval J 20(6):575–605CrossRef
11.
Zurück zum Zitat Leng J, Ruan G, Jiang P, Xu K, Liu Q, Zhou X, Liu C (2020) Blockchain-empowered sustainable manufacturing and product lifecycle management in industry 4.0: A survey. Renew Sustain Energy Rev 132:110112CrossRef Leng J, Ruan G, Jiang P, Xu K, Liu Q, Zhou X, Liu C (2020) Blockchain-empowered sustainable manufacturing and product lifecycle management in industry 4.0: A survey. Renew Sustain Energy Rev 132:110112CrossRef
12.
Zurück zum Zitat Raanaas RK, Evensen KH, Rich D, Sjøstrøm G, Patil G (2011) Benefits of indoor plants on attention capacity in an office setting. J Environ Psychol 31(1):99–105CrossRef Raanaas RK, Evensen KH, Rich D, Sjøstrøm G, Patil G (2011) Benefits of indoor plants on attention capacity in an office setting. J Environ Psychol 31(1):99–105CrossRef
13.
Zurück zum Zitat Fu Q, Chen X, Wang X, Wen S, Zhou B, Fu H (2017) Adaptive synthesis of indoor scenes via activity-associated object relation graphs. ACM Trans Graph (TOG) 36(6):1–13 Fu Q, Chen X, Wang X, Wen S, Zhou B, Fu H (2017) Adaptive synthesis of indoor scenes via activity-associated object relation graphs. ACM Trans Graph (TOG) 36(6):1–13
14.
Zurück zum Zitat Moares R, Jadhav V, Bagul R, Jacbo R, Rajguru S et al (2019) Inter ar: Interior decor app using augmented reality technology. In: Proceedings of the 5th international conference on cyber security & privacy in communication networks (ICCS), pp. 141–146 Moares R, Jadhav V, Bagul R, Jacbo R, Rajguru S et al (2019) Inter ar: Interior decor app using augmented reality technology. In: Proceedings of the 5th international conference on cyber security & privacy in communication networks (ICCS), pp. 141–146
15.
Zurück zum Zitat Dustdar S, Schreiner W (2005) A survey on web services composition. Int J Web Grid Serv 1(1):1–30CrossRef Dustdar S, Schreiner W (2005) A survey on web services composition. Int J Web Grid Serv 1(1):1–30CrossRef
16.
Zurück zum Zitat Liu M, Zhang K, Zhu J, Wang J, Guo J, Guo Y (2020) Data-driven indoor scene modeling from a single color image with iterative object segmentation and model retrieval. IEEE Trans Visual Comput Graphics 26(4):1702–1715 Liu M, Zhang K, Zhu J, Wang J, Guo J, Guo Y (2020) Data-driven indoor scene modeling from a single color image with iterative object segmentation and model retrieval. IEEE Trans Visual Comput Graphics 26(4):1702–1715
17.
Zurück zum Zitat Yanagi R, Togo R, Ogawa T, Haseyama M (2020) Enhancing cross-modal retrieval based on modality-specific and embedding spaces. IEEE Access 8:96777–96786CrossRef Yanagi R, Togo R, Ogawa T, Haseyama M (2020) Enhancing cross-modal retrieval based on modality-specific and embedding spaces. IEEE Access 8:96777–96786CrossRef
18.
Zurück zum Zitat Shih J-L, Chen H-Y (2009) A 3d model retrieval approach using the interior and exterior 3d shape information. Multimed Tools Appl 43(1):45–62MathSciNetCrossRef Shih J-L, Chen H-Y (2009) A 3d model retrieval approach using the interior and exterior 3d shape information. Multimed Tools Appl 43(1):45–62MathSciNetCrossRef
19.
Zurück zum Zitat Kaothanthong N, Chun J, Tokuyama T (2016) Distance interior ratio: A new shape signature for 2d shape retrieval. Pattern Recogn Lett 78:14–21CrossRef Kaothanthong N, Chun J, Tokuyama T (2016) Distance interior ratio: A new shape signature for 2d shape retrieval. Pattern Recogn Lett 78:14–21CrossRef
20.
Zurück zum Zitat Zhang J (2007) Visualization for information retrieval vol. 23 Zhang J (2007) Visualization for information retrieval vol. 23
21.
Zurück zum Zitat Togo R, Ogawa T, Haseyama M (2021) Interior coordination image retrieval with object-detection-based and color features. In: International workshop on advanced imaging technology (IWAIT) 2021, vol. 11766, p. 1176616 Togo R, Ogawa T, Haseyama M (2021) Interior coordination image retrieval with object-detection-based and color features. In: International workshop on advanced imaging technology (IWAIT) 2021, vol. 11766, p. 1176616
22.
Zurück zum Zitat Daniels I (2015) Feeling at home in contemporary japan: Space, atmosphere and intimacy. Emot Space Soc 15:47–55CrossRef Daniels I (2015) Feeling at home in contemporary japan: Space, atmosphere and intimacy. Emot Space Soc 15:47–55CrossRef
23.
Zurück zum Zitat Lohr VI, Pearson-Mims CH, Goodwin GK (1996) Interior plants may improve worker productivity and reduce stress in a windowless environment. J Environ Hortic 14(2):97–100CrossRef Lohr VI, Pearson-Mims CH, Goodwin GK (1996) Interior plants may improve worker productivity and reduce stress in a windowless environment. J Environ Hortic 14(2):97–100CrossRef
24.
Zurück zum Zitat Brooker G, Stone S (2010) What is interior design? Rotovision Brooker G, Stone S (2010) What is interior design? Rotovision
25.
Zurück zum Zitat Cho JY, Suh J (2019) Understanding spatial ability in interior design education: 2d-to-3d visualization proficiency as a predictor of design performance. J Inter Des 44(3):141–159 Cho JY, Suh J (2019) Understanding spatial ability in interior design education: 2d-to-3d visualization proficiency as a predictor of design performance. J Inter Des 44(3):141–159
26.
Zurück zum Zitat Sun P, Zhang N, Zuo J, Mao R, Gao X, Duan H (2020) Characterizing the generation and flows of building interior decoration and renovation waste: A case study in shenzhen city. J Clean Prod 260:121077CrossRef Sun P, Zhang N, Zuo J, Mao R, Gao X, Duan H (2020) Characterizing the generation and flows of building interior decoration and renovation waste: A case study in shenzhen city. J Clean Prod 260:121077CrossRef
27.
Zurück zum Zitat Kishi R, Araki A (2020) Importance of indoor environmental quality on human health toward achievement of the sdgs. In: Indoor environmental quality and health risk toward healthier environment for all, pp. 3–18 Kishi R, Araki A (2020) Importance of indoor environmental quality on human health toward achievement of the sdgs. In: Indoor environmental quality and health risk toward healthier environment for all, pp. 3–18
28.
Zurück zum Zitat Nhamo G, Nhemachena C, Nhamo S (2020) Using ict indicators to measure readiness of countries to implement industry 4.0 and the sdgs. Environ Econ Policy Stud 22(2):315–337CrossRef Nhamo G, Nhemachena C, Nhamo S (2020) Using ict indicators to measure readiness of countries to implement industry 4.0 and the sdgs. Environ Econ Policy Stud 22(2):315–337CrossRef
29.
Zurück zum Zitat Ruff CL, Olson MA (2009) The attitudes of interior design students towards sustainability. Int J Technol Des Educ 19(1):67–77CrossRef Ruff CL, Olson MA (2009) The attitudes of interior design students towards sustainability. Int J Technol Des Educ 19(1):67–77CrossRef
30.
Zurück zum Zitat Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: Ideas, influences, and trends of the new age. ACM Comput Surv (Csur) 40(2):1–60CrossRef Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: Ideas, influences, and trends of the new age. ACM Comput Surv (Csur) 40(2):1–60CrossRef
31.
Zurück zum Zitat Yasmin M, Mohsin S, Sharif M (2014) Intelligent image retrieval techniques: a survey. J Appl Res Technol 12(1):87–103CrossRef Yasmin M, Mohsin S, Sharif M (2014) Intelligent image retrieval techniques: a survey. J Appl Res Technol 12(1):87–103CrossRef
32.
Zurück zum Zitat Zhen L, Hu P, Wang X, Peng D (2019) Deep supervised cross-modal retrieval. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 10394–10403 Zhen L, Hu P, Wang X, Peng D (2019) Deep supervised cross-modal retrieval. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 10394–10403
33.
Zurück zum Zitat Wang B, Yang Y, Xu X, Hanjalic A, Shen HT (2017) Adversarial cross-modal retrieval. In: Proceedings of the 25th ACM international conference on multimedia (ACM MM), pp. 154–162 Wang B, Yang Y, Xu X, Hanjalic A, Shen HT (2017) Adversarial cross-modal retrieval. In: Proceedings of the 25th ACM international conference on multimedia (ACM MM), pp. 154–162
34.
Zurück zum Zitat Wei Y, Zhao Y, Lu C, Wei S, Liu L, Zhu Z, Yan S (2016) Cross-modal retrieval with cnn visual features: A new baseline. IEEE Trans Cybern 47(2):449–460 Wei Y, Zhao Y, Lu C, Wei S, Liu L, Zhu Z, Yan S (2016) Cross-modal retrieval with cnn visual features: A new baseline. IEEE Trans Cybern 47(2):449–460
35.
Zurück zum Zitat Yanagi R, Togo R, Ogawa T, Haseyama M (2021) Database-adaptive re-ranking for enhancing cross-modal image retrieval. In: Proceedings of the 29th ACM international conference on multimedia (ACM MM), pp. 3816–3825 Yanagi R, Togo R, Ogawa T, Haseyama M (2021) Database-adaptive re-ranking for enhancing cross-modal image retrieval. In: Proceedings of the 29th ACM international conference on multimedia (ACM MM), pp. 3816–3825
36.
Zurück zum Zitat Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40(1):262–282CrossRefMATH Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40(1):262–282CrossRefMATH
37.
Zurück zum Zitat Gandhani S, Singhal N (2015) Content based image retrieval: survey and comparison of cbir system based on combined features. Int J Signal Process Image Process Pattern Recogn 8(10):155–162 Gandhani S, Singhal N (2015) Content based image retrieval: survey and comparison of cbir system based on combined features. Int J Signal Process Image Process Pattern Recogn 8(10):155–162
38.
Zurück zum Zitat Li Y, Li W (2018) A survey of sketch-based image retrieval. Mach Vis Appl 29(7):1083–1100CrossRef Li Y, Li W (2018) A survey of sketch-based image retrieval. Mach Vis Appl 29(7):1083–1100CrossRef
39.
Zurück zum Zitat Jocher G, Stoken A, Borovec J, NanoCode012, ChristopherSTAN, Changyu, L., Laughing, tkianai, Hogan, A., lorenzomammana, yxNONG, AlexWang1900, Diaconu, L., Marc, wanghaoyang0106, ml5ah, Doug, Ingham, F., Frederik, Guilhen, Hatovix, Poznanski, J., Fang, J., Yu, L., changyu98, Wang, M., Gupta, N., Akhtar, O., PetrDvoracek, Rai, P.: Ultralytics/yolov5: V3.1 - Bug fixes and performance improvements Jocher G, Stoken A, Borovec J, NanoCode012, ChristopherSTAN, Changyu, L., Laughing, tkianai, Hogan, A., lorenzomammana, yxNONG, AlexWang1900, Diaconu, L., Marc, wanghaoyang0106, ml5ah, Doug, Ingham, F., Frederik, Guilhen, Hatovix, Poznanski, J., Fang, J., Yu, L., changyu98, Wang, M., Gupta, N., Akhtar, O., PetrDvoracek, Rai, P.: Ultralytics/yolov5: V3.1 - Bug fixes and performance improvements
40.
Zurück zum Zitat Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Trans Assoc Comput Linguist 5:135–146CrossRef Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Trans Assoc Comput Linguist 5:135–146CrossRef
41.
Zurück zum Zitat Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 4700–4708 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 4700–4708
42.
Zurück zum Zitat Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft COCO: Common objects in context. In: Proceedings of the IEEE European conference on computer vision (ECCV), pp. 740–755 Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft COCO: Common objects in context. In: Proceedings of the IEEE European conference on computer vision (ECCV), pp. 740–755
43.
Zurück zum Zitat Quattoni A, Torralba A (2009) Recognizing indoor scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) Quattoni A, Torralba A (2009) Recognizing indoor scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
44.
Zurück zum Zitat Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI conference on artificial intelligence Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-first AAAI conference on artificial intelligence
45.
Zurück zum Zitat Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the ieee conference on computer vision and pattern recognition (CVPR), pp. 2818–2826 Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the ieee conference on computer vision and pattern recognition (CVPR), pp. 2818–2826
46.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 770–778
47.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556
48.
Zurück zum Zitat Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 1251–1258 Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp. 1251–1258
Metadaten
Titel
Similar interior coordination image retrieval with multi-view features
verfasst von
Ren Togo
Yuki Honma
Maiku Abe
Takahiro Ogawa
Miki Haseyama
Publikationsdatum
26.08.2022
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 4/2022
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-022-00247-4

Weitere Artikel der Ausgabe 4/2022

International Journal of Multimedia Information Retrieval 4/2022 Zur Ausgabe

Premium Partner