Skip to main content
Erschienen in: Arabian Journal for Science and Engineering 8/2023

03.03.2023 | Research Article-Computer Engineering and Computer Science

An Interactive Floor Plan Image Retrieval Framework Based on Structural Features

verfasst von: Rasika Khade, Krupa Jariwala, Chiranjoy Chattopadhyay

Erschienen in: Arabian Journal for Science and Engineering | Ausgabe 8/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

To build a house, buyers meet with an architect, who analyses the land’s built-up area and creates a development blueprint. Customers may have different perspectives on their residence. As a result, in order to save architects’ time and provide an appropriate floor plan to the customer, we presented an interactive framework that allows the client to change existing designs and search for similar ones in a repository. To do this, we created a vocabulary of annotations for inserting new items, deleting existing objects, shifting the position of objects, and moving the locations of objects. The proposed framework accepts a digital form of a printed floor plan image with or without hand-drawn annotations as a query, then performs suggested editing operations and converts the image to standard form by identifying annotations. The retrieval model then analyses the processed image and provides further recommendations similar to the query floor plan image. Our contributions include (1) an interactive platform for updating an existing floor plan based on predefined vocabulary of annotations, and (2) a unique structure-based features for retrieving similar floor plans with a \(10\%\) improvement in mAP score. The suggested framework’s performance was examined using publicly available datasets, and it obtained 0.85 mAP which edge over existing state-of-the-art approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hilbert, M.; López, P.: The world’s technological capacity to store communicate and compute information. Science 332(6025), 60–65 (2011)CrossRef Hilbert, M.; López, P.: The world’s technological capacity to store communicate and compute information. Science 332(6025), 60–65 (2011)CrossRef
2.
Zurück zum Zitat Zapel, E.: Floor Plan Manual Housing. Birkhäuser, (2017) Zapel, E.: Floor Plan Manual Housing. Birkhäuser, (2017)
3.
Zurück zum Zitat Sharma, D.; Chattopadhyay, C.; Harit, G.: A unified framework for semantic matching of architectural floorplans. In: 2016 23rd international conference on pattern recognition (ICPR), pp. 2422–2427, IEEE (2016) Sharma, D.; Chattopadhyay, C.; Harit, G.: A unified framework for semantic matching of architectural floorplans. In: 2016 23rd international conference on pattern recognition (ICPR), pp. 2422–2427, IEEE (2016)
4.
Zurück zum Zitat Sharma, D.; Gupta, N.; Chattopadhyay, C.; Mehta, S.: Daniel: a deep architecture for automatic analysis and retrieval of building floor plans. In: 2017 14th IAPR international conference on document analysis and recognition (ICDAR), vol. 1, pp. 420–425, IEEE (2017) Sharma, D.; Gupta, N.; Chattopadhyay, C.; Mehta, S.: Daniel: a deep architecture for automatic analysis and retrieval of building floor plans. In: 2017 14th IAPR international conference on document analysis and recognition (ICDAR), vol. 1, pp. 420–425, IEEE (2017)
5.
Zurück zum Zitat Sharma, D.; Chattopadhyay, C.: High-level feature aggregation for fine-grained architectural floor plan retrieval. IET Comput. Vis. 12(5), 702–709 (2018)CrossRef Sharma, D.; Chattopadhyay, C.: High-level feature aggregation for fine-grained architectural floor plan retrieval. IET Comput. Vis. 12(5), 702–709 (2018)CrossRef
6.
Zurück zum Zitat Goyal, S.; Bhavsar, S.; Patel, S.; Chattopadhyay, C.; Bhatnagar, G.: Sugaman: describing floor plans for visually impaired by annotation learning and proximity-based grammar. IET Image Process. 13(13), 2623–2635 (2019)CrossRef Goyal, S.; Bhavsar, S.; Patel, S.; Chattopadhyay, C.; Bhatnagar, G.: Sugaman: describing floor plans for visually impaired by annotation learning and proximity-based grammar. IET Image Process. 13(13), 2623–2635 (2019)CrossRef
7.
Zurück zum Zitat Yamada, M.; Wang, X.; Yamasaki, T.: Graph structure extraction from floor plan images and its application to similar property retrieval. In: 2021 IEEE international conference on consumer electronics (ICCE), pp. 1–5, IEEE (2021) Yamada, M.; Wang, X.; Yamasaki, T.: Graph structure extraction from floor plan images and its application to similar property retrieval. In: 2021 IEEE international conference on consumer electronics (ICCE), pp. 1–5, IEEE (2021)
8.
Zurück zum Zitat Lee, P.K.; Stenger, B.: Shape-based floor plan retrieval using parse tree matching. In: 2021 17th international conference on machine vision and applications (MVA), pp. 1–5, IEEE (2021) Lee, P.K.; Stenger, B.: Shape-based floor plan retrieval using parse tree matching. In: 2021 17th international conference on machine vision and applications (MVA), pp. 1–5, IEEE (2021)
9.
Zurück zum Zitat Takada, Y.; Inoue, N.; Yamasaki, T.; Aizawa, K.: Similar floor plan retrieval featuring multi-task learning of layout type classification and room presence prediction. In: 2018 IEEE international conference on consumer electronics (ICCE), pp. 1–6, IEEE (2018) Takada, Y.; Inoue, N.; Yamasaki, T.; Aizawa, K.: Similar floor plan retrieval featuring multi-task learning of layout type classification and room presence prediction. In: 2018 IEEE international conference on consumer electronics (ICCE), pp. 1–6, IEEE (2018)
10.
Zurück zum Zitat Mewada, H.K.; Patel, A.V.; Chaudhari, J.; Mahant, K.; Vala, A.: Automatic room information retrieval and classification from floor plan using linear regression model. Int. J. Doc. Anal. Recognit. (IJDAR) 23(4), 253–266 (2020)CrossRef Mewada, H.K.; Patel, A.V.; Chaudhari, J.; Mahant, K.; Vala, A.: Automatic room information retrieval and classification from floor plan using linear regression model. Int. J. Doc. Anal. Recognit. (IJDAR) 23(4), 253–266 (2020)CrossRef
11.
Zurück zum Zitat Khade, R.; Jariwala, K.; Chattopadhyay, C.; Pal, U.: A rotation and scale invariant approach for multi-oriented floor plan image retrieval. Patt. Recognit. Lett. 145, 1–7 (2021)CrossRef Khade, R.; Jariwala, K.; Chattopadhyay, C.; Pal, U.: A rotation and scale invariant approach for multi-oriented floor plan image retrieval. Patt. Recognit. Lett. 145, 1–7 (2021)CrossRef
12.
Zurück zum Zitat Thomee, B.; Lew, M.S.: Interactive search in image retrieval: a survey. Int. J. Multimed. Inf. Retr. 1(2), 71–86 (2012)CrossRef Thomee, B.; Lew, M.S.: Interactive search in image retrieval: a survey. Int. J. Multimed. Inf. Retr. 1(2), 71–86 (2012)CrossRef
13.
Zurück zum Zitat Salau, A.O.; Jain, S.: Feature extraction: a survey of the types, techniques, applications. In: 2019 international conference on signal processing and communication (ICSC), pp. 158–164, IEEE (2019) Salau, A.O.; Jain, S.: Feature extraction: a survey of the types, techniques, applications. In: 2019 international conference on signal processing and communication (ICSC), pp. 158–164, IEEE (2019)
14.
Zurück zum Zitat Jian, M.; Yin, Y.; Dong, J.; Lam, K.-M.: Content-based image retrieval via a hierarchical-local-feature extraction scheme. Multimed. Tools Appl. 77(21), 29099–29117 (2018)CrossRef Jian, M.; Yin, Y.; Dong, J.; Lam, K.-M.: Content-based image retrieval via a hierarchical-local-feature extraction scheme. Multimed. Tools Appl. 77(21), 29099–29117 (2018)CrossRef
15.
Zurück zum Zitat Sharma, D.; Harit, G.; Chattopadhyay, C.: Attributed paths for layout-based document retrieval. In: Workshop on document analysis and recognition, pp. 15–26, Springer (2018) Sharma, D.; Harit, G.; Chattopadhyay, C.: Attributed paths for layout-based document retrieval. In: Workshop on document analysis and recognition, pp. 15–26, Springer (2018)
16.
Zurück zum Zitat Kumar, A.; Choudhary, S.; Khokhar, V.S.; Meena, V.; Chattopadhyay, C.: Automatic feature weight determination using indexing and pseudo-relevance feedback for multi-feature content-based image retrieval. arXiv preprint arXiv:1812.04215 (2018) Kumar, A.; Choudhary, S.; Khokhar, V.S.; Meena, V.; Chattopadhyay, C.: Automatic feature weight determination using indexing and pseudo-relevance feedback for multi-feature content-based image retrieval. arXiv preprint arXiv:​1812.​04215 (2018)
17.
Zurück zum Zitat Nandy Pal, M.; Roy, S.; Banerjee, M.: Content based retrieval of retinal oct scans using twin cnn. Sādhanā 46(3), 1–14 (2021)MathSciNetCrossRef Nandy Pal, M.; Roy, S.; Banerjee, M.: Content based retrieval of retinal oct scans using twin cnn. Sādhanā 46(3), 1–14 (2021)MathSciNetCrossRef
18.
Zurück zum Zitat Chattopadhyay, C.; Maurya, A.K.: Genre-specific modeling of visual features for efficient content based video shot classification and retrieval. Int. J. Multimed. Inf. Retr. 2(4), 289–297 (2013)CrossRef Chattopadhyay, C.; Maurya, A.K.: Genre-specific modeling of visual features for efficient content based video shot classification and retrieval. Int. J. Multimed. Inf. Retr. 2(4), 289–297 (2013)CrossRef
19.
Zurück zum Zitat Poornima, N.; Saleena, B.: An automated approach to retrieve lecture videos using context based semantic features and deep learning. Sādhanā 45(1), 1–11 (2020)CrossRef Poornima, N.; Saleena, B.: An automated approach to retrieve lecture videos using context based semantic features and deep learning. Sādhanā 45(1), 1–11 (2020)CrossRef
20.
Zurück zum Zitat Sharma, D.; Gupta, N.; Chattopadhyay, C.; Mehta, S.: A novel feature transform framework using deep neural network for multimodal floor plan retrieval. Int. J. Doc. Anal. Recognit. (IJDAR) 22(4), 417–429 (2019)CrossRef Sharma, D.; Gupta, N.; Chattopadhyay, C.; Mehta, S.: A novel feature transform framework using deep neural network for multimodal floor plan retrieval. Int. J. Doc. Anal. Recognit. (IJDAR) 22(4), 417–429 (2019)CrossRef
21.
Zurück zum Zitat Nakazato, M.; Manola, L.; Huang, T.S.: Group-based interface for content-based image retrieval. In: Proceedings of the working conference on advanced visual interfaces, pp. 187–194 (2002) Nakazato, M.; Manola, L.; Huang, T.S.: Group-based interface for content-based image retrieval. In: Proceedings of the working conference on advanced visual interfaces, pp. 187–194 (2002)
22.
Zurück zum Zitat Zheng, L.; Wetzel, A.W.; Yagi, Y.; Becich, M.J.: A graphical user interface for content-based image retrieval engine that allows remote server access through the internet. In: Proceedings of the AMIA symposium, p. 1108, American Medical Informatics Association (1998) Zheng, L.; Wetzel, A.W.; Yagi, Y.; Becich, M.J.: A graphical user interface for content-based image retrieval engine that allows remote server access through the internet. In: Proceedings of the AMIA symposium, p. 1108, American Medical Informatics Association (1998)
23.
Zurück zum Zitat Manipoonchelvi, P.; Muneeswaran, K.: Multi region based image retrieval system. Sadhana 39(2), 333–344 (2014)CrossRefMATH Manipoonchelvi, P.; Muneeswaran, K.: Multi region based image retrieval system. Sadhana 39(2), 333–344 (2014)CrossRefMATH
24.
Zurück zum Zitat Hua, J.-Z.; Liu, G.-H.; Song, S.-X.: Content-based image retrieval using color volume histograms. Int. J. Patt. Recognit. Artif. Intell. 33(11), 1940010 (2019)CrossRef Hua, J.-Z.; Liu, G.-H.; Song, S.-X.: Content-based image retrieval using color volume histograms. Int. J. Patt. Recognit. Artif. Intell. 33(11), 1940010 (2019)CrossRef
25.
Zurück zum Zitat Deserno, T.M.; Güld, M.O.; Plodowski, B.; Spitzer, K.; Wein, B.B.; Schubert, H.; Ney, H.; Seidl, T.: Extended query refinement for medical image retrieval. J. Digit. Imaging 21(3), 280–289 (2008)CrossRef Deserno, T.M.; Güld, M.O.; Plodowski, B.; Spitzer, K.; Wein, B.B.; Schubert, H.; Ney, H.; Seidl, T.: Extended query refinement for medical image retrieval. J. Digit. Imaging 21(3), 280–289 (2008)CrossRef
26.
Zurück zum Zitat Pečenovió, Z.; Do, M.N.; Vetterli, M.; Pu, P.: Integrated browsing and searching of large image collections. In: International conference on advances in visual information systems, pp. 279–289, Springer (2000) Pečenovió, Z.; Do, M.N.; Vetterli, M.; Pu, P.: Integrated browsing and searching of large image collections. In: International conference on advances in visual information systems, pp. 279–289, Springer (2000)
27.
Zurück zum Zitat Jian, M.; Jung, C.; Shen, Y.; Liu, J.: Interactive image retrieval using constraints. Neurocomputing 161, 210–219 (2015)CrossRef Jian, M.; Jung, C.; Shen, Y.; Liu, J.: Interactive image retrieval using constraints. Neurocomputing 161, 210–219 (2015)CrossRef
28.
Zurück zum Zitat Chattopadhyay, C.; Das, S.: A motion-sketch based video retrieval using mst-css representation. In: 2012 IEEE international symposium on multimedia, pp. 376–377, IEEE (2012) Chattopadhyay, C.; Das, S.: A motion-sketch based video retrieval using mst-css representation. In: 2012 IEEE international symposium on multimedia, pp. 376–377, IEEE (2012)
29.
Zurück zum Zitat Bui, T.; Ribeiro, L.; Ponti, M.; Collomosse, J.: Sketching out the details: sketch-based image retrieval using convolutional neural networks with multi-stage regression. Comput. Graph. 71, 77–87 (2018)CrossRef Bui, T.; Ribeiro, L.; Ponti, M.; Collomosse, J.: Sketching out the details: sketch-based image retrieval using convolutional neural networks with multi-stage regression. Comput. Graph. 71, 77–87 (2018)CrossRef
30.
Zurück zum Zitat Gonçalves, F.M.F.; Guilherme, I.R.; Pedronette, D.C.G.: Semantic guided interactive image retrieval for plant identification. Exp. Syst. Appl. 91, 12–26 (2018)CrossRef Gonçalves, F.M.F.; Guilherme, I.R.; Pedronette, D.C.G.: Semantic guided interactive image retrieval for plant identification. Exp. Syst. Appl. 91, 12–26 (2018)CrossRef
31.
Zurück zum Zitat Wang, Y.; Huang, F.; Zhang, Y.; Feng, R.; Zhang, T.; Fan, W.: Deep cascaded cross-modal correlation learning for fine-grained sketch-based image retrieval. Patt. Recognit. 100, 107148 (2020)CrossRef Wang, Y.; Huang, F.; Zhang, Y.; Feng, R.; Zhang, T.; Fan, W.: Deep cascaded cross-modal correlation learning for fine-grained sketch-based image retrieval. Patt. Recognit. 100, 107148 (2020)CrossRef
32.
Zurück zum Zitat Xu, P.; Yin, Q.; Huang, Y.; Song, Y.-Z.; Ma, Z.; Wang, L.; Xiang, T.; Kleijn, W.B.; Guo, J.: Cross-modal subspace learning for fine-grained sketch-based image retrieval. Neurocomputing 278, 75–86 (2018)CrossRef Xu, P.; Yin, Q.; Huang, Y.; Song, Y.-Z.; Ma, Z.; Wang, L.; Xiang, T.; Kleijn, W.B.; Guo, J.: Cross-modal subspace learning for fine-grained sketch-based image retrieval. Neurocomputing 278, 75–86 (2018)CrossRef
33.
Zurück zum Zitat Zhou, X.M.; Ang, C.H.; Ling, T.W.: Indexing for multipoint interactive similarity retrieval in iconic spatial image databases. J. Vis. Lang. Comput. 19(1), 24–38 (2008)CrossRef Zhou, X.M.; Ang, C.H.; Ling, T.W.: Indexing for multipoint interactive similarity retrieval in iconic spatial image databases. J. Vis. Lang. Comput. 19(1), 24–38 (2008)CrossRef
34.
Zurück zum Zitat Zeng, L.; Dong, Z.-K.; Yu, J.-Y.; Hong, J.; Wang, H.-Y.: Sketch-based retrieval and instantiation of parametric parts. Comput.-Aid. Des. 113, 82–95 (2019) Zeng, L.; Dong, Z.-K.; Yu, J.-Y.; Hong, J.; Wang, H.-Y.: Sketch-based retrieval and instantiation of parametric parts. Comput.-Aid. Des. 113, 82–95 (2019)
35.
Zurück zum Zitat Chugh, H.; Gupta, S.; Garg, M.; Gupta, D.; Mohamed, H.G.; Noya, I.D.; Singh, A.; Goyal, N.: An image retrieval framework design analysis using saliency structure and color difference histogram. Sustainability 14(16), 10357 (2022)CrossRef Chugh, H.; Gupta, S.; Garg, M.; Gupta, D.; Mohamed, H.G.; Noya, I.D.; Singh, A.; Goyal, N.: An image retrieval framework design analysis using saliency structure and color difference histogram. Sustainability 14(16), 10357 (2022)CrossRef
36.
Zurück zum Zitat Hasija, T.; Kadyan, V.; Guleria, K.; Alharbi, A.; Alyami, H.; Goyal, N.: Prosodic feature-based discriminatively trained low resource speech recognition system. Sustainability 14(2), 614 (2022)CrossRef Hasija, T.; Kadyan, V.; Guleria, K.; Alharbi, A.; Alyami, H.; Goyal, N.: Prosodic feature-based discriminatively trained low resource speech recognition system. Sustainability 14(2), 614 (2022)CrossRef
37.
Zurück zum Zitat Abdulhussain, S.H.; Mahmmod, B.M.; Baker, T.; Al-Jumeily, D.: Fast and accurate computation of high-order tchebichef polynomials. Concurr. Comput.: Pract. Exp. 34(27), 7311 (2022)CrossRef Abdulhussain, S.H.; Mahmmod, B.M.; Baker, T.; Al-Jumeily, D.: Fast and accurate computation of high-order tchebichef polynomials. Concurr. Comput.: Pract. Exp. 34(27), 7311 (2022)CrossRef
38.
Zurück zum Zitat Mahmmod, B.M.; Abdulhussain, S.H.; Suk, T.; Hussain, A.: Fast computation of hahn polynomials for high order moments. IEEE Access 10, 48719–48732 (2022)CrossRef Mahmmod, B.M.; Abdulhussain, S.H.; Suk, T.; Hussain, A.: Fast computation of hahn polynomials for high order moments. IEEE Access 10, 48719–48732 (2022)CrossRef
39.
Zurück zum Zitat Anderson, L.K.: Handbook for Proofreading. NTC business books (1990) Anderson, L.K.: Handbook for Proofreading. NTC business books (1990)
40.
Zurück zum Zitat Johnson, J.E.; Sundaresan, S.; Daylan, T.; Gavilan, L.; Giles, D.K.; Silva, S.I.; Jungbluth, A.; Morris, B.; Muñoz-Jaramillo, A.: Rotnet: fast and scalable estimation of stellar rotation periods using convolutional neural networks. arXiv preprint arXiv:2012.01985 (2020) Johnson, J.E.; Sundaresan, S.; Daylan, T.; Gavilan, L.; Giles, D.K.; Silva, S.I.; Jungbluth, A.; Morris, B.; Muñoz-Jaramillo, A.: Rotnet: fast and scalable estimation of stellar rotation periods using convolutional neural networks. arXiv preprint arXiv:​2012.​01985 (2020)
41.
Zurück zum Zitat Park, D.K.; Jeon, Y.S.; Won, C.S.: Efficient use of local edge histogram descriptor. In: Proceedings of the 2000 ACM workshops on multimedia, pp. 51–54 (2000) Park, D.K.; Jeon, Y.S.; Won, C.S.: Efficient use of local edge histogram descriptor. In: Proceedings of the 2000 ACM workshops on multimedia, pp. 51–54 (2000)
42.
Zurück zum Zitat Chechik, G.; Shalit, U.; Sharma, V.; Bengio, S.: An online algorithm for large scale image similarity learning. In: NIPS, pp. 306–314 (2009) Chechik, G.; Shalit, U.; Sharma, V.; Bengio, S.: An online algorithm for large scale image similarity learning. In: NIPS, pp. 306–314 (2009)
43.
Zurück zum Zitat Lazebnik, S.; Schmid, C.; Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol. 2, pp. 2169–2178, IEEE (2006) Lazebnik, S.; Schmid, C.; Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol. 2, pp. 2169–2178, IEEE (2006)
Metadaten
Titel
An Interactive Floor Plan Image Retrieval Framework Based on Structural Features
verfasst von
Rasika Khade
Krupa Jariwala
Chiranjoy Chattopadhyay
Publikationsdatum
03.03.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Arabian Journal for Science and Engineering / Ausgabe 8/2023
Print ISSN: 2193-567X
Elektronische ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-023-07672-5

Weitere Artikel der Ausgabe 8/2023

Arabian Journal for Science and Engineering 8/2023 Zur Ausgabe

Research Article-Computer Engineering and Computer Science

Anomaly Detection of Breast Cancer Using Deep Learning

RESEARCH ARTICLE - SPECIAL ISSUE - AI based health-related Computing for COVID-19 (AIHRC)

Correlation-Based Analysis of COVID-19 Virus Genome Versus Other Fatal Virus Genomes

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.