Skip to main content
Erschienen in: Machine Vision and Applications 7/2017

30.03.2017 | Special Issue Paper

ISR: indoor shop recognition via user-friendly and efficient fingerprinting on smartphones

verfasst von: Dong Zhao, Huaiyu Xu, Jiaqi An, Liang Liu, Huadong Ma

Erschienen in: Machine Vision and Applications | Ausgabe 7/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Indoor shop recognition can not only help mobile users to quickly recognize a shop to know about the information of interest without needing to enter the shop, but also assist in achieving more accurate user localization in a shopping mall. However, the existing Wi-Fi fingerprint-based approaches or image-based approaches cannot accomplish this goal well due to a huge cost of constructing large-scale fingerprint database and poor accuracy. In order to address these issues, we proposed a user-friendly and efficient fingerprinting method to collect various valuable sensory data with smartphones, which can not only reduce the randomness of fingerprints and the negative impact of pedestrians in image matching, but also be used to derive the user-to-shop distance based on the perspective projection model for assisting in determining an accurate fingerprint searching scope. We also proposed an efficient fingerprint searching and matching method to improve the recognition accuracy. We implemented a prototype system and collected fingerprint datasets in a shopping mall. Extensive experiments demonstrate that our solution achieves promising results in realistic scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Azizyan, M., Constandache, I., Roy Choudhury, R.: Surroundsense: mobile phone localization via ambience fingerprinting. In: Proceedings of ACM MobiCom, pp. 261–272 (2009) Azizyan, M., Constandache, I., Roy Choudhury, R.: Surroundsense: mobile phone localization via ambience fingerprinting. In: Proceedings of ACM MobiCom, pp. 261–272 (2009)
2.
Zurück zum Zitat Bahl, P., Padmanabhan, V.N.: Radar: an in-building RF-based user location and tracking system. In: Proceedings of IEEE INFOCOM, pp. 775–784 (2000) Bahl, P., Padmanabhan, V.N.: Radar: an in-building RF-based user location and tracking system. In: Proceedings of IEEE INFOCOM, pp. 775–784 (2000)
3.
Zurück zum Zitat Chen, D.M., Baatz, G., Koser, K., Tsai, S.S., Vedantham, R., Pylvanainen, T., Roimela, K., Chen, X., Bach, J., Pollefeys, M., et al.: City-scale landmark identification on mobile devices. In: Proceedings of IEEE CVPR, pp. 737–744 (2011) Chen, D.M., Baatz, G., Koser, K., Tsai, S.S., Vedantham, R., Pylvanainen, T., Roimela, K., Chen, X., Bach, J., Pollefeys, M., et al.: City-scale landmark identification on mobile devices. In: Proceedings of IEEE CVPR, pp. 737–744 (2011)
4.
Zurück zum Zitat Chon, Y., Lane, N.D., Li, F., Cha, H., Zhao, F.: Automatically characterizing places with opportunistic crowdsensing using smartphones. In: Proceedings of ACM UbiComp, pp. 481–490 (2012) Chon, Y., Lane, N.D., Li, F., Cha, H., Zhao, F.: Automatically characterizing places with opportunistic crowdsensing using smartphones. In: Proceedings of ACM UbiComp, pp. 481–490 (2012)
5.
Zurück zum Zitat Debnath, H., Borcea, C.: Tagpix: Automatic real-time landscape photo tagging for smartphones. In: Proceedings of IEEE MobilWare, pp. 176–184 (2013) Debnath, H., Borcea, C.: Tagpix: Automatic real-time landscape photo tagging for smartphones. In: Proceedings of IEEE MobilWare, pp. 176–184 (2013)
6.
Zurück zum Zitat Fornaciari, M., Prati, A., Grana, C., Cucchiara, R.: Lightweight sign recognition for mobile devices. In: Proceedings of IEEE ICDSC, pp. 1–6 (2013) Fornaciari, M., Prati, A., Grana, C., Cucchiara, R.: Lightweight sign recognition for mobile devices. In: Proceedings of IEEE ICDSC, pp. 1–6 (2013)
7.
Zurück zum Zitat Gao, G., Zhang, H., Chen, H.: A robust video text extraction and recognition approach using OCR feedback information. In: Proceedings of PCM, pp. 507–517 (2015) Gao, G., Zhang, H., Chen, H.: A robust video text extraction and recognition approach using OCR feedback information. In: Proceedings of PCM, pp. 507–517 (2015)
8.
Zurück zum Zitat Guo, B., Chen, H., Han, Q., Yu, Z., Zhang, D., Wang, Y.: Worker-contributed data utility measurement for visual crowdsensing systems. IEEE Trans. Mob. Comput. (2016). doi:10.1109/MC.2016.2620980 Guo, B., Chen, H., Han, Q., Yu, Z., Zhang, D., Wang, Y.: Worker-contributed data utility measurement for visual crowdsensing systems. IEEE Trans. Mob. Comput. (2016). doi:10.​1109/​MC.​2016.​2620980
9.
Zurück zum Zitat Guo, B., Wang, Z., Yu, Z., Wang, Y., Yen, N.Y., Huang, R., Zhou, X.: Mobile crowd sensing and computing: the review of an emerging human-powered sensing paradigm. ACM Comput. Surv. (CSUR) 48(1), 7 (2015)CrossRef Guo, B., Wang, Z., Yu, Z., Wang, Y., Yen, N.Y., Huang, R., Zhou, X.: Mobile crowd sensing and computing: the review of an emerging human-powered sensing paradigm. ACM Comput. Surv. (CSUR) 48(1), 7 (2015)CrossRef
10.
Zurück zum Zitat Hilsenbeck, S., Bobkov, D., Schroth, G., Huitl, R., Steinbach, E.: Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning. In: Proceedings of ACM UbiComp, pp. 147–158 (2014) Hilsenbeck, S., Bobkov, D., Schroth, G., Huitl, R., Steinbach, E.: Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning. In: Proceedings of ACM UbiComp, pp. 147–158 (2014)
11.
Zurück zum Zitat Hossain, A.M., Jin, Y., Soh, W.S., Van, H.N.: SSD: a robust RF location fingerprint addressing mobile devices’ heterogeneity. IEEE Trans. Mob. Comput. 12(1), 65–77 (2013)CrossRef Hossain, A.M., Jin, Y., Soh, W.S., Van, H.N.: SSD: a robust RF location fingerprint addressing mobile devices’ heterogeneity. IEEE Trans. Mob. Comput. 12(1), 65–77 (2013)CrossRef
12.
Zurück zum Zitat Kjærgaard, M.B.: Indoor location fingerprinting with heterogeneous clients. Pervasive Mob. Comput. 7(1), 31–43 (2011)CrossRef Kjærgaard, M.B.: Indoor location fingerprinting with heterogeneous clients. Pervasive Mob. Comput. 7(1), 31–43 (2011)CrossRef
13.
Zurück zum Zitat Li, F., Zhao, C., Ding, G., Gong, J., Liu, C., Zhao, F.: A reliable and accurate indoor localization method using phone inertial sensors. In: Proceedings of ACM UbiComp, pp. 421–430 (2012) Li, F., Zhao, C., Ding, G., Gong, J., Liu, C., Zhao, F.: A reliable and accurate indoor localization method using phone inertial sensors. In: Proceedings of ACM UbiComp, pp. 421–430 (2012)
14.
15.
Zurück zum Zitat Liu, W., Mei, T., Zhang, Y.: Instant mobile video search with layered audio–video indexing and progressive transmission. IEEE Trans. Multimed. 16(8), 2242–2255 (2014)CrossRef Liu, W., Mei, T., Zhang, Y.: Instant mobile video search with layered audio–video indexing and progressive transmission. IEEE Trans. Multimed. 16(8), 2242–2255 (2014)CrossRef
16.
Zurück zum Zitat Ma, H., Zhao, D., Yuan, P.: Opportunities in mobile crowd sensing. IEEE Commun. Mag. 52(8), 29–35 (2014) Ma, H., Zhao, D., Yuan, P.: Opportunities in mobile crowd sensing. IEEE Commun. Mag. 52(8), 29–35 (2014)
17.
Zurück zum Zitat Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: Proceedings of IEEE CVPR, pp. 2161–2168 (2006) Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: Proceedings of IEEE CVPR, pp. 2161–2168 (2006)
18.
Zurück zum Zitat Park, J.g., Curtis, D., Teller, S., Ledlie, J.: Implications of device diversity for organic localization. In: Proceedings of IEEE INFOCOM, pp. 3182–3190 (2011) Park, J.g., Curtis, D., Teller, S., Ledlie, J.: Implications of device diversity for organic localization. In: Proceedings of IEEE INFOCOM, pp. 3182–3190 (2011)
19.
Zurück zum Zitat Rai, A., Chintalapudi, K.K., Padmanabhan, V.N., Sen, R.: Zee: zero-effort crowdsourcing for indoor localization. In: Proceedings of ACM MobiCom, pp. 293–304 (2012) Rai, A., Chintalapudi, K.K., Padmanabhan, V.N., Sen, R.: Zee: zero-effort crowdsourcing for indoor localization. In: Proceedings of ACM MobiCom, pp. 293–304 (2012)
20.
Zurück zum Zitat Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: an efficient alternative to sift or surf. In: Proceedings of IEEE ICCV, pp. 2564–2571 (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: an efficient alternative to sift or surf. In: Proceedings of IEEE ICCV, pp. 2564–2571 (2011)
21.
Zurück zum Zitat Schindler, G., Brown, M., Szeliski, R.: City-scale location recognition. In: Proceedings of IEEE CVPR, pp. 1–7 (2007) Schindler, G., Brown, M., Szeliski, R.: City-scale location recognition. In: Proceedings of IEEE CVPR, pp. 1–7 (2007)
22.
Zurück zum Zitat Schroth, G., Huitl, R., Chen, D., Abu-Alqumsan, M., Al-Nuaimi, A., Steinbach, E.: Mobile visual location recognition. IEEE Signal Process. Mag. 28(4), 77–89 (2011)CrossRef Schroth, G., Huitl, R., Chen, D., Abu-Alqumsan, M., Al-Nuaimi, A., Steinbach, E.: Mobile visual location recognition. IEEE Signal Process. Mag. 28(4), 77–89 (2011)CrossRef
23.
Zurück zum Zitat Shen, G., Chen, Z., Zhang, P., Moscibroda, T., Zhang, Y.: Walkie-markie: indoor pathway mapping made easy. In: Proceedings of USENIX NSDI, pp. 85–98 (2013) Shen, G., Chen, Z., Zhang, P., Moscibroda, T., Zhang, Y.: Walkie-markie: indoor pathway mapping made easy. In: Proceedings of USENIX NSDI, pp. 85–98 (2013)
24.
Zurück zum Zitat Sun, W., Liu, J., Wu, C., Yang, Z., Zhang, X., Liu, Y.: Moloc: on distinguishing fingerprint twins. In: Proceedings of IEEE ICDCS, pp. 226–235 (2013) Sun, W., Liu, J., Wu, C., Yang, Z., Zhang, X., Liu, Y.: Moloc: on distinguishing fingerprint twins. In: Proceedings of IEEE ICDCS, pp. 226–235 (2013)
25.
Zurück zum Zitat Wang, H., Zhao, D., Ma, H., Xu, H., Hou, X.: Crowdsourcing based mobile location recognition with richer fingerprints from smartphone sensors. In: Proceedings of IEEE ICPADS, pp. 156–163 (2015) Wang, H., Zhao, D., Ma, H., Xu, H., Hou, X.: Crowdsourcing based mobile location recognition with richer fingerprints from smartphone sensors. In: Proceedings of IEEE ICPADS, pp. 156–163 (2015)
26.
Zurück zum Zitat Wang, J., Fang, D., Yang, Z., Jiang, H., Chen, X., Cai, L., et al.: E-hipa: an energy-efficient framework for high-precision multi-target-adaptive device-free localization. IEEE Trans. Mob. Comput. 16(3), 716–729 (2017) Wang, J., Fang, D., Yang, Z., Jiang, H., Chen, X., Cai, L., et al.: E-hipa: an energy-efficient framework for high-precision multi-target-adaptive device-free localization. IEEE Trans. Mob. Comput. 16(3), 716–729 (2017)
27.
Zurück zum Zitat Xu, H., Yang, Z., Zhou, Z., Shangguan, L., Yi, K., Liu, Y.: Enhancing wifi-based localization with visual clues. In: Proceedings of ACM UbiComp, pp. 963–974 (2015) Xu, H., Yang, Z., Zhou, Z., Shangguan, L., Yi, K., Liu, Y.: Enhancing wifi-based localization with visual clues. In: Proceedings of ACM UbiComp, pp. 963–974 (2015)
28.
Zurück zum Zitat Xu, H., Zhao, D., An, J., Liu, L.: Indoor shop recognition via simple but efficient fingerprinting on smartphones. In: Proceedings of IEEE CCIS (2016) Xu, H., Zhao, D., An, J., Liu, L.: Indoor shop recognition via simple but efficient fingerprinting on smartphones. In: Proceedings of IEEE CCIS (2016)
29.
Zurück zum Zitat Yang, Z., Wu, C., Liu, Y.: Locating in fingerprint space: wireless indoor localization with little human intervention. In: Proceedings of ACM MobiCom, pp. 269–280 (2012) Yang, Z., Wu, C., Liu, Y.: Locating in fingerprint space: wireless indoor localization with little human intervention. In: Proceedings of ACM MobiCom, pp. 269–280 (2012)
30.
Zurück zum Zitat Yang, Z., Wu, C., Zhou, Z., Zhang, X., Wang, X., Liu, Y.: Mobility increases localizability: a survey on wireless indoor localization using inertial sensors. ACM Comput. Surv. (CSUR) 47(3), 54 (2015)CrossRef Yang, Z., Wu, C., Zhou, Z., Zhang, X., Wang, X., Liu, Y.: Mobility increases localizability: a survey on wireless indoor localization using inertial sensors. ACM Comput. Surv. (CSUR) 47(3), 54 (2015)CrossRef
31.
Zurück zum Zitat Youssef, M., Agrawala, A.: The Horus WLAN location determination system. In: Proceedings of ACM MobiSys, pp. 205–218 (2005) Youssef, M., Agrawala, A.: The Horus WLAN location determination system. In: Proceedings of ACM MobiSys, pp. 205–218 (2005)
32.
Zurück zum Zitat Yu, Z., Xu, H., Yang, Z., Guo, B.: Personalized travel package with multi-point-of-interest recommendation based on crowdsourced user footprints. IEEE Trans. Hum. Mach. Syst. 46(1), 151–158 (2016)CrossRef Yu, Z., Xu, H., Yang, Z., Guo, B.: Personalized travel package with multi-point-of-interest recommendation based on crowdsourced user footprints. IEEE Trans. Hum. Mach. Syst. 46(1), 151–158 (2016)CrossRef
33.
Zurück zum Zitat Zhang, X., Yang, Z., Sun, W., Liu, Y., Tang, S., Xing, K., Mao, X.: Incentives for mobile crowd sensing: a survey. IEEE Commun. Surv. Tutor. 18(1), 54–67 (2016)CrossRef Zhang, X., Yang, Z., Sun, W., Liu, Y., Tang, S., Xing, K., Mao, X.: Incentives for mobile crowd sensing: a survey. IEEE Commun. Surv. Tutor. 18(1), 54–67 (2016)CrossRef
34.
Zurück zum Zitat Zhao, D., Li, X.Y., Ma, H.: Budget-feasible online incentive mechanisms for crowdsourcing tasks truthfully. IEEE/ACM Trans. Netw. 24(2), 647–661 (2016)CrossRef Zhao, D., Li, X.Y., Ma, H.: Budget-feasible online incentive mechanisms for crowdsourcing tasks truthfully. IEEE/ACM Trans. Netw. 24(2), 647–661 (2016)CrossRef
Metadaten
Titel
ISR: indoor shop recognition via user-friendly and efficient fingerprinting on smartphones
verfasst von
Dong Zhao
Huaiyu Xu
Jiaqi An
Liang Liu
Huadong Ma
Publikationsdatum
30.03.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 7/2017
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-017-0838-2

Weitere Artikel der Ausgabe 7/2017

Machine Vision and Applications 7/2017 Zur Ausgabe