Skip to main content
Top

2017 | OriginalPaper | Chapter

i-Stylist: Finding the Right Dress Through Your Social Networks

Authors : Jordi Sanchez-Riera, Jun-Ming Lin, Kai-Lung Hua, Wen-Huang Cheng, Arvin Wen Tsui

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Searching the Web has become an everyday task for most people. However, the presence of too much information can cause information overload. For example, when shopping online, a user can easily be overwhelmed by too many choices. To this end, we propose a personalized clothing recommendation system, namely i-Stylist, through the analysis of personal images in social networks. To access the available personal images of a user, the i-Stylist system extracts a number of characteristics from each clothing item such as CNN feature vectors and metadata such as color, material and pattern of the fabric. Then, these clothing items are organized as a fully connected graph to later infer the personalized probability distribution of how the user will like each clothing item in a shopping website. The user is able to modify the graph structure, e.g. adding and deleting vertices by giving feedback about the retrieved clothing items. The i-Stylist system is compared against two other baselines and demonstrated to have better performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Usually a popular item is defined by the number of likes, links, etc., that an image or user can have.
 
3
Different from the authors of this paper.
 
Literature
1.
go back to reference Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., Gool, L.: Apparel classification with style. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 321–335. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_25 CrossRef Bossard, L., Dantone, M., Leistner, C., Wengert, C., Quack, T., Gool, L.: Apparel classification with style. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 321–335. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-37447-0_​25 CrossRef
2.
go back to reference Carmel, D., Zwerdling, N., Guy, I., Ofek-Koifman, S., Har’el, N., Ronen, I., Uziel, E., Yogev, S., Chernov, S.: Personalized social search based on the user’s social network. In: ACM IKM (2009) Carmel, D., Zwerdling, N., Guy, I., Ofek-Koifman, S., Har’el, N., Ronen, I., Uziel, E., Yogev, S., Chernov, S.: Personalized social search based on the user’s social network. In: ACM IKM (2009)
3.
go back to reference Chi, H.Y., Chen, C.C., Cheng, W.H., Chen, M.S.: Ubishop: commercial item recommendation using visual part based object representation. Multimed. Tools Appl. 75, 16093–16115 (2015) Chi, H.Y., Chen, C.C., Cheng, W.H., Chen, M.S.: Ubishop: commercial item recommendation using visual part based object representation. Multimed. Tools Appl. 75, 16093–16115 (2015)
4.
go back to reference Chi, H.-Y., Cheng, W.-H., Chen, M.-S., Tsui, A.W.: MOSRO: enabling mobile sensing for real-scene objects with grid based structured output learning. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds.) MMM 2014. LNCS, vol. 8325, pp. 207–218. Springer, Heidelberg (2014). doi:10.1007/978-3-319-04114-8_18 CrossRef Chi, H.-Y., Cheng, W.-H., Chen, M.-S., Tsui, A.W.: MOSRO: enabling mobile sensing for real-scene objects with grid based structured output learning. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds.) MMM 2014. LNCS, vol. 8325, pp. 207–218. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-04114-8_​18 CrossRef
5.
go back to reference Dooms, S., De Pessemier, T., Martens, L.: A user-centric evaluation of recommender algorithms for an event recommendation system. In: RecSys (2011) Dooms, S., De Pessemier, T., Martens, L.: A user-centric evaluation of recommender algorithms for an event recommendation system. In: RecSys (2011)
6.
go back to reference Guntuku, S.C., Qiu, L., Roy, S., Lin, W., Jakhetiya, V.: Do others perceive you as you want them to?: modeling personality based on selfies. In: ASM (2015) Guntuku, S.C., Qiu, L., Roy, S., Lin, W., Jakhetiya, V.: Do others perceive you as you want them to?: modeling personality based on selfies. In: ASM (2015)
7.
go back to reference Hidayati, S.C., Hua, K., Cheng, W., Sun, S.: What are the fashion trends in new york? In: ACM Multimedia Conference (2014) Hidayati, S.C., Hua, K., Cheng, W., Sun, S.: What are the fashion trends in new york? In: ACM Multimedia Conference (2014)
8.
go back to reference Hu, Y., Yi, X., Davis, L.S.: Collaborative fashion recommendation: A functional tensor factorization approach. In: ACM Multimedia (2015) Hu, Y., Yi, X., Davis, L.S.: Collaborative fashion recommendation: A functional tensor factorization approach. In: ACM Multimedia (2015)
9.
go back to reference Huang, C., Wei, C., Wang, Y.F.: Active learning based clothing image recommendation with implicit user preferences. In: ICME Workshops (2013) Huang, C., Wei, C., Wang, Y.F.: Active learning based clothing image recommendation with implicit user preferences. In: ICME Workshops (2013)
10.
go back to reference Iwata, T., Watanabe, S., Sawada, H.: Fashion coordinates recommender system using photographs from fashion magazines. In: IJCAI (2011) Iwata, T., Watanabe, S., Sawada, H.: Fashion coordinates recommender system using photographs from fashion magazines. In: IJCAI (2011)
11.
go back to reference Kiapour, M.H., Han, X., Lazebnik, S., Berg, A.C., Berg, T.L.: Where to buy it: matching street clothing photos in online shops. In: ICCV (2015) Kiapour, M.H., Han, X., Lazebnik, S., Berg, A.C., Berg, T.L.: Where to buy it: matching street clothing photos in online shops. In: ICCV (2015)
12.
go back to reference Knijnenburg, B.P., Willemsen, M.C.: Evaluating recommender systems with user experiments. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 309–352. Springer, Boston (2015)CrossRef Knijnenburg, B.P., Willemsen, M.C.: Evaluating recommender systems with user experiments. In: Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 309–352. Springer, Boston (2015)CrossRef
13.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012)
14.
go back to reference Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., Yan, S.: Hi, magic closet, tell me what to wear! In: Proceedings of ACM Multimedia (2012) Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., Yan, S.: Hi, magic closet, tell me what to wear! In: Proceedings of ACM Multimedia (2012)
15.
go back to reference van der Maaten, L., Hinton, G.E.: Visualizing high-dimensional data using t-SNE. JMLR 9, 2579–2605 (2008)MATH van der Maaten, L., Hinton, G.E.: Visualizing high-dimensional data using t-SNE. JMLR 9, 2579–2605 (2008)MATH
16.
go back to reference Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013)
17.
go back to reference Nguyen, H.T., Almenningen, T., Havig, M., Schistad, H., Kofod-Petersen, A., Langseth, H., Ramampiaro, H.: Learning to rank for personalised fashion recommender systems via implicit feedback. In: Prasath, R., O’Reilly, P., Kathirvalavakumar, T. (eds.) MIKE 2014. LNCS (LNAI), vol. 8891, pp. 51–61. Springer, Heidelberg (2014). doi:10.1007/978-3-319-13817-6_6 Nguyen, H.T., Almenningen, T., Havig, M., Schistad, H., Kofod-Petersen, A., Langseth, H., Ramampiaro, H.: Learning to rank for personalised fashion recommender systems via implicit feedback. In: Prasath, R., O’Reilly, P., Kathirvalavakumar, T. (eds.) MIKE 2014. LNCS (LNAI), vol. 8891, pp. 51–61. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-13817-6_​6
18.
go back to reference Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers (1999) Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers (1999)
19.
go back to reference van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Empowering visual categorization with the GPU. IEEE Trans. Multimed. 13(1), 60–70 (2011)CrossRef van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Empowering visual categorization with the GPU. IEEE Trans. Multimed. 13(1), 60–70 (2011)CrossRef
20.
go back to reference Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: Overfeat: Integrated recognition, localization and detection using convolutional networks. In: ICLR (2014) Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: Overfeat: Integrated recognition, localization and detection using convolutional networks. In: ICLR (2014)
21.
go back to reference Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: CVPR Workshops (2014) Sharif Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: CVPR Workshops (2014)
22.
go back to reference Simo-Serra, E., Fidler, S., Moreno-Noguer, F., Urtasun, R.: Neuroaesthetics in fashion: modeling the perception of fashionability. In: CVPR (2015) Simo-Serra, E., Fidler, S., Moreno-Noguer, F., Urtasun, R.: Neuroaesthetics in fashion: modeling the perception of fashionability. In: CVPR (2015)
23.
go back to reference Tsai, T.H., Cheng, W.H., You, C.W., Hu, M.C., Tsui, A.W., Chi, H.Y.: Learning and recognition of on-premise signs (opss) from weakly labeled street view images. IEEE Trans. TIP 23(3), 1047–1059 (2014) Tsai, T.H., Cheng, W.H., You, C.W., Hu, M.C., Tsui, A.W., Chi, H.Y.: Learning and recognition of on-premise signs (opss) from weakly labeled street view images. IEEE Trans. TIP 23(3), 1047–1059 (2014)
24.
go back to reference Weijer, J.V.D., Gevers, T., Bagdanov, A.: Boosting color saliency in image feature detection. IEEE Trans. PAMI 28, 150–156 (2005)CrossRef Weijer, J.V.D., Gevers, T., Bagdanov, A.: Boosting color saliency in image feature detection. IEEE Trans. PAMI 28, 150–156 (2005)CrossRef
25.
go back to reference Yamaguchi, K., Berg, T.L., Ortiz, L.E.: Chic or social: visual popularity analysis in online fashion networks. In: ACM ICM (2014) Yamaguchi, K., Berg, T.L., Ortiz, L.E.: Chic or social: visual popularity analysis in online fashion networks. In: ACM ICM (2014)
26.
go back to reference Yamaguchi, K., Kiapour, M.H., Ortiz, L.E., Berg, T.L.: Retrieving similar styles to parse clothing. IEEE Trans. PAMI 37(5), 1028–1040 (2015)CrossRef Yamaguchi, K., Kiapour, M.H., Ortiz, L.E., Berg, T.L.: Retrieving similar styles to parse clothing. IEEE Trans. PAMI 37(5), 1028–1040 (2015)CrossRef
Metadata
Title
i-Stylist: Finding the Right Dress Through Your Social Networks
Authors
Jordi Sanchez-Riera
Jun-Ming Lin
Kai-Lung Hua
Wen-Huang Cheng
Arvin Wen Tsui
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-51811-4_54