skip to main content
research-article

Collaborative Intent Prediction with Real-Time Contextual Data

Authors Info & Claims
Published:16 August 2017Publication History
Skip Abstract Section

Abstract

Intelligent personal assistants on mobile devices such as Apple’s Siri and Microsoft Cortana are increasingly important. Instead of passively reacting to queries, they provide users with brand new proactive experiences that aim to offer the right information at the right time. It is, therefore, crucial for personal assistants to understand users’ intent, that is, what information users need now. Intent is closely related to context. Various contextual signals, including spatio-temporal information and users’ activities, can signify users’ intent. It is, however, challenging to model the correlation between intent and context. Intent and context are highly dynamic and often sequentially correlated. Contextual signals are usually sparse, heterogeneous, and not simultaneously available. We propose an innovative collaborative nowcasting model to jointly address all these issues. The model effectively addresses the complex sequential and concurring correlation between context and intent and recognizes users’ real-time intent with continuously arrived contextual signals. We extensively evaluate the proposed model with real-world data sets from a commercial personal assistant. The results validate the effectiveness the proposed model, and demonstrate its capability of handling the real-time flow of contextual signals. The studied problem and model also provide inspiring implications for new paradigms of recommendation on mobile intelligent devices.

References

  1. Gediminas Adomavicius and Alexander Tuzhilin. 2011. Context-aware recommender systems. In Recommender Systems Handbook. Springer, 217--253.Google ScholarGoogle Scholar
  2. Jushan Bai. 2003. Inferential theory for factor models of large dimensions. Econometrica 71, 1 (2003), 135--171.Google ScholarGoogle ScholarCross RefCross Ref
  3. Jushan Bai and Peng Wang. 2016. Econometric analysis of large factor models. Annu. Rev. Econ. 8, 1 (2016), 53--80.Google ScholarGoogle Scholar
  4. Marta Banbura, Domenico Giannone, Michele Modugno, and Lucrezia Reichlin. 2013. Now-casting and the real-time data flow. Handbook of Economic Forecasting (2013).Google ScholarGoogle Scholar
  5. Marta Banbura, Domenico Giannone, and Lucrezia Reichlin. 2012. Nowcasting. The Oxford Handbook of Economic Forecasting (2012).Google ScholarGoogle Scholar
  6. Rasmus Bro. 1997. PARAFAC. Tutorial and applications. Chemomet. Intell. Lab. Syst. 38, 2 (1997), 149--171.Google ScholarGoogle ScholarCross RefCross Ref
  7. Laurent Charlin, Rajesh Ranganath, James McInerney, and David M. Blei. 2015. Dynamic poisson factorization. In RecSys’15. 155--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Peter A. Chew, Brett W. Bader, Tamara G. Kolda, and Ahmed Abdelali. 2007. Cross-language information retrieval using PARAFAC2. In KDD’07. 143--152. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Aaron Clauset, Cosma Rohilla Shalizi, and M. E. J. Newman. 2009. Power-law distributions in empirical data. SIAM Rev. 51, 4 (2009), 661--703. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Dixon and Gerry Wiener. 1993. TITAN: Thunderstorm identification, tracking, analysis, and nowcasting-A radar-based methodology. J. Atmos. Ocean. Technol. 10, 6 (1993), 785--797.Google ScholarGoogle ScholarCross RefCross Ref
  11. Catherine Doz, Domenico Giannone, and Lucrezia Reichlin. 2011. A two-step estimator for large approximate dynamic factor models based on Kalman filtering. J. Econ. 164, 1 (2011), 188--205.Google ScholarGoogle ScholarCross RefCross Ref
  12. Catherine Doz, Domenico Giannone, and Lucrezia Reichlin. 2012. A quasi--maximum likelihood approach for large, approximate dynamic factor models. Rev. Econ. Stat. 94, 4 (2012), 1014--1024.Google ScholarGoogle ScholarCross RefCross Ref
  13. Brendan Duncan and Charles Elkan. 2014. Nowcasting with numerous candidate predictors. In ECML PKDD’14. 370--385.Google ScholarGoogle Scholar
  14. Mario Forni, Domenico Giannone, Marco Lippi, and Lucrezia Reichlin. 2009. Opening the black box: Structural factor models with large cross sections. Econ. Theory 25, 05 (2009), 1319--1347.Google ScholarGoogle ScholarCross RefCross Ref
  15. Domenico Giannone, Lucrezia Reichlin, and Luca Sala. 2005. Monetary policy in real time. In NBER Macroeconomics Annual 2004, Volume 19. 161--224.Google ScholarGoogle ScholarCross RefCross Ref
  16. Domenico Giannone, Lucrezia Reichlin, and David Small. 2008. Nowcasting: The real-time informational content of macroeconomic data. J. Mon. Econ. 55, 4 (2008), 665--676.Google ScholarGoogle ScholarCross RefCross Ref
  17. Richard A. Harshman. 1972. PARAFAC2: Mathematical and technical notes. UCLA Work. Pap. Phonet. 22, 3044 (1972), 122215.Google ScholarGoogle Scholar
  18. Thomas Hofmann. 2003. Collaborative filtering via gaussian probabilistic latent semantic analysis. In SIGIR’03. 259--266. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Dietmar Jannach, Lukas Lerche, and Michael Jugovac. 2015. Adaptation and evaluation of recommendations for short-term shopping goals. In RecSys’15. 211--218. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Rudolph Emil Kalman. 1960. A new approach to linear filtering and prediction problems. J. Basic Eng. 82, 1 (1960), 35--45.Google ScholarGoogle ScholarCross RefCross Ref
  21. Alexandros Karatzoglou, Xavier Amatriain, Linas Baltrunas, and Nuria Oliver. 2010. Multiverse recommendation: N-dimensional tensor factorization for context-aware collaborative filtering. In RecSys’10. 79--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Henk AL Kiers, Jos MF Ten Berge, and Rasmus Bro. 1999. PARAFAC2-Part I. A direct fitting algorithm for the PARAFAC2 model. J. Chemomet. 13, 3--4 (1999), 275--294.Google ScholarGoogle ScholarCross RefCross Ref
  23. Tamara G. Kolda and Brett W. Bader. 2009. Tensor decompositions and applications. SIAM Rev. 51, 3 (2009), 455--500. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Yehuda Koren. 2009. Collaborative filtering with temporal dynamics. In KDD’09. 447--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Yehuda Koren and Robert Bell. 2011. Advances in collaborative filtering. In Recommender Systems Handbook. 145--186.Google ScholarGoogle Scholar
  26. Vasileios Lampos and Nello Cristianini. 2012. Nowcasting events from the social web with statistical learning. Trans. Iintell. Syst. Technol. 3, 4 (2012), 72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Thomas Lansdall-Welfare, Vasileios Lampos, and Nello Cristianini. 2012. Nowcasting the mood of the nation. Significance 9, 4 (2012), 26--28.Google ScholarGoogle ScholarCross RefCross Ref
  28. D. N. Lawley and A. E. Maxwell. 1962. Factor analysis as a statistical method. J. Roy. Stat. Soc. D 12, 3 (1962), 209--229.Google ScholarGoogle Scholar
  29. Lei Lin, Ming Ni, Qing He, Jing Gao, Adel W. Sadek, and Transportation Informatics Tier I. Director. 2015. Modeling the impacts of inclement weather on freeway traffic speed: An exploratory study utilizing social media data. In Proceedings of the Transportation Research Board 94th Annual Meeting.Google ScholarGoogle ScholarCross RefCross Ref
  30. Qi Liu, Haiping Ma, Enhong Chen, and Hui Xiong. 2013. A survey of context-aware mobile recommendations. Int. J. Inf. Technol. Dec. Mak. 12, 01 (2013), 139--172.Google ScholarGoogle Scholar
  31. Alexander E. MacDonald, Yuanfu Xie, and Randolph H. Ware. 2002. Diagnosis of three-dimensional water vapor using a GPS network. Mon. Weather Rev. 130, 2 (2002), 386--397.Google ScholarGoogle ScholarCross RefCross Ref
  32. Tariq Mahmood, Francesco Ricci, and Adriano Venturini. 2009. Improving recommendation effectiveness: Adapting a dialogue strategy in online travel planning. Inf. Technol. Tour. 11, 4 (2009), 285--302.Google ScholarGoogle ScholarCross RefCross Ref
  33. Clifford Mass. 2012. Nowcasting: The promise of new technologies of communication, modeling, and observation. Bull. Am. Meteorol. Soc. 93, 6 (2012), 797--809.Google ScholarGoogle ScholarCross RefCross Ref
  34. William R. Moninger, Stanley G. Benjamin, Brian D. Jamison, Thomas W. Schlatter, Tracy Lorraine Smith, and Edward J. Szoke. 2010. Evaluation of regional aircraft observations using TAMDAR. Weather Forecast. 25, 2 (2010), 627--645.Google ScholarGoogle ScholarCross RefCross Ref
  35. Stephen W. Raudenbush and Anthony S. Bryk. 2002. Hierarchical Linear Models: Applications and Data Analysis Methods. Sage.Google ScholarGoogle Scholar
  36. Steffen Rendle. 2012. Factorization machines with libFM. Trans. Intell. Syst. Technol. 3, 3 (2012), 1--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized markov chains for next-basket recommendation. In WWW’10. 811--820. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Steven L. Scott and Hal R. Varian. 2014. Predicting the present with bayesian structural time series. Int. J. Math. Model. Numer. Optim. 5, 1--2 (2014), 4--23.Google ScholarGoogle Scholar
  39. Mary Beth Seasholtz and Bruce Kowalski. 1993. The parsimony principle applied to multivariate calibration. Anal. Chim. Acta 277, 2 (1993), 165--177.Google ScholarGoogle ScholarCross RefCross Ref
  40. Milad Shokouhi and Qi Guo. 2015. From queries to cards: Re-ranking proactive card recommendations based on reactive search history. In SIGIR’15. 695--704. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Yang Song and Qi Guo. 2016. Query-less: Predicting task repetition for NextGen proactive search and recommendation engines. In WWW’16. 543--553. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. James H. Stock and Mark W. Watson. 2002. Forecasting using principal components from a large number of predictors. J. Am. Stat. Assoc. 97, 460 (2002), 1167--1179.Google ScholarGoogle ScholarCross RefCross Ref
  43. John Z. Sun, Dhruv Parthasarathy, and Kush R. Varshney. 2014. Collaborative kalman filtering for dynamic matrix factorization. Trans. Sign. Process. 62, 14 (2014), 3499--3509. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Yu Sun, Nicholas Jing Yuan, Yingzi Wang, Xing Xie, Kieran McDonald, and Rui Zhang. 2016a. Contextual intent tracking for personal assistants. In KDD’16. 273--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Yu Sun, Nicholas Jing Yuan, Xing Xie, Kieran McDonald, and Rui Zhang. 2016b. Collaborative nowcasting for contextual recommendation. In WWW’16. 1407--1418. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Yingzi Wang, Nicholas Jing Yuan, Yu Sun, Fuzheng Zhang, Xing Xie, Qi Liu, and Enhong Chen. 2016. A contextual collaborative approach for app usage forecasting. In UbiComp’16. 1247--1258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Greg Welch and Gary Bishop. 1995. An Introduction to the Kalman Filter. Technical Report. Chapel Hill, NC. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. James W. Wilson, N. Andrew Crook, Cynthia K. Mueller, Juanzhen Sun, and Michael Dixon. 1998. Nowcasting thunderstorms: A status report. Bull. Am. Meteorol. Soc. 79, 10 (1998), 2079--2099.Google ScholarGoogle ScholarCross RefCross Ref
  49. Qiang Wu, Christopher J. C. Burges, Krysta M. Svore, and Jianfeng Gao. 2010. Adapting boosting for information retrieval measures. Inf. Retriev. 13, 3 (2010), 254--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Yongfeng Zhang, Min Zhang, Yi Zhang, Guokun Lai, Yiqun Liu, Honghui Zhang, and Shaoping Ma. 2015. Daily-aware personalized recommendation based on feature-level time series analysis. In WWW’15. 1373--1383. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Hengshu Zhu, Enhong Chen, Hui Xiong, Kuifei Yu, Huanhuan Cao, and Jilei Tian. 2015. Mining mobile user preferences for personalized context-aware recommendation. Trans. Intell. Syst. Technol. 5, 4 (2015), 58. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Collaborative Intent Prediction with Real-Time Contextual Data

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Transactions on Information Systems
                ACM Transactions on Information Systems  Volume 35, Issue 4
                Special issue: Search, Mining and their Applications on Mobile Devices
                October 2017
                461 pages
                ISSN:1046-8188
                EISSN:1558-2868
                DOI:10.1145/3112649
                Issue’s Table of Contents

                Copyright © 2017 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 16 August 2017
                • Accepted: 1 January 2017
                • Revised: 1 December 2016
                • Received: 1 June 2016
                Published in tois Volume 35, Issue 4

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader