Skip to main content
Top

2015 | OriginalPaper | Chapter

Sense and Focus: Towards Effective Location Inference and Event Detection on Twitter

Authors : Yihong Zhang, Claudia Szabo, Quan Z. Sheng

Published in: Web Information Systems Engineering – WISE 2015

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Twitter users post observations about their immediate environment as a part of the 500 million tweets posted everyday. As such, Twitter can become the source for invaluable information about objects, locations, and events, which can be analyzed and monitored in real time, not only to understand what is happening in the world, but also an event’s exact location. However, Twitter data is noisy as sensory values, and information such as the location of a tweet may not be available, e.g., only 0.9 % of tweets have GPS data. Due to the lack of accurate and fine-grained location information, existing Twitter event monitoring systems focus on city-level or coarser location identification, which cannot provide details for local events. In this paper, we propose SNAF (Sense and Focus), an event monitoring system for Twitter data that emphasizes local events. We increase the availability of the location information significantly by finding locations in tweet messages and users’ past tweets. We apply data cleaning techniques in our system, and with extensive experiments, we show that our method can improve the accuracy of location inference by 5 % to 20 % across different error ranges. We also show that our prototype implementation of SNAF can identify critical local events in real time, in many cases earlier than news reports.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) The Semantic Web. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007)CrossRef Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., Ives, Z.: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) The Semantic Web. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007)CrossRef
2.
go back to reference Branch, J., Szymanski, B., Giannella, C., Wolff, R., Kargupta, H.: In-network outlier detection in wireless sensor networks. In: Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (2006) Branch, J., Szymanski, B., Giannella, C., Wolff, R., Kargupta, H.: In-network outlier detection in wireless sensor networks. In: Proceedings of the 26th IEEE International Conference on Distributed Computing Systems (2006)
3.
go back to reference Daiber, J., Jakob, M., Hokamp, C., Mendes, P.N.: Improving efficiency and accuracy in multilingual entity extraction. In: Proceedings of the 9th International Conference on Semantic Systems (2013) Daiber, J., Jakob, M., Hokamp, C., Mendes, P.N.: Improving efficiency and accuracy in multilingual entity extraction. In: Proceedings of the 9th International Conference on Semantic Systems (2013)
4.
go back to reference Graham, M., Hale, S.A., Gaffney, D.: Where in the world are you? Geolocation and language identification in twitter. Prof. Geogr. 66(4), 568–578 (2014)CrossRef Graham, M., Hale, S.A., Gaffney, D.: Where in the world are you? Geolocation and language identification in twitter. Prof. Geogr. 66(4), 568–578 (2014)CrossRef
5.
go back to reference Hong, L., Ahmed, A., Gurumurthy, S., Smola, A.J., Tsioutsiouliklis, K.: Discovering geographical topics in the twitter stream. In: Proceedings of the 21st International World Wide Web Conference (2012) Hong, L., Ahmed, A., Gurumurthy, S., Smola, A.J., Tsioutsiouliklis, K.: Discovering geographical topics in the twitter stream. In: Proceedings of the 21st International World Wide Web Conference (2012)
6.
go back to reference Ikawa, Y., Enoki, M., Tatsubori, M.: Location inference using microblog messages. In: Proceedings of the 21st International World Wide Web Conference Companion (2012) Ikawa, Y., Enoki, M., Tatsubori, M.: Location inference using microblog messages. In: Proceedings of the 21st International World Wide Web Conference Companion (2012)
7.
go back to reference Jeffery, S.R., Alonso, G., Franklin, M.J., Hong, W., Widom, J.: Declarative support for sensor data cleaning. In: Fishkin, K.P., Schiele, B., Nixon, P., Quigley, A. (eds.) PERVASIVE 2006. LNCS, vol. 3968, pp. 83–100. Springer, Heidelberg (2006) CrossRef Jeffery, S.R., Alonso, G., Franklin, M.J., Hong, W., Widom, J.: Declarative support for sensor data cleaning. In: Fishkin, K.P., Schiele, B., Nixon, P., Quigley, A. (eds.) PERVASIVE 2006. LNCS, vol. 3968, pp. 83–100. Springer, Heidelberg (2006) CrossRef
8.
go back to reference Jurka, T.P., Collingwood, L., Boydstun, A., Grossman, E., van Atteveldt, W.: Rtexttools: Automatic text classification via supervised learning. R package version 1.3, 9 (2012) Jurka, T.P., Collingwood, L., Boydstun, A., Grossman, E., van Atteveldt, W.: Rtexttools: Automatic text classification via supervised learning. R package version 1.3, 9 (2012)
9.
go back to reference Knox, E.M., Ng, R.T.: Algorithms for mining distance based outliers in large datasets. In: Proceedings of 24th International Conference on Very Large Data Bases (1998) Knox, E.M., Ng, R.T.: Algorithms for mining distance based outliers in large datasets. In: Proceedings of 24th International Conference on Very Large Data Bases (1998)
10.
go back to reference Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (1995) Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (1995)
11.
go back to reference Lee, p., Lakshmanan, L.V., Milios, E.E.: Incremental cluster evolution tracking from highly dynamic network data. In: Proceedings of the 30th International Conference on Data Engineering (2014) Lee, p., Lakshmanan, L.V., Milios, E.E.: Incremental cluster evolution tracking from highly dynamic network data. In: Proceedings of the 30th International Conference on Data Engineering (2014)
12.
go back to reference Li, C., Sun, A.: Fine-grained location extraction from tweets with temporal awareness. In: Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval (2014) Li, C., Sun, A.: Fine-grained location extraction from tweets with temporal awareness. In: Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval (2014)
13.
go back to reference Li, R., Lei, K.H., Khadiwala, R., Chang, K.-C.: Tedas: a twitter-based event detection and analysis system. In: Proceedings of 28th International Conference on Data Engineering (2012) Li, R., Lei, K.H., Khadiwala, R., Chang, K.-C.: Tedas: a twitter-based event detection and analysis system. In: Proceedings of 28th International Conference on Data Engineering (2012)
14.
go back to reference Lingad, J., Karimi, S., Yin, J.: Location extraction from disaster-related microblogs. In: Proceedings of the 22nd International World Wide Web Conference Companion (2013) Lingad, J., Karimi, S., Yin, J.: Location extraction from disaster-related microblogs. In: Proceedings of the 22nd International World Wide Web Conference Companion (2013)
15.
go back to reference McMinn, A.J., Moshfeghi, Y., Jose, J.M.: Building a large-scale corpus for evaluating event detection on twitter. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, pages 409–418. ACM (2013) McMinn, A.J., Moshfeghi, Y., Jose, J.M.: Building a large-scale corpus for evaluating event detection on twitter. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, pages 409–418. ACM (2013)
16.
go back to reference Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: Real-time event detection by social sensors. In: Proceedings of the 19th International World Wide Web Conference (2010) Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: Real-time event detection by social sensors. In: Proceedings of the 19th International World Wide Web Conference (2010)
17.
go back to reference Sakaki, T., Okazaki, M., Matsuo, Y.: Tweet analysis for real-time event detection and earthquake reporting system development. IEEE Trans. Knowl. Data Eng. 25(4), 919–931 (2013)CrossRef Sakaki, T., Okazaki, M., Matsuo, Y.: Tweet analysis for real-time event detection and earthquake reporting system development. IEEE Trans. Knowl. Data Eng. 25(4), 919–931 (2013)CrossRef
18.
go back to reference Schulz, A., Hadjakos, A., Paulheim, H., Nachtwey, J., Mühlhäuser, M.: A multi-indicator approach for geolocalization of tweets. In: Proceedings of the Seventh International Conference on Weblogs and Social Media (2013) Schulz, A., Hadjakos, A., Paulheim, H., Nachtwey, J., Mühlhäuser, M.: A multi-indicator approach for geolocalization of tweets. In: Proceedings of the Seventh International Conference on Weblogs and Social Media (2013)
19.
go back to reference Sheng, B., Li, Q., Mao, W., Jin, W.: Outlier detection in sensor networks. In: Proceedings of the 8th ACM International Symposium on Mobile Ad Hoc Networking and Computing (2007) Sheng, B., Li, Q., Mao, W., Jin, W.: Outlier detection in sensor networks. In: Proceedings of the 8th ACM International Symposium on Mobile Ad Hoc Networking and Computing (2007)
20.
go back to reference Subramaniam, S., Palpanas, T., Papadopoulos, D., Kalogeraki, V., Gunopulos, D.: Online outlier detection in sensor data using non-parametric models. In: Proceedings of the 32nd International Conference on Very Large Data Bases (2006) Subramaniam, S., Palpanas, T., Papadopoulos, D., Kalogeraki, V., Gunopulos, D.: Online outlier detection in sensor data using non-parametric models. In: Proceedings of the 32nd International Conference on Very Large Data Bases (2006)
21.
go back to reference Unankard, S., Li, X., Sharaf, M., Zhong, J., Li, X.: Predicting elections from social networks based on sub-event detection and sentiment analysis. In: Benatallah, B., Bestavros, A., Manolopoulos, Y., Vakali, A., Zhang, Y. (eds.) WISE 2014, Part II. LNCS, vol. 8787, pp. 1–16. Springer, Heidelberg (2014) CrossRef Unankard, S., Li, X., Sharaf, M., Zhong, J., Li, X.: Predicting elections from social networks based on sub-event detection and sentiment analysis. In: Benatallah, B., Bestavros, A., Manolopoulos, Y., Vakali, A., Zhang, Y. (eds.) WISE 2014, Part II. LNCS, vol. 8787, pp. 1–16. Springer, Heidelberg (2014) CrossRef
22.
go back to reference Unankard, S., Li, X., Sharaf, M.A.: Emerging event detection in social networks with location sensitivity. World Wide Web J. (2015, in press) Unankard, S., Li, X., Sharaf, M.A.: Emerging event detection in social networks with location sensitivity. World Wide Web J. (2015, in press)
23.
go back to reference Wen, Y.-J., Agogino, A.M., Goebel, K.: Fuzzy validation and fusion for wireless sensor networks. In: Proceedings of the ASME International Mechanical Engineering Congress (2004) Wen, Y.-J., Agogino, A.M., Goebel, K.: Fuzzy validation and fusion for wireless sensor networks. In: Proceedings of the ASME International Mechanical Engineering Congress (2004)
24.
go back to reference Zhang, Y., Meratnia, N., Havinga, P.: Outlier detection techniques for wireless sensor networks: A survey. IEEE Commun. Surv. Tutor. 12(2), 159–170 (2010)CrossRef Zhang, Y., Meratnia, N., Havinga, P.: Outlier detection techniques for wireless sensor networks: A survey. IEEE Commun. Surv. Tutor. 12(2), 159–170 (2010)CrossRef
Metadata
Title
Sense and Focus: Towards Effective Location Inference and Event Detection on Twitter
Authors
Yihong Zhang
Claudia Szabo
Quan Z. Sheng
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-26190-4_31

Premium Partner