skip to main content
10.1145/3144789.3144797acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiciipConference Proceedingsconference-collections
research-article

Better Weather Forecasting through truth discovery Analysis

Authors Info & Claims
Published:17 July 2017Publication History

ABSTRACT

In many real world applications, the same object or event may be described by multiple sources. As a result, conflicts among these sources are inevitable and these conflicts cause confusion as we have more than one value or outcome for each object. One significant problem is to resolve the confusion and to identify a piece of information which is trustworthy. This process of finding the truth from conflicting values of an object provided by multiple sources is called truth discovery or fact-finding. The main purpose of the truth discovery is to find more and more trustworthy information and reliable sources. Because the major assumption of truth discovery is on this intuitive principle, the source that provides trustworthy information is considered more reliable, and moreover, if the piece of information is from a reliable source, then it is more trustworthy. However, previously proposed truth discovery methods either do not conduct source reliability estimation at all (Voting Method), or even if they do, they do not model multiple properties of the object separately. This is the motivation for researchers to develop new techniques to tackle the problem of truth discovery in data with multiple properties. We present a method using an optimization framework which minimizes the overall weighted deviation between the truths and the multi-source observations. In this framework, different types of distance functions can be plugged in to capture the characteristics of different data types. We use weather datasets collected by four different platforms for extensive experiments and the results verify both the efficiency and precision of our methods for truth discovery.

References

  1. Xin Luna Dong, Laure Bertiequille, and Divesh Srivastava. Integrating conflicting data: the role of source dependence. Proceedings of The Vldb Endowment, 2(1):550--561, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Xin Luna Dong, Laure Bertiequille, and Divesh Srivastava. Truth discovery and copying detection in a dynamic world. Proceedings of The Vldb Endowment, 2(1):562--573, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Li Jia, Hongzhi Wang, Jianzhong Li, and Hong Gao. Incremental truth discovery for information from multiple data sources. pages 56--66, 2013.Google ScholarGoogle Scholar
  4. Xian Li, Xin Luna Dong, Kenneth Lyons, Weiyi Meng, and Divesh Srivastava. Truth finding on the deep web: is the problem solved? 6(2):97--108, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Anish Das Sarma, Xin Luna Dong, and Alon Halevy. Data integration with dependent sources. pages 401412, 2011.Google ScholarGoogle Scholar
  6. Dong Wang, Lance Kaplan, Hieu Le, and Tarek Abdelzaher. On truth discovery in social sensing: a maximum likelihood estimation approach. pages 233--244, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Xiaoxin Yin, Jiawei Han, and Philip S Yu. Truth discovery with multiple conflicting information providers on the web. IEEE Transactions on Knowledge and Data Engineering, 20(6):796--808, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Alban Galland, Serge Abiteboul, Amelie Marian, and Pierre Senellart. Corroborating information from disagreeing views. pages 131--140, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Bo Zhao, Benjamin I. P Rubinstein, Jim Gemmell, and Jiawei Han. A bayesian approach to discovering truth from conflicting sources for data integration. Proceedings of the Vldb Endowment, 5(6):550--561, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Jeff Pasternack and Dan Roth. Knowing what to believe (when you already know something). pages 877--885, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Xiaoxin Yin and Wenzhao Tan. Semi-supervised truth discovery. international world wide web conferences, pages 217--226, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bo Zhao and Jiawei Han. A probabilistic model for estimating real-valued truth from conflicting sources. Proc.of Intl.workshop on Quality in Databases.Google ScholarGoogle Scholar
  13. Rakesh Agrawal and Samuel Ieong. Aggregating web offers to determine product prices. pages 435--443, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Better Weather Forecasting through truth discovery Analysis

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        ICIIP '17: Proceedings of the 2nd International Conference on Intelligent Information Processing
        July 2017
        211 pages
        ISBN:9781450352871
        DOI:10.1145/3144789

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 17 July 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        ICIIP '17 Paper Acceptance Rate32of202submissions,16%Overall Acceptance Rate87of367submissions,24%
      • Article Metrics

        • Downloads (Last 12 months)4
        • Downloads (Last 6 weeks)1

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader