skip to main content
10.1145/2939672.2945383acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
tutorial
Public Access

Extracting Optimal Performance from Dynamic Time Warping

Published:13 August 2016Publication History

ABSTRACT

Dynamic Time Warping (DTW) is a distance measure that compares two time series after optimally aligning them. DTW is being used for decades in thousands of academic and industrial projects despite the very expensive computational complexity, O(n2). These applications include data mining, image processing, signal processing, robotics and computer graphics among many others. In spite of all this research effort, there are many myths and misunderstanding about DTW in the literature, for example "it is too slow to be useful" or "the warping window size does not matter much." In this tutorial, we correct these misunderstandings and we summarize the research efforts in optimizing both the efficiency and effectiveness of both the basic DTW algorithm, and of the higher-level algorithms that exploit DTW such as similarity search, clustering and classification. We will discuss variants of DTW such as constrained DTW, multidimensional DTW and asynchronous DTW, and optimization techniques such as lower bounding, early abandoning, run-length encoding, bounded approximation and hardware optimization. We will discuss a multitude of application areas including physiological monitoring, social media mining, activity recognition and animal sound processing. The optimization techniques are generalizable to other domains on various data types and problems.

Skip Supplemental Material Section

Supplemental Material

kdd2016_tutorial_optimal_performance_01-acm.mp4

mp4

1.1 GB

kdd2016_tutorial_optimal_performance_02-acm.mp4

mp4

999.3 MB

References

  1. T. Barto and T. Skopal, "Revisiting Techniques for Lower bounding the Dynamic Time Warping Distance," in Proceedings of the 5th International Conference on Similarity Search and Applications, 2012, pp. 192--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. D. J. Berndt and J. Clifford, "Using Dynamic Time Warping to Find Patterns in Time Series," in KDD Workshop, 1994, pp. 359--370.Google ScholarGoogle Scholar
  3. Y. Chen, B. Hu, E. Keogh, and G. E. A. P.. Batista, "DTW-D: Time Series Semi-supervised Learning from a Single Example," in Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '13, 2013, p. 383. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Chu, E. Keogh, D. Hart, and M. Pazzani, "Iterative Deepening Dynamic Time Warping for Time Series," in Proceedings of the 2002 SIAM International Conference on Data Mining, 2002, pp. 195--212.Google ScholarGoogle Scholar
  5. P. Jangyodsuk, C. Conly, and V. Athitsos, "Sign Language Recognition Using Dynamic Time Warping and Hand Shape Distance Based on Histogram of Oriented Gradient Features," in Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments, 2014, pp. 50:1--50:6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. E. Keogh, "Exact indexing of dynamic time warping," in Proceedings of the 28th international conference on Very Large Data Bases, 2002, pp. 406--417. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. E. J. Keogh and M. J. Pazzani, "Scaling up dynamic time warping for data mining applications," in Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '00, 2000, pp. 285--289. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. E. J. Keogh, L. Wei, X. Xi, S. Lee, and M. Vlachos, "LB_Keogh Supports Exact Indexing of Shapes under Rotation Invariance with Arbitrary Representations and Distance Measures," in Vldb, 2006, pp. 882--893. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S.-W. Kim, S. Park, and W. W. Chu, "An index-based approach for similarity search supporting time warping in large sequence databases," in Data Engineering, 2001. Proceedings. 17th International Conference on, 2001, pp. 607--614. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Myers, L. Rabiner, and A. Rosenberg, "Performance tradeoffs in dynamic time warping algorithms for isolated word recognition," IEEE Trans. Acoust., vol. 28, no. 6, pp. 623--635, Dec. 1980.Google ScholarGoogle ScholarCross RefCross Ref
  11. F. Petitjean, G. Forestier, G. I. Webb, A. E. Nicholson, Y. Chen, and E. Keogh, "Dynamic Time Warping Averaging of Time Series Allows Faster and More Accurate Classification," in 2014 IEEE International Conference on Data Mining, 2014, pp. 470--479. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. L. R. Rabiner, A. E. Rosenberg, and S. E. Levinson, "Considerations in dynamic time warping algorithms for discrete word recognition," J. Acoust. Soc. Am., vol. 63, no. S1, pp. S79--S79, 1978.Google ScholarGoogle ScholarCross RefCross Ref
  13. T. Rakthanmanon, B. Campana, A. Mueen, G. Batista, B. Westover, Q. Zhu, J. Zakaria, and E. Keogh, "Searching and mining trillions of time series subsequences under dynamic time warping," in Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '12, 2012, p. 262. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. T. M. Rath and R. Manmatha, "Word image matching using dynamic time warping," in Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on, 2003, vol. 2, pp. II--521.Google ScholarGoogle Scholar
  15. H. Sakoe and S. Chiba, "Dynamic programming algorithm optimization for spoken word recognition," IEEE Trans. Acoust. Speech, Lang. Process., vol. 26, no. 1, pp. 43--50, 1978.Google ScholarGoogle ScholarCross RefCross Ref
  16. Y. Sakurai, C. Faloutsos, and M. Yamamuro, "Stream Monitoring under the Time Warping Distance," 2013 IEEE 29th Int. Conf. Data Eng., vol. 0, pp. 1046--1055, 2007.Google ScholarGoogle Scholar
  17. D. Sart, A. Mueen, W. Najjar, V. Niennattrakul, and E. Keogh, "Accelerating Dynamic Time Warping Subsequnce Search with GPUs and FPGAs. ICDM 2010," in Proceedings - IEEE International Conference on Data Mining, ICDM, 2010, pp. 1001--1006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. M. Toyoda, Y. Sakurai, and Y. Ishikawa, "Pattern Discovery in Data Streams Under the Time Warping Distance," VLDB J., vol. 22, no. 3, pp. 295--318, Jun. 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. N. Tselas and P. Papapetrou, "Benchmarking Dynamic Time Warping on Nearest Neighbor Classification of Electrocardiograms," in Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments, 2014, pp. 4:1--4:4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. B.-K. Y. B.-K. Yi, H. V. Jagadish, and C. Faloutsos, "Efficient retrieval of similar time sequences under time warping," in Proceedings 14th International Conference on Data Engineering, 1998, pp. 201--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Q. Zhu, G. Batista, T. Rakthanmanon, and E. Keogh, "A Novel Approximation to Dynamic Time Warping allows Anytime Clustering of Massive Time Series Datasets," in Proceedings of the 2012 SIAM International Conference on Data Mining, 2012, pp. 999--1010.Google ScholarGoogle Scholar
  22. Y. Chen, G. Chen, K. Chen, and B. C. Ooi, "Efficient Processing of Warping Time Series Join of Motion Capture Data," in 2009 IEEE 25th International Conference on Data Engineering, 2009, pp. 1048--1059. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. M. Shokoohi-Yekta, J. Wang, and E. Keogh, "On the Non-Trivial Generalization of Dynamic Time Warping to the Multi-Dimensional Case," in Proceedings of the 2015 SIAM International Conference on Data Mining, pp. 289--297.Google ScholarGoogle Scholar
  24. Keogh's Tutorials: http://www.cs.ucr.edu/~eamonn/tutorials.htmlGoogle ScholarGoogle Scholar

Index Terms

  1. Extracting Optimal Performance from Dynamic Time Warping

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
      August 2016
      2176 pages
      ISBN:9781450342322
      DOI:10.1145/2939672

      Copyright © 2016 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 August 2016

      Check for updates

      Qualifiers

      • tutorial

      Acceptance Rates

      KDD '16 Paper Acceptance Rate66of1,115submissions,6%Overall Acceptance Rate1,133of8,635submissions,13%

      Upcoming Conference

      KDD '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader