Skip to main content

2021 | OriginalPaper | Buchkapitel

PQ-HDC: Projection-Based Quantization Scheme for Flexible and Efficient Hyperdimensional Computing

verfasst von : Chi-Tse Huang, Cheng-Yang Chang, Yu-Chuan Chuang, An-Yeu (Andy) Wu

Erschienen in: Artificial Intelligence Applications and Innovations

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Brain-inspired Hyperdimensional (HD) computing is an emerging technique for low-power/energy designs in many machine learning tasks. Recent works further exploit the low-cost quantized (bipolarized or ternarized) HD model and report dramatic improvements in energy efficiency. However, the quantization loss of HD models leads to a severe drop in classification accuracy. This paper proposes a projection-based quantization framework for HD computing (PQ-HDC) to achieve a flexible and efficient trade-off between accuracy and efficiency. While previous works exploit thresholding-quantization schemes, the proposed PQ-HDC progressively reduces quantization loss using a linear combination of bipolarized HD models. Furthermore, PQ-HDC allows quantization with flexible bit-width while preserving the computational efficiency of the Hamming distance computation. Experimental results on the benchmark dataset demonstrate that PQ-HDC achieves a 2.82% improvement in accuracy over the state-of-the-art method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kanerva, P.: Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cogn. Comput. 1(2), 139–159 (2009)CrossRef Kanerva, P.: Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cogn. Comput. 1(2), 139–159 (2009)CrossRef
2.
Zurück zum Zitat Rahimi, A., et al.: Efficient biosignal processing using hyperdimensional computing: network templates for combined learning and classification of ExG signals. Proc. IEEE 107(1), 123–143 (2019)MathSciNetCrossRef Rahimi, A., et al.: Efficient biosignal processing using hyperdimensional computing: network templates for combined learning and classification of ExG signals. Proc. IEEE 107(1), 123–143 (2019)MathSciNetCrossRef
3.
Zurück zum Zitat Rahimi, A., et al.: Hyperdimensional computing for noninvasive brain–computer interfaces: blind and one-shot classification of EEG error-related potentials. In: Proceedings of the 10th ACM/EAI International Conference on Bio-Inspired Information and Communications Technologies (BICT), pp. 19–26 (2017) Rahimi, A., et al.: Hyperdimensional computing for noninvasive brain–computer interfaces: blind and one-shot classification of EEG error-related potentials. In: Proceedings of the 10th ACM/EAI International Conference on Bio-Inspired Information and Communications Technologies (BICT), pp. 19–26 (2017)
4.
Zurück zum Zitat Najafabadi, F.R., Rahimi, A., Kanerva, P., Rabaey, J.M.: Hyperdimensional computing for text classification. In: Design, Automation Test in Europe Conference Exhibition (DATE). University Booth (2016) Najafabadi, F.R., Rahimi, A., Kanerva, P., Rabaey, J.M.: Hyperdimensional computing for text classification. In: Design, Automation Test in Europe Conference Exhibition (DATE). University Booth (2016)
5.
Zurück zum Zitat Imani, M., et al.: VoiceHD: hyperdimensional computing for efficient speech recognition. In: ICRC, pp. 1–6. IEEE (2017) Imani, M., et al.: VoiceHD: hyperdimensional computing for efficient speech recognition. In: ICRC, pp. 1–6. IEEE (2017)
6.
Zurück zum Zitat Imani, M., et al.: HDNA: energy-efficient dna sequencing using hyperdimensional computing. In: BHI, pp. 271–274. IEEE (2018) Imani, M., et al.: HDNA: energy-efficient dna sequencing using hyperdimensional computing. In: BHI, pp. 271–274. IEEE (2018)
7.
Zurück zum Zitat Chang, E., et al.: Hyperdimensional computing-based multimodality emotion recognition with physiological signals. In: Proceedings of the IEEE International Symposium on AI for Circuits and Systems (AICAS), March 2019, pp. 137–141 (2019) Chang, E., et al.: Hyperdimensional computing-based multimodality emotion recognition with physiological signals. In: Proceedings of the IEEE International Symposium on AI for Circuits and Systems (AICAS), March 2019, pp. 137–141 (2019)
8.
Zurück zum Zitat Horowitz, M.: Computing’s energy problem (and what we can do about it). In: IEEE International Solid-State Circuits Conference on Digest of Technical Papers (ISSCC), February 2014, pp. 10–14 (2014) Horowitz, M.: Computing’s energy problem (and what we can do about it). In: IEEE International Solid-State Circuits Conference on Digest of Technical Papers (ISSCC), February 2014, pp. 10–14 (2014)
9.
Zurück zum Zitat Imani, M., et al.: QuantHD: a quantization framework for hyperdimensional computing. In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) (2019) Imani, M., et al.: QuantHD: a quantization framework for hyperdimensional computing. In: IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) (2019)
10.
Zurück zum Zitat Chuang, Y.-C., Chang, C.-Y., Wu, A.-Y.A.: Dynamic hyperdimensional computing for improving accuracy-energy efficiency trade-offs. In: IEEE Workshop on Signal Processing Systems (SiPS). IEEE (2020) Chuang, Y.-C., Chang, C.-Y., Wu, A.-Y.A.: Dynamic hyperdimensional computing for improving accuracy-energy efficiency trade-offs. In: IEEE Workshop on Signal Processing Systems (SiPS). IEEE (2020)
Metadaten
Titel
PQ-HDC: Projection-Based Quantization Scheme for Flexible and Efficient Hyperdimensional Computing
verfasst von
Chi-Tse Huang
Cheng-Yang Chang
Yu-Chuan Chuang
An-Yeu (Andy) Wu
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-79150-6_34

Premium Partner