Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Bücher
Zeitschriften
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
MTZ-Fachkongress

Antriebe und Energiesysteme von morgen


Austausch von Automobil- und Energiewirtschaft

Am 14./15. Mai geht es in Chemnitz um die Mobilitätswende durch Elektro- und Wasserstofffahrzeuge.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
BoundaryNet: An Attentive Deep Network with Fast Marching Distance Maps for Semi-automatic Layout Annotation Kapitel lesen Erstes Kapitel lesen

2021 | OriginalPaper | Buchkapitel

One-Model Ensemble-Learning for Text Recognition of Historical Printings

verfasst von : Christoph Wick, Christian Reul

Erschienen in: Document Analysis and Recognition – ICDAR 2021

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a novel method for Automatic Text Recognition (ATR) on early printed books. Our approach significantly reduces the Character Error Rates (CERs) for book-specific training when only a few lines of Ground Truth (GT) are available and considerably outperforms previous methods. An ensemble of models is trained simultaneously by optimising each one independently but also with respect to a fused output obtained by averaging the individual confidence matrices. Various experiments on five early printed books show that this approach already outperforms the current state-of-the-art by up to 20% and 10% on average. Replacing the averaging of the confidence matrices during prediction with a confidence-based voting boosts our results by an additional 8% leading to a total average improvement of about 17%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Explore Hierarchical Relations Reasoning and Global Information Aggregation
Nächstes Kapitel On the Use of Attention in Deep Learning Based Denoising Method for Ancient Cham Inscription Images
Fußnoten
3
Since it is usually unclear how many lines of GT are required to achieve a certain CER and the transcriptions effort correlates with the amount of errors within the ATR result, it is usually advantageous to perform the GT production iteratively: Starting from an often quite erroneous output of an existing mixed model only a minimal amount of GT (for example 100 lines) is produced and used to train a first book-specific model. In most cases, applying this model to unseen data (for example 150 further lines) already results in a significantly better ATR output which can be corrected much faster than before. After training another model these steps are repeated until a satisfactory CER is reached or the whole book is transcribed.
 
4
Since the traditional cross-fold training approach consists of n, usually five, independent training sub processes it is possible to minimise the training duration by running these processes in parallel if several, ideally n, GPUs are available. However, we think that the presence of, at most, a single GPU should be considered the default case.
 
Literatur
1.
Al Azawi, M., Liwicki, M., Breuel, T.: Combination of multiple aligned recognition outputs using WFST and LSTM. In: 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 31–35. IEEE (2015)
2.
Boschetti, F., Romanello, M., Babeu, A., Bamman, D., Crane, G.: Improving OCR accuracy for classical critical editions. In: Research and Advanced Technology for Digital Libraries, pp. 156–167 (2009)
3.
Breuel, T.: High performance text recognition using a hybrid convolutional-LSTM implementation. In: 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), pp. 11–16. IEEE (2017)
4.
Calvo-Zaragoza, J., Toselli, A.H., Vidal, E.: Handwritten music recognition for mensural notation with convolutional recurrent neural networks. Pattern Recogn. Lett. (2019)
5.
Graves, A., Fernández, S., Gomez, F., Schmidhuber, J.: Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In: Proceedings of the 23rd International Conference on Machine learning, pp. 369–376. ACM (2006)
6.
Kiessling, B.: Kraken - an Universal Text Recognizer for the Humanities. DH 2019 Digital Humanities (2019)
7.
Kingma, D., Ba, J.: Adam: a method for stochastic optimization. In: ICLR (2014)
8.
Kurata, G., Audhkhasi, K.: Guiding ctc posterior spike timings for improved posterior fusion and knowledge distillation. arXiv preprint arXiv:​1904.​08311 (2019)
9.
Reul, C., et al.: Ocr4all–an open-source tool providing a (semi-) automatic ocr workflow for historical printings. App. Sci. 9(22), 4853 (2019)CrossRef
10.
Reul, C., Springmann, U., Wick, C., Puppe, F.: Improving OCR accuracy on early printed books by utilizing cross fold training and voting. In: 2018 13th IAPR International Workshop on Document Analysis Systems (DAS). pp. 423–428. IEEE (2018). https://​ieeexplore.​ieee.​org/​document/​8395233
11.
12.
Rice, S.V., Jenkins, F.R., Nartker, T.A.: The fifth annual test of OCR accuracy. Information Science Research Institute (1996)
13.
Rice, S.V., Kanai, J., Nartker, T.A.: An algorithm for matching OCR-generated text strings. Int. J. Pattern Recogn. Artif. Intell. 8(05), 1259–1268 (1994)CrossRef
14.
Rice, S.V., Nartker, T.A.: The ISRI analytic tools for OCR evaluation. UNLV/Information Science Research Institute, TR-96-02 (1996)
15.
16.
Smith, R.: An overview of the Tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), vol. 2, pp. 629–633. IEEE (2007)
17.
18.
19.
Sánchez, J.A., Romero, V., Toselli, A.H., Villegas, M., Vidal, E.: Icdar 2017 competition on handwritten text recognition on the read dataset. In: 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 01, pp. 1383–1388 (2017). https://​doi.​org/​10.​1109/​ICDAR.​2017.​226
20.
Wick, C., Puppe, F.: Experiments and detailed error-analysis of automatic square notation transcription of medieval music manuscripts using CNN/LSTM-networks and a neume dictionary. J. New Music Res., 1–19 (2021)
21.
Wick, C., Reul, C., Puppe, F.: Calamari - a high-performance tensorflow-based deep learning package for optical character recognition. Digital Human. Q. 14(1) (2020)
Metadaten
Titel
One-Model Ensemble-Learning for Text Recognition of Historical Printings
verfasst von
Christoph Wick
Christian Reul
Copyright-Jahr
2021
Buch
Document Analysis and Recognition – ICDAR 2021

Print ISBN: 978-3-030-86548-1

Electronic ISBN: 978-3-030-86549-8

Copyright-Jahr: 2021

DOI
https://doi.org/10.1007/978-3-030-86549-8_25

Premium Partner

    Bildnachweise