Skip to main content

2020 | OriginalPaper | Buchkapitel

A Preliminary Attempt to Evaluate Machine Translations of Ukiyo-e Metadata Records

verfasst von : Yuting Song, Biligsaikhan Batjargal, Akira Maeda

Erschienen in: Digital Libraries at Times of Massive Societal Transition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Providing multilingual metadata records for digital objects is a way expanding access to digital cultural collections. Recent advancements in deep learning techniques have made machine translation (MT) more accurate. Therefore, we evaluate the performance of three well-known MT systems (i.e., Google Translate, Microsoft Translator, and DeepL Translator) in translating metadata records of ukiyo-e images from Japanese to English. We evaluate the quality of their translations with an automatic evaluation metric BLEU. The evaluation results show that DeepL Translator is better at translating ukiyo-e metadata records than Google Translate or Microsoft Translator, with Microsoft Translator performing the worst.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen, J., Azogu, O., Knudson, R.: Enabling multilingual information access to digital collections: an investigation of metadata records translation. In: Proceedings of the 2014 ACM/IEEE Joint Conference on Digital Libraries, pp. 467–468 (2014) Chen, J., Azogu, O., Knudson, R.: Enabling multilingual information access to digital collections: an investigation of metadata records translation. In: Proceedings of the 2014 ACM/IEEE Joint Conference on Digital Libraries, pp. 467–468 (2014)
2.
Zurück zum Zitat Chen, J., Ding, R., Jiang, S., Knudson, R.: A preliminary evaluation of metadata records machine translation. Electron. Libr. 30(2), 264–277 (2012)CrossRef Chen, J., Ding, R., Jiang, S., Knudson, R.: A preliminary evaluation of metadata records machine translation. Electron. Libr. 30(2), 264–277 (2012)CrossRef
6.
Zurück zum Zitat Goto, S., Lin, D., Ishida, T.: Crowdsourcing for evaluating machine translation quality. In: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), pp. 3456–3463 (2014) Goto, S., Lin, D., Ishida, T.: Crowdsourcing for evaluating machine translation quality. In: Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), pp. 3456–3463 (2014)
7.
Zurück zum Zitat Isabelle, P., Cherry, C., Foster, G.: A challenge set approach to evaluating machine translation. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2486–2496 (2017) Isabelle, P., Cherry, C., Foster, G.: A challenge set approach to evaluating machine translation. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2486–2496 (2017)
8.
Zurück zum Zitat Lavie, A., Agarwal, A.: METEOR: an automatic metric for MT evaluation with high levels of correlation with human judgments. In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pp. 65–72 (2005) Lavie, A., Agarwal, A.: METEOR: an automatic metric for MT evaluation with high levels of correlation with human judgments. In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pp. 65–72 (2005)
12.
Zurück zum Zitat Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2002) Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2002)
13.
Zurück zum Zitat Reyes Ayala, B., Knudson, R., Chen, J., Cao, G., Wang, X.: Metadata records machine translation combining multi-engine outputs with limited parallel data. J. Assoc. Inf. Sci. Technol. 69(1), 47–59 (2018)CrossRef Reyes Ayala, B., Knudson, R., Chen, J., Cao, G., Wang, X.: Metadata records machine translation combining multi-engine outputs with limited parallel data. J. Assoc. Inf. Sci. Technol. 69(1), 47–59 (2018)CrossRef
14.
Zurück zum Zitat Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of the 7th Conference of the Association for Machine Translation of the Americas, pp. 223–231 (2006) Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of the 7th Conference of the Association for Machine Translation of the Americas, pp. 223–231 (2006)
Metadaten
Titel
A Preliminary Attempt to Evaluate Machine Translations of Ukiyo-e Metadata Records
verfasst von
Yuting Song
Biligsaikhan Batjargal
Akira Maeda
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-64452-9_24