Skip to main content
SpringerLink
Log in

A Comprehensive Study of Machine Translation Tools and Evaluation Metrics

  • Conference paper
  • First Online:
Inventive Systems and Control

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 204))

Abstract

In this article, the ideas of statistical and neural machine translation approaches were explored. Various machine translation tools and machine translation evaluation metrics were also investigated. Nowadays, machine translation plays a key role in the society where different languages are spoken as it removes the language barrier and digital divide in the society by providing access to all information in the local language which a person can understand. There were different phases of machine translation as its evolution is concerned, and different approaches were followed in different phases some requiring an enormous amount of parallel corpus which is considered a crucial element of machine translation. In the proposed system, some of the parameters were examined to carry the analysis of several translation tools, and evaluation metrics are also available for accessing the quality of machine translation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. M. Zafar, Interactive English to Urdu machine translation using example-based approach. 1(3), 275–282 (2009)

    Google Scholar 

  2. L.J. Schulman, Communication on noisy channel: a coding theorm for computation (IEEE Computer Society Press, 1992), pp. 724–733

    Google Scholar 

  3. D. Bahdanau, K. Cho, Y. Bengio, Neural machine translation by jointly learning to align and translate (2014), pp. 1–15

    Google Scholar 

  4. K. Cho, B. van Merrienboer, D. Bahdanau, Y. Bengio, On the properties of neural machine translation: encoder–decoder approaches (2015), pp. 103–111

    Google Scholar 

  5. P. Koehn et al., Moses: open source toolkit for statistical machine translation, in Proceedings of the 45th annual meeting of the ACL on interactive poster and demonstration sessions (2007), pp. 177–180

    Google Scholar 

  6. A. Stolcke, SRILM-an extensible language modeling toolkit, in 7th international Conference on Spoken Language Processing (2002)

    Google Scholar 

  7. P. Clarkson, R. Rosenfeld, Statistical language modeling using the CMU-Cambridge toolkit, in 5th European Conference on Speech Communication and Technology (1997)

    Google Scholar 

  8. P. Koehn, Pharaoh: a beam search decoder for phrase-based statistical machine translation models, in Conference of the Association for Machine Translation in the Americas (2004), pp. 115–124

    Google Scholar 

  9. A. Patry, F. Gotti, P. Langlais, MOOD: a modular object-oriented decoder for statistical machine translation, in LREC (2006), pp. 709–714

    Google Scholar 

  10. M. Junczys-Dowmunt et al., Marian: fast neural machine translation in c++, in Proceedings of the ACL 2018—58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations (2015), pp. 116–121

    Google Scholar 

  11. R. Sennrich et al., Nematus: a toolkit for neural machine translation, in 15th Conference of the European Chapter of the Association for Computational Linguistics EACL 2017—Proceedings of the Software Demonstrations (2017), pp. 65–68

    Google Scholar 

  12. Q.U. Guide, Thot Toolkit for statistical machine translation (2017)

    Google Scholar 

  13. D.J. Walker, The open “ai” kitTM: general machine learning modules from statistical machine translation, in Workshop of MT Summit X, Open-Source Machine Translation (2005)

    Google Scholar 

  14. K. Heafield, KenLM: faster and smaller language model queries, in Proceedings of the 6th Workshop on Statistical Machine Translation (2011), pp. 187–197

    Google Scholar 

  15. M. Federico, N. Bertoldi, M. Cettolo, IRSTLM: an open source toolkit for handling large scale language models, in 9th Annual Conference of the International Speech Communication Association (2008)

    Google Scholar 

  16. G. Klein, Y. Kim, Y. Deng, J. Senellart, A.M. Rush, Opennmt: open-source toolkit for neural machine translation. arXiv Prepr. arXiv1701.02810 (2017)

    Google Scholar 

  17. M.L. Forcada et al., Apertium: a free/open-source platform for rule-based machine translation. Mach. Transl. 25(2), 127–144 (2011)

    Article  Google Scholar 

  18. Z. Li et al., Joshua: an open source toolkit for parsing-based machine translation, in Proceedings of the 4th Workshop on Statistical Machine Translation (2009), pp. 135–139

    Google Scholar 

  19. M. Mohanan, P. Samuel, Open NLP based refinement of software requirements. Int. J. Comput. Inf. Syst. Ind. Manag. Appl. 8, 293–300 (2016)

    Google Scholar 

  20. A.K. McCallum, Mallet: a machine learning for language toolkit (2002). http//mallet.cs.umass.edu

    Google Scholar 

  21. L. Verwimp, P. Wambacq, et al., TF-LM: tensor flow-based language modeling Toolkit (2019), pp. 2968–2973. https://www.lrec-conf.org/proceedings/lrec2018/index.html

  22. D.O. Mart\inez, Thot Toolkit for statistical machine translation (2018)

    Google Scholar 

  23. K. Papineni, S. Roukos, T. Ward, W.-J. Zhu, BLEU: a method for automatic evaluation of machine translation, in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (2002), pp. 311–318

    Google Scholar 

  24. Y. Zhang, S. Vogel, A. Waibel, Interpreting bleu/nist scores: how much improvement do we need to have a better system?, in LREC (2004)

    Google Scholar 

  25. M. Snover, B. Dorr, R. Schwartz, L. Micciulla, J. Makhoul, A study of translation edit rate with targeted human annotation, in Proceedings of Association for Machine Translation in the Americas, vol. 200, no. 6 (2006)

    Google Scholar 

  26. S. Banerjee, A. Lavie, METEOR: an automatic metric for MT evaluation with improved correlation with human judgments, in Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization (2005), pp. 65–72

    Google Scholar 

  27. A. Mauser, S. Hasan, H. Ney, Automatic evaluation measures for statistical machine translation system optimization, in LREC (2008)

    Google Scholar 

  28. C.-Y. Lin, F.J. Och, Orange: a method for evaluating automatic evaluation metrics for machine translation, in COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics (2004), pp. 501–507

    Google Scholar 

  29. Y.S. Chan, H.T. Ng, MAXSIM: a maximum similarity metric for machine translation evaluation, in Proceedings of ACL-08: HLT (2008), pp. 55–62.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of CS and IT, Maulana Azad National Urdu University, Hyderabad, India

    Syed Abdul Basit Andrabi & Abdul Wahid

Authors
  1. Syed Abdul Basit Andrabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdul Wahid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Syed Abdul Basit Andrabi .

Editor information

Editors and Affiliations

  1. Research and Industry Incubation Center, Dayananda Sagar College of Engineering, Bengaluru, Karnataka, India

    V. Suma

  2. Department of Electrical Engineering, Dayeh University, Changhua, Taiwan

    Joy Iong-Zong Chen

  3. School of Information Technology, Deakin University, Geelong, VIC, Australia

    Zubair Baig

  4. GoPerception Laboratory, Cornell University, Ithaca, NY, USA

    Haoxiang Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Andrabi, S.A.B., Wahid, A. (2021). A Comprehensive Study of Machine Translation Tools and Evaluation Metrics. In: Suma, V., Chen, J.IZ., Baig, Z., Wang, H. (eds) Inventive Systems and Control. Lecture Notes in Networks and Systems, vol 204. Springer, Singapore. https://doi.org/10.1007/978-981-16-1395-1_62

Download citation

Publish with us

Policies and ethics

Search

Navigation