Abstract
Verbmobil is a speaker-independent and bidirectional speech-to-speech translation system for spontaneous dialogs in mobile situations. It recognizes spoken input, analyses and translates it, and finally utters the translation. The multilingual system handles dialogs in three business-oriented domains, with context-sensitive translation between three languages (German, English, and Japanese). Since Verbmobil emphasizes the robust processing of spontaneous dialogs, it poses difficult challenges to human language technology, that we discuss in this paper. We present Verbmobil as a hybrid system incorporating both deep and shallow processing schemes. We describe the anatomy of Verbmobil and the functionality of its main components. We discuss Verbmobil’s multi-blackboard architecture that is based on packed representations at all processing stages. These packed representations together with formalisms for underspecification capture the non-determinism in each processing phase, so that the remaining uncertainties can be reduced by linguistic, discourse and domain constraints as soon as they become applicable. We present Verbmobil’s multi-engine approach, eg. its use of five concurrent translation engines: statistical translation, case-based translation, substring-based translation, dialog-act based translation, and semantic transfer. Distinguishing features like the multilingual prosody module and the generation of dialog summaries are highlighted. We conclude that Verbmobil has successfully met the project goals with more than 80% of approximately correct translations and a 90% success rate for dialog tasks.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alexandersson, J., Poller P., and Kipp, M. Generating Multilingual Dialog Summaries. In this volume.
Auerswald, M. Example-Based Machine Translation with Translation Templates. In this volume.
Becker, T., and Lopez, P. The Application of HPSG-to-TAG Compilation Techniques. In this volume.
Becker, T., Kilger, A., Lopez, P., and Poller, P. The Verbmobil Generation Component VMGECO. In this volume.
Block, H. Example-Based Incremental Synchronous Interpretation. In this volume.
Bub, T., Wahlster, W., and Waibel, A. (1997). Verbmobil: The Combination of Deep and Shallow Processing for Spontaneous Speech Translation. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing, München, Germany, 71 – 74, IEEE.
Burger, S., Weilhammer, K., Tillmann H., and Schiel, F. Verbmobil Data Collection and Annotation. In this volume.
Emele, M., Dorna, M., Lüdeling, A., Zinsmeister, H., and Rohrer C. Semantic-Based Transfer. In this volume.
Haiber, U., Mangold H., Regel-Brietzmann P., Ruske, G., and Schleß, V. Robust Recognition of Spontaneous Speech. In this volume.
Hinrichs, E.W., Kübler, S., Kordoni, V., and Müller, F. (a) Robust Chunk Parsing for Spontaneous Speech. In this volume.
Hinrichs, E.W., Bartels, J., Kawata Y., Kordoni, V., and Telljohann, H. (b) The Tübingen Treebanks for Spoken German, English, and Japanese. In this volume.
Jekat, S., and v. Hahn, W. Multilingual Verbmobil-Dialogs: Experiments, Data Collection and Data Analysis. In this volume.
Kay, M., Gawron, J.M., and P. Norvig. (1994) Verbmobil: A Translation System for Faceto-Face Dialog. Stanford, CSLI Lecture Notes No. 33 CA: CSLI Publications
Kiefer, B., Krieger, H.-U., and Nederhof, M.-J. Efficient and Robust HPSG Parsing of Word Graphs. In this volume.
Kipp, M., Alexandersson, J., Reithinger, N., and Engel, R. Dialog Processing. In this volume.
Malenke, M., Bäumler, M., and Paulus, E. Speech Recognition Performance Assessment. In this volume.
Klüter, A., Ndiaye, A., and Kirchmann, H. Verbmobil from a Software Engineering Point of View: System Design and Software Integration. In this volume.
Pinkal, M., Rupp C.J., and Worm, K. Robust Semantic Processing of Spoken Language. In this volume.
Schiehlen, M. Semantic Construction. In this volume.
Spilker J., Klarner, M., and Görz, G. Processing Self-Corrections in a Speech-to-Speech System. In this volume.
Stöber, K., Wagner, P., Helbig, J., Köster, S., Stall, D., Thomae, M., Blauert, J., Hess, W., Hoffmann, R., and Mangold, H. Speech Synthesis by Multilevel Selection and Concatenation of Units from Large Speech Corpora. In this volume.
Takezawa, T., Morimoto, T., Sagisaka, Y., Campbell, N., Iida, H., Sugaya, F., Yokoo, A., and Yamamoto, S. (1998): A Japanese-to-English Speech Translation System: ATRMATRIX. In Proceedings of the ICSLP, 957–960.
Tessiore, L., and v. Hahn, W. Functional Validation of a Machine Interpretation System: Verbmobil. In this volume.
Vogel, S., Och, F.J., Tillmann, C., Niessen, S., Sawaf, H., and Ney, H. Statistical Methods for Machine Translation. In this volume.
Waibel, A., Soltau, H., Schultz, T., Schaaf, Th., and Metze, F. Multilingual Speech Recognition. In this volume.
Wahlster, W (1993): Verbmobil: Translation of Face-to-Face Dialogs. In Proceedings of the Fourth Machine Translation Summit, Kobe, Japan, 128–135.
Woszczyna, M., ed., (1999) Proceedings of the C-STAR Workshop. Schwetzingen, Germany, September 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wahlster, W. (2000). Mobile Speech-to-Speech Translation of Spontaneous Dialogs: An Overview of the Final Verbmobil System. In: Wahlster, W. (eds) Verbmobil: Foundations of Speech-to-Speech Translation. Artificial Intelligence. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-04230-4_1
Download citation
DOI: https://doi.org/10.1007/978-3-662-04230-4_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-08730-1
Online ISBN: 978-3-662-04230-4
eBook Packages: Springer Book Archive