Abstract
During the last 50 years, since the development of ELIZA by Weizenbaum, technologies for developing conversational systems have made a great stride. The number of conversational systems is increasing. Conversational systems emerge almost in every digital device in many application areas. In this paper, we present the review of the development of conversational systems regarding technologies and their special features including language tricks.
Access provided by CONRICYT-eBooks. Download conference paper PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
1 Introduction
Fifty years ago, the chatbot ELIZA was created and considered the first piece of conversational software. The chatbot ELIZA was intended to emulate a psycho-therapist. At that time, it did not pass the Turing test (Turing 1950). Today, conversational computer systems are emerging in many domains, ranging from hotline support over game environments to educational contexts. Some of them can pass the Turing test (e.g., Eugene Goostman (Eugene 2014)). Not only we can find conversational computer systems in many application domains, but smartphones that almost everyone uses daily are integrated with a natural language speech assistant (e.g., “Siri” for iPads, “S-Voice” for Samsung tablets/smartphones, “Google Now”), which allows the user to give commands or to ask for information. Recently, “Alexa” speaker of Amazon has been developed and is available for English and German speakers. We are facing a change in human-computer interaction: the interaction between humans and computer systems is shifting towards natural language-based interfaces. This paper aims at reviewing the technologies that have been being developed to build conversational systems. Concretely, we investigate the following research questions: Which technologies have been deployed for developing conversational systems? Which language tricks have been commonly exploited? How are typical evaluation methods for conversational systems?
2 Methodology
In order to answer the above questions, we searched on the Internet using search machines. Documents that matched the keywords “chatbot”, “conversational agent”, “pedagogical agent”, or “conversational system” were collected. The number of resulting papers was enormous. Since we intended to investigate technologies for developing conversational systems, we constrained our search based on the following criteria:
-
1.
The conversational system was developed for scientific purposes;
-
2.
The conversational system must have been scientifically evaluated or participated in a competition;
-
3.
Information about the technologies deployed in that system was available.
At the end, we reviewed 59 conversational systems that are summarized in Appendix “Table of reviewed conversational systems”. We categorized the collected systems into “chatbots” and “dialog systems” (Klüwer 2011; Dingli and Scerri 2013; van Woudenberg 2014). The terminology “chatbot” originated from the system CHATTERBOT, which was invented as a game character for the 1989 multiuser dungeon game “TinyMUD” (Mauldin 1994). From the technical point of view, Klüwer (2011) summarized the following typical processing steps of a chatbot: (1) input cleaning (removal and substitution of characters and words like smileys and contractions), (2) using a pattern-matching algorithm to match input templates against the cleaned input, (3) determining the response templates, and (4) generating a response. The second category of conversational systems is “dialog system”. This term denotes a system, which is able to hold a conversation with another agent or with a human. McTear notes the following differences between dialog systems and chatbots: “Dialog systems make use of more theoretically motivated techniques” and “dialog systems often are developed for a specific domain, whereas simulated conversational systems [chatbots] are aimed at open domain conversation.” (McTear 2004). While a typical chatbot is built based on a knowledge base, which comprises a fixed set of input-response templates and a pattern-matching algorithm, a dialogue system typically requires four components: a preprocessing component, a natural language understanding component, a dialog manager, and a response generation component (Lester et al. 2004). The main differences in the architecture between dialog systems and chatbots are the natural language understanding component and the dialog manager.
These two categories of conversational systems are not clearly defined. Rather, these categories describe typical components of each type of conversational systems. A chatbot may also have been implemented using natural language understanding technologies, e.g., LSABot (Agostaro et al. 2005) or overlaps with other components of a typical dialog system. Despite of the overlapping between the two categories, our review is based on them to classify collected conversational systems and their technologies.
3 Results
3.1 Chatbots
Pattern Matching.
Pattern matching techniques were used by many chatbots including ELIZA (Weizenbaum 1966), SHRDLU (Winograd 1972; Hutchens 1997), Speech Chatbot (Senef et al. 1991), PARRY (Colby 1981; Hutchens 1997), PC Therapist III (Weintraub 1986; Hutchens 1997), Chatterbot in “TinyMUD” (Mauldin 1994), TIPS (Whalen 1996; Hutchens 1997), FRED (Garner 1996; Hutchens 1997), CONVERSE (Batacharia et al. 1997; Bradeško and Mladenić 2012), HEX (Hutchens 1997), Albert One (Garner, 2005; Bradeško and Mladenić, 2012), Jabberwock (Pirner 2005; Bradeško and Mladenić 2012). ELIZA, the first chatbot developed by Weizenbaum (1966), deployed pattern matching in order to generate an appropriate response to the user’s utterance. For example, ELIZA would analyze the user’s input “He says I’m depressed much of the time” by matching it to the keywords in a pre-specified dictionary. Then, for a found keyword, ELIZA applies an associated input-response rule. Based on this principle, ELIZA transforms the phrase “I am” into the phrase “You are”. The response generation algorithm adds a phrase “I am sorry to hear” prior to “you are” and a response is generated “I am sorry to hear you are depressed.”
Cleverscript.
Rollo Carpenter invented the core concepts and developed an algorithm for a chatbot in 1982 (https://www.existor.com/products/cleverbot-data-for-machine-learning). In 1996, this algorithm and the chatbot went online under the name “Jabberwacke”. Since 2006, this chatbot was rebranded as Cleverbot and the authoring language Cleverscript for developing chatbots was announced (Cleverscript 2016). The main concept of Cleverscript is based on spreadsheets. Words and phrases that can be recognized (input) or generated (output) by Cleverscript are written on separate lines of the spreadsheet (Jackermeier 2015). Cleverscript and the concept of this chatbot authoring language make the development of chatbots relatively easy. In 2007, Eviebot (https://www.eviebot.com/en/), a female embodied chatbot with realistic facial expressions, went online. Additionally, Boibot, a male counterpart for Eviebot, was introduced in 2015 (https://www.boibot.com/en/). Both share the same technology with Cleverbot and are able to speak several languages.
Chatscript.
Chatscript is another authoring language, which serves to facilitate the development of chatbots. Similar to Cleverscript, Chatscript is based on pattern matching (Jackermeier 2015). Another special feature of Chatscript is the so-called Concept Set, which covers semantic-related concepts of a constituent in user input. Chatbots that have been developed using Chatscripts include Suzette (Wilcox and Wilcox 2010), Rosette (Abdul-Kader and Woods 2015), Albert (Latorre-Navarro and Harris 2015), and a conversational agent of Bogatu and colleagues (2015).
AIML.
In 2001, an XML based language for developing chatbots called AIML was released. The “A.L.I.C.E.” chatbot (Wallace 2003) was the first one developed using this technology. In the past few years, AIML has established itself as one of the most used technologies in today’s chatbots. AIML is based on pattern matching (das Graças Bruno Marietto et al. 2013). An AIML script consists of several “categories”, which are defined by the tag <category>. Each category consists of only one <pattern> tag, which defines a possible user input, and at least one <template> tag, which specifies the chatbot’s response for the user’s input. Like Cleverscript, AIML makes use of wildcards in order to cover a large possibility of user’s inputs. In order to interpret these AIML tags, a chatbot needs an AIML interpreter, which is implemented according to the corresponding AIML specification (either 1.0 or 2.0). Various AIML interpreters using different programming languages such as Java or Python are available (http://www.alicebot.org). Since developing AIML chatbots does not require skills in a specific programming language, this technology facilitates the development of chatbots. Thus, a huge body of chatbots has been developed using AIML technology such as Freudbot (Freudbot 2009), Max (Kopp et al. 2005), the chatbots in (Pilato et al. 2005), Penelope and Alex (Doering et al. 2008), HmoristBot (Augello et al. 2008), chatbot of Alencar et al. (Alencar and Netto 2011), the system of van Rosmalen et al. (2012), Ella (Bradeško and Mladenić 2012), MathGame (Silvervarg et al. 2013), Chappie (Behera 2016), and Mitsuku (Abdul-Kader et al. 2015).
Language Tricks.
In addition to the technologies for chatbots above, we also notice that many chatbots used language tricks in order to fool users and to pass the evaluation. Abdul-Kader (2015) and Bradeško and Mladenić (2012) summarized four language tricks that are usually used by chatbots including: canned responses, model of personal history, no logical conclusion, typing errors and simulating key strokes. Canned responses are used by chatbots in order to cover questions/answers of the user that are not anticipated in the knowledge based of the chatbot. A model of personal history (e.g., history about the past, childhood stories, social environments, and political and religious attitudes, etc.) enriches the “social background” of a chatbot and pretends the user to a real “person”. Statements with no logical conclusion like “today is today” are embedded in chatbots in order to enrich smalltalks. Typing errors and simulating key strokes are usually used to simulate a “human being” who is typing and making typo errors. HeX (Hutchens 1997), CONVERSE (Batacharia et al. 1997; Bradeško and Mladenić 2012), PC Therapist III (Bradeško and Mladenić, 2012), and TIPS (Bradeško and Mladenić 2012) are conversational systems that make use of one or more language tricks.
3.2 Dialog Systems
Based on typical components of a dialog system (Lester et al. 2004), we reviewed the technologies of these components.
Preprocessing.
Most dialog systems process the user’s input before it is forwarded to the Natural Language Understanding component. The tasks of pre-process are divers. Berger (2014) summarized the following preprocessing tasks of dialog systems: sentence detection, co-resolution, tokenization, lemmatization, POS-tagging, dependency parsing, named entity recognition, semantic role labeling. We found that the dialog systems mostly deployed the following natural language preprocessing tasks: Tokenization (Veselov 2010; Wilks et al. 2010; Eugene 2014; Bogatu et al. 2015; Amilon 2015), POS-Tagging (Lasguido et al. 2013; Dingli et al. 2013; Higashinaka et al. 2014; Ravichandran et al. 2015), sentence detection or chunking (Latorre-Navarro et al. 2015), Named Entity Recognition (Wilks et al. 2010; Lasguido et al. 2013).
Natural Language Understanding.
The result of preprocessing tasks is ready for the natural language understanding component. For this step, the following approaches are used in dialog systems: Latent Semantic Analysis based on the Vector Space Model (VSM), e.g. in LSAbot (Agostaro et al. 2005), IRIS (Branchs et al. 2012), AutoTutor (Graesser et al. 1999), Operation ARIES! (Forsyth et al. 2013), dialog system of Pilato et al. (2005); TF-IDF techniques, e.g., Discussion-Bot (Feng et al. 2007).
Dialog Manager.
The dialogue manager is responsible for coordinating the flow of the conversation in a dialogue system. Approaches to developing dialogue manager are categorized in (1) finite state-based systems, (2) frame-based systems, and (3) agent-based systems Klüwer (2011) and Berger (2014). In finite state-based dialog systems, the flow of the dialogue is specified through a set of dialogue states with transitions denoting various alternative paths through a dialogue graph. At each state, the system produces prompts, recognizes (or rejects) specific words and phrases in response to the prompt, and produces actions based on the recognized response. The dialogue states and their transitions must be designed in advance. Many dialogue systems have been developed applying this approach, e.g. the Nuance automatic banking system (van Woudenberg 2014). Frame-based systems ask the user questions that enable the system to fill slots in a template in order to perform a task such as providing train timetable information. In this type of systems, the dialog flow is not fixed. The dialog flow depends upon the content of the user input, and the information that is elicited by the system. This approach has been used in systems that provide information about movies, train schedules, and the weather. The advantage of the simplicity of these domains is that it is possible to build very robust dialogue systems. One does not need to obtain full linguistic analyses of the user input. The approach underlying agent-based dialog systems is detecting the plans, beliefs and desires of the users and modeling this information in a Belief-Desire-Intention (BDI) agent. Due to the multiple reasoning steps for constructing plans, beliefs and desires of the users, this approach is challenging.
Response Generation. The technologies deployed for generating responses are various in different dialog systems. CONVERSE has a generation module, which adds different types of the same expression to an utterance and generates a smooth response (Batacharia et al. 1997). RITEL has a natural language generation module, which is based upon a set of template sentences (Galibert et al. 2005). The proposed conversational system of Higashinaka et al. (2014) combines different modules for utterance generation: the versatile, question answering, personal question answering, topic-inducing, related-word, Twitter, predicate-argument structure, pattern and user predicate-argument structure modules. The generation of utterances applying these modules is based on the last estimated dialogue-act. The conversational agent Albert (Latorre-Navarro et al. 2015) has a language generation module, which consists of templates containing text, pointers, variables and other control functions.
Special Features.
In addition to technologies for typical dialog systems, we also have learned that conversational systems have been implemented with special features in order to make them more likely “humans”. For instance, some systems are able to learn from conversations and can apply this knowledge later. The chatbot MegaHal (Hutchens 1997; Hutchens et al. 1998) talks a lot of gibberish in order to fool its user, whereas the system Ella (Bradeško and Mladenić 2012) is able to spot gibberish initiated by the user and react in an appropriate way. Moreover, there are many multimodal systems (Ferguson et al. 1996; Bickmore et al. 2000; Bohus et al. 2004; Pradhan et al. 2016), which can communicate with the user through both text and speech channels. With the development of embodied conversational agents, features like gestures, facial expressions or eye gazes become increasingly important (Alexander et al. 2006; Ayedoun et al. 2015). Developers of pedagogical agents also often include graphics, videos, animations and interactive simulations into their system to increase the student’s motivation (Kim et al. 2007; Forsyth et al. 2013; Pradhan et al. 2016).
3.3 Evaluation Methods
Since we only collected conversational systems that have been evaluated or participated in a competition contest, we categorized the evaluation methods that have been used into four classes: (1) qualitative analysis, (2) quantitative analysis, (3) pre-/posttest, and (4) chatbot competitions. Note, that many systems may have been evaluated using more than just one evaluation method.
The first most applied evaluation method was the quantitative method, which used interviews or questionnaires. Examples of conversational systems that have been evaluated using this method include, e.g., Speech Chatbot (Senef et al. 1991), TRAINS-95 (Ferguson et al. 1996; Sikorski and Allen 1996), Herman the Bug in Design-A-Plant (Lester et al. 1997), REA (Bickmore et al., Bickmore and Cassell 2000), LARRI (Bohus et al. 2004), FAQchat (Shawar et al. 2005), Discussion-Bot (Feng et al. 2007), Freudbot (Freudbot 2009), Justin and Justina (Kenny et al. 2011), the dialogue system of Shibata et al. (2014), or Pharmabot (Comendador et al. 2015).
The second widely used evaluation method is quantitative. The quantitative method makes use of dialog protocols generated by conversations between the user and the system. Examples of conversational systems that have been evaluated using this method include RAILTEL (Bennacef et al. 1996), Max (Kopp et al. 2005), HumoristBot (Augello et al. 2008), Senior Companion (Wilks et al. 2010, 2008), SimStudent (MacLellan et al. 2014), Betty’s Brain (Leelawong et al. 2008; Biswas et al. 2005), CALMsystem (Kerly et al. 2007), Discussion-Bot (Feng et al. 2007), the dialogue system of Planells et al. (2013), or Albert (Latorre-Navarro et al. 2015).
The third evaluation method deploys pre- and post-tests. The method has been used usually for evaluating pedagogical agents to measure the learning effect. This method was applied for the evaluation of MathGirls (Kim et al. 2007), My Science Tutor (Pradhan et al. 2016), Herman the Bug (Lester et al. 1997) or MetaTutor (Bouchet et al. 2013; Harley et al. 2014).
The fourth evaluation method is the participation of a conversational system in a competition contest, for example, the Loener prize, which is based on the Turing Test (Abdul-Kader et al. 2015). Loebner Prize winners were, for instance, PARRY (Colby 1981; Hutchens 1977), CONVERSE (Batacharia et al. 1997; Bradevsko et al. 2012), A.L.I.C.E (Wallace 2003), Albert One (Garner 2005; Bradeško and Mladenić 2012), Elbot (Abdul-Kader et al. 2015), and Mitsuku (Abdul-Kader et al. 2015).
4 Discussion and Conclusions
In this paper, we have reviewed the technologies, language tricks, special features, and evaluation methods of conversational systems. While chatbots deploy dominantly pattern matching techniques and language tricks, most dialog systems exploit natural language technologies. We also have learned that most chatbots participated in the Turing test contests (e.g., Loebner prize), while dialog systems were mostly evaluated by the pre-/post-test, quantitative, or qualitative methods. This can be explained by the fact that dialog systems are more goal-oriented (e.g., to improve learning gains of students) and chatbots rather serve smalltalks in different domains. Based on the summary table in Appendix, we can notice the tendency of applied technologies for conversational systems: they are becoming more AI-oriented and deploying more natural language processing technologies.
In this paper, due to the page limit, we summarized the technologies for developing conversational systems. We plan to elaborate on these technologies in more details in a journal article.
References
Abdul-Kader, S.A., Woods, J.: Survey on Chatbot design techniques in speech conversation systems. Int. J. Adv. Comput. Sci. Appl. 6(7), 72–80 (2015)
Agostaro, F., Augello, A., Pilato, G., Vassallo, G., Gaglio, S.: A conversational agent based on a conceptual interpretation of a data driven semantic space. In: Advances in Artificial Intelligence. LNCS, vol. 3673, pp. 381–392 (2005)
Alexander, S., Sarrafzadeh, A., Hill, S.: Easy with eve: a functional affective tutoring system. In: Rebolledo-Mendez, G., Martinez-Miron, E. (eds.) Workshop on Motivational and Affective Issues in ITS held at the 8th International Conference on ITS, pp. 38–45 (2006)
Alencar, M., Netto, J.M.: In Proceedings - Frontiers in Education Conference (2011)
Amilon, M.: Chatbot with common-sense database. Bachelor’s thesis in Computer Science, KTH Royal Institute of Technology, Sweden (2015)
Augello, A., Saccone, G., Gaglio, S., Pilato, G.: Humorist bot: bringing computational humour in a Chat-Bot system. In: Proceedings of the International Conference on Complex, Intelligent and Software Intensive Systems (2008)
Ayedoun, E., Hayashi, Y., Seta, K.: A conversational agent to encourage willingness to communicate in the context of english as a foreign language. J. Procedia Comput. Sci. 60, 1433–1442 (2015). ScienceDirect
Batacharia, B., Levy, D., Catizone, R., Krotov, A., Wilks, Y.: CONVERSE: a conversational companion. In: Wilks, Y. (ed.) Machine Conversations. The Springer International Series in Engineering and Computer Science, vol. 511. Springer, Heidelberg (1997)
Behera, B.: Chappie-A Semi-automatic Intelligent Chatbot (2016). https://www.cse.iitb.ac.in/~bibek/WriteUP_2016.pdf. Accessed 02 May 2017
Bennacef, S., Devillers, L., Rosset, S., Lamel, L.: Dialog in the RAILTEL Telephone-Based System (1996)
Berger, M.: Modelling of Natural Dialogues in the Context of Speech-based Information and Control Systems. Ph.D. dissertation submitted to Christian-Albrechts-Universität zu Kiel. AKA. IOS Press (2014)
Bickmore, T., Cassell, J.: “How about this weather?” Social Dialogue with Embodied Conversational Agents. American Association for Artificial Intelligence (2000)
Biswas, G., Schwartz, D., Leelawong, K., Vye, N., TAG-V: Learning by teaching a new agent paradigm for educational software. Int. J. Appl. Artif. Intell. 19(3–4) (2005)
Bogatu, A., Rotarescu, T., Rebedea, T., Ruseti, S.: Conversational Agent that Models a Historical Personality (2015)
Bohus, D., Rudnicky, A.I.: LARRI: a language-based maintenance and repair assistant. Computer Science Department (2004). http://repository.cmu.edu/compsci/1347
Bouchet, F., Harley, J.M., Azevedo, R.: Impact of different pedagogical agents’ adaptive self-regulated prompting strategies on learning with MetaTutor. In: Proceedings of the International Conference on Artificial Intelligence in Education, pp. 815–819 (2013)
Bradeško, L., Mladenić, D.: A survey of chabot systems through a Loebner prize competition. Artificial Intelligence laboratory, Jozef Stefan Institute, Ljubljana Slovenia (2012)
Branchs, R.F., Li, H.: IRIS: a chat-oriented dialogue system based on the vector space model. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 37–42. Association for Computational Linguistics (2012)
Cleverbot: Data for Machine Learning. Conversation Data API on (2016). https://www.existor.com/products/cleverbot-data-for-machine-learning/. Accessed 12 Feb 2017
Cleverscript (2016). https://www.existor.com/products/cleverscript/. Accessed 6 Dec 2017
Colby, K.M.: Modeling a paranoid mind. Behav. Brain Sci. 4(4), 515–534 (1981). doi:10.1017/S0140525X00000030. Cambridge University Press
Comendador, B.E.V., Francisco, B.M.B., Medenilla, J.F., Nacion, S.M.T., Serac, T.B.E.: Pharmabot: a pediatric generic medicine consultant Chatbot. J. Autom. Control Eng. 3(2), 137–140 (2015)
das Graças Bruno Marietto, M., de Aguiar, R.V., de Oliveira Barbosa, G., Botelho, W.T., Pimentel, E., dos Santos Franca, R., da Silva, V.L.: Artificial intelligence markup language: a brief tutorial (2013)
Dingli, A., Scerri, D.: Dialog systems and their inputs. In: HCI International 2013 - Posters’ Extended Abstracts. Communications in Computer and Information Science, vol. 374, pp. 601–605 (2013)
Doering, A., Veletsianos, G., Yerasimou, T.: Conversational agents and their longitudinal affordances on communication and interaction. J. Interact. Learn. Res. 19(2), 251–270 (2008). AACE
Eugene: Turing Test Sucess Marks Milestone in Computing History (2014). Accessed 08 Dec 2016
Feng, D., Shaw, E., Kim, J., Hovy, E.: An intelligent discussion-bot for answering student queries in threaded discussions. Interaction Challenges for Intelligent Assistants, Papers from the 2007 AAAI Spring Symposium, Technical report SS-07-04 (2007)
Ferguson, G., Allen, J., Miller, B.: TRAINS-95: towards a mixed-initiative planning assistant. In: Proceedings of the 3rd Conference on Artificial Intelligence Planning Systems, pp. 70–77. AAAI (1996)
Forsyth, C.M., Graesser, A.C., Pavlik Jr., P., Cai, Z., Butler, H., Halpern, D., Millis, K.: Operation ARIES!: methods, mystery, and mixed models: discourse features predict affect in a serious game. J. Educ. Data Min. 5(1), 147–189 (2013)
Freudbot (2009). https://fhss2.athabascau.ca/html/Freudbot/test.html. Accessed 12 Feb 2017
Galibert, O., Illouz, G., Rosset, S.: Ritel: an open-domain, human-computer dialog system. In: Proceedings of the 9th European Conference on Speech Communication and Technology (2005)
Garner, R.: The idea of FRED. ALMA-Scores of the Unfinished Thought, Issue 1 (1996)
Garner, R.: Multifaceted Conversational Systems. Colloquium on Conversational Systems, University of Surrey (2005). http://www.robitron.com/Robby/Multifaceted.ppt. Accessed 04 May 2017
Graesser, A.C., Wiemer-Hastings, K., Wiemer-Hastings, P., Kreuz, R.: AutoTutor: a simulation of a human tutor. J. Cogn. Syst. Res. 1, 35–51 (1999). Oden, G.C. (ed.)
Harley, J.M., Bouchet, F., Papaioannou, N., Carter, C., Trevors, G., Feyzi-Beghnagh, R., Azevedo, R., Landis, R.S.: Assessing learning with MetaTutor, a multi-agent hypermedia learning environment. In: Symposium on Innovative Practices for Assessing Learning in Computer Based Learning Environments, American Educational Research Association (2014)
Higashinaka, R., Imamura, K., Meguro, T., Miyazaki, C., Kobayashi, N., Sugiyama, H., Hirano, T., Makino, T., Matsuo, Y.: Towards an open-domain conversational system fully based on natural language processing. In: Proceedings of the 25th International Conference on Computational Linguistics, pp. 928–939 (2014)
Hutchens, J.L.: How to Pass the Turing Test by Cheating (1997)
Hutchens, J.L., Alder, M.D.: Introducing MegaHal. In: Proceedings of the Joint Conference on New Methods in Language Processing and Computational Natural Language Learning, pp. 271–274 (1998)
Jackermeier, R.: Analyse von Chatbot-Beschreibungssprachen AIML 2.0 im Vergleich zu ChatScript und Cleverscript (2015)
Kenny, P.G., Parsons, T.D.: Embodied conversational virtual patients. In: Perez-Marin, D., Pascual-Nieto, I. (eds.) Conversational Agents and Natural Language Interaction: Techniques and Effective Practices (2011)
Kerly, A., Ellis, R., Bull, S.: CALMsystem: a conversational agent for learner modelling. In: Proceedings of AI-2007, 27th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, pp. 89–102. Springer (2007)
Kim, Y., Wei, Q., Xu, B., Ko, Y., Ilieva, V.: MathGirls: toward developing girls’ positive attitude and self-efficacy through pedagogical agents. In: Luckin, R., Koedinger, K.R., Greer, J. (eds.) Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work, vol. 158, pp. 119–126. IOS Press (2007)
Klüwer, T.: From Chatbots to Dialog Systems. In: Perez-Marin, D., Pascual-Nieto, I. (eds.) Conversational Agents and Natural Language Interaction: Techniques and Effective Practices (2011)
Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application (2005)
Lasguido, N., Sakti, S., Neubig, G., Toda, T., Adriani, M., Nakamura S.: Developing non-goal dialog system based on examples of drama television. In: Natural Interaction with Robots, Knowbots and Smartphones, pp. 355–361 (2013)
Latorre-Navarro, E.M., Harris, J.G.: An intelligent natural language conversational system for academic advising. (IJACSA) Int. J. Adv. Comput. Sci. Appl. 6(1), 110–119 (2015)
Leelawong, K., Biswas, G.: Designing learning by teaching agents: the Betty’s brain system. Int. J. Artif. Intell. Educ. 18(3), 181–208 (2008)
Lester, J.C., Converse, S.A., Kahler, S.E., Barlow, S.T., Stone, B.A., Bhogal, R.S.: The persona effect: affective impact of animated pedagogical agents. In: Proceedings of CHI, pp. 359–366. ACM Press (1997)
Lester, J., Branting, K., Mott, B.: Conversational agents. In: Singh, M.P. (ed.) The Practical Handbook of Internet Computing. Chapman & Hall/CRC, Boca Raton (2004)
MacLellan, C.J., Wiese, E.S., Matsuda, N., Koedinger, K.R.: SimStudent: Authoring Expert Models by Tutoring (2014)
Mauldin, M.L.: Chatterbots, TinyMuds, and the turing test: entering the Loebner Prize competition. In: Proceedings of the 12th National Conference on Artificial Intelligence, vol. 1, pp. 16–21. American Association for Artificial Intelligence (1994)
McTear, M.F.: Spoken Dialogue Technology-Toward the Conversational User Interface. Springer, London (2004)
Pilato, G., Vassallo, G., Augello, A., Vasile, M., Gaglio, S.: Expert chat-bots for cultural heritage. Intelligenza Artificiale 2, 25–31 (2005)
Pirner, J.: The beast can talk (2005). http://www.abenteuermedien.de/jabberwock/how-jabberwock-works.pdf. Accessed 04 May 2017
Planells, J., Hurtado, L., Segarra, E., Sanchis, E.: A multi-domain dialog system to integrate heterogeneous SpokenDialog systems. In: Proceedings of 14th Annual Conference of the International Speech Communication Association (2013)
Pradhan, S., Cole, R., Ward, W.: My science tutor: learning science with a conversational virtual tutor. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics - System Demonstrations, pp. 121–126 (2016)
Ravichandran, G., Reddy, N.M., Shriya G.S.: dBot: AI based conversational agent. Int. J. Sci. Res. (IJSR) (2015). ISSN (Online): 2319-7064, 1277-1279
Sarrafzadeh, A., Fourie, L., Kingston, T., Alexander, S.T.V., Overmyer, S., Shanbehzadeh, J.: Eve: an affect-sensitive pedagogical agent. In: Global Business and Technology Association Conference, pp. 573–579 (2014)
Senef, S., Glass, J.G., Hirschmann, L., Polifroni, J.: Development and preliminary evaluation of the MIT ATIS system. In: Proceedings of the Workshop on Speech and Natural Language, pp. 88–93. Association for Computational Linguistics (1991)
Shawar, B.A., Atwell, E., Roberts, A.: FAQchat as an information retrieval system. In: Proceedings of the 2nd Language and Technology Conference Human Language Technologies as a Challenge, pp. 274–278 (2005)
Shibata, T., Egashira, Y., Kurohashi, S.: Chat-like conversational system based on selection of reply generating module with reinforcement learning. In: Proceedings of 5th International Workshop on Spoken Dialog Systems (2014)
Sikorski, T., Allen, J.F.: TRAINS-95 System Evaluation (1996)
Silvervarg, A., Jönsson, A.: Towards a conversational pedagogical agent capable of affecting attitudes and self-efficacy (2013)
Toney, D., Rosset, S., Max, A., Galibert, O., Bilinski, E.: An evaluation of spoken and textual interaction in the RITEL interactive question answering system. In: Proceedings of the International Conference on Language Resources and Evaluation (2008)
Turing, A.M.: Computing Machinery and Intelligence. Mind 49, 433–460 (1950)
Van Rosmalen, P., Eikelboom, J., Bloemers, E., van Winzum, K., Spronck, P.: Towards a game-chatbot: extending the interaction in serious games. In: Proceedings of the 6th European Conference on Games Based Learning (2012)
Van Woudenberg, A.F.: A Chatbot dialogue manager, Chatbots and dialogue systems: a hybrid approach. Master thesis, Open University of the Netherlands (2014)
Veselov, V.: Eugene Goostman (2010)
Wallace, R.S.: The elements of AIML style. In: 2003 ALICE A.I. Foundation, Inc. (2003)
Weintraub, J.: History of the PC Therapist (1986). http://www.loebner.net/Prizef/weintraub-bio.html.
Weizenbaum, J.: A computer program for the study of natural language communication between man and machine. Commun. ACM 9(1), 36–45 (1966)
Whalen, T.: My experience at Loebner prize, ALMA, Issue 1 (1996)
Wilcox, B., Wilcox, S.: Suzette, the Most Human Computer (2010)
Wilks, Y., Worgan, S.: A prototype for a Conversational Companion for reminiscing about images. In: Computer Speech & Language (2008). doi:10.1016/j.csl.2010.04.002
Wilks, Y., Catizone, R., Dingli, A., Cheng, W.: Demonstration of a prototype for a Conversational Companion for reminiscing about images. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (2010)
Winograd, T.: Understanding Natural Language. Academic Press, Cambridge (1972)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix: Table of Reviewed Conversational Systems
Appendix: Table of Reviewed Conversational Systems
Year | Category (Name) | Technology |
---|---|---|
1966 | Chatbot (ELIZA) (Weizenbaum 1966) | Pattern matching; keyword searching |
1971 | Parsing, interpretation-action-module | |
1972 | Parsing, grammatical detection, semantic analysis | |
1991 | Chatbot (PC Therapist III) (Bradeško and Mladenić 2012) | Parsing, pattern matching, knowledge database (quotes & phrases) |
1991 | Speech Chatbot (Senef et al. 1991) | Parsing, Response Generator, Semantic Frame Representation, Pattern Matching |
1994 | Chatbot (TIPS) (Bradeško and Mladenić 2012) | Pattern matching, system similar to a database |
1994 | Chatbot (Chatterbot in TinyMud) (Mauldin 1994) | Pattern matching, Markov chain models |
1996 | Chatbot (HeX) (Hutchens 1997) | Pattern matching, Markov chain models |
1996 | Chatbot (Jabberwacky/Cleverbot) (Cleverbot 2016) | Cleverscript |
1996 | Speech Dialog System (TRAINS-95) (Ferguson et al. 1996) | Bottom-up chart parser; Discourse manager; Text generator; Language understanding; Verbal reasoner |
1996 | Speech Dialog System (RAILTEL) (Bennacef et al. 1996) | Speech recognition; Literal and contextual understanding; Parser, Dialog manager |
1997 | Chatbot (CONVERSE) (Batacharia et al. 1997; Bradeško and Mladenić, 2012) | Input module; Pre-processing; Parser; Pattern matching; WordNet synonyms; ontology; fact & person database; Action module; Topic change module; Utterance generator |
1997 | Speech Dialog System (Herman the Bug) (Lester et al. 1997) | Coherence-Structured Behavior Space Framework, Behaviour Control |
1998 | Chatbot (MegaHal) (Hutchens 1998) | Markov chain models; Keyword matching |
1999 | Dialog system (AutoTutor) (Graesser et al. 1999) | NLP (POS tags); Dialog move generator; Latent semantic analysis; Regular expression matching; Speech act classifiers |
1998–99 | Chatbot (Albert One) (Garner 2005; Bradeško and Mladenić 2012) | Pattern matching |
2000 | Speech Dialog System (REA) (Bickmore et al. 2000) | Discourse planner; Natural language generation engine |
2000/01 | Chatbot (A.L.I.C.E) (Wallace 2003) | AIML |
2001 | Advanced Pattern Matching; Tokenization (dynamic) | |
2002 | Chatbot (Ella) (Bradeško and Mladenić 2012) | Pattern matching, AIML, WorldNet |
2003 | Chatbot (Jabberwock) (Pirner 2005; Bradeško and Mladenić, 2012) | Parsing (Context Free Grammar); Pattern Matching; Markov Chains Models |
2004 | Speech Dialog System (LARRI) (Bohus et al. 2004) | Speech recognition; Dialog manager; Response generator; Parsing with semantic Grammar; Task Markup Language |
2005 | Dialog System (Freudbot) (Freudbot 2009) | AIML |
2005 | Dialog System (LSAbot) (Agostaro et al. 2005) | LSA, AIML (same knowledge database as ALICE) |
2005 | Dialog System (FAQchat) (Shawar et al. 2005) | Advanced Pattern Matching |
2005 | Embodied Dialog System (Max) (Kopp et al. 2005) | NLP, Dialog Manager; Interpreter; AIML |
2005 | Speech Dialog System (RITEL) (Galibert et al. 2005; Toney et al. 2008) | Speech Recognition; Parsing; Input Analysis, Named Entity Analysis; Lexical Analysis; Dialog Manager; Response Generator |
2005 | Chatbot (Pilato et al. 2005) | AIML, Latent Semantic Analysis |
2006 | Speech Dialog System (Eve) (Alexander et al. 2006; Sarrafzadeh et al. 2014) | Facial expression analysis; Case-Based Methods; Dialog Manager |
2007 | Dialog System (CALMsystem) (Kerly et al. 2007) | NLP techniques; Pattern Matching |
2007 | Chatbot (Discussion-Bot) (Feng et al. 2007) | Information-Retrieval and NLP techniques |
2007 | Speech Dialog System (MathGirls) (Kim et al. 2007) | Relational database where actions are stored |
2008 | Dialogue System (Penelope and Alex) (Doering et al. 2008) | AIML |
2008 | Dialogue System (Betty’s Brain) (Leelawong et al. 2008; Biswas et al. 2005) | Qualitative Reasoning Methods; Perception System; Knowledge Database |
2008 | Dialog System (HumoristBot) (Augello et al. 2008) | AIML |
2010 | Chatbot (Suzette) (Wilcox and Wilcox 2010) | ChatSript |
2010 | Dialog System (Senior Companion) (Wilks et al. 2010; Wilks et al. 2008) | Tokenization; POS tagging; Parsing; Information Extraction techniques (Named Entity Recognition); Reasoner; Dialog Manager |
2011 | Chatbot (Rosette) (Abdul-Kader et al. 2015) | ChatScript |
2011 | Speech Embodied Dialog System (JUSTIN und JUSTINA) (Kenny et al. 2011) | Speech Recognition; Parsing, Question-Answering; Pattern Matching; Dialog Manager; Response Generator |
2011 | Chatbot (Alencar et al. 2011) | AIML |
2011 | Dialog System (Operation ARIES!) (Forsyth et al. 2013) | Training Module; LSA; Regular Expressions; Pattern Matching |
2012 | Chatbot (IRIS) (Branchs et al. 2012) | Vector Space Model |
2012 | Chatbot (van Rosmalen et al. 2012) | Lexical analysis, AIML, semantic structure |
2013 | Chatbot (Mitsuku) (Abdul-Kader et al. 2015) | AIML |
2013 | Dialog System (Lasguido et al. 2013) | Dialog Manager; POS-Tagging, NER, Similarity Search |
2013 | Dialog System (Math Game) (Silvervarg et al. 2013) | AIML; Dialog Manager |
2013 | Dialog System (MetaTutor) (Bouchet et al. 2013; Harley et al. 2014) | NLP, Dialog Manager, Parsing, XML, Facial Expression Analysis |
2013 | Speech Dialog System (Planells et al. 2013) | Speech recognition; Task Manager, Multimodal Response Generator |
2013 | Dialog System (Prototype) (Dingli et al. 2013) | ChatScript, POS-Tagging, Response Generator |
2014 | Dialog System (Higashinaka et al. 2014) | Natural language understanding (Noun Phrase removal, POS-Tagging); Dialog Manager; Response Generator; Question-Answering; Pattern Matching |
2014 | Dialog System (Shibata et al. 2014) | Dialog Manager, Response Generator, Markov Chain Models |
2014 | Dialog System (SimStudent) (MacLellan et al. 2014) | Machine-Learning techniques; Regular Expressions |
2014 | Dialog System (My Science Tutor, Virtual Tutor Marni) (Pradhan et al. 2016) | Parsing; Semantic annotation |
2015 | Chatbot (Amilon 2015) | Parsing (Parser Trees); ConceptNet |
2015 | Speech Dialog System (dBot) (Ravichandran et al. 2015) | parsing, POS-Tagging, Noun-Phrase Extraction + Artificial Intelligence algorithm |
2015 | Dialog System (Model of Historical Personality) (Bogatu et al. 2015) | ChatScript, POS-Tagging, Tokenization, Lemmatization; Morphological analysis |
2015 | Dialog System (Pharmabot) (Comendador et al. 2015) | Parsing |
2015 | Dialog System (Albert) (Latorre-Navarro et al. 2015) | Dialog manager; ChatScript; NLU (POS Tags; Noun-Phrase Chunking; Lexical Relations) |
2016 | Chatbot (Chappie) (2016) | NLP; AIML; Response Generator |
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Masche, J., Le, NT. (2018). A Review of Technologies for Conversational Systems. In: Le, NT., van Do, T., Nguyen, N., Thi, H. (eds) Advanced Computational Methods for Knowledge Engineering. ICCSAMA 2017. Advances in Intelligent Systems and Computing, vol 629. Springer, Cham. https://doi.org/10.1007/978-3-319-61911-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-61911-8_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-61910-1
Online ISBN: 978-3-319-61911-8
eBook Packages: EngineeringEngineering (R0)