Abstract
As an overview, in terms of individual learning, ReaderBench encompasses the functionalities of both CohMetrix (McNamara et al. 2010) (see 2.2.2 Textual Complexity Computational Approaches) and iStart (McNamara et al. 2007a; Graesser et al. 2005) (see 2.3 Reading Strategies), as it provides teachers and learners information on their reading/writing activities: initial textual complexity assessment, assignment of texts to learners, capture of metacognitions reflected in one’s textual verbalizations, and reading strategies assessment (a detailed comparison is presented at the end of this chapter).
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
- Support Vector Machine
- Latent Semantic Analysis
- Individual Assessment
- Reading Strategy
- Semantic Distance
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Benjamin, R.G.: Reconstructing readability: Recent developments and recommendations in the analysis of text difficulty. Educational Psychology Review 24, 63–88 (2012)
Bergstra, J., Bengio, Y.: Random Search for Hyper-Parameter Optimization. The Journal of Machine Learning Research 13, 281–305 (2012)
Brown, J.D.: An EFL readability index. JALT Journal 20(2), 7–36 (1998)
Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(3), 27:21–27:27 (2011)
Chi, M.T.H., de Leeuw, N., Chui, M.H., Lavancher, C.: Eliciting self-explanations improves understanding. Cognitive Science 18, 439–477 (1994)
Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C. (eds.): Introduction to Algorithms, 3rd edn. MIT Press, Cambridge (2009)
Cortes, C., Vapnik, V.N.: Support-Vector Networks. Machine Learning 20(3), 273–297 (1995)
Dahl, R.: Matilda (trans: Robillot H). Folio Junior (Livre 744). Gallimard, Paris (2007)
Dascalu, M., Dessus, P., Bianco, M., Trausan-Matu, S., Nardy, A.: Mining Texts, Learners Productions and Strategies with ReaderBench. In: Peña-Ayala, A. (ed.) Educational Data Mining: Applications and Trends. SCI. Springer (in press)
Dascalu, M., Dessus, P., Trausan-Matu, Ş., Bianco, M., Nardy, A.: ReaderBench, an Environment for Analyzing Text Complexity and Reading Strategies. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS, vol. 7926, pp. 379–388. Springer, Heidelberg (2013)
Dascălu, M., Trausan-Matu, S., Dessus, P.: Towards an integrated approach for evaluating textual complexity for learning purposes. In: Popescu, E., Li, Q., Klamma, R., Leung, H., Specht, M. (eds.) ICWL 2012. LNCS, vol. 7558, pp. 268–278. Springer, Heidelberg (2012)
Davison, A., Kantor, R.: On the failure of readability formulas to define readable texts: A case study from adaptations. Reading Research Quarterly 17, 187–209 (1982)
Denhière, G., Lemaire, B., Bellissens, C., Jhean-Larose, S.: A semantic space for modeling children’s semantic memory. In: Landauer, T.K., McNamara, D.S., Dennis, S., Kintsch, W. (eds.) Handbook of Latent Semantic Analysis, pp. 143–165. Erlbaum, Mahwah (2007)
Dessus, P., Bianco, M., Nardy, A., Toffa, F., Dascalu, M., Trausan-Matu, S.: Automated analysis of pupils’ self-explanations of a narrative text. In: de Vries, E., Scheiter, K. (eds.) Staging knowledge and experience, Meeting of the EARLI SIG 2 “Comprehension of Text and Graphics”, Grenoble, France, pp. 52–54. LSE, Pierre-Mendès-France University (2012)
Duan, K.-B., Keerthi, S.S.: Which Is the Best Multiclass SVM Method? An Empirical Study. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 278–285. Springer, Heidelberg (2005)
Feng, L., Jansche, M., Huenerfauth, M., Elhadad, N.A.: Comparison of Features for Automatic Readability Assessment. In: 23rd Int. Conf. on Computational Linguistics (COLING 2010), Beijing, China, pp. 276–284. ACL (2010)
Flesch, R.: A new readability yardstick. Journal of Applied Psychology 32(3), 221–233 (1948)
François, T.: Les apports du traitement automatique du langage à la lisibilité du français langue étrangère. Université Catholique de Louvain, Faculté de Philosophie, Arts et Lettres, Louvain-la-Neuve, Belgium (2012)
François, T., Miltsakaki, E.: Do NLP and machine learning improve traditional readability formulas? In: First Workshop on Predicting and improving text readability for target reader populations (PITR2012), Montreal, Canada, pp. 49–57. ACL (2012)
Galley, M., McKeown, K.: Improving Word Sense Disambiguation in Lexical Chaining. In: Gottlob, G., Walsh, T. (eds.) 18th International Joint Conference on Artificial Intelligence (IJCAI 2003), Acapulco, Mexico, pp. 1486–1488. Morgan Kaufmann Publishers, Inc. (2003)
Geisser, S.: Predictive inference: an introduction. Chapman and Hall, New York (1993)
Gervasi, V., Ambriola, V.: Quantitative assessment of textual complexity. In: Barbaresi, M.L. (ed.) Complexity in Language and Text, Plus, Pisa, Italy, pp. 197–228 (2002)
Graesser, A.C.: An introduction to strategic reading comprehension. In: McNamara, D.S. (ed.) Reading Comprehension Strategies: Theories, Intervention and Technologies, pp. 3–26. Erlbaum, Mahwah (2007)
Graesser, A.C., McNamara, D.S., Louwerse, M.M., Cai, Z.: Coh-Metrix: Analysis of text on cohesion and language. Behavioral Research Methods, Instruments, and Computers 36(2), 193–202 (2004)
Graesser, A.C., McNamara, D.S., VanLehn, K.: Scaffolding deep comprehension strategies through Point&Query, AutoTutor, and iStart. Educational Psychologist 40(4), 225–234 (2005)
Graesser, A.C., Singer, M., Trabasso, T.: Constructing inferences during narrative text comprehension. Psychological Review 101(3), 371–395 (1994)
Gunning, R.: The technique of clear writing. McGraw-Hill, New York (1952)
House, A., Kuiken, F.: Complexity, Accuracy, and Fluency in Second Language Acquisition. Applied Linguistics 30(4), 461–473 (2009)
Hsu, C.-W., Lin, C.-J.: A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks 13(2), 415–425 (2002)
Hsu, C.W., Chang, C.-C., Lin, C.-J.: A practical guide to support vector classification. National Taiwan University, Taipei (2010)
Kincaid, J.P., Fishburne, R.P., Rogers, R.L., Chissom, B.S.: Derivation of New Readability Formulas (automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Chief of Naval Technical Training, Naval Air Station Memphis (1975)
Kozak, K., Agrawal, A., Machuy, N., Csucs, G.: Data Mining Techniques in High Content Screening: A Survey. Journal of Computer Science & Systems Biology 2, 219–239 (2009)
Kukemelk, H., Mikk, J.: The Prognosticating Effectivity of Learning a Text in Physics. Quantitative Linguistics 14, 82–103 (1993)
Landauer, T.K., Dumais, S.T.: A solution to Plato’s problem: the Latent Semantic Analysis theory of acquisition, induction and representation of knowledge. Psychological Review 104(2), 211–240 (1997)
Lee, H., Chang, A., Peirsman, Y., Chambers, N., Surdeanu, M., Jurafsky, D.: Deterministic coreference resolution based on entity-centric, precision-ranked rules. Computational Linguistics 39(4) (2013)
Lee, H., Peirsman, Y., Chang, A., Chambers, N., Surdeanu, M., Jurafsky, D.: Stanford’s Multi-Pass Sieve Coreference Resolution System at the CoNLL-2011 Shared Task. In: Fifteenth Conference on Computational Natural Language Learning: Shared (TaskCONLL Shared Task 2011), Portland, OR, pp. 28–34. ACL (2011)
Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval, vol. 1. Cambridge University Press, Cambridge (2008)
McNamara, D.S.: SERT: Self-Explanation Reading Training. Discourse Processes 38, 1–30 (2004)
McNamara, D.S., Boonthum, C., Levinstein, I.B.: Evaluating self-explanations in iSTART: Comparing word-based and LSA algorithms. In: Landauer, T.K., McNamara, D.S., Dennis, S., Kintsch, W. (eds.) Handbook of Latent Semantic Analysis, pp. 227–241. Erlbaum, Mahwah (2007a)
McNamara, D.S., Graesser, A.C., Louwerse, M.M.: Sources of text difficulty: Across the ages and genres. In: Sabatini, J.P., Albro, E. (eds.) Assessing Reading in the 21st Century, p. 27. R&L Education, Lanham (in press)
McNamara, D.S., Louwerse, M.M., McCarthy, P.M., Graesser, A.C.: Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes 47(4), 292–330 (2010)
McNamara, D.S., O’Reilly, T.P., Rowe, M., Boonthum, C., Levinstein, I.B.: iSTART: A web-based tutor that teaches self-explanation and metacognitive reading strategies. In: McNamara, D.S. (ed.) Reading Comprehension Strategies: Theories, Interventions, and Technologies, pp. 397–420. Erlbaum, Mahwah (2007b)
Millis, K., Magliano, J.P., Todaro, S.: Measuring discourse-level processes with verbal protocols and Latent Semantic Analysis. Scientific Studies of Reading 10(3), 225–240 (2006)
Nardy, A., Bianco, M., Toffa, F., Rémond, M., Dessus, P.: Contrôle et régulation de la compréhension: l’acquisition de stratégies de 8 à 11 ans. In: David, J., Royer, C. (eds.) L’apprentissage de la Lecture: Convergences, Innovations, Perspectives, p. 16. Peter Lang, Bern-Paris (in press)
O’Reilly, T.P., Sinclair, G.P., McNamara, D.S.: iSTART: A Web-based Reading Strategy Intervention that Improves Students’ Science Comprehension. In: Kinshuk, S.D.G., Isaías, P. (eds.) Int. Conf. Cognition and Exploratory Learning in Digital Age (CELDA 2004), Lisbon, Portugal, p. 8. IADIS Press (2004)
Oprescu, B., Dascalu, M., Trausan-Matu, S., Dessus, P., Bianco, M.: Automated Assessment of Paraphrases in Pupil’s Self-Explanations. Scientific Bulletin, University Politehnica of Bucharest, Series C (in press)
Oprescu, B., Dascalu, M., Trausan-Matu, S., Rebedea, T., Dessus, P., Bianco, M.: Analiza automata a auto-explicatiilor. Revista Romana de Interactiune Om-Calculator 5(2), 71–76 (2012)
Page, E.: The imminence of grading essays by computer. Phi Delta Kappan 47, 238–243 (1966)
Page, E.: Analyzing student essays by computer. International Review of Education 14(2), 210–225 (1968)
Petersen, S.E., Ostendorf, M.: A machine learning approach to reading level assessment. Computer Speech and Language 23, 89–106 (2009)
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, New York (2007)
Raghunathan, K., Lee, H., Rangarajan, S., Chambers, N., Surdeanu, M., Jurafsky, D., Manning, C.A.: Multi-Pass Sieve for Coreference Resolution. In: Conference on Empirical Methods in Natural Language Processing (EMNLP 2010), Cambridge, MA, pp. 492–501. ACL (2010)
Sagot, B.: WordNet Libre du Francais (WOLF). INRIA, Paris (2008)
Sagot, B., Darja, F.: Building a free French wordnet from multilingual resources. In: Ontolex 2008, Marrakech, Maroc, p. 6 (2008)
Schmidt, H.: Probabilistic Part-of-Speech Tagging Using Decision Trees. In: Int. Conf. on New Methods in Language Processing, Manchester, UK, vol. 4, pp. 44–49. Citeseer (1994)
Schmidt, H.: TreeTagger -a language independent part-of-speech tagger. Institute for Computational Linguistics, University of Stuttgart, Stuttgart (1995)
Schulze, M.: Measuring textual complexity in student writing. In: American Association of Applied Linguistics (AAAL 2010), Atlanta, GA, pp. 590–619. Waterloo Centre for German Studies (2010)
Shannon, C.E.: A Mathematical Theory of Communication. The Bell System Technical Journal 27, 379–423, 623–656 (1948)
Shannon, C.E.: Prediction and entropy of printed English. The Bell System Technical Journal 30, 50–64 (1951)
Slotnick, H.: Toward a theory of computer essay grading. Journal of Educational Measurement 9(4), 253–263 (1972)
Toutanova, K., Klein, D., Manning, C.D., Singer, Y.: Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network. In: HLT-NAACL 2003, Edmonton, Canada, pp. 252–259. ACL (2003)
Trabasso, T., van den Broek, P.: Causal thinking and the representation of narrative events. Journal of Memory and Language 24, 612–630 (1985)
Trausan-Matu, S., Dascalu, M., Dessus, P.: Textual Complexity and Discourse Structure in Computer-Supported Collaborative Learning. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 352–357. Springer, Heidelberg (2012)
van Dijk, T.A., Kintsch, W.: Strategies of discourse comprehension. Academic Press, New York (1983)
Vitale, M.R., Romance, N.R.: A knowledge-based framework for unifying content-area reading comprehension and reading comprehension strategies. In: McNamara, D.S. (ed.) Reading Comprehension Strategies, pp. 73–104. Erlbaum, Mahwah (2007)
Wolfe, M.B.W., Magliano, J.P., Larsen, B.: Causal and semantic relatedness in discourse understanding and representation. Discourse Processes 39(2-3), 165–187 (2005)
Wresch, W.: The imminence of grading essays by computer—25 years later. Computers and Composition 10(2), 45–58 (1993)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Dascalu, M. (2014). ReaderBench (2) - Individual Assessment through Reading Strategies and Textual Complexity. In: Analyzing Discourse and Text Complexity for Learning and Collaborating. Studies in Computational Intelligence, vol 534. Springer, Cham. https://doi.org/10.1007/978-3-319-03419-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-03419-5_8
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03418-8
Online ISBN: 978-3-319-03419-5
eBook Packages: EngineeringEngineering (R0)