Using Heuristic Rules from Sentence Decomposition of Experts- Summaries to Detect Students- Summarizing Strategies

Authors: Norisma Idris, Sapiyan Baba, Rukaini Abdullah

Abstract:

Summarizing skills have been introduced to English syllabus in secondary school in Malaysia to evaluate student-s comprehension for a given text where it requires students to employ several strategies to produce the summary. This paper reports on our effort to develop a computer-based summarization assessment system that detects the strategies used by the students in producing their summaries. Sentence decomposition of expert-written summaries is used to analyze how experts produce their summary sentences. From the analysis, we identified seven summarizing strategies and their rules which are then transformed into a set of heuristic rules on how to determine the summarizing strategies. We developed an algorithm based on the heuristic rules and performed some experiments to evaluate and support the technique proposed.

Keywords: Summarizing strategies, heuristic rules, sentencedecomposition.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1078871

References:

[1] A. L. Brown, and J. D. Day, "Macrorules for summarizing texts: The development of expertise" Journal of Verbal Learning and Verbal Behavior, 1983, Vol. 22, pp. 1-14.
[2] Gurdashan Kaur. "The Role of Summarization Instruction in the Comprehension of Expository Texts", Unpublished Master dissertation. Faculty of Education, University of Malaya, 1997.
[3] I. Zipitria, A. Arruarte, J. A. Elorriaga, and A. Díaz de Ilarraza, "Towards a Cognitive Model of Summary Evaluation", in J. Mostow & P. Tedesco (Eds.) Proceedings of the ITS-2004 on Modeling Human Teaching Tactics and Strategies, 2004, pp. 25-34. Maceió, Brazil.
[4] D. Wade-Stein, and E. Kintsch, "Summary Street: Interactive Computer Support for Writing", Cognition and Instruction, 2004, Vol. 22, pp 333 - 362.
[5] M. Franzke, E. Kintsch, D. Caccamise, N. Johnson, and S. Dooley, "Summary Street®: Computer support for comprehension and writing" Journal Educational Computing Research, 2005, Vol. 33(1) 53-80.
[6] B. Lemaire, S. Mandin, P. Dessus, and G. Denhière, "Computational cognitive models of summarization assessment skills", Proceedings of the 27th Annual Meeting of the Cognitive Science Society (CogSci' 2005). Stresa, Italy, July 21-23, 2005, pp.1266-1271.
[7] P. Winograd, "Strategic Difficulties in Summarizing Texts", Reading Research Quarterly. 1984, 19(4):404ÔÇö425.
[8] I. Norisma, Mohd. Sapiyan Baba, and Rukaini Abdullah, "An Analysis on student-written summaries: A Step towards Developing an Automated Summarization Assessment", International Conference on Electrical Engineering and Informatics (ICEEI2007). Institut Teknologi Bandung, Indonesia, June 17 - 19, 2007, pp. 550 - 553.
[9] I. Mani, Automatic Summarization. Amsterdam: John Benjamins Publishing Company, 2001, Chapter 3.
[10] B. Endres-Niggemeyer, K. Haseloh, J. Miller, S. Peist, I. Santini de Segel, A. Sigel, J. Wheeler, and B. Wollny, B. Summarizing Information. Springer, Berlin, 1998.
[11] H. Jing, and K. McKeown, "Cut and Paste Text Summarization", In Proceedings of the 1st Meeting of the North American Chapter of the Association for Computational Linguistics, 2000, pp. 178-185.
[12] M. L. Nguyen, and S. Horiguchi, "Accuracy enhancement for the decomposition of human-written summary", International Journal of Computer Processing of Oriental Languages, 2005, Vol. 18, No. 1, pp 53-74.