An Integrated Natural Language Processing Approach for Conversation System

Authors: Zhi Teng, Ye Liu, Fuji Ren

Abstract:

The main aim of this research is to investigate a novel technique for implementing a more natural and intelligent conversation system. Conversation systems are designed to converse like a human as much as their intelligent allows. Sometimes, we can think that they are the embodiment of Turing-s vision. It usually to return a predetermined answer in a predetermined order, but conversations abound with uncertainties of various kinds. This research will focus on an integrated natural language processing approach. This approach includes an integrated knowledge-base construction module, a conversation understanding and generator module, and a state manager module. We discuss effectiveness of this approach based on an experiment.

Keywords: Conversation System, integrated knowledge-base construction, conversation understanding and generator, state manager

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1060163

References:

[1] Will, Thomas, Creating a Dynamic Speech Dialogue. Vdm Verlag Dr. Mller, 2007.
[2] R. J. Lempert, S. W. Popper, and S. C. Bankes, Shaping the next one hundred years: new methods for quantitative, long-term policy analysis. Santa Monica, CA.: RAND, 2003.
[3] J. Allen, D. Byron, M. Dzikovska, G. Ferguson, L. Galescu, and A. Stent, "Towards conversational human-computer interaction," AI Magazine, vol. 22, 2001.
[4] Ong Sing Goh, Arnold Depickere, Chun Che Fung and Kok Wai Wong, "A Multilevel Natural Language Query Approach for Conversational Agent Systems", IAENG International Journal of Computer Science, vol.33-1, 2007.
[5] Teruhisa Misu and Tatsuya Kawahara, Speech-based Interactive Information Guidance System using Question-Answering and Information Recommendation, the 2007 International Conference on Acoustics, Speech and Signal Processing,vol.10.
[6] Hidekazu Kubota, Ken Saitoh, Ken Kumagai, Yohei Kawaguchi, Satoshi Nomura , Yasuyuki Sumi and Toyoaki Nishida, Conversation quantisation for conversational knowledge process, Inderscience Publishers, Volume 3 Issue 2, pp.134-144, 2007.
[7] L. Devillers et al., Annotations for Dynamic Diagnosis of the Dialog State, LREC-02.
[8] T. Paek & E. Horvitz. Conversation as action under uncertainty. Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence (UAI),pp.455-464, 2000.
[9] F. Benamara and P. Saint-Dizier, "Advanced Relaxation for Cooperative Question Answering," in.New Directions in Question Answering: MIT Press, 2004.
[10] H. Chung, K. Han, H. Rim, S. Kim, J. Lee, Y. Song, and D.Yoon, "A Practical QA System in Restricted Domains," presented at the ACL Workshop on Question Answering in Restricted Domains, 2004.
[11] F. Benamara, "Cooperative Question Answering in Restricted Domains: the WEBCOOP Experiment," presented at the ACL Workshop on Question Answering in Restricted Domains, 2004.
[12] William H. Fletcher, "Facilitating the compilation and dissemination of ad-hoc web corpora", in Papers from the Fifth International Conference on Teaching and Language Corpora, 2004.
[13] M. Baroni and S. Bernardini, "Bootcat: Bootstrapping corpora and terms from the web", in Proceedings of LREC 2004.
[14] David B. Bracewell, Fuji Ren and Shingo Kuroiwa, Mining News Sites to Create Special Domain News Collections, INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE VOLUME 4, NUMBER 1, pp.56-63, 2007.
[15] Lucy Vanderwendeet et al. Beyond SumBasic: Task-focused summarization with sentence simplification and lexical expansion. Information Processing and Management 43, pp.1606-1618, 2007.
[16] Harman, D. K. Overview of the fourth text retrieval conference (TREC- 4). In D. K. Harman (Ed.), Proceedings of the fourth text retrieval conference. NIST Special Publication 500-236, pp. 1-24.
[17] Zhi Teng, Ye Liu and Fuji Ren, A Multimedia Conversation System with Application in Supervised Learning Methods and Ranking Function, International Journal of Innovative Computing, Information and Control, Volume 4, Number 6, pp.107-119, 2008.
[18] Chih-Chung Chang and Chih-Jen Lin, LIBSVM : a library for support vector machines, 2001.
[19] B. Billerbeck and J. Zobel, Techniques for Efficient Query Expansion.
[20] Nianwen Xue and Martha Palmer. Annotating the Propositions in the Penn Chinese Treebank. In The Proceedings of the 2nd SIGHAN Workshop on Chinese Language Processing, pp. 47-54,Japan, 2003.
[21] Nianwen Xue and Martha Palmer. Calibrating features for semantic role labeling. In Pro ceedings of 2004 Conference on Empirical Methods in Natural Language Processing, pp.88-94,Spain, 2004.
[22] H. Zhang, H. Yu, D. Xiong and Q. Liu, HHMM-based chinese lexical analyzer ICTCLAS, Proc. Of the 2nd SigHan Workshop, pp.184-187, 2003.
[23] Qin Bing, Liu Ting Chen Shang-Lin and Li Sheng. "Sentences Optimum Selection for Multi-document Summarization", Journal of Computer Research and Development, Vol.43, No.6 2006-06-01, pp.1129-1134, 2006.
[24] A. Diekema, O. Yilmazel, and E. Liddy., "Evaluation of Restricted Domain Question-Answering Systems," presented at the ACL Workshop on Question Answering in Restricted Domains, 2004.
[25] Zhi Teng, Fuji Ren and Shingo Kuroiwa, "Emotion Recognition from Text based on the Rough Set Theory and the Support Vector Machines", 2007 IEEE International Conference on NLP-KE, ISBN: 978-1-4244- 1610-3 pp.36-41, Beijing china, 2007.