Identifying Quality Islamic Content in Community Question Answering Sites

Authors: Rabia Bibi, Muhammad Shahzad Faisal, Khalid Iqbal, Atif Inayat

Abstract:

Internet is growing rapidly and new community-based content is added by people every second. With this fast-growing community-based content, if a user requires answers of particular questions, then reviews are required from experts or community. However, it is difficult to get quality answers. The Muslim community all over the world is seeking help to get their questions and issues discussed to get answers. Online web portals of religious schools and community-based question answering sites are two big platforms to solve the issues of users. In the case of religious schools, there are experts and qualified religious scholars (mufti) who can give the expert opinion. However, the quality of community-based content cannot be guaranteed as it may not be an answer that satisfies the question of a user. Users on CQA sites may include spammers or individual criticizing the questioner instead of providing useful answers. In this paper, we research strategies to naturally distinguish the right content. As an experiment, we concentrate on Yahoo! Answers, and Quora, popular online QA sites, where questions are asked, answered, edited, and organized by a large community of users. We present the classification of data to categorize both relevant and irrelevant answers. Specifically, we demonstrate that the proposed framework can isolate quality answers from the rest with an exactness near that of people.

Keywords: Community-based question and answering, evaluation and prediction of quality answer, answer classification, Islamic content, answer ranking.

References:

[1] S. Kim, J. S. Oh, and S. Oh, "Best-answer selection criteria in a social Q&A site from the user-oriented relevance perspective," Proceedings of the American Society for Information Science and Technology, vol. 44, no. 1, pp. 1–15, Oct. 2008.
[2] T. Saracevic, "Evaluation of evaluation in information retrieval," pp. 138–146, Jan. 1995. (Online). Available: http://dl.acm.org/citation.cfm?id=215351. Accessed: Nov. 8, 2016.
[3] Y. Liu, J. Bian, and E. Agichtein, "Predicting information seeker satisfaction in community question answering," Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR ’08, 2008. (Online). Available: http://www.mathcs.emory.edu/~eugene/papers/sigir2008-cqa-satisfaction.pdf. Accessed: Nov. 8, 2016.
[4] Y. Freund, R. Schapire, and N. Abe, "A short introduction to boosting," Journal-Japanese Society For Artificial Intelligence, vol. 14, p. 1612, 1999
[5] E. M. Voorhees, "The TREC robust retrieval track," ACM SIGIR Forum, vol. 39, no. 1, p. 11, 2005. (Online). Available: http://trec.nist.gov/pubs/trec12/papers/ROBUST.OVERVIEW.pdf. Accessed: Nov. 8, 2016.
[6] D. N. Kresh, "Offering high quality reference service on the web: The collaborative digital reference service (CDRS)," Jun. 2000. (Online). Available: http://dl.acm.org/citation.cfm?id=865252. Accessed: Nov. 9, 2016.
[7] J. James, "The Global Census of Digital Reference," 5th Annual VRD Conference, 2003
[8] Harper, F. Maxwell, D. Raban, S. Rafaeli, and J. A. Konstan, "Predictors of answer quality in online Q&A sites," pp. 865–874, Jun. 2008. (Online). Available: http://dl.acm.org/citation.cfm?id=1357191. Accessed: Nov. 8, 2016.
[9] Q. Su, D. Pavlov, J.-H. Chow, and W. C. Baker, "Internet-scale collection of human-reviewed data," pp. 231–240, Aug. 2007. (Online). Available: http://dl.acm.org/citation.cfm?id=1242604. Accessed: Nov. 8, 2016.
[10] Z. Zhu, D. Bernhard, and I. Gurevych, "A Multi-Dimensional Model for Assessing the Quality of Answers in Social Q&A Sites," 2009. (Online). Available: http://tuprints.ulb.tu-darmstadt.de/1940/1/TR_dimension_model.pdf. Accessed: Nov. 8, 2016.
[11] C. Shah, U. C. Hill, J. S. Oh, and S. Oh, "Exploring characteristics and effects of user participation in online social Q&A sites," First Monday, vol. 13, no. 9, Sep. 2008. (Online). Available: http://www.firstmonday.dk/ojs/index.php/fm/article/view/2182. Accessed: Nov. 8, 2016.
[12] L. Rokach and O. Maimon, "Introduction to Decision Trees," Data Mining with Decision Trees: theory and application, p. 5, 2008.
[13] C. Shah, S. Oh, and J. S. Oh, "Research agenda for social Q&A," Library & Information Science Research, vol. 31, no. 4, pp. 205–209, Dec. 2009. (Online). Available: http://www.sciencedirect.com/science/article/pii/S074081880900098X. Accessed: Nov. 8, 2016.