Continuous FAQ Updating for Service Incident Ticket Resolution

Authors: Kohtaroh Miyamoto

Abstract:

As enterprise computing becomes more and more complex, the costs and technical challenges of IT system maintenance and support are increasing rapidly. One popular approach to managing IT system maintenance is to prepare and use a FAQ (Frequently Asked Questions) system to manage and reuse systems knowledge. Such a FAQ system can help reduce the resolution time for each service incident ticket. However, there is a major problem where over time the knowledge in such FAQs tends to become outdated. Much of the knowledge captured in the FAQ requires periodic updates in response to new insights or new trends in the problems addressed in order to maintain its usefulness for problem resolution. These updates require a systematic approach to define the exact portion of the FAQ and its content. Therefore, we are working on a novel method to hierarchically structure the FAQ and automate the updates of its structure and content. We use structured information and the unstructured text information with the timelines of the information in the service incident tickets. We cluster the tickets by structured category information, by keywords, and by keyword modifiers for the unstructured text information. We also calculate an urgency score based on trends, resolution times, and priorities. We carefully studied the tickets of one of our projects over a 2.5-year time period. After the first 6 months we started to create FAQs and confirmed they improved the resolution times. We continued observing over the next 2 years to assess the ongoing effectiveness of our method for the automatic FAQ updates. We improved the ratio of tickets covered by the FAQ from 32.3% to 68.9% during this time. Also, the average time reduction of ticket resolution was between 31.6% and 43.9%. Subjective analysis showed more than 75% reported that the FAQ system was useful in reducing ticket resolution times.

Keywords: FAQ System, Resolution Time, Service Incident Tickets, IT System Maintenance.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1337669

References:

[1] A. April and A. Abran, “Software maintenance management: evaluation and continuous improvement”, Wiley-IEEE Computer Society Press, 2012.
[2] M. Ohno, K. Miyamoto and K. Yoshikawa, “Extracting works for offshore outsourcing through service request log analysis”, Frontiers in Service Science 2014.
[3] K. Miyamoto, T.Nerome, and T. Nakamura, “Document Quality Checking Tool for Global Software Development,” Service Research and Innovation Institute (SRII 2012), 2012, pp. 267-276.
[4] B. Orand andJ. Villarreal, “Foundations of IT Service Management with ITIL 2011: ITIL Foundations Course in a Book,” Create Space Independent Publishing Platform, 2011.
[5] T. H. Davenport and L. Prusak, “Working Knowledge: How Organizations Manage What They Know,” Harvard Business School press, 1998.
[6] W. Newk-Fon Hey Tow, J. Venable, and P. Dell, “Toward More Effective Knowledge Management: An Investigation of Problems in Knowledge Identification,” Pacific Asia Conference on Information Systems (PACIS 2011), paper 194, 2011.
[7] J. Skene, F. Raimondi, and W. Emmerich, "Service-Level Agreements for Electronic Services," IEEE Transactions on Software Engineering, Vol. 36 Issue 2, 2010, pp. 288-304.
[8] K. Miyamoto, R. Anand, and J. Lee, “Improving IT Service Incident Resolution by Using an FAQ System”, Service Research and Innovation Institute (SRII 2014), 2014.
[9] R. Anand, J. Lee, K. Miyamoto, L. Mei, and Q. Li, “The Dialog Manager: A system for managing procedural knowledge,” IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI 2013), 2013.
[10] N. Indurkhya and F. J. Damerau, “Handbook of Natural Language Processing”, Second Edition, Series: Chapman & Hall/CRC Machine Learning & Pattern Recognition, February 22, 2010.
[11] “Statistical Methods. Least Squares, Kolmogorov-Smirnov Test, Design of Experiments, Optimal Design, Regression Analysis, Student's T-Test”, Booksllc. Net, 2013, ISBN 10: 1157454089
[12] A. Aizawa, "An information-theoretic perspective of tf–idf measures", Information Processing & Management, Vol. 39, Issue 1, January 2003, pp .45–65.
[13] K. Miyamoto, R. Anand, and J. Lee, “Automatic Updating FAQ Knowledge from Service Incident Tickets”, Frontiers in Service Science 2014. 2014.
[14] M. Demarest, "Understanding Knowledge Management," Long Range Planning, Vol. 30, No. 3, pp. 374-384 (1997).
[15] M. Schneider, B. Rittle-Johnson, and J. R. Star. "Relations among conceptual knowledge, procedural knowledge, and procedural flexibility in two samples differing in prior knowledge," Developmental psychology 47.6, 2011.
[16] M. G. Marchetta and Q. F. Raymundo, "An artificial intelligence planning approach to manufacturing feature recognition." Computer-Aided Design 42.3. pp.248-256, 2010.
[17] A. Lammer, S. Eggert, and N. Gronau. "A Procedure model for a SOA-Based integration of enterprise systems." Information Resources Management: Concepts, Methodologies, Tools, and Applications, 2010.
[18] N. Vibert, C. Ros, L. L. Bigot, M. Ramond, J. Gatefin, andJ. F. Rouet, “Effects of domain knowledge on reference search with the PubMed database: An experimental study.” Journal of the American Society for Information Science and Technology, 60(7), 2009, pp. 1423-1447.
[19] T. W. Bickmore, L. M. Pfeifer, andM. K. Paasche-Orlow, “Health document explanation by virtual agents.” In Intelligent Virtual Agents, Springer Berlin Heidelberg, 2007, pp. 183-196.
[20] A. Perer and B. Shneiderman, "Systematic yet flexible discovery: guiding domain experts through exploratory data analysis," In Proceedings of the 13th International Conference on Intelligent User Interfaces, 2008, pp. 109-118.
[21] D. Contractor, G. Kothari, T. A. Faruquie, L. V. Subramaniam, and S. Negi, S, "Handling noisy queries in cross language faq retrieval," In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, 2010,pp. 87-96.
[22] Y. Liu, C. Yin, H. Ogata, G. Qiao, and Y. Yano, "A FAQ-Based e-Learning Environment to Support Japanese Language Learning," International Journal of Distance Education Technologies (IJDET), 2011, pp. 45-55.