Eliciting and Confirming Data, Information, Knowledge and Wisdom in a Specialist Health Care Setting: The WICKED Method
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 32918
Eliciting and Confirming Data, Information, Knowledge and Wisdom in a Specialist Health Care Setting: The WICKED Method

Authors: S. Impey, D. Berry, S. Furtado, M. Galvin, L. Grogan, O. Hardiman, L. Hederman, M. Heverin, V. Wade, L. Douris, D. O'Sullivan, G. Stephens


Healthcare is a knowledge-rich environment. This knowledge, while valuable, is not always accessible outside the borders of individual clinics. This research aims to address part of this problem (at a study site) by constructing a maximal data set (knowledge artefact) for motor neurone disease (MND). This data set is proposed as an initial knowledge base for a concurrent project to develop an MND patient data platform. It represents the domain knowledge at the study site for the duration of the research (12 months). A knowledge elicitation method was also developed from the lessons learned during this process - the WICKED method. WICKED is an anagram of the words: eliciting and confirming data, information, knowledge, wisdom. But it is also a reference to the concept of wicked problems, which are complex and challenging, as is eliciting expert knowledge. The method was evaluated at a second site, and benefits and limitations were noted. Benefits include that the method provided a systematic way to manage data, information, knowledge and wisdom (DIKW) from various sources, including healthcare specialists and existing data sets. Limitations surrounded the time required and how the data set produced only represents DIKW known during the research period. Future work is underway to address these limitations.

Keywords: Healthcare, knowledge acquisition, maximal data sets, action design science.

Procedia APA BibTeX Chicago EndNote Harvard JSON MLA RIS XML ISO 690 PDF Downloads 451


[1] Churchman, C.W., Guest editorial: Wicked problems. 1967, JSTOR. p. B141-B142.
[2] Rittel, H.W. and M.M. Webber, Dilemmas in a general theory of planning. Policy sciences, 1973. 4(2): p. 155-169.
[3] Sein, M.K., et al., Action design research. MIS quarterly, 2011: p. 37-56.
[4] Abbasi, M., et al., The development of a minimum data set for an infertility registry. Perspectives in health information management, 2018. 15(Winter).
[5] Beck, A.J., et al., Improving data for behavioral health workforce planning: development of a minimum data set. American journal of preventive medicine, 2018. 54(6): p. S192-S198.
[6] Blum, B.I., Clinical information systems—a review. Western Journal of Medicine, 1986. 145(6): p. 791.
[7] Graves, J.R. and S. Corcoran, The study of nursing informatics. Image: the journal of nursing scholarship, 1989. 21(4): p. 227-231.
[8] Ackoff, R.L., From data to wisdom. Journal of applied systems analysis, 1989. 16(1): p. 3-9.
[9] Nelson, R., Informatics: Evolution of the Nelson Data, Information, Knowledge and Wisdom Model: Part 2. OJIN: The Online Journal of Issues in Nursing, 2020. 25(3).
[10] Harrington, L., American Nurses Association releases new scope and standards of nursing informatics practice. AACN Adv Crit Care, 2015. 26(2): p. 93-6.
[11] Nonaka, I. and H. Takeuchi, The knowledge-creating company: how Japanese companies create the dynamics of innovation / Ikujiro Nonaka and Hirotaka Takeuchi. 1995, Oxford University Press.
[12] Polanyi, M., The tacit dimension (2009 ed.). 1966, The University of Chicago Press, London.
[13] Frické, M., The knowledge pyramid: a critique of the DIKW hierarchy. Journal of information science, 2009. 35(2): p. 131-142.
[14] Ati, M. Knowledge capturing in autonomous system design for chronic disease risk assessment. in 2014 IEEE Conference on Biomedical Engineering and Sciences (IECBES). 2014. IEEE.
[15] Choy, K.L.T., et al., An intelligent case-based knowledge management system for quality improvement in nursing homes. VINE Journal of Information and Knowledge Management Systems, 2018.
[16] Hegde, S., et al., Qualitative findings from a pilot stage implementation of a novel organizational learning tool toward operationalizing the safety-II paradigm in health care. Applied ergonomics, 2020. 82: p. 102913.
[17] Steurer, J., U. Held, and O.S. Miettinen, Diagnostic probability function for acute coronary heart disease garnered from experts' tacit knowledge. Journal of clinical epidemiology, 2013. 66(11): p. 1289-1295.
[18] Thoroddsen, A., H.K. Guðjónsdóttir, and E. Guðjónsdóttir. From capturing nursing knowledge to retrieval of data from a data warehouse. in Nursing Informatics. 2014.
[19] Ayub, Y.I., O.P. Kogeda, and M. Lall, Capturing tacit knowledge: A case of traditional doctors in Mozambique. South African Journal of Information Management, 2018. 20(1): p. 1-8.
[20] Borders, J., et al., ShadowBox™: Flexible training to impart the expert mindset. Procedia Manufacturing, 2015. 3: p. 1574-1579.
[21] Kamsu-Foguem, B., G. Diallo, and C. Foguem, Conceptual graph-based knowledge representation for supporting reasoning in African traditional medicine. Engineering Applications of Artificial Intelligence, 2013. 26(4): p. 1348-1365.
[22] Majima, Y., et al., Video Review System for Sharing Tacit Knowledge of Clinical Nursing Practice. Studies in health technology and informatics, 2018. 250: p. 41-44.
[23] Pegoraro, F., E.A.P. Santos, and E.d.F.R. Loures, A support framework for decision making in emergency department management. Computers & Industrial Engineering, 2020. 146: p. 106477.
[24] Torshizi, A.D., et al., A hybrid fuzzy-ontology based intelligent system to determine level of severity and treatment recommendation for Benign Prostatic Hyperplasia. Computer methods and programs in biomedicine, 2014. 113(1): p. 301-313.
[25] Wulff, A., et al., An interoperable clinical decision-support system for early detection of SIRS in pediatric intensive care using openEHR. Artificial intelligence in medicine, 2018. 89: p. 10-23.
[26] Becerril-Montekio, V., et al., Using systematized tacit knowledge to prioritize implementation challenges in existing maternal health programs: implications for the post MDG era. Health policy and planning, 2016. 31(8): p. 1031-1038.
[27] González-Ferrer, A., et al., Development of a computer-interpretable clinical guideline model for decision support in the differential diagnosis of hyponatremia. International Journal of Medical Informatics, 2017. 103: p. 55-64.
[28] Fox, J., et al., OpenClinical. net: A platform for creating and sharing knowledge and promoting best practice in healthcare. Computers in Industry, 2015. 66: p. 63-72.
[29] Lara, B., et al., Knowledge management through two virtual communities of practice (Endobloc and Pneumobloc). Health Informatics Journal, 2017. 23(3): p. 170-180.
[30] Rolls, K.D., et al., Intensive care nurses on social media: An exploration of knowledge exchange on an intensive care virtual community of practice. Journal of clinical nursing, 2020. 29(7-8): p. 1381-1397.
[31] Sims, J.M., Communities of practice: Telemedicine and online medical communities. Technological Forecasting and Social Change, 2018. 126: p. 53-63.
[32] Wieringa, S., et al., How knowledge is constructed and exchanged in virtual communities of physicians: qualitative study of mindlines online. Journal of medical Internet research, 2018. 20(2): p. e34.
[33] Wolbrink, T.A., et al., Building a global, online community of practice: the OPENPediatrics World Shared Practices Video Series. Academic Medicine, 2017. 92(5): p. 676-679.
[34] Mohammadhassanzadeh, H., et al., Semantics-based plausible reasoning to extend the knowledge coverage of medical knowledge bases for improved clinical decision support. BioData mining, 2017. 10(1): p. 1-31.
[35] Petrovic, S., N. Mishra, and S. Sundar, A novel case based reasoning approach to radiotherapy planning. Expert Systems with Applications, 2011. 38(9): p. 10759-10769.
[36] Choquet, R., et al., A methodology for a minimum data set for rare diseases to support national centers of excellence for healthcare and research. Journal of the American Medical Informatics Association, 2015. 22(1): p. 76-85.
[37] Covelli, A.F., et al., Development of the Doctor of Nursing Practice nurse practitioner minimum data set (DNP NP MDS). Journal of Professional Nursing, 2022. 39: p. 54-68.
[38] Zakerabasali, S., et al., Development and validation of the Neonatal Abstinence Syndrome Minimum Data Set (NAS-MDS): a systematic review, focus group discussion, and Delphi technique. The Journal of Maternal-Fetal & Neonatal Medicine, 2020: p. 1-8.
[39] Farrington-Darby, T. and J.R. Wilson, The nature of expertise: A review. Applied ergonomics, 2006. 37(1): p. 17-32.
[40] Ericsson, K.A., et al., The Cambridge handbook of expertise and expert performance. 2018: Cambridge University Press.
[41] Brown, R.R., A. Deletic, and T.H. Wong, Interdisciplinarity: how to catalyse collaboration. Nature News, 2015. 525(7569): p. 315.
[42] Dagenais, C., et al., Codifying explicit and tacit practitioner knowledge in community social pediatrics organizations: Evaluation of the first step of a knowledge transfer strategy. Evaluation and program planning, 2020. 79: p. 101778.
[43] Fernandez, N., et al., Revealing tacit knowledge used by experienced health professionals for interprofessional collaboration. Journal of interprofessional care, 2020. 34(4): p. 537-544.
[44] Davenport, T.H., Working knowledge: how organizations manage what they know / Thomas H. Davenport, Laurence Prusak. 1998. p. 0-7.
[45] Arora, S., et al., Project ECHO: a telementoring network model for continuing professional development. Journal of Continuing Education in the Health Professions, 2017. 37(4): p. 239-244.
[46] Berman, J., et al., Building a knowledge translation platform in Malawi to support evidence-informed health policy. Health research policy and systems, 2015. 13(1): p. 1-5.
[47] Frisch, N., et al., Growing a Professional Network to Over 3000 Members in Less Than 4 Years: Evaluation of InspireNet, British Columbia's Virtual Nursing Health Services Research Network. Journal of Medical Internet Research, 2014. 16(2): p. e49-11.
[48] Gresh, A., et al., Utilization of communities of practice for ongoing learning and knowledge dissemination: Making the case for the Global Alliance for Nursing and Midwifery (GANM). Nurse Education in Practice, 2017. 26: p. 64-67.
[49] Lewis, H., et al., Dermatology ECHO - an innovative solution to address limited access to dermatology expertise. Rural & Remote Health, 2018. 18(1): p. 1-8.
[50] Ziebarth, D. and C. Hunter, Moving toward a virtual knowledge platform for faith community nurses. CIN: Computers, Informatics, Nursing, 2016. 34(11): p. 503-512.
[51] Ardichvili, A., Learning and knowledge sharing in virtual communities of practice: Motivators, barriers, and enablers. Advances in developing human resources, 2008. 10(4): p. 541-554.
[52] Babajani-Vafsi, S., et al., Factors influencing the participation of nurses in knowledge-sharing within mobile instant messaging based virtual communities of practice: a qualitative content analysis. Advances in Medical Education and Practice, 2019. 10: p. 897.
[53] Barnett, S., et al., Usefulness of a virtual community of practice and web 2.0 tools for general practice training: experiences and expectations of general practitioner registrars and supervisors. Australian Journal of Primary Health, 2013. 19(4): p. 292-296.
[54] Francis-Coad, J., et al., Can a web-based community of practice be established and operated to lead falls prevention activity in residential care? Geriatric Nursing, 2017. 38(2): p. 133-140.
[55] Rodman, L. and J. Trespalacios, Knowledge-sharing and potential virtual communities of practice in the US Coast Guard’s Afloat Community: A qualitative pilot study. TechTrends, 2018. 62(6): p. 602-611.
[56] Shehab, S., R.E.A. Rahim, and S. Daud, Knowledge sharing behavior of nursing supervisors in online healthcare communities. International Journal of Pharmaceutical Research, 2019. 11(1): p. 1662-78.
[57] Valaitis, R.K., et al., Online communities of practice as a communication resource for community health nurses working with homeless persons. Journal of advanced nursing, 2011. 67(6): p. 1273-1284.
[58] Isaacson, K. and W.S. Looman, Strategies for developing family nursing communities of practice through social media. Journal of Family Nursing, 2017. 23(1): p. 73-89.
[59] Pyrko, I., V. Dörfler, and C. Eden, Thinking together: what makes communities of practice work? Human relations, 2017. 70(4): p. 389-409.
[60] Blaz, J.W., et al., The Hidden Lives of Nurses' Cognitive Artifacts. 2016. 7(3): p. 832.
[61] Blaz, W.J., et al., The Symbolic Functions of Nurses' Cognitive Artifacts on a Medical Oncology Unit. 2018.
[62] De Marinis, M.G., et al., ‘If it is not recorded, it has not been done!’? Consistency between nursing records and observed nursing care in an Italian hospital. Journal of clinical Nursing, 2010. 19(11‐12): p. 1544-1552.
[63] Gunningberg, L., M.F. Dahm, and A. Ehrenberg, Accuracy in the recording of pressure ulcers and prevention after implementing an electronic health record in hospital care. BMJ Quality & Safety, 2008. 17(4): p. 281-285.
[64] Paans, W., et al., Prevalence of accurate nursing documentation in patient records. Journal of advanced nursing, 2010. 66(11): p. 2481-2489.
[65] Baxter, H.C., Specialized knowledge transfer: Accelerating the expertise development cycle. Procedia Manufacturing, 2015. 3: p. 1465-1472.
[66] Castro, A.G., et al., The use of concept maps during knowledge elicitation in ontology development processes–the nutrigenomics use case. BMC bioinformatics, 2006. 7(1): p. 1-14.
[67] Grigore, B., et al., A comparison of two methods for expert elicitation in health technology assessments. BMC medical research methodology, 2016. 16(1): p. 1-11.
[68] Hamilton, A.L., J. Coldwell-Neilson, and A. Craig, Development of an information management knowledge transfer framework for evidence-based occupational therapy. VINE: The journal of information and knowledge management systems, 2014.
[69] Kinchin, I.M., L.B. Cabot, and D.B. Hay, Using concept mapping to locate the tacit dimension of clinical expertise: Towards a theoretical framework to support critical reflection on teaching. Learning in Health and Social Care, 2008. 7(2): p. 93-104.
[70] Prasarnphanich, P., B.D. Janz, and J. Patel, Towards a better understanding of system analysts' tacit knowledge: A mixed method approach. Inf. Technol. People, 2016. 29(1): p. 69-98.
[71] Shaw, N. and P. Liu. A Knowledge Management System (KMS) using a storytelling-based approach to collect tacit knowledge. in SoutheastCon 2016. 2016. IEEE.
[72] Starr, R.R. and J.M.P. De Oliveira, Concept maps as the first step in an ontology construction method. Information systems, 2013. 38(5): p. 771-783.
[73] Woo, J.-H., et al., Dynamic Knowledge Map: reusing experts' tacit knowledge in the AEC industry. Automation in construction, 2004. 13(2): p. 203-207.
[74] Mullarkey, M.T. and A.R. Hevner, An elaborated action design research process model. European Journal of Information Systems, 2019. 28(1): p. 6-20.
[75] Roper, N., W.W. Logan, and A.J. Tierney, The elements of nursing: a model for nursing based on a model of living. 1998.
[76] Purao, S., Design research in the technology of information systems: Truth or dare. GSU Department of CIS Working Paper, 2002. 34: p. 45-77.
[77] Gill, A.Q. and E. Chew, Configuration information system architecture: Insights from applied action design research. Information & Management, 2019. 56(4): p. 507-525.
[78] Pan, S.L., et al., Sustainability design principles for a wildlife management analytics system: An action design research. European Journal of Information Systems, 2020: p. 1-22.