Testing the Validity of Maturity Model for E-Government Implementation in Indonesia

Authors: Darmawan Napitupulu, Dana Indra Sensuse, Aniati Murni

Abstract:

The research was conducted to empirically validate the proposed maturity model of e-Government implementation, composed of four dimensions, further specified by 54 success factors as attributes. To do so, there are two steps were performed. First, expert’s judgment was conducted to test its content validity. The second, reliability study was performed to evaluate inter-rater agreement by using Fleiss Kappa approach. The kappa statistic (kappa coefficient) is the most commonly used method for testing the consistency among raters. Fleiss Kappa was a generalization of Kappa in extensions to the case of more than two raters (multiple raters) with multi-categorical ratings. Our findings show that most attributes of the proposed model were related to their corresponding dimensions. According to our results, The percentage of agree answers given by the experts was 73.69% in dimension A, 89.76% in B, 81.5% in C and 60.37% in D. This means that more than half of the attributes of each dimensions were appropriate or relevant to the dimensions they were supposed to measure, while 85% of attributes were relevant enough to their corresponding dimensions. Inter-rater reliability coefficient also showed satisfactory result and interpreted as substantial agreement among raters. Therefore, the proposed model in this paper was valid and reliable to measure the maturity of e-Government implementation.

Keywords: E-Government, Model, Maturity, Validity, Reliability Kappa.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1099098

References:

[1] Yildiz, M. (2007). E-government research: Reviewing the literature, limitations, and ways forward. Government information quarterly, 24(3), 646-665
[2] United Nations, & American Society for Public Administration (ASPA) (2002). Benchmarking e-Government: A global perspective. New York: United Nations
[3] Tung, L.L., Rieck, O., 2005. Adoption of electronic government services among business organizations in Singapore. Journal of Strategic Information Systems 14 (4), 417–440
[4] Ke, W., Wei, K.K., 2004. Successful e-government in Singapore. Communications of the ACM 47 (6), 95–99
[5] Valdez et al., 2011. Conception, development and implementation of an e-Government maturity model in public agencies. Government Information Quarterly 28, Elsevier, 176-181
[6] Andersen, K. V., & Henriksen, H. Z. (2006). E-Government maturity models: Extension of the Layne and Lee model. Government information quarterly, 23(2), 236-248
[7] Cresswell, A., Pardo, T., & Canestraro, D. (2006). Digital capability assessment for e-Government: A multi-dimensional approach. In M. A. Wimmer, H. J. Scholl, Å. Grönlund, & K. V. Andersen (Eds.), EGOV 2006, Lecture notes in computer science, Vol. 4084 (pp. 293—304). Berlin: Springer-Verlag
[8] Wimmer, M., & Tambouris, E. (2002). Online one-stop government: A working framework and requirements. In R. Traunmüller (Ed.), Information systems: The eBusiness challenge (pp. 117-130). Boston: Kluwer Academic Publishers
[9] Suhono H. Supangkat, 2006. Strategy Framework of e-Government Implementation. Proceeding Indonesia ICT National Conference, ITB
[10] Gupta B. et al. 2008. Adoption of ICT in a government organization in a developing country: An empirical study. Journal of Strategic Information System 17, 140-154
[11] Lam, W., 2005. Barriers to e-government integration. Journal of Enterprise Information Management 18 (5/6), 511–530
[12] Bhatnagar, S., 2000. Social implications of information and communication technology in developing countries: lessons from Asian success stories. Electronic Journal on Information Systems in Developing Countries 1 (4), 1–9
[13] Gilbert, D., Balestrini, P., Littleboy, D., 2004. Barriers and benefits in the adoption of e-government. The International Journal of Public Sector Management 17 (4/5), 286–301
[14] Grant, G., Chau, D., 2005. Developing a generic framework for egovernment. Journal of Global Information Management 13 (1), 1–29
[15] Zhang, J., Dawes, S.S., Sarkis, J., 2005. Exploring stakeholders’ expectations of the benefits and barriers of e-government knowledge sharing. Journal of Enterprise Information Management 18 (5/6), 548– 567
[16] Tolbert, C.J., Mossberger, K., 2006. The effects of e-government on trust and confidence in government. Public Administration Review 66 (3), 354–369
[17] Prattipati, S.N., 2003. Adoption of e-governance: differences between countries in the use of online government services. Journal of American Academy of Business 3 (1/2), 386–401
[18] http://www.waseda.jp/eng/news12/130326_egov.html
[19] Misra, D.C., 2006. World e-government ranking by Waseda University Institute of e-government. Retrieved from:
[20] Lee, S.M., Tan, X., Timi, S., 2005. Current practices of leading egovernment countries. Communications of the Association for Computing Machinery 48 (10), 99–104
[21] Chen, Y.N., Chen, H.M., Huang, W., Ching, R.K.H., 2006. EGovernment strategies in developed and developing countries: an implementation framework and case study. Journal of Global Information Management 1 (14), 23–46
[22] Darmawan Napitupulu & Dana Indra Sensuse, 2014. The Critical Success Factors Study for e-Government Implementation, International Journal of Computer Application, Vol 89, No. 16, March 2014
[23] http://unpan3.un.org/egovkb/Portals/egovkb/Documents/un/2014- Survey/E-Gov_Complete_Survey-2014.pdf
[24] http://pegi.layanan.go.id/download/tabel_pegi_2012/PeGI%20Provinsi% 202012.jpg
[25] Bullen, C.V. and J.F. Rockart, 1981. A primer on critical success factors. Research Report. Sloan School of Management, Massachusetts Institute of Technology, USA. CISR No. 69
[26] Straub, D., Boudreau, M-C, & Gefen D., 2004. Validation Guidelines For IS Positivist Research, Communication of the Association for Information System, Vol. 13, pp. 380-427
[27] Lopez de Castro B. et al. 2013. Testing the validity of the International Atomic Energy Agency (IAEA) safety culture model. Elsevier. Accident Analysis and Prevention 60, 231-244
[28] Fleiss, J.L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378-382.
[29] Wen-Yu Hsu, 2014. Examining the diagnostic criteria for Internet addiction : Expert validation, Journal of the Formosan Medical Association xx, 1-5, Elsevier Science Direct
[30] Viera J. Anthony et al. 2005.Understanding Interobserver Agreement : The Kappa Statistic, Family Medicine, Research Series
[31] Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
[32] Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960;20:37-46.
[33] Darmawan Napitupulu & Dana Indra Sensuse, 2014. Toward Maturity Model For E-Government Implementation Based on Success Factors, International Conference Advanced Computer Science and Information Systems (ICACSIS), University of Indonesia.