Use of Item Response Theory in Medical Surgical Nursing Achievement Examination

Authors: Rita C. Ramos

Abstract:

Medical Surgical Nursing is one of the major subjects in nursing. This study examined the validity and reliability of the achievement examination utilizing the Classical Test Theory and Item Response Theory. The study answered the following objectives specifically : ( a) To establish the validity and reliability of the achievement examination utilizing Classical Test Theory and Item Response Theory ; ( b ) To determine the dimensionality measure of items and ( c ) to compare the item difficulty and item discrimination of the Medical Surgical Nursing Achievement examination using Classical Test Theory ( CTT ) and Item Response Theory ( IRT ). The developed instrument was administered to fourth year nursing students (N= 136) of a private university in Manila. The findings yielded the following results: The achievement examination is reliable both using CTT and IRT. The findings indicate person and item statistics from two frameworks are quite alike. The achievement examination formed a unidimensional construct.

Keywords: Achievement Examination, Item Response Theory, Medical Surgical, Nursing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1331297

References:

[1] B. A. Bhakta , " Using item response theory to explore the psychometric properties of extended matching questions examination in undegraduate medical education"Biomed Central,vol,pp. 1-13, March 2005.
[2] S. E. Embretsson& S.P. Reise , "The New Rules of Measurement " (Book style), " in Item Response Theory for Psychologist, " Mahwey, New Jersey: Lawrence Erlbaum Associates, Publishers, 2000, pp. 13-17.
[3] K.H. Frith,J.P. Sewell &D.J.Clark "Best Practices in NCLEX- RN Readiness Preparation for Bacclaureate Student Success, "Computers, Informatics , Nursing, vol.23, pp. 322 -329.September- October 2005.
[4] R.Hernandez , "Comparison of the Item Discrimination and Item Difficulty of the Quick- Mental Aptitude Test using CTT and IRT, " The International Journal of Educational and Psychological Assessment, vol. 1, pp. 12-18, April 2009.
[5] C.Magno , "Demonstrating the Difference between Classical Test Theory and Item Response Theory Using Derived Test Data, "The International Journal of Educational and Psychological Assessment vol. 1, pp. 1-11, April 2009.
[6] S. C.Morrison, C. C. Adamson, A. A. Nibert, S.S. Hsia(2004). HESI Exams: An Overview of Reliability and Validity. Computers in Nursing, vol. 22,pp. 220-226, August 2004.
[7] A. T., Nibert, " A Third Study on Predicting NCLEX Success With the HESI Exit Exam, "Computers in Nursing,vol. 19, pp. 172-178, July 2001.
[8] J.Pomeranz , " Rasch Analysis as a Technique to Examine the Psychometric Properties of a Career Ability Placement Survey Substest, "Rehabilitation Counselling Bulletin ,vol. , pp. 251-259, July 2008.
[9] J.L. Silvestre- Tipay, " Item Response Theory and Classical Test Theory: An Empirical Comparison of Item/ Person Statistics in Biological Science Test, "The International Journal of Educational and Psychological Assessment, vol. 1, pp. 19-31, April 2009.
[10] Nursing Licensure Exam Results November (Periodicaltype) NLE. Civil Service and PRC Board Examintations, November 2009.
[11] J. M. Linacre , " User-s Guide to Winsteps Rasch Computer Program 3.69.0 (Program Manual) , 2009, pp. 1- 485.