Personalized Learning: An Analysis Using Item Response Theory

Authors: A. Yacob, N. Hj. Ali, M. H. Yusoff, M. Y. MohdSaman, W. M. A. F. W. Hamzah

Abstract:

Personalized learning becomes increasingly popular which not be restricted by time, place or any other barriers. This study proposes an analysis of Personalized Learning using Item Response Theory which considers course material difficulty and learner ability.The study investigates twenty undergraduate students at TATI University College, who are taking programming subject. By using the IRT,it was found that, finding the most appropriate problem levels to each student include high and low level test items together is not a problem. Thus, the student abilities can be asses more accurately and fairly. Learners who experience more anxiety will affect a heavier cognitive load and receive lower test scores.Instructors are encouraged to provide a supportive learning environment to enhance learning effectiveness because Cognitive Load Theory concerns the limited capacity of the brain to absorb new information.

Keywords: Analysis, Cognitive Load Theory, Item Response Theory, Learning, Motivation, Performance.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1092056

References:

[1] B. Baker, & Frank, Item response theory: Parameter estimation techniques. New York: Marcel Dekker. 1992.
[2] C. K. Hulin, C. L., Drasgow, F., & Parsons, Item response theory: Application to psychological measurement. Homewood, IL: Dow Jones Irwin. 1983.
[3] C. Chen, H. Lee, and Y. Chen, "Personalized e-learning system using Item Response Theory,” Comput. Educ., 2005.
[4] Y. Yung-Chin, H. Rong-Guey, C. Li-Ju, C. Kun-Yi, and C. Yan-Lin, "Development and Evaluation of a Confidence-Weighting Computerized Adaptive Testing,” Educ. Technol. Soc., vol. 13, no. 3, pp. 163–176, 2010.
[5] "Using Rasch Analysis to identify uncharacteristic responses to undergraduate assessments,” Teach. Math. Appl., 2010.
[6] A. Baylari and G. Montazer, "Design a personalized e-learning system based on item response theory and artificial neural network approach,” Expert Syst. Appl., 2009.
[7] M. Thomas, "The value of item response theory in clinical assessment: A review,” Assessment, 2011.
[8] F.-H. Wang, "Application of componential IRT model for diagnostic test in a standard conformant elearning system,” in In Sixth international conference on advanced learning technologies (ICALT’06), 2006.
[9] B. B. Reeve and P. Fayers, Applying item response theory modelling for evaluating questionnaire item and scale properties. 2005, pp. 55–73.
[10] L. Ding and R. Beichner, "Approaches to data analysis of multiple-choice questions,” 2009.
[11] G. FISCHER and I. MOLENAAR, Rasch models: foundations, recent developments and applications. 1995, p. New York: Springer–Verlag.
[12] J. Funk and R. Rogge, "Testing the ruler with item response theory: increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index.,” J. Fam. Psychol., 2007.
[13] M. O. Edelen and B. B. Reeve, "Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement.,” Qual. Life Res., vol. 16, pp. 5–18, Jan. 2007.
[14] J. Runnels, "Evaluation of a Streaming Instrument,” J. Kanda Univ. Int. Stud., vol. 25, 2013.
[15] D. Beglar, "A Rasch-based validation of the Vocabulary Size Test,” Lang. Test., vol. 27, no. 1, pp. 101–118, Oct. 2009.
[16] P. Baghaei and N. Amrahi, "Validation of a multiple choice English vocabulary test with the Rasch model,” J. Lang. Teach. Res., vol. 2, no. 5, pp. 1052–1060, 2011.
[17] R. Hambleton and R. Jones, "Comparison of classical test theory and item response theory and their applications to test development,” Educ. Meas. issues …, 1993.
[18] A. Manuscript, "NIH Public Access,” vol. 38, 2007.
[19] V. Gothwal and T. Wright, "Rasch analysis of the quality of life and vision function questionnaire,” Optom. Vis. …, 2009.
[20] D. Kinney, "Examining Construct Stability Across Career Stage Cohorts,” 2011.
[21] M. Reckase, Multidimensional item response theory. 2009.
[22] J. M. Linacre, Winsteps Help for Rasch Analysis. 2012.
[23] R. Pishghadam and H. S. Ahmadi, "Development and Validation of an English Language Teacher Competency Test Using Item Response Theory,” Int. J. …, 2011.
[24] I. Chen and C. Chang, "Cognitive load theory: An empirical study of anxiety and task performance in language learning,” … Res. …, 2009.
[25] F. Amadieu, C. Mariné, and C. Laimay, "The attention-guiding effect and cognitive load in the comprehension of animations,” Comput. Human Behav., 2011.
[26] E. Cooper, "Overloading on Slides: Cognitive Load Theory and Microsoft’s Slide Program PowerPoint,” AACE J., 2009.
[27] F. Kirschner, L. Kester, and G. Corbalan, "Cognitive load theory and multimedia learning, task characteristics, and learning engagement: The current state of the art,” 2010.
[28] B. B. Koning, H. K. Tabbers, R. M. J. P. Rikers, and F. Paas, "Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design,” Educ. Psychol. Rev., vol. 21, no. 2, pp. 113–140, Apr. 2009.
[29] N. A. Thompson, "Classical Item and Test Analysis with CITAS White Paper,” 2009.
[30] H. Kurum, "Application of the Rasch Rating Scale Model with Mathematics Anxiety Rating Scale-Short Version (MARS-SV),” 2012.
[31] M. Sulaiman, Z. Haji Ismail, A. Abdul Aziz, and A. Zaharim, "Lesson Study : Assessing Pre-service Teacher ’ s Performance of Teaching Chemistry,” pp. 208–213, 2011.
[32] T. Sakumura and H. Hirose, "Test evaluation system via the Web using the item response theory,” vol. 13, no. 3A, pp. 647–656, 2010.
[33] J. Baumert, M. Kunter, and W. Blum, "Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress,” Am. Educ. …, 2010.
[34] J. M. Linacre, "Sample size and item calibration stability,” Rasch Meas. Trans., vol. 7, no. 4, p. 328, 1994.