Applying GQM Approach towards Development of Criterion-Referenced Assessment Model for OO Programming Courses

Authors: Norazlina Khamis, Sufian Idris, Rodina Ahmad

Abstract:

The most influential programming paradigm today is object oriented (OO) programming and it is widely used in education and industry. Recognizing the importance of equipping students with OO knowledge and skills, it is not surprising that most Computer Science degree programs offer OO-related courses. How do we assess whether the students have acquired the right objectoriented skills after they have completed their OO courses? What are object oriented skills? Currently none of the current assessment techniques would be able to provide this answer. Traditional forms of OO programming assessment provide a ways for assigning numerical scores to determine letter grades. But this rarely reveals information about how students actually understand OO concept. It appears reasonable that a better understanding of how to define and assess OO skills is needed by developing a criterion referenced model. It is even critical in the context of Malaysia where there is currently a growing concern over the level of competency of Malaysian IT graduates in object oriented programming. This paper discussed the approach used to develop the criterion-referenced assessment model. The model can serve as a guideline when conducting OO programming assessment as mentioned. The proposed model is derived by using Goal Questions Metrics methodology, which helps formulate the metrics of interest. It concluded with a few suggestions for further study.

Keywords: Object-oriented programming, programmingassessment, criterion-referenced assessment model, goal questionsmetrics.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1076872

References:

[1] J. Bennedsen and E.M Carpersen, "A Competence Model for Object Interaction in Introductory Programming" in Proceeding of 18th Workshop of the Psychology of Programming Interest Group, 2006.
[2] J. Bennedsen and E.M Carpersen, "Teaching Object Oriented Programming" in 18th European Object oriented Workshop, 2004.
[3] Biggs, J. "What the student does: Teaching for enhanced learning", Higher EducationResearch and Development, 18(1), 57. 1999.
[4] C. Daly and J. Horgan, "Automatic Plagiarism Detection" Proceedings of the International Conference in Applied Informatics. pp 255-259, 2001.
[5] C. Kelleher and R. Pausch, "Lowering the Barriers to Programming: A Taxonomy of Programming Environments and Languages for Novice Programmers", ACM Computing Surveys, 37(2), pp. 83-137, 2005.
[6] E. Lahtinen and T. Ahoniemi, "Visualisations to Support Programming on Different Levels of Cognitive Development" in Proceedings of The Fifth Koli Calling Conference on Computer Science Education.
[7] Computing Curricula 2001 Computer Science, Final Report, December 2001.
[8] M. McCracken, V. Almastrum, D. Diaz, M. Guzdial, D. Hagan, D. Kolikant, C. Laver, L. Thomas, I. Utting, and T. Wilusz, " A multinational, multi-institutional study of assessment of programming skills of first-year CS students." In ACM Sigcse Bullettin, 33(4), pp 125-140. 2001.
[9] S. Robins, J. Rountree, and N. Rountree, "Learning and Teaching Programming: A Review and Discussion", Computer Science Education, 13(2), pp. 137-172, 2003.
[10] F. Wei, H.S Moritz, M.S Parvez, and D.G Blank " A Student Mpdel For Object Oriented Design and Programming" in Journal of Computing Science in Colleges, Vol 20(5) p 260-273. 2005.
[11] V. R Basilli, Gianlugi. C and Rombach H. D "The Goal Question Metric Approach" 1996 Available on http://wwwagse.informatik.unikl. de/pubs/repository/basili94b/encyclo.gqm.pdf
[12] M. Kolling "The problem of Teaching Object-oriented Programming, Part 1: Languages," Journal of Object Oriented Programming, 11(8), 8- 15, 1999.
[13] K.B. McKeithen, J.S. Reitman, H.H. Rueter, S.C. Hirtle, "Knowledge Organization and Skills Differences in Computer Programmers," Cognitive Psychology, 307-325, 1981.
[14] H.B Graham and L.M Verbyla, "An Online programming Assessment Tool," in Proceedings of the Fifth Australasian Conference on Computing Education, Vol 20, Adelaide, Australia, 69 - 75, 2003.
[15] J.F Patenaude, E. Merlo, M. Dagenais, B Lague, "Extending Software Quality Assessment Techniques to Java Systems," IWPC, Seventh International Workshop on Program Comprehension, 49, 1999.
[16] M.E Califf and M. Goodwin, "Testing Skills and Knowledge: Introducing a Laboratory Exam in CS1" in Proceedings of the 33rd SIGCSE Technical Symposium on Computer Science Cincinnati, Kentucky, 217 - 221, 2002.
[17] Norazlina Khamis and Sufian Idris, "Investigating Current Object Oriented Programming Assessment method in Malaysia-s Universities", in Proceeding of ICEEI 2007, Bandung, Indonesia, 2007.
[18] Erickson, B. L., and Strommer, D. W. Teaching College Freshmen. San Francisco: Jossey-Bass, 1991.
[19] Norazlina K., and Sufian. Idris. "Issues with Object Oriented Programming Assessment in Malaysia-s Univerisities" to be publish in Proceeding of 1st International Malaysian Educational Technology Convention, 2007.
[20] Dunn, L., Morgan, C., O-Reilly, M., & Parry, S. "The Student Assessment Handbook", London: Routledge Falmer. 2004.
[21] Rust, C., Price, M., & O-Donovan, B. "Improving students- learning by developing their understanding of assessment criteria and processes" Assessment & Evaluation in Higher Education, 28(2), 147.2003.
[22] Ungku Harun AlRashid Ahmad. "Meeting The Demands of Global Firms: Survey Finding" Presented at Workshop on Enhancing Graduates Employability in A Globalised Economy, MDC. 2004.