Defining Programming Problems as Learning Objects

Authors: José Paulo Leal, Ricardo Queirós

Abstract:

Standards for learning objects focus primarily on content presentation. They were already extended to support automatic evaluation but it is limited to exercises with a predefined set of answers. The existing standards lack the metadata required by specialized evaluators to handle types of exercises with an indefinite set of solutions. To address this issue existing learning object standards were extended to the particular requirements of a specialized domain. A definition of programming problems as learning objects, compatible both with Learning Management Systems and with systems performing automatic evaluation of programs, is presented in this paper. The proposed definition includes metadata that cannot be conveniently represented using existing standards, such as: the type of automatic evaluation; the requirements of the evaluation engine; and the roles of different assets - tests cases, program solutions, etc. The EduJudge project and its main services are also presented as a case study on the use of the proposed definition of programming problems as learning objects.

Keywords: Content Packaging, eLearning Services, Interoperability, Learning Objects.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1058099

References:

[1] Dagger, D., O'Connor, A., Lawless, S., Walsh, E., Wade, V.: Service Oriented eLearning Platforms: From Monolithic Systems to Flexible Services (2007)
[2] Bryden, A.: Open and Global Standards for Achieving an Inclusive Information Society.
[3] IMS Global Learning Consortium. URL: http://www.imsglobal.org
[4] IEEE Learning Technology Standards Committee. URL: http://ieeeltsc.org
[5] ISO/IEC- International Organization for Standardization. URL: http://standards.iso.org/ittf/PubliclyAvailableStandards/index.html
[6] Friesen, N.: Interoperability and Learning Objects: An Overview of ELearning Standardization". Interdisciplinary Journal of Knowledge and Learning Objects. 2005.
[7] IMS-CP - IMS Content Packaging, Information Model, Best Practice and Implementation Guide, Version 1.1.3 Final Specification IMS Global Learning Consortium Inc., URL: http://www.imsglobal.org/content/packaging.
[8] IMS-Metadata - IMS MetaData. Information Model, Best Practice and Implementation Guide, Version 1.2.1 Final Specification IMS Global Learning Consortium Inc., URL: http://www.imsglobal.org/metadata.
[9] IMS-QTI - IMS Question and Test Interoperability. Information Model, Best Practice and Implementation Guide, Version 1.2.1 Final Specification IMS Global Learning Consortium Inc., URL: http://www.imsglobal.org/question/index.html.
[10] IMS DRI - IMS Digital Repositories Interoperability - Core Functions Information Model, URL: http://www.imsglobal.org/digitalrepositories/driv1p0/imsdri_infov1p0.ht ml.
[11] Simon, B., Massart, D., van Assche, F., Ternier, S., Duval, E., Brantner, S., Olmedilla, D., & Miklos, Z. (2005). A Simple Query Interface for Interoperable Learning Repositories. In Proceedings of the WWW 2005 Conference, retrieved March 16, 2006 from http://nm.wu-wien.ac.at/elearning/ interoperability/www2005-workshop-sqi-2005-04-14.pdf
[12] Godby, C.J.: What Do Application Profiles Reveal about the Learning Object Metadata Standard? Ariadne Article in eLearning Standards, 2004.
[13] IMS Application Profile Guidelines Overview, Part 1 - Management Overview, Version 1.0. URL: http://www.imsglobal.org/ap/apv1p0/imsap_oviewv1p0.html.
[14] ADL SCORM URL: http://www.adlnet.gov/Technologies/scorm
[15] IMS Common Cartridge Profile, Version 1.0 Final Specification. URL: http://www.imsglobal.org/cc/ccv1p0/imscc_profilev1p0.html
[16] Clark, J, Murata, M.: RELAX NG Specification, OASIS Committee Specification, December 2001, http://relaxng.org/spec-20011203.html
[17] Clark, J.: TREX - Tree Regular Expressions for XML. Thai Open Source Software Center, 2001, http://www.thaiopensource.com/trex/.
[18] Murata, M.: RELAX (Regular Language description for XML). INSTAC (Information Technology Research and Standardization Center), 2001, http://www.xml.gr.jp/relax/.
[19] Moller, A.: Document Structure Description 2.0, BRICS, 2002, http://www.brics.dk/DSD/dsd2.html.
[20] The Schematron, An XML Structure Validation Language using Patterns in Trees, http://www.ascc.net/xml/resource/schematron/schematron.html.
[21] EduJudge project - Integrating On-line Judge into Effective E-learning. URL: http://www.edujudge.eu
[22] ACM ICPC - International Collegiate Programming Contest. URL: http://icpc.baylor.edu/icpc/
[23] Krafzig, D., Banke, K., Slama, D. Enterprise SOA: Service-Oriented Architecture Best Practices. 1.ed. Estados Unidos da América: Prentice Hall, 2004. ISBN 0131465759
[24] Leal, J.P., Queir├│s, R.: CrimsonHex: a Service Oriented Repository of Specialised Learning Objects. In: ICEIS 2009: 11th International Conference on Enterprise Information Systems, Milan (2009)
[25] Meier, W.: eXist: An Open Source Native XML Database. In: NODe 2002 Web and Database-Related Workshops, (2002)
[26] Regueras, L.M., Verd├║, E., Castro, J.P., Pérez, M.A., Verd├║, M.J.Design of a Distributed and Asynchronous System for Remote Evaluation of Students- Submissions in Competitive E-learning. In: ICEE 2008: International Conference on Engineering Education, Budapest (2008).
[27] Cole, J., Foster, H.: Using Moodle - Teaching with the Popular Open Source Course Management System, O'Reilly - Community Press.
[28] EduJudge MetaData (EJ MD) specification (version 2.0). URL: http://mooshak.dcc.fc.up.pt/~edujudge/schemaDoc/examples/ejmd/ejmd _v2.xsd