Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 30737
Defining Programming Problems as Learning Objects

Authors: José Paulo Leal, Ricardo Queirós


Standards for learning objects focus primarily on content presentation. They were already extended to support automatic evaluation but it is limited to exercises with a predefined set of answers. The existing standards lack the metadata required by specialized evaluators to handle types of exercises with an indefinite set of solutions. To address this issue existing learning object standards were extended to the particular requirements of a specialized domain. A definition of programming problems as learning objects, compatible both with Learning Management Systems and with systems performing automatic evaluation of programs, is presented in this paper. The proposed definition includes metadata that cannot be conveniently represented using existing standards, such as: the type of automatic evaluation; the requirements of the evaluation engine; and the roles of different assets - tests cases, program solutions, etc. The EduJudge project and its main services are also presented as a case study on the use of the proposed definition of programming problems as learning objects.

Keywords: Interoperability, learning objects, Content Packaging, eLearning Services

Digital Object Identifier (DOI):

Procedia APA BibTeX Chicago EndNote Harvard JSON MLA RIS XML ISO 690 PDF Downloads 1244


[1] Dagger, D., O'Connor, A., Lawless, S., Walsh, E., Wade, V.: Service Oriented eLearning Platforms: From Monolithic Systems to Flexible Services (2007)
[2] Bryden, A.: Open and Global Standards for Achieving an Inclusive Information Society.
[3] IMS Global Learning Consortium. URL:
[4] IEEE Learning Technology Standards Committee. URL:
[5] ISO/IEC- International Organization for Standardization. URL:
[6] Friesen, N.: Interoperability and Learning Objects: An Overview of ELearning Standardization". Interdisciplinary Journal of Knowledge and Learning Objects. 2005.
[7] IMS-CP - IMS Content Packaging, Information Model, Best Practice and Implementation Guide, Version 1.1.3 Final Specification IMS Global Learning Consortium Inc., URL:
[8] IMS-Metadata - IMS MetaData. Information Model, Best Practice and Implementation Guide, Version 1.2.1 Final Specification IMS Global Learning Consortium Inc., URL:
[9] IMS-QTI - IMS Question and Test Interoperability. Information Model, Best Practice and Implementation Guide, Version 1.2.1 Final Specification IMS Global Learning Consortium Inc., URL:
[10] IMS DRI - IMS Digital Repositories Interoperability - Core Functions Information Model, URL: ml.
[11] Simon, B., Massart, D., van Assche, F., Ternier, S., Duval, E., Brantner, S., Olmedilla, D., & Miklos, Z. (2005). A Simple Query Interface for Interoperable Learning Repositories. In Proceedings of the WWW 2005 Conference, retrieved March 16, 2006 from interoperability/www2005-workshop-sqi-2005-04-14.pdf
[12] Godby, C.J.: What Do Application Profiles Reveal about the Learning Object Metadata Standard? Ariadne Article in eLearning Standards, 2004.
[13] IMS Application Profile Guidelines Overview, Part 1 - Management Overview, Version 1.0. URL:
[15] IMS Common Cartridge Profile, Version 1.0 Final Specification. URL:
[16] Clark, J, Murata, M.: RELAX NG Specification, OASIS Committee Specification, December 2001,
[17] Clark, J.: TREX - Tree Regular Expressions for XML. Thai Open Source Software Center, 2001,
[18] Murata, M.: RELAX (Regular Language description for XML). INSTAC (Information Technology Research and Standardization Center), 2001,
[19] Moller, A.: Document Structure Description 2.0, BRICS, 2002,
[20] The Schematron, An XML Structure Validation Language using Patterns in Trees,
[21] EduJudge project - Integrating On-line Judge into Effective E-learning. URL:
[22] ACM ICPC - International Collegiate Programming Contest. URL:
[23] Krafzig, D., Banke, K., Slama, D. Enterprise SOA: Service-Oriented Architecture Best Practices. 1.ed. Estados Unidos da América: Prentice Hall, 2004. ISBN 0131465759
[24] Leal, J.P., Queir├│s, R.: CrimsonHex: a Service Oriented Repository of Specialised Learning Objects. In: ICEIS 2009: 11th International Conference on Enterprise Information Systems, Milan (2009)
[25] Meier, W.: eXist: An Open Source Native XML Database. In: NODe 2002 Web and Database-Related Workshops, (2002)
[26] Regueras, L.M., Verd├║, E., Castro, J.P., Pérez, M.A., Verd├║, M.J.Design of a Distributed and Asynchronous System for Remote Evaluation of Students- Submissions in Competitive E-learning. In: ICEE 2008: International Conference on Engineering Education, Budapest (2008).
[27] Cole, J., Foster, H.: Using Moodle - Teaching with the Popular Open Source Course Management System, O'Reilly - Community Press.
[28] EduJudge MetaData (EJ MD) specification (version 2.0). URL: _v2.xsd