Students´ Knowledge, or Random Choice in ESP?

Authors: Ivana Šimonová

Abstract:

As widely accepted, didactic multiple-choice tests are referred as a tool providing feedback easily and quickly. Despite the final test scores are corrected by a special formula and number of high plausibility distractors is taken into consideration, the results may be influenced by the random choice. The survey was held in three academic years at the Faculty of Informatics and Management, University of Hradec Kralove, Czech Republic, where the multiple-choice test scores were compared to the open-answer ones. The research sample included 567 respondents. The collected data were processed by the NCSS2007 statistic software by the method of frequency and multiple regression analysis and presented in the form of figures and tables. The results proved statistically significant differences in test scores in academic years 2 and 3, and were discussed from the point of the credit system and conditions for teaching/learning English in the Czech education system.

Keywords: ESP, higher education, multiple-choice test, open-answer test.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1093760

References:

[1] W. A. Mehrens and I. L. Lehmann, Using standardized tests in education. OUP: Longman, 4 sub edition, 1986.
[2] P. Horovčák and B. Stehlíková, "Electronic testing and factors influencing its results,” in Acta Montanistica Slovaca, 2007, vol. 12, no. 2, pp. 102-113.
[3] A. Leither, "Do student learning styles translate to different "testing styles?,” in Journal of political science education, 2011, vol. 7, no. 4, pp. 416-433.
[4] D. Andrich, I. Marais and S. Hurphy, S. "Using the theorem by Andersen and the dichotomous Rasch model to access the presence of random guessing in multiple choice items,” in Journal of educational and behavioral statistics, 2012, vol. 37, no. 3, pp. 417-442.
[5] M. N. Desrochers and J. M. Shelnutt, "Effect of answer format and review method on college students´ learning,” in Computers & Education, 2012, vol. 59,no. 3, pp. 946-951.
[6] M. Waalkens, V. Aleven and N. Taatgen, "Does supporting multiple student strategies lead to greater learning and motivation? Investigating a source of complexity in the architecture of intelligent tutoring systems,” in Computers&Education, 2013, vol. 60, no. 1, pp. 159-171.
[7] I. Šimonová and P. Poulová, Learning style reflection within tertiary e-education. Hradec Kralove: WAMAK, 2012, ch. 6.
[8] C. A. Johnston, Unlocking the will to learn. Thousand Oaks: Corwin Press, Inc., 1996, p. 121
[9] S. Lin and Ch. Singh, "Can multiple-choice questions simulate free-response questions?,” in Physics Education Research Conference, Omaha, Nebraska: August 3-4, 2011, 1413, pp. 47-50, (Online). Retrieved January 04, http://www.compadre.org/portal/items/detail.cfm
[10] T. M. Haladyna, Developing and validating multiple-choice test items. Lawrence Erlbaum Associates, 1994.
[11] E. Hatch and A. Lazaraton, The research manual. Design and statistics for applied linguistics. USA: Heinle&Heinle Publishers, 1991.
[12] D. H. Hymes, "Toward linguistic competence,” (Online), Retrieved November 18, 2013, http://www.aila.info/download/publications/ review/AILA02.pdf.
[13] H. Cheng, "A comparison of multiple-choice and open-ended response formats for the assessment of listening performance,” in Foreign language annuals, 2004, vol. 37, no. 4, pp. 544-555.
[14] M. Linn and M. Miller, Measurement and assessment in teaching. 9th edition. New Jersey: Pearson education, 2005.
[15] P. McCoubrie, "Improving the fairness of multiple-choice questions: a literary review,” in Medical teacher, 2004, vol. 26, no. 8, pp. 709-712.
[16] M. Currie and T. Chiramanee, "The effect of multiple-choice item format on the measurement of knowledge of language structure,” in Language testing, vol. 27, pp. 471-491.
[17] J. Lee, "Second language reading topic familiarity and test score: test taking strategies for multiple-choice comprehension questions,” Ph.D thesis, 2011, in I. Ibadurrahman, "The use of multiple-choice questions in language testing,” Retrieved April 11, 2014, http://www.slideshare.net/IhsanIbadurrahman/pros-and-cons-of-multiple-choice-question-in-language-testing.
[18] D. DiBattista, J. A. Sinnige-Egger and G. Fortuna, "The "none of the above” option in multiple-choice testing: an experimental study,” in Journal of experimental education, vol. 82, no. 2, pp. 168-183.
[19] J. Burgerová and I. Cimermanová, "Creating a sense of presence in online learningenvironment,” DIVAI – Proceedings of 10th International scientific conference on distance learning in applied informatics. Wolters Kluwer, 2014, pp. 275-284.