QUALITY ANALYSIS OF ENGLISH FINAL TEST FOR LIGHT VEHICLE ENGINEERING STUDENTS AT SMK NEGERI 1 NGULING

Maya Fitriyah Firdaus, Lestari Setyowati, Barotun Mabaroh

Abstract


The purpose of this study is to investigate the quality of an English final test of SMKN 1 Nguling seen from its content validity, reliability, item difficulty, discriminating power, and effectiveness of distractor. The design of this study was qualitative research which focuses on content analysis and descriptive quantitative. The result shows that the test was considered sufficient. In particular, the researchers found out that the content validity of the test is very high, and the reliability of the test is moderate (r. 0.427). However, the test had poor item difficulty as half of the test items test was in the difficult category.  The test also has poor discriminating power.  Finally, in terms of the effectiveness of distractors, the result shows that 24 items need some revisions. The researchers concluded that even though the test is high in content validity and moderate in its reliability, the test still needs some improvements, especially in discriminating power and item distracter.


Full Text:

PDF

References


Akbari, Ramin. 2012. Validity in Language Testing. Coombe,Christine (eds), The Cambridge Guide to Second Language Assessment (pp.32). USA: Cambridge University Press.

Arifin, Zainal. 2016. Evaluasi Pembelajaran. Bandung: PT. Remaja Rosdakarya Offset

Arifin, Zainal. 2009. Evaluasi Pembelajaran. Bandung: PT. Remaja Rosdakarya

Arikunto, S. 2016. Dasar-Dasar Evaluasi Pendidikan. Jakarta: Bumi Aksara.

Arikunto, S. 2008. Prosedur Penelitian Suatu Pendekatan Praktik. Jakarta: Rineka Karya.

Arikunto, S, 2003, Dasar-Dasar Evaluasi Pendidikan, edisi revisi, Bumi Aksara, Yogyakarta

Aulia, Nurimah Arum. 2017. An Item Analysis Of English Final Test For The Twelfth Grade In SMA Negeri 1 Kejayan. Unpublished. S1 Thesis. Pasuruan: English Educational Study Program STKIP PGRI Pasuruan.

Basuki, Ismet & Hariyanto. 2017. Asesmen Pembelajaran. Bandung: PT.Remaja Roosdakarya

Brown, H. D. & Lee, H. K 2015. Teaching by Principle: An interactive Approach to Language Pedagogy Fourth Edition. San Francisco: Pearson.

Brown, H. D. 2001. Teaching by Principle: An interactive Approach to Language Pedagogy Second Edition. San Francisco: Longman

Cohen, J.R. & Swerdlik, M.E. 2010. Psychological Testing and Assessment An Introductional to Test and Measurement Seventh Edition. New York: McGraw-Hill

Davies, A., Brown, A., Elder, C. and Hill, K. (1999). Dictionary of Language Testing. Cambridge: Cambridge University Press.

Farhady, H. 2012. Principle of Language Assessment. Coombe, Christine (eds), The Cambridge Guide to Second Language Assessment (pp.38). USA: Cambridge University Press.

Farida, Ida. 2017. Evaluasi Pembelajaran Berdasarkan Kurikulum Nasional. Bandung: PT. Remaja Rosdakarya.

Gierl, Mark J. et al. 2017. Developing, analyzing, and Using Distractor for Multiple-Choice Tests in Educational: A Comprehensive review. Review of Educational Research, 87 (6). (online) (http://rer.aera.net) accessed on July, 31st 2019.

Heaton, J. B. 1988. Writing English Language Tests: A Practical Guide for Teachers of English As a Second or Foreign Language. London: Longman.

Hughes, A. 2003. Testing for language teachers. Cambridge: Cambridge University Press.

Luoma, S. 2004. Assessing speaking. Cambridge: Cambridge University Press

Kellaghan, T., & Greaney, V. 2001. Using Assessment To Improve the Quality of Education. Fundamentals of Educational Planning. Retrieved from https://inee.org/system/files/resources/Using_Assessment_to_Improve_the_Quality_of_Education.pdf on 24 April 2021

Kemp, J.E, Morrison, G.R. & Ross, S.M. 1994. Designing Effective Instruction. New York: Macmillan College Publishing Company.

Ngalimun. 2018. Evaluasi dan Penelitian Pembelajaran. Yogyakarta: Parama Ilmu.

https://semnas.unikama.ac.id/ks2b/arsip/2017/berkas/28.pdf on 2 April 2021.

Sudjana, N. 2014. Penilaian Hasil Proses Balajar Mengajar. Bandung: PT. Remaja Rosdakarya.

Sudijono, A. 2011. Evaluasi Pedidikan. Jakarta; Raja Grafindo Persada

Sudijono, A 2008. Pengantar Evaluasi Pendidikan. Jakarta: PT. Radja Grafindo Persada

Sulistyo, G. 2018 EFL Learning Assessment At Schools An Introduction to Its Basic Concepts and Principles. Malang: CV Bintang Sejahtera Abadi

Sulistyo, G. 2017. Ict-Based (Authentic) Assessment In The Context Of Language Teaching In The Indonesian (Lower And Upper) Secondary Levels Of Education: Potential Areas For Real-World Development. A Paper presented in Konferensi Nasional Sastra, Bahasa & Budaya (KS2B) Universitas Kanjuruhan Malang, p. 239-254.

Sulistyo, G.H. 2015. EFL Learning Assessment at Schools. An Introduction to its Concepts and Principles. Malang: Universitas Negeri Malang.

Wahyuningrum, Tri. 2017. Item Analysis Try Out Test for National Final Examination. Unpublished. S1 Thesis. Pasuruan: English Educational Study Program STKIP PGRI Pasuruan.

Wells, C.S & Wollack, J.A. 2003. An Instructor’s Guide to Understanding Test Reliability. Testing & Evaluation Services University of Wisconsin. Retrieved from https://testing.wisc.edu/Reliability.pdf on 2 April 2021.




DOI: http://dx.doi.org/10.17977/um046v5i12021p30-37

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 J-ELLiT (Journal of English Language, Literature, and Teaching)



Editorial and Administration Office:
This Journal is published and managed by Department of English, Faculty of Letters, Universitas Negeri Malang. 
Jl. Semarang No. 5, Malang, Indonesia.
Phone. (0341) 551312. 
Homepage: http://journal2.um.ac.id/index.php/jellit/index
email: jellit.journal@um.ac.id 

P-ISSN: 2580-670X
E-ISSN: 2580-9687

counter to Flickr View My Stats

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Flag Counter

Cover designed by Rahmati P. Yaniafari