Development of a project assessment instrument to measure skills using historical sources for history study program students at the University of Riau

Asyrul Fikri, Aman Aman, Suarman Suarman, Isjoni Isjoni, Sumarno Sumarno

Abstract


The goal of this study is to create a project evaluation tool that can be used to evaluate students' knowledge of how to use historical sources at the University of Riau's History Study Program. The three steps of the employed instrument development approach are: (i) problem analysis and instrument development needs; (ii) development of a framework for project evaluation instruments; and (iii) validation tests, instrument trials, and instrument changes by experts. 54 randomly chosen students from the history education study program at Riau University made up the research subjects. Research data was gathered through surveys and literature reviews. The SPSS version 25.0 application is used to do statistical analysis as part of the data analysis approach. 4.416. This demonstrates the instrument's excellent design and alignment with the intended use of the measurement. With an average score of 4.24, the test results further demonstrate this instrument's capacity to deliver reliable assessments. The instrument's validity and reliability scored highly. Based on these results, it can be said that the project evaluation tool created in this study has strong validity and reliability in assessing students in the University of Riau's History Study Program's capacity to use historical materials. This test is a useful tool for determining how well students can examine and comprehend historical sources. In the subject of historical education, this study has a significant impact on the creation of project assessment tools and can serve as the foundation for future advancements.


Keywords


knowledge of history, skills to use historical resources, and project evaluation

Full Text:

PDF

References


Al-Hattami, A. A. (2020). E-Assessment of students performance during the E-Teaching and learning. International Journal of Advanced Science and Technology, 29(8s), 1537–1547.

Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008

Anis, M. Z. A., Putro, H. P. N., Susanto, H., & Hastuti, K. P. (2020). Historical thinking model in achieving cognitive dimension of Indonesian history learning. PalArch’s Journal of Archaeology of Egypt/Egyptology, 17(7), 7894–7906.

Astalini, A., Kurniawan, D., Sulistiyo, U., Perdana, R., & Susbiyanto, S. (2019). E-assessment motivation in physics subjects for senior high school. International Journal of Online and Biomedical Engineering, 15(11), 4–15. https://doi.org/10.3991/ijoe.v15i11.10843

Aula, M. F. R., Suyitno, H., & Rosyida, I. (2019). Mathematical literacy ability viewed from studentTM s learning style based on gender differences on PBL assistance project assessment. Unnes Journal of Mathematics Education Research, 8(1), 96–103.

Barros, A., Carneiro, A. D. T., & Wanderley, S. (2019). Organizational archives and historical narratives: Practicing reflexivity in (re)constructing the past from memories and silences. Qualitative Research in Organizations and Management: An International Journal, 14(3), 280–294. https://doi.org/10.1108/QROM-01-2018-1604

Biasutti, M., & Frate, S. (2017). A validity and reliability study of the attitudes toward sustainable development scale. Environmental Education Research, 23(2), 214–230. https://doi.org/10.1080/13504622.2016.1146660

Box, C., Skoog, G., & Dabbs, J. M. (2015). A case study of teacher personal practice assessment theories and complexities of implementing formative assessment. American Educational Research Journal, 52(5), 956–983. https://doi.org/10.3102/0002831215587754

Brew, A., & Saunders, C. (2020). Making sense of research-based learning in teacher education. Teaching and Teacher Education, 87(January), 102935. https://doi.org/10.1016/j.tate.2019.102935

Carrasco, C. G., & Martnez, P. M. (2016). Historical skills in compulsory education: Assessment, inquiry based strategies and students’ argumentation. Journal of New Approaches in Educational Research, 5(2), 130–136. https://doi.org/10.7821/naer.2016.7.172

Claravall, E. B., & Irey, R. (2021). Fostering historical thinking: The use of document based instruction for students with learning differences. Journal of Social Studies Research, xxxx, 1–16. https://doi.org/10.1016/j.jssr.2021.08.001

Cowgill II, D. A., & Waring, S. M. (2017). Historical thinking: An evaluation of student and teacher ability to analyse sources. Journal of Social Studies Education Research, 8(1), 115–145.

Doppelt, Y. (2005). Assessment of project-based learning in a Mechatronics context. Journal of Technology Education, 16(2), 7–24. https://doi.org/10.21061/jte.v16i2.a.1

Fisher, D. (2021). The effect of project-based assessment with value clarification technique in improving students’ civics learning outcomes by controlling the family environment. European Journal of Educational Research, 11(1), 69–81.

Gazi, F., Atan, T., & Kılıç, M. (2022). The assessment of internal indicators on the balanced scorecard measures of sustainability. Sustainability (Switzerland), 14(14), 1–19. https://doi.org/10.3390/su14148595

Hairida, H., & Junanto, T. (2018). The effectiveness of performance assessment in project-based learning by utilizing local potential to increase the science literacy. International Journal of Pedagogy and Teacher Education, 2(July), 17. https://doi.org/10.20961/ijpte.v2i0.25722

Handayani, F., Hartono, H., & Lestari, W. (2019). Need analysis in the development of hots-oriented study project assessment instrument in android-based science learning. Journal of Educational Research and Evaluation, 8(1), 57–64. https://doi.org/10.15294/jere.v8i1.31799

Hazi, H. (2020). On instructional improvement: A modest essay. Journal of Educational Supervision, 3(3), 90–103. https://doi.org/10.31045/jes.3.3.7

Ibay, S. B., & Pa-alisbo, M. A. C. (2020). An assessment of the managerial skills and professional development needs of private catholic secondary school administrators in Bangkok, Thailand. World Journal of Education, 10(1), 149–163. https://doi.org/10.5430/wje.v10n1p149

Janah, S. M., & Hamami, T. (2022). The effectiveness of self-assessment to improve metacognitive ability in Islamic religious education. Ta’dib, 25(2), 247. https://doi.org/10.31958/jt.v25i2.5911

Jong, B., & Tan, K. H. (2021). Using padlet as a technological tool for assessment of students’ writing skills in online classroom settings. International Journal of Education and Practice, 9(2), 411–423. https://doi.org/10.18488/journal.61.2021.92.411.423

Lubas, K. (2022). Research-based learning model for senior high school science instruction research questions. Psychology and Education: A Multidisciplinary Journal, 2(4), 316–328. https://doi.org/10.5281/zenodo.6727906

Martínez-Hita, M., Gómez-Carrasco, C. J., & Miralles-Martínez, P. (2021). The effects of a gamified project based on historical thinking on the academic performance of primary school children. Humanities and Social Sciences Communications, 8(1), 1–10. https://doi.org/10.1057/s41599-021-00796-9

Matriano, A. (2020). Ensuring student-centered, constructivist and project-based experiential learning applying the exploration, research, interaction and creation (Eric) learning model. International Online Journal of Education and Teaching (IOJET), 7(1), 214–227.

Mayilyan, H. (2019). Augmented reality in education, AR globe project assessment in actual teaching-learning environment. International Journal of Learning, Teaching and Educational Research, 18(3), 1–14. https://doi.org/10.26803/ijlter.18.3.1

Ningsih, T. Z., Sariyatun, & Sutimin, L. A. (2019). Development of portfolio assessment to measure the student’s skill of using primary source evidence. New Educational Review, 56(2), 101–113. https://doi.org/10.15804/tner.2019.56.2.08

Nurulwati, N., Herliana, F., Elisa, E., & Musdar, M. (2021). The effectiveness of project-based learning to increase science process skills in static fluids topic. AIP Conference Proceedings, 2320(March). https://doi.org/10.1063/5.0037628

Ofianto, O., & Suhartono, S. (2015). An assessment model of historical thinking skills by means of the RASCH model. Research and Evaluation in Education, 1(1), 73. https://doi.org/10.21831/reid.v1i1.4899

Oliver, K., & Purichia, H. (2018). Analysing historical primary source open educational resources: A blended pedagogical approach. Contemporary Issues in Technology and Teacher Education (CITE Journal), 18(2), 392–415.

Puurtinen, M., Nivala, M., & Virta, A. (2015). Visual sources and historical thinking in higher education. Nordidactica: Journal Of Humanities And Social Science Education, 2015(4), 1–20.

Rantala, J., & van den Berg, M. (2015). Finnish high school and university students’ ability to handle multiple source documents in history. Historical Encounters, 2(1), 70–88.

Reisman, A., Brimsek, E., & Hollywood, C. (2019). Assessment of historical analysis and argumentation (AHAA): a new measure of document-based historical thinking. Cognition and Instruction, 37(4), 534–561. https://doi.org/10.1080/07370008.2019.1632861

Rini, D. S., Adisyahputra, D. V. S., & Sigit, D. V. (2020). Boosting student critical thinking ability through project based learning, motivation and visual, auditory, kinesthetic learning style: A study on Ecosystem Topic. Universal Journal of Educational Research, 8(4A), 37–44. https://doi.org/10.13189/ujer.2020.081806

Saeed, G. T., Hassan, A. E., Al Omary, H. L., & Alawad, Z. M. (2017). Multiple choice questions and essay questions in assessment of success rate in medical physiology. Journal of the Faculty of Medicine Baghdad, 59(4), 333–335. https://doi.org/10.32007/jfacmedbagdad.59481

Sajjad, M., Khan, R. A., & Yasmeen, R. (2018). Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool. Pakistan Journal of Medical Sciences, 34(1), 164–169. https://doi.org/10.12669/pjms.341.14354

Saputri, D. Y., Rukayah, R., & Indriayu, M. (2018). Need assessment of interactive multimedia based on game in elementary school: A challenge into learning in 21st century. International Journal of Educational Research Review, 3(3), 1–8. https://doi.org/10.24331/ijere.411329

Schaufeli, W. B., Desart, S., & De Witte, H. (2020). Burnout assessment tool (Bat)-development, validity, and reliability. International Journal of Environmental Research and Public Health, 17(24), 1–21. https://doi.org/10.3390/ijerph17249495

Seixas, P., Gibson, L., & Ercikan, K. (2015). A design process for assessing historical thinking: the case of a one-hour test. In K. Ercikan & P. Seixas (Eds.), New Directions in Assessing Historical Thinking (pp. 124–138). Routled.

Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1), 1–7. https://doi.org/10.1177/2158244018821751

Simamora, R. M. (2020). The Challenges of online learning during the COVID-19 pandemic: An essay analysis of performing arts education students. Studies in Learning and Teaching, 1(2), 86–103. https://doi.org/10.46627/silet.v1i2.38

Suwarno, S., Wahidin, W., & Nur, S. H. (2020). Project-based learning model assisted by worksheet: It’s effect on students’ creativity and learning outcomes. JPBI (Jurnal Pendidikan Biologi Indonesia), 6(1), 113–122. https://doi.org/10.22219/jpbi.v6i1.10619

Vanderoost, J., Janssen, R., Eggermont, J., Callens, R., & De Laet, T. (2018). Elimination testing with adapted scoring reduces guessing and anxiety in multiplechoice assessments, but does not increase grade average in comparison with negative marking. PLoS ONE, 13(10), 1–27. https://doi.org/10.1371/journal.pone.0203931

Zachrich, L., Weller, A., Baron, C., & Bertram, C. (2020). Historical experiences: A framework for encountering complex historical sources. History Education Research Journal, 17(2). https://doi.org/10.14324/herj.17.2.08




DOI: http://dx.doi.org/10.17977/um048v29i1p48-57

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Jurnal Ilmu Pendidikan

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.


Jurnal Ilmu Pendidikan
ISSN: 0215-9643 | E-ISSN: 2442-8655
Contact
Lembaga Penelitian dan Pengabdian Kepada Masyarakat (LP2M) Universitas Negeri Malang (UM)
Graha Rektorat, Floor 6, Jl. Semarang No 5 Malang 65145
Homepage: http://journal2.um.ac.id/index.php/jip
E-mail: jip@um.ac.id

Jurnal Ilmu Pendidikan is licensed under a Creative Commons Attribution 4.0 International License.

View My Stats