User Acceptance of Online Examination System Using the Unified Theory of Acceptance and Use of Technology (UTAUT) Model

Mario Hendrial Christanto Ay, Hakkun Elmunsyah, Aji Prasetya Wibawa

Abstract


User acceptance is one of the factors that need to be considered in order to improve the quality of the online examination system. Therefore, an evaluation model is needed to measure online examination system user acceptance. The Unified Theory of Acceptance and Use of Technology (UTAUT) is one of the evaluation models used in this study. This study aims to determine the user acceptance of the web-based online examination system at Public VHS 4 Malang using the UTAUT factors. The UTAUT factors used are performance expectancy, effort expectancy, social influence, and facilitating conditions as exogenous latent variables, and behavioral intention as an endogenous latent variable. The respondents in this study were students in the 12th grade of 2022/2023 school year. The total number of students was 274. The data obtained were analyzed using the Partial Least Square (PLS) method using SmartPLS 3 software. In this study, performance expectancy, effort expectancy, and facilitating conditions have a positive and significant effect on behavioral intention, while social influence has a positive but insignificant effect on behavioral intention.

Full Text:

PDF

References


I. F. Sandria, Slamet, and R. Santoso, “Pola Penerimaan Ujian Nasional Berbasis Komputer (UNBK) Terhadap Siswa SMK Prapanca Dengan Menggunakan Metode Unified Theory Of Acceptance And Use Of Technology (UTAUT),” JSIKA, vol. 7, no. 2, pp. 1-9, 2018.

Hadi, S. Pengembangan Computerized Adaptive Test Berbasis Web, Aswaja Pressindo, Yogyakarta, 2013.

E. Andika, D. Djajasukma, and H. Heryanto, “Analisis Manfaat Penerapan Sistem Informasi Ujian Online: Studi Kasus SMK Pasim Plus,” JTERA - Jurnal Teknologi Rekayasa, vol. 2, no. 1, pp. 47-54, Jun. 2017.

N. Hidayatun, “Kajian Teknologi Sistem Ujian Online Dengan Menggunakan Model UTAUT,” Paradigma - Jurnal Komputer dan Informatika - E-Journal BSI, vol. 15, no. 1, pp. 67-79, Mar. 2013.

R. J. Hill, M. Fishbein, and I. Ajzen, “Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research.,” Contemporary Sociology, vol. 6, no. 2, p. 244, Mar. 1977.

F. D. Davis, R. P. Bagozzi, and P. R. Warshaw, “User Acceptance of Computer Technology: A Comparison of Two Theoretical Models,” Management Science, vol. 35, no. 8, pp. 982- 1003, Aug. 1989.

F. D. Davis, R. P. Bagozzi, and P. R. Warshaw, “Extrinsic and Intrinsic Motivation to Use Computers in the Workplace1,” Journal of Applied Social Psychology, vol. 22, no. 14, pp. 1111–1132, Jul. 1992.

I. Ajzen, “The theory of planned behavior,” Organizational Behavior and Human Decision Processes, vol. 50, no. 2, pp. 179–211, Dec. 1991.

S. Taylor and P. A. Todd, “Understanding Information Technology Usage: A Test of Competing Models,” Information Systems Research, vol. 6, no. 2, pp. 144–176, Jun. 1995.

R. L. Thompson, C. A. Higgins, and J. M. Howell, “Personal Computing: Toward a Conceptual Model of Utilization,” MIS Quarterly, vol. 15, no. 1, p. 125, Mar. 1991.

G. C. Moore and I. Benbasat, “Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation,” Information Systems Research, vol. 2, no. 3, pp. 192–222, Sep. 1991.

D. R. Compeau and C. A. Higgins, “Application of Social Cognitive Theory to Training for Computer Skills,” Information Systems Research, vol. 6, no. 2, pp. 118–143, Jun. 1995.

V. Venkatesh, M.G. Morris, G.B. Davis, and F.D. Davis, “User Acceptance of Information Technology: Toward a Unified View,” MIS Quarterly, vol. 27, no. 3, pp. 425-478, 2003.

A. P. Widiodo and R. Gernowo, “Hubungan Faktor Penerimaan Aplikasi Ujian Sekolah Berbasis Komputer Menggunakan Model UTAUT,” in Seminar Nasional Pendidikan, Sains dan Teknologi FMIPA UNIMUS, pp. 32-38, Oct. 7, 2017.

Y. Sriyeni, D. Antoni, M. Akbar, “Analisis Penerimaan dan Penggunaan Teknologi Computer Based Test (CBT) sebagai Media Ujian Online dengan Model Unified Theory of Acceptance And Use of Technology (UTAUT),” TEKNOMATIKA, vol. 8, no. 1, pp. 93-104, Mar. 2018.

O. Hamalik, Kurikulum Dan Pembelajaran, Bumi Aksara, Jakarta, 2013.

Wahana, “Wahana, Pemanfaatan Teknologi Informasi untuk Pendidikan dengan Ujian Berbasis Komputer,” Jurnal Teknologi Pendidikan, vol. 2, no. 2, pp. 177-185, 2013.

R. G. Jimoh, K. S. Abduljaleel, and Y. K. Kawu, “Students’ Perception of Computer Based Test (CBT) for Examining Undergraduate Chemistry Courses,” J. Emerg. Trends Comput. Inf. Sci., vol. 3, no. 2, pp. 125-134, Feb. 2012.

Ramllah and A. Nurkhin, “Analysis of Factors Affecting Behavioral Intention to Use E-Learning Uses the Unified Theory of Acceptance and Use of Technology Approach,” KnE Social Sciences, vol. 4, no. 6, pp. 1005-1025, 2020.

A. Alshehri, M. Rutter, and S. Smith, “An Implementation of the UTAUT Model for Understanding Students’ Perceptions of Learning Management Systems: A Study within Tertiary Institutions in Saudi Arabia,” International Journal of Distance Education Technologies, vol. 17, no.3, pp. 1-24. 2019.

G. Afacan Adanır, and M. Çınar, “The Acceptance and Use of an Online Exam System by Online Learners: Implementation of the UTAUT Model,” Sakarya University Journal of Education, vol. 11, no. 3, pp. 412-430, 2021.

M. Jawaid, F. A. Moosa, F. Jaleel, and J. Ashraf, “Computer Based Assessment (CBA): Perception of Residents at Dow University of Health Sciences,” Pakistan Journal of Medical Sciences, vol. 30, no. 4, pp. 688-691, 2014

M. Arif, K. Ameen, and M. Rafiq, “Factors Affecting Student Use of Web-based Services,” The Electronic Library, vol. 36, no. 3, pp. 518-534, 2018.

M. M. Abbad, “Using the UTAUT Model to Understand Students’ Usage of e-Learning Systems in Developing Countries,” Education and Information Technologies, vol. 26, pp. 7205-7224, 2021.

M. Zheng, and D. Bender, “Evaluating Outcomes of Computer-Based Classroom Testing: Student Acceptance and Impact on Learning and Exam Performance,” Medical Teacher, vol. 41, no. 1, pp. 75-82. 2019.

S. Prasiska, D. Kurniadi, dan M. Anwar, “Analisis Perilaku Penggunaan Aplikasi Ujian Sekolah Berbasis Komputer Menggunakan Model UTAUT (Unified Theory Of Acceptance And Use Technology) Di SMK Negeri 1 Batipuh,” Jurnal Vokasional Teknik Elektronika dan Informatika (VOTEKNIKA), vol. 6, no. 2, pp. 15-21, 2018.

J. M. Sirianni, Y. J. Ng, and A. Vishwanath, “Adopting Computer-Based Assessments: The Role of Perceived Value in Classroom Technology Acceptance,” Online Journal of Communication and Media Technologies, vol. 7, no. 4, pp. 1-23, 2017.

M. Asvial, J. Mayangsari, and A. Yudistriansyah, “Behavioral Intention of e-Learning: A Case Study of Distance Learning at a Junior High School in Indonesia due to the COVID-19 Pandemic,” International Journal of Technology, vol. 12, no. 1, pp. 54-64, 2021.

A. Ginting, Roslina, dan Wanayumini, “Analisis Penerimaan Sistem Ujian CBT Menggunakan Metode UTAUT (Unified Theory of Acceptance and Use of Technology) di Lingkungan Kampus,” Jurnal Media Informatika Budidarma, vol. 5, no. 2, pp. 532-539, 2021.

R. D. Mahande, and J. D. Malago, “An E-learning Acceptance Evaluation Through UTAUT Model in a Postgraduate Program,” Journal of Educators Online, col. 16, no. 2, pp. 1-10, 2019.

W. Abdillah and J. Hartono, Partial Least Square (PLS) – Alternatif Structural Equation Modeling dalam Penelitian Bisnis, ANDI, Yogyakarta, 2015.

J. Sarwono and U. Narimawati, Membuat Skripsi, Tesis dan Disertasi dengan Partial Least Square SEM (PLS SEM), ANDI, Yogyakarta, 2015.

F. G. Karaoğlan Yılmaz, R. Yılmaz, and T. Öztürk, “Examining University Students’ Acceptance of Web-based Formative Assessment System,” Hacettepe University Journal of Education, vol. 35, pp. 25-36, 2020.

H. Elmunsyah, W. N. Hidayat, K. Asfani, and Kusumadyahdewi, “Mobile App-based Learning Media to Facilitate Student Learning,” World Transactions on Engineering and Technology Education, vol. 17, no. 1, pp. 88-92. 2019.

S. W. Maulida, H. Elmunsyah, and S. Patmanthara, “The Contributions of Computer Facility, Test Preparation, and Learning Motivation Against The Results of Computer-based Final Examination Result of VHS Students of Software Engineering Expertise Package in Malang City,” AIP Conference Proceedings 1887, 020069, 2017.

J. F. Hair, J. J. Risher, M. Sarstedt, and C. M. Ringle, “When to Use and How to Report The Results of PLS-SEM,” European Business Review, vol. 30, no. 1, pp. 2-24, 2019.

M. Wetzels, G. Odekerken-Schröder, and C. van Oppen, “Using PLS Path Modeling for Assessing Hierarchical Construct Models: Guidelines and Empirical Illustration,” MIS Quarterly, vol. 33, no. 1, pp. 177-195, 2009.




DOI: http://dx.doi.org/10.17977/um010v6i12023p30-37

Refbacks

  • There are currently no refbacks.


 

 Letters in Information Technology Education (LITE)
 2654-5667
 Contact
 Published by Electrical Engineering, Universitas Negeri   Malang, Indonesia
 Jl. Semarang No. 5 Malang, East Java, Indonesia
 Homepage:  http://journal2.um.ac.id/index.php/lite/index
 E-mail: [email protected]

View My Stats