Deep Learning for Multi-Structured Javanese Gamelan Note Generator

Arik Kurniawati; Eko Mulyanto Yuniarno; Yoyon Kusnendar Suprapto

doi:10.17977/um018v6i12023p41-56

Deep Learning for Multi-Structured Javanese Gamelan Note Generator

Arik Kurniawati, Eko Mulyanto Yuniarno, Yoyon Kusnendar Suprapto

Abstract

Javanese gamelan, a traditional Indonesian musical style, has several song structures called gendhing. Gendhing (songs) are written in conventional notation and require gamelan musicians to recognize patterns in the structure of each song. Usually, previous research on gendhing focuses on artistic and ethnomusicological perspectives, but this study is to explore the correlation between gendhing as traditional music in Indonesia and deep learning technology that replaces the task of gamelan composers. This research proposes CNN-LSTM to generate notation of ricikan struktural instruments as an accompaniment to Javanese gamelan music compositions based on balungan notation, rhythm, song structure, and gatra information. This proposed method (CNN-LSTM) is compared with LSTM and CNN. The musical data in this study is represented using numerical notation for the main melody in balungan notation. The experimental results showed that the CNN-LSTM model showed better performance compared to the LSTM and CNN models, with accuracy values of 91.9%, 91.5%, and 91.2% for CNN-LSTM, LSTM, and CNN, respectively. And the value of note distance for the Sampak song structure is 4 for the CNN-LSTM model, 8 for the LSTM model, and 12 for the CNN model. The smaller the note distance, the closer it is to the original notation provided by the gamelan composer. This study provides relevance for novice gamelan musicians who are interested in learning karawitan, especially in understanding ricikan struktural music notation and gamelan art in composing musical compositions of a song.

Full Text:

PDF

References

Martongprawit, “Catatan Pengetahuan Karawitan,” Surakarta: Akademi Seni Karawitan Indonesia (ASKI), 1975.

R Supanggah, “Bothèkan Karawitan I,” . Jakarta: Masyarakat Seni Pertunjukan Indonesia, 2002.

A. Setyoko and Z. W. Pratama, “Faktor-Faktor Kesulitan Pembelajaran Praktik Karawitan Jawa Program studi Etnomusikologi Fakultas Ilmu Budaya Universitas Mulawarman,” Jurnal Mebang: Kajian Budaya Musik dan Pendidikan Musik, vol. 1, no. 2, pp. 81–92, 2021.

S. Ananda and N. Scorviana Herminasari, “Minat Generasi Muda Kepada Pelestarian Gamelan Jawa Di Komunitas Gamelan Muda Samurti Andaru Laras,” Jurnal Studi Budaya Nusantara, 2022.

D. P. Prasetyo, “Ragam Garap Kendhang Kalih Ladrang Dalam Karawitan Gaya Surakarta,” Skripsi Institut Seni Indonesia Surakarta, 2016.

V. Melinda, “Garap Tabuhan Kempul Pada Gendhing Alit Dalam Klenèngan,” Skripsi Fakultas Seni Pertunjukan ISI Yogyakarta, 2019.

D. Purwanto, “Permainan Ricikan Kenong Dalam Karawitan Jawa Gaya Surakarta,” Gelar: Jurnal Seni Budaya, 11(2), 2013.

Supardi, “Ricikan struktural Salah Satu Indikator Pada Pembentukan Gending Dalam Karawitan Jawa,” Keteg, vol. 13, no. 1, 2013.

J. P. Briot, G. Hadjeres, and F. D. Pachet, “Deep Learning Techniques for Music Generation,” Heidelberg: Springer, 2020.

R. Madhok, S. Goel, and S. Garg, “SentiMozart: Music Generation based on Emotions,” International Conference on Agents and Artificial Intelligence, Vol 2, pp. 501-506, 2018.

Yang L. C., Chou S. Y., and Yang Y. H., “MidiNet: A Convolutional Generative Adversarial Network for Symbolic-Domain Music Generation,” arXiv preprint arXiv:1703.10847, 2017.

Q. Li, W. Cai, X. Wang, Y. Zhou, D. D. Feng, and M. Chen, “Medical Image Classification with Convolutional Neural Network,” International Conference on Control Automation Robotics & Vision (ICARCV), pp. 844-848, IEEE, 2014.

S. Tanberk and D. B. Tükel, “Style-specific Turkish Pop Music Composition with CNN and LSTM Network,” World Symposium on Applied Machine Intelligence and Informatics (SAMI), pp.181-185, IEEE, 2021.

J. Chen, “Construction of Music Intelligent Creation Model Based on Convolutional Neural Network,” Computational Intelligence and Neuroscience, 2022.

F. Minglei, “Application of Music Industry Based on The Deep Neural Network,” Scientific Programming, pp.1-6, 2022.

F. Shah, T. Naik and N. Vyas, “LSTM Based Music Generation,” International Conference on Machine Learning and Data Engineering (iCMLDE), pp. 48-53, 2019.

S. Mangal, R. Modak, & P. Joshi, “LSTM Based Music Generation System,” International Advanced Research Journal in Science, Engineering and Technology, Vol. 6, Issue 5, 2019.

Y. Huang, X. Huang, and Q. Cai, “Music Generation Based on Convolution-LSTM,” Computer and Information Science, 11(3), 50-56, 2018.

S. Liang, B. Zhu, Y. Zhang, S. Cheng, & J. Jin, “A Double Channel CNN-LSTM Model for Text Classification,“ IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems, pp. 1316-1321, 2020.

A. Agga, A. Abbou, M. Labbadi, Y. El Houm, & I. H. O. Ali, “CNN-LSTM: An Efficient Hybrid Deep Learning Architecture for Predicting Short-Term Photovoltaic Power Production,” Electric Power Systems Research, 208, 2022.

T. Liu, J. Bao, J. Wang, Y. Zhang, “A Hybrid CNN⁻LSTM Algorithm for Online Defect Recognition of CO₂ Welding,” Sensors (Basel), 18(12):4369, 2018.

W. Tan, J. Zhang, J. Wu, H. Lan, X. Liu, K. Xiao, & P. Guo, “Application of CNN and Long Short-Term Memory Network in Water Quality Predicting,” Intelligent Automation & Soft Computing, 34(3), 1943-1958, 2022.

W. Lu, J. Li, Y. Li, A. Sun, & J. Wang, “A CNN-LSTM-Based Model to Forecast Stock Prices,” Complexity, pp 1-10, 2020.

A. M. Syarif, A. Azhari, S. Suprapto, & K. Hastuti, “Human and Computation-Based Music Representation for Gamelan Music,” Malaysian Journal of Music, 9, 82-100, 2020.

K. Hastuti, & K. Mustafa, “A Method for Automatic Gamelan Music Composition,” International Journal of Advances in Intelligent Informatics, 2(1), 26-37, 2016.

K. Hastuti, A. Azhari, A. Musdholifah, & R. Supanggah, “Rule-Based and Genetic Algorithm for Automatic Gamelan Music Composition,” International Review on Modelling and Simulations, 10(3), pp 202-212, 2017.

A. Kurniawati, E. M. Yuniarno, Y. K. Suprapto, & A. N. I. Soewidiatmaka, “Automatic Note Generator for Javanese Gamelan Music Accompaniment using Deep Learning,” International Journal of Advances in Intelligent Informatics, 9(2), pp 231-248, 2023.

M. Ashraf, F. Abid, M. Atif, and S. Bashir, “The Role of CNN and RNN in the Classification of Audio Music Genres,” VFAST Transactions on Software Engineering, 2022.

M. Ashraf, F. Abid, I. U. Din, J. Rasheed, M. Yesiltepe, S. F. Yeo, & M. T. Ersoy, “A Hybrid CNN and RNN Variant Model for Music Classification,” Applied Sciences, 13(3), 1476, 2023.

X. Luo, “Automatic Music Genre Classification based on CNN and LSTM”, Highlights in Science, Engineering and Technology, pp39, 61-66, 2023.

R. Gupta, S. Ashish, H. Shekhar, and M. D. S. Dominic, “Music Genre Classification Using CNN and RNN-LSTM,” Micro-Electronics and Telecommunication Engineering: Proceedings of 5th ICMETE 2021 (pp. 729-745). Singapore: Springer Nature Singapore, 2021.

D. Kostrzewa, P. Kaminski, & R. Brzeski, “Music Genre Classification: Looking for The Perfect Network,” International Conference on Computational Science, pp.55-67, Cham: Springer International Publishing, 2021.

R. T. Irene, C. Borrelli, M. Zanoni, M. Buccoli, & A. Sarti, “Automatic Playlist Generation using Convolutional Neural Networks and Recurrent Neural Networks,” 27th European Signal Processing Conference (EUSIPCO), pp. 1-5, 2019.

T. Ito and S. Arai, “Harmonic Representation for CNN-LSTM Automatic Chord Recognition,” 3rd International Conference on Cybernetics and Intelligent System (ICORIS), pp. 1-5, 2021.

S. B. Puri , S. P. Mahajan, “Automatic Note and Chord Recognition for Harmonium Music: A Deep Learning Approach,” Journal of Critical Reviews, 7(15), 2020.

S. Hizlisoy, S.Yildirim, & Z. Tufekci, “Music Emotion Recognition using Convolutional Long Short Term Memory Deep Neural Networks,” Engineering Science and Technology, 24(3), pp760-767, 2021.

S. Sheykhivand, Z. Mousavi, T. Y. Rezaii, & A. Farzamnia, “Recognizing Emotions Evoked by Music using CNN-LSTM Networks on EEG Signals,’’ IEEE Access, 8, 139332-139345, 2020.

S. Ayadi and Z. Lachiri, “A combined CNN-LSTM Network for Audio Emotion Recognition using Speech and Song attributs,” 6th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), pp. 1-6, 2022.

A. Ranjan, V. N. J. Behera, and M. Reza, “Using a Bi-directional LSTM Model with Attention Mechanism trained on MIDI Data for Generating Unique Music,” Artificial Intelligence for Data Science in Theory and Practice, Nov. 2022.

J. Gareth, W. Daniela, H. Trevor, and T. Robert, J. Gareth, W. Daniela, H. Trevor, & T. Robert, “An Introduction to Statistical Learning: with Applications in R,” Spinger, 2013.

DOI: http://dx.doi.org/10.17977/um018v6i12023p41-56