Generating Javanese Stopwords List using  K-means Clustering Algorithm

Aji Prasetya Wibawa; Hidayah Kariima Fithri; Ilham Ari Elbaith Zaeni; Andrew Nafalski

doi:10.17977/um018v3i22020p106-111

Generating Javanese Stopwords List using K-means Clustering Algorithm

Aji Prasetya Wibawa, Hidayah Kariima Fithri, Ilham Ari Elbaith Zaeni, Andrew Nafalski

Abstract

Stopword removal necessary in Information Retrieval. It can remove frequently appeared and general words to reduce memory storage. The algorithm eliminates each word that is precisely the same as the word in the stopword list. However, generating the list could be time-consuming. The words in a specific language and domain must be collected and validated by specialists. This research aims to develop a new way to generate a stop word list using the K-means Clustering method. The proposed approach groups words based on their frequency. The confusion matrix calculates the difference between the findings with a valid stopword list created by a Javanese linguist. The accuracy of the proposed method is 78.28% (K=7). The result shows that the generation of Javanese stopword lists using a clustering method is reliable.

Full Text:

PDF

References

R. T. Lo, B. He, and I Ounis “Automatically Building a Stopword List for an Information Retrieval System,” J. Digit. Inf. Manag. vol. 3, no. 1, pp. 3–8, 2005.

J. Kaur, “A Systematic Review on Stopword Removal Algorithms,” Int. J. Future Revolut. Comp. Sci. Comm. Eng. vol. 4, no. 4, pp. 207–210, 2018.

J. Kaur and P.K. Buttar, 2018. “Stopwords Removal and its Algorithms Based on Different Methods”. International Journal of Advanced Research in Computer Science, vol. 9, no. 5, pp. 81–88, Oct. 2018.

S. Vijayarani, M. J. Ilamathi, and M. Nithya, “Preprocessing Techniques for Text Mining - An Overview,” Int. J. of Comp. Sci. Comm. Net. vol. 5, no. 1, pp. 7–16, 2015.

L. Dolamic and J. Savoy, “When Stopword Lists Make the Difference,” J. Am. Soc. Inf. Sci. Technol., vol. 61, no. 1, pp. 200–203, 2010.

F. Zou, F. L. Wang, X. Deng, S. Han, and L. S. Wang, “Automatic Construction of Chinese Stop Word List,” Proc. 5th WSEAS Int. Conf. Appl. Comp. Sci. 2006, pp. 1010–1015, 2006.

J. K. Raulji, “Stop-Word Removal Algorithm and its Implementation for Sanskrit Language,” Int. J. Comp. Applica. vol. 150, no. 2, pp. 15–17, 2016.

R. M. Duwairi, “Arabic Sentiment Analysis using Supervised Classification,” Int. Conf. Futur. Internet Things Cloud, pp. 579–583, 2014.

R. M. Rakholia and J. R. Saini, “A Rule-Based Approach to Identify Stop Words for Gujarati Language,” Proc. 5th Int. Conf. Front. Intell. Comput. Theory Appl. Adv. Intell. Syst. Comput., p. 515, 2017.

M. C. Kirana, N. P. Perkasa, M. Z. Lubis, and M. Fani, “Visualisasi Kualitas Penyebaran Informasi Gempa Bumi di Indonesia Menggunakan Twitter,” Journal of Applied Informatics and Computing, vol. 3, no. 1, pp. 23–32, 2019.

A. P. Wibawa, A. Nafalski, J. Tweedale, N. Murray, and A. E. Kadarisman, “Hybrid Machine Translation for Javanese Speech Levels,” Proc. 5th Int. Conf. Knowl. Smart Technol., pp. 64–69, 2013.

S. Poedjosoedarmo, “Javanese Speech Levels,” Indonesia, vol. 6, no. 6, pp. 54–81, 1968.

A. P. Wibawa, A. Nafalski, A. E. Kadarisman, and W. F. Mahmudy, “Indonesian-to-Javanese Machine Translation,” Int. J. Innov. Manag. Tech., vol. 4, no. 4, pp. 451–454, 2013.

S. V. S. Gunasekara and P. S. Haddela, “Context aware stopwords for Sinhala Text classification,” 2018 Natl. Inf. Technol. Conf., pp. 1–6, 2018.

T. M. Kodinariya, “Review on determining number of Cluster in K-Means Clustering,” International Journal of Advance Research in Computer Science and Management Studies, vol. 1, no. 6, pp. 90–95, 2013.

K. A. A. Nazeer and M. P. Sebastian, “Improving the Accuracy and Efficiency of the k-means Clustering Algorithm,” Proceedings of the World Congress on Engineering 2009, vol. I, pp. 1–5, 2009.

D. T. Pham, S. S. Dimov, and C. D. Nguyen, “Selection of K in K -means clustering,” Proc. Inst. Mech. Eng. Part C: J. Mech. Eng. Sci., vol. 219, no 1, May 2004, pp. 103–119, 2005.

F. Leisch, “A toolbox for K -centroids cluster analysis,” Computational Statistics & Data Analysis, vol. 51, no 2, pp. 526–544, 2006.

N. Grozavu, Y. Bennani, and M. Lebbah, “From variable weighting to cluster characterization in topographic unsupervised learning,” Proc. Int. Jt. Conf. Neural Networks, pp. 1005–1010, 2009.

V. M. Patro and M. R. Patra, “Augmenting Weighted Average with Confusion Matrix to Enhance Classification Accuracy,” Transactions on Machine Learning and Artificial Intelligence, vol. 2, no. 4, pp. 77–91, 2014.

A. Mishra and S. Vishwakarma, “Analysis of TF-IDF Model and its Variant for Document Retrieval,” Int. Conf. Comput. Intell. Commun. Networks Anal., pp. 772–776, 2015.

DOI: http://dx.doi.org/10.17977/um018v3i22020p106-111