Recurrent Session Approach to Generative Association Rule based Recommendation

Tubagus Arief Armanda; Ire Puspa Wardhani; Tubagus M. Akhriza; Tubagus M. Adrie Admira

doi:10.17977/um018v6i22023p199-214

Recurrent Session Approach to Generative Association Rule based Recommendation

Tubagus Arief Armanda, Ire Puspa Wardhani, Tubagus M. Akhriza, Tubagus M. Adrie Admira

Abstract

This article introduces a generative association rule (AR)-based recommendation system (RS) using a recurrent neural network approach implemented when a user searches for an item in a browsing session. It is proposed to overcome the limitations of the traditional AR-based RS which implements query-based sessions that are not adaptive to input series, thus failing to generate recommendations. The dataset used is accurate retail transaction data from online stores in Europe. The contribution of the proposed method is a next-item prediction model using LSTM, but what is trained to develop the model is an associative rule string, not a string of items in a purchase transaction. The proposed model predicts the next item generatively, while the traditional method discriminatively. As a result, for an array of items that the user has viewed in a browsing session, the model can always recommend the following items when traditional methods cannot. In addition, the results of user-centered validation of several metrics show that although the level of accuracy (similarity) of recommended products and products seen by users is only 20%, other metrics reach above 70%, such as novelty, diversity, attractiveness and enjoyability.

Full Text:

PDF

References

T. Silveira, M. Zhang, X. Lin, Y. Liu, and S. Ma, “How good your recommender system is? A survey on evaluations in recommendation,” Int. J. Mach. Learn. Cybern., vol. 10, no. 5, 2019.

J. Ben Schafer, J. A. Konstan, and J. Riedl, “E-Commerce Recommendation Applications,” in Applications of Data Mining to Electronic Commerce, 2011.

F. O. Isinkaye, Y. O. Folajimi, and B. A. Ojokoh, “Recommendation systems : Principles , methods and evaluation,” Egypt. Informatics J., vol. 16, no. 3, pp. 261–273, 2015.

Q. Y. Shambour, M. M. Abu-Alhaj, and M. M. Al-Tahrawi, “A hybrid collaborative filtering recommendation algorithm for requirements elicitation,” Int. J. Comput. Appl. Technol., vol. 63, no. 1–2, 2020.

W. Jiang et al., “A new time-aware collaborative filtering intelligent recommendation system,” Comput. Mater. Contin., vol. 61, no. 2, pp. 849–859, 2019.

K. Yi, T. Chen, and G. Cong, “Library personalized recommendation service method based on improved association rules,” Libr. Hi Tech, vol. 36, no. 3, pp. 443–457, 2018.

Y. Tian, B. Zheng, Y. Wang, Y. Zhang, and Q. Wu, “College library personalized recommendation system based on hybrid recommendation algorithm,” in Procedia CIRP, 2019.

M. Ge, F. Ricci, and D. Massimo, “Health-aware food recommender system,” in RecSys 2015 - Proceedings of the 9th ACM Conference on Recommender Systems, 2015.

X. Li et al., “Application of intelligent recommendation techniques for consumers’ food choices in restaurants,” Front. Psychiatry, 2018.

L. D. Adistia, T. M. Akhriza, and S. Jatmiko, “Sistem Rekomendasi Buku untuk Perpustakaan Perguruan Tinggi Berbasis Association Rule,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 3, no. 2, 2019.

T. K. Dang, Q. P. Nguyen, and V. S. Nguyen, “A Study of Deep Learning-Based Approaches for Session-Based Recommendation Systems,” SN Computer Science, vol. 1, no. 4. 2020.

S. Wang, L. Cao, Y. Wang, Q. Z. Sheng, M. A. Orgun, and D. Lian, “A Survey on Session-based Recommender Systems,” ACM Comput. Surv., vol. 54, no. 7, 2022.

M. Ludewig and D. Jannach, “Evaluation of session-based recommendation algorithms,” User Model. User-adapt. Interact., vol. 28, no. 4–5, 2018.

S. Latifi, N. Mauro, and D. Jannach, “Session-aware recommendation: A surprising quest for the state-of-the-art,” Inf. Sci. (Ny)., vol. 573, 2021.

M. Ludewig, N. Mauro, S. Latifi, and D. Jannach, “Empirical analysis of session-based recommendation algorithms,” User Model. User-adapt. Interact., vol. 31, no. 1, 2021.

M. Maher et al., “Comprehensive Empirical Evaluation of Deep Learning Approaches for Session-Based Recommendation in E-Commerce,” Entropy, vol. 24, no. 11, 2022.

D. Wang, D. Xu, D. Yu, and G. Xu, “Time-aware sequence model for next-item recommendation,” Appl. Intell., vol. 51, no. 2, 2021.

G. M. Harshvardhan, M. K. Gourisaria, S. S. Rautaray, and M. Pandey, “UBMTR: Unsupervised Boltzmann machine-based time-aware recommendation system,” J. King Saud Univ. - Comput. Inf. Sci., 2021.

J. Li, Y. Wang, and J. McAuley, “Time interval aware self-attention for sequential recommendation,” in WSDM 2020 - Proceedings of the 13th International Conference on Web Search and Data Mining, 2020.

Y. Guo, Y. Ling, and H. Chen, “A time-aware graph neural network for session-based recommendation,” IEEE Access, vol. 8, 2020.

T. M. Phuong, T. C. Thanh, and N. X. Bach, “Neural session-aware recommendation,” IEEE Access, vol. 7, 2019.

J. Zhao et al., “DCFGAN: An adversarial deep reinforcement learning framework with improved negative sampling for session-based recommender systems,” Inf. Sci. (Ny)., vol. 596, 2022.

X. Huang, Y. He, B. Yan, and W. Zeng, “Fusing frequent sub-sequences in the session-based recommender system[Formula presented],” Expert Syst. Appl., vol. 206, 2022.

L. van Maasakkers, D. Fok, and B. Donkers, “Next-basket prediction in a high-dimensional setting using gated recurrent units,” Expert Syst. Appl., vol. 212, 2023.

T. Liu, X. Yin, and W. Ni, “Next Basket Recommendation Model Based on Attribute-Aware Multi-Level Attention,” IEEE Access, vol. 8, 2020.

B. Peng, Z. Ren, S. Parthasarathy, and X. Ning, “M2: Mixed Models With Preferences, Popularities and Transitions for Next-Basket Recommendation,” IEEE Trans. Knowl. Data Eng., vol. 35, no. 4, 2023.

U. Niranjan, R. B. V. Subramanyam, and V. Khanaa, “Developing a Web Recommendation System Based on Closed Sequential Patterns,” in Communications in Computer and Information Science, 2010.

G. E. Yap, X. L. Li, and P. S. Yu, “Effective next-items recommendation via personalized sequential pattern mining,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2012.

B. Mobasher, H. Dai, T. Luo, and M. Nakagawa, “Effective Personalization Based on Association Rule Discovery from Web Usage Data,” in Proceedings of the Third International Workshop on Web Information and Data Management (WIDM), 2001.

T. M. Akhriza, Y. Ma, and J. Li, “Revealing the Gap Between Skills of Students and the Evolving Skills Required by the Industry of Information and Communication Technology,” Int. J. Softw. Eng. Knowl. Eng., vol. 27, no. 05, pp. 675–698, 2017.

M. Lippi, M. A. Montemurro, M. Degli Esposti, and G. Cristadoro, “Natural Language Statistical Features of LSTM-Generated Texts,” IEEE Trans. Neural Networks Learn. Syst., vol. 30, no. 11, 2019.

R. Dolphin, “LSTM Neworks A Detailed Explanation,” Web Page, 2020. (accessed Jan. 06, 2022).

P. P. Barman and A. Boruah, “A RNN based approach for next word prediction in assamese phonetic transcription,” in Procedia Computer Science, 2018.

J. Brownlee, “Text Generation With LSTM Recurrent Neural Networks in Python with Keras,” Machine learning mastery, 2018.

J. Gordon and J. M. Hernández-Lobato, “Combining deep generative and discriminative models for Bayesian semi-supervised learning,” Pattern Recognit., vol. 100, 2020.

A. Fujino, N. Ueda, and K. Saito, “A hybrid generative/discriminative approach to text classification with additional information,” Inf. Process. Manag., vol. 43, no. 2, 2007.

C. L. P. Chen and S. Feng, “Generative and Discriminative Fuzzy Restricted Boltzmann Machine Learning for Text and Image Classification,” IEEE Trans. Cybern., vol. 50, no. 5, 2020.

N. C. Dvornek, X. Li, J. Zhuang, and J. S. Duncan, “Jointly Discriminative and Generative Recurrent Neural Networks for Learning from fMRI,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2019.

A. Carta, “Building a RNN Recommendation Engine with TensorFlow,” Medium.com2, 2021. (accessed Jan. 06, 2022).

S. Ambulgekar, S. Malewadikar, R. Garande, and B. Joshi, “Next Words Prediction Using Recurrent NeuralNetworks,” ITM Web Conf., vol. 40, 2021.

S. G. Vadlamudi, S. Kumar, S. Sahu, A. Malviya, and P. Choudhury, “Multi-Window Time-Aware Personalized Recommendation System,” IN201741023671, 2017.

Q. Zhang, L. Cao, C. Shi, and Z. Niu, “Neural Time-Aware Sequential Recommendation by Jointly Modeling Preference Dynamics and Explicit Feature Couplings,” IEEE Trans. Neural Networks Learn. Syst., 2021.

H. Miao, A. Li, L. S. Davis, and A. Deshpande, “Towards unified data and lifecycle management for deep learning,” in Proceedings - International Conference on Data Engineering, 2017.

T. Iqbal and S. Qureshi, “The survey: Text generation models in deep learning,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 6. 2022.

M. Kaminskas and D. Bridge, “Diversity, serendipity, novelty, and coverage: A survey and empirical analysis of beyond-Accuracy objectives in recommender systems,” ACM Transactions on Interactive Intelligent Systems, vol. 7, no. 1. 2016.

P. Gravino, B. Monechi, and V. Loreto, “Towards novelty-driven recommender systems,” Comptes Rendus Physique, vol. 20, no. 4. 2019.

K. Kapoor, V. Kumar, L. Terveen, J. A. Konstan, and P. Schrater, “‘i like to explore sometimes’: Adapting to dynamic user novelty preferences,” in RecSys 2015 - Proceedings of the 9th ACM Conference on Recommender Systems, 2015.

Z. Zolaktaf, R. Babanezhad, and R. Pottinger, “A generic top-n recommendation framework for trading-off accuracy, novelty, and coverage,” Proc. - IEEE 34th Int. Conf. Data Eng. ICDE 2018, pp. 149–160, 2018.

k. Nanath and M. Ahmed, “User-Centric Evaluation of Recommender Systems: A literature review,” Int. J. Bus. Inf. Syst., vol. 1, no. 1, 2020.

D. Y. A. Waykar, “Human-AI Collaboration in Explainable Recommender Systems: An Exploration of User-Centric Explanations and Evaluation Frameworks,” INTERANTIONAL J. Sci. Res. Eng. Manag., vol. 07, no. 07, 2023.

T. M. Akhriza and I. D. Mumpuni, “Quantitative class association rule-based approach to lecturer career promotion recommendation,” Int. J. Inf. Decis. Sci., vol. 13, no. 2, 2021.

T. M. Akhriza, Y. Ma, and J. Li, “Novel Push-Front Fibonacci Windows Model for Finding Emerging Patterns with Better Completeness and Accuracy:,” ETRI J., vol. 40, no. 1, 2018.

R. Patel and S. Patel, “Deep Learning for Natural Language Processing,” in Lecture Notes in Networks and Systems, 2021, pp. 523–533.

K. Bradley and B. Smyth, “Improving Recommendation Diversity,” in Proceedings of the 12th irish conference on artificial intelligence and cognitive science, 2001.

T. Yu, J. Guo, W. Li, H. J. Wang, and L. Fan, “Recommendation with diversity: An adaptive trust-aware model,” Decis. Support Syst., vol. 123, 2019.

R. Xie et al., “Improving Accuracy and Diversity in Matching of Recommendation With Diversified Preference Network,” IEEE Trans. Big Data, vol. 8, no. 4, 2022.

Y. Lin, C. Huang, W. Yao, and Y. Shao, “Personalised attraction recommendation for enhancing topic diversity and accuracy,” J. Inf. Sci., vol. 49, no. 2, 2023.

C. Matt, A. Benlian, T. Hess, and C. Weiß, “Escaping from the filter bubble? the effects of novelty and serendipity on users’ evaluations of online recommendations,” in 35th International Conference on Information Systems “Building a Better World Through Information Systems”, ICIS 2014, 2014.

DOI: http://dx.doi.org/10.17977/um018v6i22023p199-214