International Journal of Advanced Technology and Engineering Exploration (IJATEE) ISSN (P): 2394-5443 ISSN (O): 2394-7454 Vol - 10, Issue - 104, July 2023
  1. 1
    Google Scholar
Evolutionary extreme learning machine based collaborative filtering

Pratibha Yadav, Shweta Tyagi and Harmeet Kaur

Abstract

Research in the field of collaborative filtering (CF) has demonstrated its importance and effectiveness compared to other recommendation engines such as content-based and hybrid recommendation systems. However, there is ongoing research in the field of CF to improve the list of recommended items and generate accurate recommendations when dealing with sparse datasets. To enhance the prediction quality of recommender systems, a method based on an evolutionary extreme learning machine (EELM) for CF has been proposed to address the issue of sparsity. First, the dataset is pre-processed by filling in missing rating values in the rating database. Additionally, the dataset is trimmed by removing items with a limited number of ratings. This tailored rating database is then utilized with the extreme learning machine(ELM) technique to improve the quality of recommendations in the domain of CF. Furthermore, to enhance the accuracy of the proposed recommendation method, an evolutionary genetic algorithm(GA) was employed to train the parameters of the ELM-based model. The variants of the proposed scheme are compared to traditional recommendation methods by computing metrics such as mean absolute error (MAE), root mean square error (RMSE), precision, recall, and F-measure. Empirical analysis consistently indicates that the proposed approach outperforms the traditional CF-based recommendation method. The average accuracy metrics MAE and RMSE are reduced by factors of 9.69% and 32.83%, respectively, using the proposed technique. Additionally, the proposed scheme improves the classification accuracy of the recommender system by an average of 11.54%.

Keyword

Recommender system, Collaborative filtering, Missing data prediction, Extreme learning machine, Genetic algorithm.

Cite this article

Yadav P, Tyagi S, Kaur H

Refference

[1][1]Resnick P, Iacovou N, Suchak M, Bergstrom P, Riedl J. Grouplens: an open architecture for collaborative filtering of netnews. In proceedings of the 1994 ACM conference on computer supported cooperative work 1994 (pp. 175-86).

[2][2]Shardanand U, Maes P. Social information filtering: algorithms for automating “word of mouth”. In proceedings of the SIGCHI conference on human factors in computing systems 1995 (pp. 210-7).

[3][3]Adomavicius G, Tuzhilin A. Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering. 2005; 17(6):734-49.

[4][4]Bobadilla J, Ortega F, Hernando A, Gutiérrez A. Recommender systems survey. Knowledge-Based Systems. 2013; 46:109-32.

[5][5]De CR, Van HL, Htun NN, Štiglic G, Vanden AV, Verbert K. Health recommender systems: systematic review. Journal of Medical Internet Research. 2021; 23(6):1-21.

[6][6]Behera G, Nain N. Collaborative filtering with temporal features for movie recommendation system. Procedia Computer Science. 2023; 218:1366-73.

[7][7]Xu C, Ding AS, Liao SS. A privacy-preserving recommendation method based on multi-objective optimisation for mobile users. International Journal of Bio-Inspired Computation. 2020; 16(1):23-32.

[8][8]Sood M, Kaur H. Preference based personalized news recommender system. International Journal of Advanced Computer Research. 2014; 4(2):575-81.

[9][9]Li G, Zhang J. Music personalized recommendation system based on improved KNN algorithm. In IEEE 3rd advanced information technology, electronic and automation control conference 2018 (pp. 777-81). IEEE.

[10][10]Wang Y, Ma W, Zhang M, Liu Y, Ma S. A survey on the fairness of recommender systems. ACM Transactions on Information Systems. 2023; 41(3):1-43.

[11][11]Bedi P, Kaur H. Trust based personalized recommender system. INFOCOMP Journal of Computer Science. 2006; 5(1):19-26.

[12][12]Koren Y, Rendle S, Bell R. Advances in collaborative filtering. Recommender Systems Handbook. 2021: 91-142.

[13][13]Balabanović M, Shoham Y. Fab: content-based, collaborative recommendation. Communications of the ACM. 1997; 40(3):66-72.

[14][14]Tyagi S, Bharadwaj KK. A hybrid recommender system using rule-based and case-based reasoning. International Journal of Information and Electronics Engineering. 2012; 2(4):586-90.

[15][15]Walek B, Fajmon P. A hybrid recommender system for an online store using a fuzzy expert system. Expert Systems with Applications. 2023; 212:118565.

[16][16]Lops P, De GM, Semeraro G. Content-based recommender systems: state of the art and trends. Recommender Systems Handbook. 2011:73-105.

[17][17]Çano E, Morisio M. Hybrid recommender systems: a systematic literature review. Intelligent Data Analysis. 2017; 21(6):1487-524.

[18][18]Schafer JB, Frankowski D, Herlocker J, Sen S. Collaborative filtering recommender systems. The Adaptive Web: Methods and Strategies of Web Personalization. 2007: 291-324.

[19][19]Liang S, Ma L, Yuan F. A singularity-based user similarity measure for recommender systems. International Journal of Innovative Computing Information and Control. 2015; 11(5):1629-38.

[20][20]Fkih F. Similarity measures for collaborative filtering-based recommender systems: review and experimental comparison. Journal of King Saud University-Computer and Information Sciences. 2022; 34(9):7645-69.

[21][21]Jeong B, Lee J, Cho H. Improving memory-based collaborative filtering via similarity updating and prediction modulation. Information Sciences. 2010; 180(5):602-12.

[22][22]Pennock DM, Horvitz EJ, Lawrence S, Giles CL. Collaborative filtering by personality diagnosis: a hybrid memory-and model-based approach. Proceedings of the sixteenth conference on uncertainty in artificial intelligence 2010 (pp. 473-80). ACM.

[23][23]Chang TM, Hsiao WF, Chang WL. An ordinal regression model with SVD hebbian learning for collaborative recommendation. Journal of Information Science and Engineering. 2014; 30(2):387-401.

[24][24]Yadav P, Tyagi S. Hybrid fuzzy collaborative filtering: an integration of item-based and user-based clustering techniques. International Journal of Computational Science and Engineering. 2017; 15(3-4):295-310.

[25][25]Rodpysh KV, Mirabedini SJ, Banirostam T. Employing singular value decomposition and similarity criteria for alleviating cold start and sparse data in context-aware recommender systems. Electronic Commerce Research. 2023; 23(2):681-707.

[26][26]Kunegis J, Albayrak S. Adapting ratings in memory-based collaborative filtering using linear regression. In international conference on information reuse and integration 2007 (pp. 49-54). IEEE.

[27][27]Shang T, He Q, Zhuang F, Shi Z. Extreme learning machine combining matrix factorization for collaborative filtering. In the international joint conference on neural networks 2013 (pp. 1-8). IEEE.

[28][28]Zhu H, Luo Y, Weng C, Li M. A collaborative filtering recommendation model using polynomial regression approach. In fourth China grid annual conference 2009 (pp. 134-8). IEEE.

[29][29]Brenner A, Pradel B, Usunier N, Gallinari P. Predicting most rated items in weekly recommendation with temporal regression. In proceedings of the workshop on context-aware movie recommendation 2010 (pp. 24-7). ACM.

[30][30]Frank E, Hall M. Additive regression applied to a large-scale collaborative filtering problem. In AI: advances in artificial intelligence: 21st Australasian joint conference on artificial intelligence Auckland, New Zealand, 2008 (pp. 435-46). Springer Berlin Heidelberg.

[31][31]Montanés E, Quevedo JR, Díaz I, Ranilla J. Collaborative tag recommendation system based on logistic regression. ECML PKDD Discovery Challenge. 2009: 173-88.

[32][32]Park ST, Chu W. Pairwise preference regression for cold-start recommendation. In proceedings of the third conference on recommender systems 2009 (pp. 21-8). ACM.

[33][33]Huang GB, Zhu QY, Siew CK. Extreme learning machine: theory and applications. Neurocomputing. 2006; 70(1-3):489-501.

[34][34]Lika B, Kolomvatsos K, Hadjiefthymiades S. Facing the cold start problem in recommender systems. Expert Systems with Applications. 2014; 41(4):2065-73.

[35][35]Mild A, Natter M. Collaborative filtering or regression models for internet recommendation systems?. Journal of Targeting, Measurement and Analysis for Marketing. 2002; 10:304-13.

[36][36]Vucetic S, Obradovic Z. Collaborative filtering using a regression-based approach. Knowledge and Information Systems. 2005; 7:1-22.

[37][37]Chuan Y, Jieping X, Xiaoyong DU. Recommendation algorithm combining the user-based classified regression and the item-based filtering. In proceedings of the 8th international conference on electronic commerce: the new e-commerce: innovations for conquering current barriers, obstacles and limitations to conducting successful business on the internet 2006 (pp. 574-8). ACM.

[38][38]Purushotham S, Liu Y, Kuo CC. Collaborative topic regression with social matrix factorization for recommendation systems. International conference on machine learning 2012 (pp. 1-8).

[39][39]Deng W, Zheng Q, Chen L. Real-time collaborative filtering using extreme learning machine. In international joint conference on web intelligence and intelligent agent technology 2009 (pp. 466-73). IEEE.

[40][40]Huang GB, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics). 2011; 42(2):513-29.

[41][41]Wang Y, Cao F, Yuan Y. A study on effectiveness of extreme learning machine. Neurocomputing. 2011; 74(16):2483-90.

[42][42]Huang GB. Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Transactions on Neural Networks. 2003; 14(2):274-81.

[43][43]Tyagi S, Yadav P, Arora M, Vashisth P. Predicting users’ interest through ELM-based collaborative filtering. Data, Engineering and Applications. 2019:23-33.

[44][44]Blum K. Density matrix theory and applications. Springer Science & Business Media; 2012.

[45][45]Song S, Wang M, Lin Y. An improved algorithm for incremental extreme learning machine. Systems Science & Control Engineering. 2020; 8(1):308-17.

[46][46]Alencar AS, Neto AR, Gomes JP. A new pruning method for extreme learning machines via genetic algorithms. Applied Soft Computing. 2016; 44:101-7.

[47][47]Feng G, Huang GB, Lin Q, Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Transactions on Neural Networks. 2009; 20(8):1352-7.

[48][48]Zhang W, Jiang Q, Chen L, Li C. Two-stage ELM for phishing web pages detection using hybrid features. World Wide Web. 2017; 20:797-813.

[49][49]Scardapane S, Comminiello D, Scarpiniti M, Uncini A. Online sequential extreme learning machine with kernels. IEEE Transactions on Neural Networks and Learning Systems. 2014; 26(9):2214-20.

[50][50]Zhu QY, Qin AK, Suganthan PN, Huang GB. Evolutionary extreme learning machine. Pattern Recognition. 2005; 38(10):1759-63.

[51][51]Cao J, Lin Z, Huang GB, Liu N. Voting based extreme learning machine. Information Sciences. 2012; 185(1):66-77.

[52][52]Sánchez-monedero J, Gutiérrez PA, Hervás-martínez C. Evolutionary ordinal extreme learning machine. In hybrid artificial intelligent systems: 8th international conference, Salamanca, Spain 2013 (pp. 500-9). Springer Berlin Heidelberg.

[53][53]Savitha R, Suresh S, Sundararajan N. Fast learning circular complex-valued extreme learning machine (CC-ELM) for real-valued classification problems. Information Sciences. 2012; 187:277-90.

[54][54]Liu X, Li P, Gao C. Symmetric extreme learning machine. Neural Computing and Applications. 2013; 22:551-8.

[55][55]De JK. Learning with genetic algorithms: an overview. Machine Learning. 1988; 3:121-38.

[56][56]Hazir E, Ozcan T, Koç KH. Prediction of adhesion strength using extreme learning machine and support vector regression optimized with genetic algorithm. Arabian Journal for Science and Engineering. 2020; 45:6985-7004.

[57][57]Hahnloser RH, Sarpeshkar R, Mahowald MA, Douglas RJ, Seung HS. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature. 2000; 405(6789):947-51.

[58][58]Ma H, King I, Lyu MR. Effective missing data prediction for collaborative filtering. In proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval 2007 (pp. 39-46). ACM.

[59][59]Nair V, Hinton GE. Rectified linear units improve restricted Boltzmann machines. In proceedings of the 27th international conference on machine learning 2010 (pp. 807-14).

[60][60]Herlocker JL, Konstan JA, Terveen LG, Riedl JT. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS). 2004; 22(1):5-3.

[61][61]Karypis G. Evaluation of item-based top-n recommendation algorithms. In proceedings of the tenth international conference on information and knowledge management 2001 (pp. 247-54). ACM.

[62][62]Kim TH, Yang SB. An effective threshold-based neighbor selection in collaborative filtering. In advances in information retrieval: 29th European conference on IR research, Rome, Italy, 2007 (pp. 712-5). Springer Berlin Heidelberg.