AutoML for Deep Recommender Systems: A Survey
Hongzhi Yin2022, ArXiv
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
Recommender systems play a significant role in information filtering and have been utilised in different scenarios, such as e-commerce and social media. With the prosperity of deep learning, deep recommender systems show superior performance by capturing non-linear information and item-user relationships. However, the design of deep recommender systems heavily relies on human experiences and expert knowledge. To tackle this problem, Automated Machine Learning (AutoML) is introduced to automatically search for the proper candidates for different parts of deep recommender systems. This survey performs a comprehensive review of the literature in this field. Firstly, we propose an abstract concept for AutoML for deep recommender systems (AutoRecSys) that describes its building blocks and distinguishes it from conventional AutoML techniques and recommender systems. Secondly, we present a taxonomy as a classification framework containing embedding dimension search, feature interaction sea...
Related papers
An Application-oriented Review of Deep Learning in Recommender Systems
International Journal of Intelligent Systems and Applications
The development in technology has gifted huge set of alternatives. In the modern era, it is difficult to select relevant items and information from the large amount of available data. Recommender systems have been proved helpful in choosing relevant items. Several algorithms for recommender systems have been proposed in previous years. But recommender systems implementing these algorithms suffer from various challenges. Deep learning is proved successful in speech recognition, image processing and object detection. In recent years, deep learning has been also proved effective in handling information overload and recommending items. This paper gives a brief overview of various deep learning techniques and their implementation in recommender systems for various applications. The increasing research in recommender systems using deep learning proves the success of deep learning techniques over traditional methods of recommender systems.
A review on deep learning for recommender systems: challenges and remedies
Artificial Intelligence Review
Recommender systems are effective tools of information filtering that are prevalent due to increasing access to the Internet, personalization trends, and changing habits of computer users. Although existing recommender systems are successful in producing decent recommendations, they still suffer from challenges such as accuracy, scalability, and cold-start. In the last few years, deep learning, the state-of-the-art machine learning technique utilized in many complex tasks, has been employed in recommender systems to improve the quality of recommendations. In this study, we provide a comprehensive review of deep learningbased recommendation approaches to enlighten and guide newbie researchers interested in the subject. We analyze compiled studies within four dimensions which are deep learning models utilized in recommender systems, remedies for the challenges of recommender systems, awareness and prevalence over recommendation domains, and the purposive properties. We also provide a comprehensive quantitative assessment of publications in the field and conclude by discussing gained insights and possible future work on the subject.
Deep Learning-Based Recommendation: Current Issues and Challenges
International Journal of Advanced Computer Science and Applications
Due to the revolutionary advances of deep learning achieved in the field of computer vision, object recognition and natural language processing, the deep learning gained much attention. The recommendation task is influenced by the deep learning trend which shows its significant effectiveness. The deep learning based recommender models provides a better detention of user preferences, item features and users-items interactions history. In this paper, we provide a recent literature review of researches dealing with deep learning based recommendation approaches which is preceded by a presentation of the main lines of the recommendation approaches and the deep learning techniques. Then we finish by presenting the recommendation approach adopted by the most popular video recommendation platform YouTube which is based essentially on deep learning advances.
ADVANCED RECOMMENDATION SYSTEMS THROUGH DEEP LEARNING
Many companies have realized the importance of deep learning, which justifies their growing interest in the use of recommender systems to boost their sales. They aim to predict users' intents and recommend products likely to be of their interests. The purpose of this study is to provide a review of deep learning techniques for recommendation systems that have been used in research and industry.
A Survey of State-of-the-art: Deep Learning Methods on Recommender System
The advancement in technology accelerated and opened availability of various alternatives to make a choice in every domain. In the era of big data it is a tedious and time consuming task to evaluate the features of a large amount of information provided to make a choice. One solution to ease this overload problem is building recommender system that can process a large amount of data and support users' decision making ability. In this paper different traditional recommendation techniques, deep learning approaches for recommender system and survey of deep learning techniques on recommender system are presented. A variety of techniques have been proposed to perform recommendation, including content based, collaborative and hybrid recommenders. Due to the limitation of the traditional recommendation methods in obtaining accurate result a deep learning approach is introduced both for collaborative and content based approaches that will enable the model to learn different features of users and items automatically to improve accuracy of recommendation. Even though deep learning poses a great impact in various areas, applying the model to a recommender systems have not been fully exploited. With the help of the advantage of deep learning in modeling different types of data, deep recommender systems can better understand users' demand to further improve quality of recommendation.
Deep Autoencoder for Recommender Systems: Parameter Influence Analysis
Australasian Conference on Information Systems 2018, 2018
Recommender systems have recently attracted many researchers in the deep learning community. The state-of-the-art deep neural network models used in recommender systems are multilayer perceptron and deep autoencoder (DAE). In this work, we focus on DAE model due to its superior capability to reconstruct the inputs, which works well for recommender systems. Existing works have similar implementations of DAE but the parameter settings are vastly different for similar datasets. In this work, we have built a flexible DAE model, named FlexEncoder that uses configurable parameters and unique features to analyse the parameter influences on the prediction accuracy of recommender systems. Extensive evaluation on the MovieLens datasets are conducted, which drives our conclusions on the influences of DAE parameters. We find that DAE parameters strongly affect the prediction accuracy of the recommender systems, and the effect remains valid for similar datasets in a larger.
Algorithm Implementation for Product Recommendation System Using Collaborative Filtering and Deep Learning
2020
Collaborative Filtering (CF) and Deep Learning is one of the most successful recommendation approaches to cope with information overload in the real world. However, typical CF methods equally treat every user and item, and cannot distinguish the variation of user’s interests across different domains. This violates the reality that user’s interests always center on some specific domains, and the users having similar tastes on one domain may have totally different tastes on another domain. Different CF techniques can be classified into two classes: memory-based methods and model based methods., we studied a novel Domainsensitive Recommendation (DsRec) algorithm, to make the rating prediction by exploring the useritem subgroup analysis simultaneously.
A Novel Approach towards Movie Recommender System using Deep Learning Techniques
International Journal of Computing and Digital Systems, 2022
Recommender systems have become a key technology to help the users in interacting with the increasingly larger data and information available online. The rapid advancements in Deep Learning techniques have been very useful in recommendation systems as it enhances the overall performance and accuracy of the recommendation systems. This paper attempts to work on a hybrid recommendation model by considering a weighted average of top N recommendations from both content based and collaborative based filtering methods and hence eliminating their individual shortcomings. A LightFM module has been also used to evaluate the loss functions on this hybrid model and to capture the latent features about attributes of users and items. Thereafter, a class of two-layer undirected graphical models, called Restricted Boltzmann Machine (RBM) and Auto-encoder is successfully applied to the Movielens data set to provide the accurate recommendations. This study shows that the proposed approach outperform the traditional recommender systems in terms of accuracy.
A Novel Hybrid Deep Multi-Criteria Model for Recommender System
2021
Recommender systems are everywhere books, products, movies, and more. Traditional recommender systems typically use a single criterion in the recommendation, while studies have shown that multi-criteria recommending is more accurate. Novel deep learning techniques have produced remarkable achievements in many fields. The use of such techniques in recommendation systems has started to get attention recently, and several models of recommendation have been proposed based on deep learning. However, there is still no work for using deep learning in hybrid multi-criteria recommender systems. In this work, a model for a hybrid deep multi-criteria recommender system was presented. The model mainly includes two major parts: In the first one, the model obtains the user ID, item ID, and the item metadata to be used as input to a deep neural network in order to predict the criteria ratings. In the second part, the obtained ratings act as an input to another deep neural network, where the overal...
Deep Learning to Address Candidate Generation and Cold Start Challenges in Recommender Systems: A Research Survey
ArXiv, 2019
Among the machine learning applications to business, recommender systems would take one of the top places when it comes to success and adoption. They help the user in accelerating the process of search while helping businesses maximize sales. Post phenomenal success in computer vision and speech recognition, deep learning methods are beginning to get applied to recommender systems. Current survey papers on deep learning in recommender systems provide a historical overview and taxonomy of recommender systems based on type. Our paper addresses the gaps of providing a taxonomy of deep learning approaches to address recommender systems problems in the areas of cold start and candidate generation in recommender systems. We outline different challenges in recommender systems into those related to the recommendations themselves (include relevance, speed, accuracy and scalability), those related to the nature of the data (cold start problem, imbalance and sparsity) and candidate generation....
Related topics
Related papers
Deep Learning Methods on Recommender System: A Survey of State-of-the-art
2017
The advancement in technology accelerated and opened availability of various alternatives to make a choice in every domain. In the era of big data it is a tedious and time consuming task to evaluate the features of a large amount of information provided to make a choice. One solution to ease this overload problem is building recommender system that can process a large amount of data and support users’ decision making ability. In this paper different traditional recommendation techniques, deep learning approaches for recommender system and survey of deep learning techniques on recommender system are presented. A variety of techniques have been proposed to perform recommendation, including content based, collaborative and hybrid recommenders. Due to the limitation of the traditional recommendation methods in obtaining accurate result a deep learning approach is introduced both for collaborative and content based
RecDNNing: a recommender system using deep neural network with user and item embeddings
2019 10th International Conference on Information and Communication Systems (ICICS), 2019
The success of applying deep learning to many domains has gained strong interest in developing new revolutionary recommender systems. However, there are little works studying these systems that employ deep learning; additionally, there is no study showing how to combine the users and items embedding with deep learning to enhance the effectiveness of the recommender systems. Therefore, this paper proposes a novel approach called RecDNNing with a combination of embedded users and items combined with deep neural network. The proposed recommendation approach consists of two phases. In the first phase, we create a dens numeric representation for each user and item, called user embedding and item embedding, respectively. Following that, the items and users embedding are averaged and then concatenated before being fed into the deep neural network. In the second phase, we use the model of the deep neural network to take the concatenated users and items embedding as the inputs in order to predict the scores of rating by applying the forward propagation algorithm. The experimental results on MovieLens show that the proposed RecDNNing outperforms state-of-the-art algorithms.
Comparative study on traditional recommender systems and deep learning based recommender systems
Advances in Modelling and Analysis B, 2018
Recommender systems is a big breakthrough for the field of e-commerce. Product recommendation is challenging task to e-commerce companies. Traditional Recommender Systems provided the solutions in recommending the products. This in turn help companies to generate good revenue. Now a day Deep Learning is using in every domain. Deep Learning techniques in the field of Recommender Systems can be directly applied. Deep Learning has ample number of algorithms. These algorithms can be used to give recommendations to users to purchase products. In this paper performance of Traditional Recommender Systems and Deep Learning-based Recommender Systems are compared.
A Deep Hybrid Model for Recommendation Systems
Lecture Notes in Computer Science, 2019
Recommendation has been a long-standing problem in many areas ranging from e-commerce to social websites. Most current studies focus only on traditional approaches such as content-based or collaborative filtering while there are relatively fewer studies in hybrid recommendation systems. With the emergence of deep learning techniques in different fields including computer vision and natural language processing, Recommendation Systems (RSs) have also become an active area of for these techniques. There are several studies that utilize ID embeddings of users and items to implement collaborative filtering with deep neural networks. However, such studies do not take advantage of other categorical or continuous features of inputs. In this paper, we propose a new deep neural network architecture which uses ID embeddings, and also auxiliary information such as features of job postings and candidates. Experimental results on a real world dataset from a job website show that the proposed method improves recommendation results over deep learning models utilizing only ID embeddings.
Research on Understanding the Effect of Deep Learning on User Preferences
Arabian Journal for Science and Engineering, 2020
Recommender systems are becoming more essential than ever as the data available online is increasing manifold. The increasing data presents us with an opportunity to build complex systems that can model the user interactions more accurately and extract sophisticated features to provide recommendations with better accuracy. To construct these complex models, deep learning is emerging as one of the most powerful tools. It can process large amounts of data to learn the structure and patterns that can be exploited. It has been used in recommender systems to solve cold-start problem, better estimate the interaction functions, and extract deep feature representations, among other facets that plague the traditional recommender systems. As big data is becoming more prevalent, there is a need to use tools that can take advantage of such explosive data. An extensive study on recommender systems using deep learning has been performed in the paper. The literature review spans in-depth analysis and comparative study of the research domain. The paper exhibits a vast range of scope for efficient recommender systems in future.
Collaborative Deep Learning for Recommender Systems Collaborative Deep Learning for Recommender Systems
Collaborative filtering (CF) is a successful approach commonly used by many recommender systems. Conventional CF-based methods use the ratings given to items by users as the sole source of information for learning to make recommendation. However, the ratings are often very sparse in many applications, causing CF-based methods to degrade significantly in their recommendation performance. To address this sparsity problem, auxiliary information such as item content information may be utilized. Collaborative topic regression (CTR) is an appealing recent method taking this approach which tightly couples the two components that learn from two different sources of information. Nevertheless, the latent representation learned by CTR may not be very effective when the auxiliary information is very sparse. Inspired by recent success demonstrated by deep learning models, we propose in this paper a hierarchical Bayesian model called collaborative deep learning (CDL), which tightly couples a Bayesian formulation of the stacked denoising autoencoder and probabilistic matrix factorization. Extensive experiments on real-world datasets show that CDL can significantly advance the state of the art.
Deep Learning Architecture for Collaborative Filtering Recommender Systems
Applied Sciences, 2020
This paper provides an innovative deep learning architecture to improve collaborative filtering results in recommender systems. It exploits the potential of the reliability concept to raise predictions and recommendations quality by incorporating prediction errors (reliabilities) in the deep learning layers. The underlying idea is to recommend highly predicted items that also have been found as reliable ones. We use the deep learning architecture to extract the existing non-linear relations between predictions, reliabilities, and accurate recommendations. The proposed architecture consists of three related stages, providing three stacked abstraction levels: (a) real prediction errors, (b) predicted errors (reliabilities), and (c) predicted ratings (predictions). In turn, each abstraction level requires a learning process: (a) Matrix Factorization from ratings, (b) Multilayer Neural Network fed with real prediction errors and hidden factors, and (c) Multilayer Neural Network fed with...
Survey on Recommender System Using Deep Learning Networks
Artificial Intelligence Evolution
In today’s times, the recommended system is a very powerful weapon of shoppers that is very helpful in advancing the Internet, personalized tendencies, and online shopping. The recommended system is used primarily for commercial benefit. The recommended system works on the strength of the user’s past shopping experience and its feedback, whether it is positive or negative. Hence the recommended system is also an innovative method. There is a deferred method of the recommended system which has its own advantages and disadvantages. In this paper, the Recommender system based on deep learning is proposed, and also discussed the challenges and issues which are related to the deep learning based recommender system. i.e., Accuracy, Cold Start Problem, Scalability States etc. In this paper, we have also discussed the work done so far, which has been given by various scientists / researchers / investigators. Advancement of machine learning and deep learning is very big, in today’s era. This...
ConvSVD++: A Hybrid Deep CF Recommender Model using Convolutional Neural Network
Journal of Computer Science, 2020
Recommender systems are powerful systems that give added value to business and corporation. They are relatively recent technology and they will only keep improving in the future. The most widely used algorithms for recommender systems are categorized into the traditional recommender and deep-based recommender system. The traditional recommendation algorithm suffers from sparse data that significantly degrades recommendation accuracy. The hybrid approaches are attempts to tackle recommendation challenges. This paper addresses the integration of deep learning into traditional recommendation approaches especially, Collaborative Filtering (CF) algorithms to get a significant accurate prediction. It proposes a hybrid deep CF recommender model called ConvSVD++ that tightly integrates Convolution Neural Network (CNN) and Singular Value Decomposition (SVD++). The proposed model incorporates items’ content, implicit user’s feedback along with explicit item-user interaction to enhance predict...
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.