QoS Prediction Model of Cloud Services Based on Deep Learning

WenJun Huang,PeiYun Zhang,,YuTong Chen,MengChu Zhou,,Yusuf Al-Turki,,and Abdullah Abusorrah,

Dear editor,

This letter presents a deep learning-based prediction model for the quality-of-service (QoS) of cloud services.Specifically,to improve the QoS prediction accuracy of cloud services,a new QoS prediction model is proposed,which is based on multi-staged multi-metric feature fusion with individual evaluations.The multi-metric features include global,local,and individual ones.Experimental results show that the proposed model can provide more accurate QoS prediction results of cloud services than several state-of-the-art methods.

Cloud computing provides users with fast and secure cloud services,called “service” for short.With the rapid development of cloud computing,the number of cloud-based services continues to increase.However,it is difficult for users to choose services from lots of candidates to meet their needs.In this case,users must compare their QoS,and then determine the best ones.

QoS can describe non-functional attributes of a service,which is a key indicator often used to evaluate service performance in cloud computing.Due to the uncertainty of user information (such as network status and personal preferences),when different users call the same services,their QoS may differ.Therefore,accurate prediction of QoS values of services is thus required in order to help users choose the most suitable cloud services.

Many methods have emerged to predict QoS,most of which are inspired by collaborative filtering for service recommendation.These methods predict missing QoS values by collecting historical information of users or services.However,they only use information from an original user-service QoS matrix,which may ignore some important factors that affect QoS,such as locations.Differences in user information,service characteristics,and network status lead to different QoS.

With the rapid development of deep learning and computing environments,deep neural network (DNN) technologies have significantly impacted many fields,such as computer vision,data mining,and natural language processing.A DNN has a strong nonlinear fitting ability,which can approximate any nonlinear continuous function.It can extract advanced features from original data after statistical learning on a large amount of data.Thus,it is widely used in many artificial intelligence applications to provide the highest prediction accuracy.DNNs can also be used to accurately predict cloud-service QoS.

Related work:Significant studies have been devoted to solving this problem in recent years.They result in the four main types of methods: Memory-based,model-based,hybrid collaborative filtering,and neural network-based ones.

Memory-based collaborative filtering methods only use an original user-service QoS matrix to predict QoS.Zhanget al.[1] propose a QoS prediction method in the field of cloud computing.It learns user features via non-negative matrix factorization (NMF) and utilizes the QoS of similar users to improve prediction accuracy.Although memory-based collaborative filtering methods are easy to implement,they are easily affected by data sparsity.Meanwhile,they have problems such as cold start and poor scalability.

Model-based collaborative filtering methods are widely used to solve the problems mentioned above.Aiming at predicting candidate services for a real-time service adjustment,Zhuet al.[2] propose an adaptive matrix factorization method for online QoS prediction.

Hybrid collaborative filtering methods combine memory-based and model-based methods.Since collecting QoS values may cause privacy problems,the studies [3],[4] propose privacy protection strategies to obtain high QoS prediction accuracy while protecting user privacy.These methods offer the advantages of both memory based and model-based methods.However,they have the problem of high computational complexity.

In recent years,with the development of artificial intelligence,neural networks have been applied to the field of QoS prediction.Using the time correlation of QoS,Xionget al.[5] propose a novel personalized matrix factorization method based on Long Short-Term Memory (LSTM) for online QoS prediction.Chenet al.[6] combine an empirical mode decomposition and multivariate LSTM model to propose a hybrid QoS prediction method.However,their network structures and QoS prediction accuracy have much room for improvement in their data preprocessing and feature extraction.This work aims to make such important improvements.

Problem statement:Usually,a user can call multiple cloud services,and a cloud service can be called by different users.As the number of cloud services continues to increase,many services offer similar functions.Users hope to choose a service that meets their needs,which can be achieved by choosing the one with the best QoS from similar services.

After a user calls a cloud service,its QoS value is collected by a cloud system and stored in an original user-service QoS matrix,which is denoted asQ.InQ,rows and columns representusers and services,respectively.Items represent QoS values.qij∈Qrepresents the QoS value of servicejdeployed by useri.Fig.1 shows the QoS values provided after three users call five services.

Fig.1.An original user-service QoS matrix Q.

Given that not all users call all cloud services in a cloud system,Qmay have some missing items,which may result in a sparseQ.Due to the similarity among services and among users,missing items can be predicted by using existing/known items inQ.The predicted items are shown in bold in Fig.2.To accurately predict QoS values,we propose a QoS prediction model based on deep learning,which adopts multi-staged multi-metric feature fusion with individual evaluations for the first time.

Basic concepts:

● Multi-metric features: They include global,local,and individual ones.

Fig.2.A user-service QoS matrix with predicted items.

● Local feature matrixG: Based on distance similarity,similar users and similar cloud services are extracted fromand thenGis generated.Local features ? can be obtained fromG.

● Individual feature matrices: There are two types of individual feature matrices including matrixUfor users and matrixSfor cloud services.They are obtained by performing NMF on matrixQ.Individual features ? can be extracted from them.

● Individual evaluation: It comes from matrix.If the proposed model predicts a QoS value of cloud servicejfor useri,serves as an individual evaluation.

Proposed prediction model:A new DNN is designed to predict QoS values,which is called multi-staged multi-metric-feature DNN(MM-DNN),as shown in Fig.3.It has four stages.Multi-metric features are fused in different concatenation layers.Stages 1–3 serve to fuse global,local,and individual features,respectively.In each stage,an individual evaluation is used to modify features,which makes the output more accurate.If these features are input together into MM-DNN at the same time in Stage 1,it may cause a problem of excessive values.Before outputting a final predicted QoS value in Stage 4,an individual evaluation is input to further improve the value.A detailed analysis of the four stages is shown as follows:

Stage 1: Global features are input to the proposed model.Then information with the same size as that of local features is further extracted throughLfully connected layers.The features are modified by concatenating an individual evaluation in a concatenation layer.The forward propagation process at this stage can be expressed as

where φ() denotes a rectified linear unit,i.e.,φ(x) = max(0,x).? is the concatenation operation.y0is the input of Stage1 in MM-DNN.y2is obtained through the fully connected layer after concatenatingy1and.ykis the output of thekth fully connected layer of Stage 1.αkandβkrepresent the weight and bias of thekth fully connected layer,respectively.yLis the output of Stage 1.

Stage 2: It consists of two concatenation layers andMfully connected layers.Local features are concatenated in a concatenation layer and fed into a fully connected layer.After concatenating an individual evaluation in a concatenation layer,they are learned through fully connected layers.The process is expressed as follows:

whereyLand ? are the inputs of Stage 2 in MM-DNN,yL+1is obtained through the fully connected layer after concatenatingyLand?,yL+2is obtained through the fully connected layer after concatenatingyL+1and,yL+zis the output of fully connected layer(L+z),andyL+Mis the output of Stage 2.

Stage 3: It contains two concatenation layers andZfully connected layers.Individual features are connected in a concatenation layer and learned through a fully connected layer.An individual evaluation is then concatenated in a concatenation layer and fed into fully connected layers.The process is expressed as:

whereyL+Mand ? are inputs of Stage 3 in MM-DNN,yL+M+1is obtained through the fully connected layer after concatenatingyL+Mand ?,yL+M+2is obtained through the fully connected layer after concatenatingyL+M+1and,yL+M+bis the output of the fully connected layer (L+M+b) of MMDNN,andyL+M+Zis the output of Stage 3.

Stage 4: It consists of a concatenation layer and a fully connected layer.The goal of the proposed model is to predict the QoS value of cloud servicejfor useri.Thus,an individual evaluationis input and connected in the last concatenation layer and learned to further improve the prediction result through the last fully connected layer.The predicted QoS values are then output.The process is expressed as:

whereyL+M+Zandare inputs of Stage 4.yL+M+Z+1is obtained through the fully connected layer after concatenatingyL+M+Zand.yL+M+Z+1is the output of Stage 4.It is also the output of MM-DNN.pijis a QoS prediction value of cloud servicejfor userifrom the output of MM-DNN.

Experiments:Our experiments use an Intel Core i7-11700KF CPU @ 3.60GHz,NVIDIA GeForce RTX3090 GPU,and Windows 10 64bit.We use Python 3.7 and Pytorch 1.8.0 to realize MM-DNN.

To evaluate the performance of the proposed model,experiments are conducted on a real-world QoS data set of services,which is called WS-DREAM [7].Letμbe the matrix density:

where ξ is the number of existing items in an original user-service QoS matrixQ.|Q| is the total number of entries inQ.Mean absolute error (MAE) and root mean square error (RMSE) are used as indicators to evaluate prediction accuracy.

The proposed model is compared with the following methods:Probabilistic matrix factorization (PMF) [8],neighborhood-integrated deep matrix factorization (NDMF) [9],and covering-based web service quality prediction via neighborhood-aware matrix factorization (CNMF) [10].

Fig.3.The structure of MM-DNN.

Experimental parameters are set in Table 1.They are obtained through lots of experiments.Given four different matrix densities(5%,10%,15%,and 20%),the MAE and RMSE of the four methods are compared.Tables 2 and 3 show the MAE and RMSE of the response time and throughput (i.e.,two kinds of QoS) of the four methods,respectively.MM-DNN outperforms its peers in terms of prediction accuracy with different matrix densities.The results clearly show that MM-DNN outperforms its peers by 6.1% to 21.2%in response time and by 0.2% to 6.8% in throughput.

Table 1.Experimental Parameters

Table 2.Comparison of Response Time

Table 3.Comparison of Throughput

Conclusions:This paper presents a QoS prediction model for cloud services based on deep learning and multi-staged multi-metric feature fusion with individual evaluations.A new deep neural network model is constructed to fuse the extracted multi-metric features in multiple stages.At each stage of the model,individual evaluations are used to modify features to improve prediction accuracy.Experimental results show that the proposed method can predict QoS values more accurately than the three compared methods.Our future work plans to use time information to improve the proposed model.Since MM-DNN needs a large amount of data for training,it has limitations when facing a highly dynamic environment.More studies are needed to deal with the related issues [11]–[12].

Acknowledgments:This work was in part supported by the National Natural Science Foundation of China (61872006),the Startup Foundation for New Talents of NUIST,Institutional Fund Projects (IFPNC-001-135-2020),and the Deanship of Scientific Research (DSR) at King Abdulaziz University,Jeddah,Saudi Arabia under grant no.GCV19-37-1441.