Deep recurrent model for server load and performance prediction in data center (Q1694249)

Summary: Recurrent Neural Network (RNN) has been widely applied to many sequential tagging tasks such as Natural Language Processing (NLP) and time series analysis, and it has been proved that RNN works well in those areas. In this paper, we propose using RNN with Long Short-Term Memory (LSTM) units for server load and performance prediction. Classical methods for performance prediction focus on building relation between performance and time domain, which makes a lot of unrealistic hypotheses. Our model is built based on events (user requests), which is the root cause of server performance. We predict the performance of the servers using RNN-LSTM by analyzing the log of servers in data center which contains user's access sequence. Previous work for workload prediction could not generate detailed simulated workload, which is useful in testing the working condition of servers. Our method provides a new way to reproduce user request sequence to solve this problem by using RNN-LSTM. Experiment result shows that our models get a good performance in generating load and predicting performance on the data set which has been logged in online service. We did experiments with nginx web server and mysql database server, and our methods can been easily applied to other servers in data center.