RAP-Optimizer: Resource-Aware Predictive Model for Cost Optimization of Cloud AIaaS Applications
Listed in
This article is not in any list yet, why not save it to one of your lists.Abstract
Artificial Intelligence (AI) applications are rapidly growing, and more applications are joining the market competition. As a result, the AI-as-a-service (AIaaS) model is experiencing rapid growth. Many of these AIaaS-based applications are not properly optimized initially. Once they start experiencing a large volume of traffic, different challenges start revealing themselves. One of these challenges is maintaining a profit margin for the sustainability of the AIaaS application-based business model, which depends on the proper utilization of computing resources. This paper introduces the resource award predictive (RAP) model for AIaaS cost optimization called RAP-Optimizer. It is developed by combining a deep neural network (DNN) with the simulated annealing optimization algorithm. It is designed to reduce resource underutilization and minimize the number of active hosts in cloud environments. It dynamically allocates resources and handles API requests efficiently. The RAP-Optimizer reduces the number of active physical hosts by an average of 5 per day, leading to a 45% decrease in server costs. The impact of the RAP-Optimizer was observed over a 12-month period. The observational data show a significant improvement in resource utilization. It effectively reduces operational costs from USD 2600 to USD 1250 per month. Furthermore, the RAP-Optimizer increases the profit margin by 179%, from USD 600 to USD 1675 per month. The inclusion of the dynamic dropout control (DDC) algorithm in the DNN training process mitigates overfitting, achieving a 97.48% validation accuracy and a validation loss of 2.82%. These results indicate that the RAP-Optimizer effectively enhances resource management and cost-efficiency in AIaaS applications, making it a valuable solution for modern cloud environments.