Affiliation:
1. School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China
2. Key Lab of Information Network Security, Ministry of Public Security, Shanghai 200031, China
Abstract
Container technology has gained a widespread application in cloud computing environments due to its low resource overhead and high flexibility. However, as the number of containers grows, it becomes increasingly challenging to achieve the rapid and coordinated optimization of multiple objectives for container scheduling, while maintaining system stability and security. This paper aims to overcome these challenges and provides the optimal allocation for a large number of containers. First, a large-scale multi-objective container scheduling optimization model is constructed, which involves the task completion time, resource cost, and load balancing. Second, a novel optimization algorithm called LSMOF-AD (large-scale multi-objective optimization framework with muti-stage and adaptive differential strategies) is proposed to effectively handle large-scale container scheduling problems. The experimental results show that the proposed algorithm has a better performance in multiple benchmark problems compared to other advanced algorithms and can effectively reduce the task processing delay, while achieving a high resource utilization and load balancing compared to other scheduling strategies.
Funder
Shanghai Pilot Program for Basic Research
Reference45 articles.
1. A new Apache Spark-based framework for big data streaming forecasting in IoT networks;Troncoso;J. Supercomput.,2023
2. Vaño, R., Lacalle, I., Sowiński, P., S-Julián, R., and Palau, C.E. (2023). Cloud-Native Workload Orchestration at the Edge: A Deployment Review and Future Directions. Sensors, 23.
3. Load balancing scheduling mechanism for OpenStack and Docker integration;Qian;J. Cloud Comput. Adv. Syst. Appl.,2023
4. Docker Cluster Management for the Cloud—Survey Results and Own Solution;Peinl;J. Grid Comput.,2016
5. Scheduling in distributed systems: A cloud computing perspective;Bittencourt;Comput. Sci. Rev.,2018