Data Management of Data Processing Framework in Green Data Center

Abstract

Abstract: Using renewable energy in data center is an environment-friendly way to solve the problem of high energy consumption of data center. Since renewable energy is variable, delaying the jobs which has no strict deadline i a widely used strategy to maximize the usage of renewable energy. Meanwhile, turning the idle servers off can further reduce energy consumption. If the data required by the jobs to be processed are unavailable, some servers in sleep state need to be reactivated to guarantee that the data required by the jobs are available. Such operation may lead to energy waste due to the frequent reactive processes. An effective data management algorithm was proposed, which copied the data required by the jobs in waiting queue to active servers in advance. By doing so, the times that the sleep servers were reactivated could be reduced. Simulation results show that the times can be reduced by 43% on average.

Key words: green data center, data processing framework, energy, renewable energy, data management

CLC Number:

TP391.9

Zhang Xiao, Gao Yuan, Wang Xiaoliang, Ge Yiyong, Yang Haixiang, Wan Shupeng. Data Management of Data Processing Framework in Green Data Center[J]. Journal of System Simulation, 2016, 28(3): 592-599.

References

[1] Gao P X, Curtis A P, Wong B, Keshav S.It’s not easy being green[C]// Proceedings of the ACM SIGCOMM 2012, Helsinki, Finland. USA: ACM, 2012: 211-222.
[2] Deng W, Liu F, Jin H, et al.Harnessing renewable energy in cloud datacenters: opportunities and challenges[J]. IEEE Network (S0890-8044), 2014, 28(1): 48-55.
[3] Goiri Í, Le K, Nguyen T D, et al.GreenHadoop: leveraging green energy in data-processing frameworks[C]// Proceedings of the 7th ACM European Conference on Computer Systems. USA: ACM, 2012: 57-70.
[4] Goiri Í, Beauchea R, Le K, et al.GreenSlot: scheduling energy consumption in green datacenters[C]// Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. USA: ACM, 2011: 20.
[5] Goiri Í, Katsak W, Le K, et al.Parasol and GreenSwitch: Managing datacenters powered by renewable energy[C]// Proceedings of the eighteenth international conference on Architectural support for programming languages and operating systems. USA: ACM, 2013: 51-64.
[6] Aksanli B, Venkatesh J, Zhang L, et al.Utilizing green energy prediction to schedule mixed batch and service jobs in data centers[J]. ACM SIGOPS Operating Systems Review (S0163-5980), 2012, 45(3): 53-57.
[7] Leverich J, Kozyrakis C.On the energy (in) efficiency of hadoop clusters[J]. ACM SIGOPS Operating Systems Review (S0163-5980), 2010, 44(1): 61-65.
[8] Lang W, Patel J M.Energy management for mapreduce clusters[J]. Proceedings of the VLDB Endowment (S2150-8097), 2010, 3(1-2): 129-139.
[9] Zaharia M, Borthakur D, Sarma J S, et al.Job scheduling for multi-user mapreduce clusters[M]// Tech. Rep. UCB/EECS-2009-55, 2009. Berkeley, USA: EECS Department, University of California, 2009.
[10] Ibanez E, Brinkman G, Lew D.Sub-hour solar data for power system modeling from static spatial variability analysis[M]. USA: National Renewable Energy Laboratory, 2012.
[11] Liu Z, Chen Y, Bash C, et al.Renewable and cooling aware workload management for sustainable data centers[C]// ACM SIGMETRICS Performance Evaluation Review. USA: ACM, 2012, 40(1): 175-186.
[12] Li C, Zhang W, Cho C B, et al.SolarCore: Solar energy driven multi-core architecture power management[C]// High Performance Computer Architecture (HPCA), 2011 IEEE 17th International Symposium on. USA: IEEE, 2011: 205-216.
[13] Li C, Qouneh A, Li T. iSwitch: coordinating and optimizing renewable energy powered server clusters[C]// Computer Architecture (ISCA), 2012 39th Annual International Symposium on. USA: IEEE, 2012: 512-523.
[14] Sharma N, Barker S, Irwin D, et al.Blink: managing server clusters on intermittent power[C]// ACM SIGARCH Computer Architecture News. USA: ACM, 2011, 39(1): 185-198.

[1]	Sen Zhang, Mengyan Zhang, Jingping Shao, Jiexin Pu. Multi-UAVs 3D Path Planning Method Based on Random Strategy Search [J]. Journal of System Simulation, 2022, 34(6): 1286-1295.
[2]	Yanqin Long, Guifang Qiao, Guangming Song, Ying Zhang, Linlin Cheng. Motion Simulation and Performance Analysis of 2D Variable Stiffness Snake-like Robot [J]. Journal of System Simulation, 2022, 34(4): 759-767.
[3]	Lixin Ma, Ying Cheng. Optimal Operation for Park Integrated Energy System Considering Interruptible Loads [J]. Journal of System Simulation, 2022, 34(4): 817-825.
[4]	Jun Dong, Chunming Ye. Research on Joint Optimization of Energy-Saving Distributed Manufacturing and Preventive Maintenance for Semiconductor Wafers [J]. Journal of System Simulation, 2022, 34(3): 584-602.
[5]	Zi'an Zhao, Hong Zhou, Yingjian Lei. Modeling and Optimization for Manufacturing Cell Scheduling Based on Improved Wolf Pack Algorithm and Simulation [J]. Journal of System Simulation, 2022, 34(2): 201-211.
[6]	Yongzhi Wang, Zhenchao Li, Pengyu Liu, Hui Wang. LOD Modeling Method for Three-Dimensional Objects with Energy Operator [J]. Journal of System Simulation, 2022, 34(2): 247-257.
[7]	Yan Bai, Lulu Wu, Yin'e He, Yuying Wang. Energy Consumption Prediction for Air-conditioning System Based on Dynamic Temperature Control [J]. Journal of System Simulation, 2022, 34(2): 366-375.
[8]	Li Gang, Zhang Caixia, Hu Shaolin, Wang Xiangdong, Guo Jing. WSN Clustering Routing Protocol for Bridge Structure Health Monitoring [J]. Journal of System Simulation, 2022, 34(1): 62-69.
[9]	Yan Xiuying, Dang Miaomiao. Optimization of Household Electricity Consumption Period Based on Improved Multi-objective Particle Swarm Optimization [J]. Journal of System Simulation, 2022, 34(1): 70-78.
[10]	Zeng Sijie, Yan Liang, Duan Xiaojun. Planning and Analysis on UAV Trajectory Based on PCE Method [J]. Journal of System Simulation, 2022, 34(1): 145-152.
[11]	Zhang Luan, Luo Zhengjun, Zhou Dequn. Agent- based Research on Power Absorption Simulation Analysis of Renewable Energy [J]. Journal of System Simulation, 2022, 34(1): 170-178.
[12]	Hu Rong, Dong Yuming, Qian Bin. Pathfinder Algorithm for Green Pipeline Scheduling with Limited Buffers [J]. Journal of System Simulation, 2021, 33(6): 1384-1396.
[13]	Han Jingang, Li Xu. Energy Management of Marine Current Power Generation System Based on Fuzzy Logical Control [J]. Journal of System Simulation, 2021, 33(6): 1406-1414.
[14]	Sun Weiqing, Song He, Han Dong, Tian Kunpeng. Deep Peak-shaving Transformation Planning of Thermal Power Units Based on Approximate Dynamic Programming [J]. Journal of System Simulation, 2021, 33(6): 1415-1426.
[15]	Li Wenxiang, Li Ye, Dong Jieshuang, Li Yiming. Development Paths of New Energy Vehicles Incorporating CO₂ Emissions Trading Scheme [J]. Journal of System Simulation, 2021, 33(6): 1451-1465.