收藏本站
收藏 | 投稿 | 论文排版

Scalable local reconstruction code design for hot data reads in cloud storage systems

Zhikai ZHANG  Shushi GU  Qinyu ZHANG  
【摘要】:Since demand for data is significantly heterogeneous in cloud storage systems(CSSs), there is traffic congestion in nodes storing hot data. In erasure-coded CSSs, traffic congestion can be alleviated by degraded reads sacrificing the bandwidth of surviving nodes. Local reconstruction codes(LRCs) reduce the bandwidth consumption of degraded reads, but cannot provide skewed throughput gain for the hot data. In this paper, we propose a scalable local reconstruction code(SLRC) that relies on LRCs but is more flexible in improving the throughput of a specific data block. First, we develop the local maximum throughput(LMT) to measure the maximum throughput of the hot data blocks by analyzing the actual read arrival rate of LRCs. Further, we elaborate on the structure of SLRC and analyze their performance metrics, which include storage overhead, reconstruction cost, and LMT. To select the appropriate code, we present the minimum reconstruction cost, minimum storage overhead, and minimum penalty algorithms. Finally, we implement extensive experiments on several typical SLRCs on the Hadoop distributed file system. Higher LMT and lower bandwidth consumption can be provided by SLRCs for hot data block degraded reads in CSSs compared with RS codes and LRCs.

知网文化
【相似文献】
中国期刊全文数据库 前18条
1 LIU Bo;CHEN Ming;HU Chao;HU Hui;XU Bo;;Optimizing the Resource Utilization of Datacenter Networks with OpenFlow[J];中国通信;2016年03期
2 史维华;洪志良;胡潮红;亢勇;;Temperature self-adaptive program algorithm on 65nm MLC NOR flash memory[J];半导体学报;2009年08期
3 Jiahua Zhu;Xianliang Jiang;Yan Yu;Guang Jin;Haiming Chen;Xiaohui Li;Long Qu;;An Efficient Priority-Driven Congestion Control Algorithm for Data Center Networks[J];中国通信;2020年06期
4 Shaheryar Najam;Muhammad Yasir Qadri;Zohaib Najam;Jameel Ahmed;Nadia N.Qadri;;A Fuzzy Logic Based Power-Efficient Run-Time Reconfigurable Multicore System[J];Chinese Journal of Electronics;2018年03期
5 邬延辉,陆鑫达;An Improved Model for Computing-Intensive Tasks on Heterogeneous Workstations[J];Journal of Shanghai Jiaotong University;2004年02期
6 孙昱东;谢志良;;Macro-Dataflow Computational Model and Its Simulation[J];Journal of Computer Science and Technology;1990年03期
7 Jun Li;Baochun Li;;Erasure Coding for Cloud Storage Systems: A Survey[J];Tsinghua Science and Technology;2013年03期
8 Jing Wang;Wei Luo;Wei Liang;Xiangyang Liu;Xiaodai Dong;;Locally Minimum Storage Regenerating Codes in Distributed Cloud Storage Systems[J];中国通信;2017年11期
9 Li Chen;Baochun Li;Bo Li;;On Meeting Deadlines in Datacenter Networks[J];Tsinghua Science and Technology;2013年03期
10 Chiou-Yng Lee;Pramod Kumar Meher;Chia-Chen Fan;;Fault-Tolerant Bit-Parallel Multiplier for Polynomial Basis of GF(2~m)[J];Journal of Electronic Science and Technology of China;2009年04期
11 YANG Lianghuai;ZHANG Ting;FAN Yulei;GONG Weihua;YU Jian;;Exploiting Internal Parallelism of SSD for Hash Join[J];Chinese Journal of Electronics;2019年05期
12 王超;谷大武;祝力;;Formalization of Fault Analysis and a New Approach of Fault Detection[J];Journal of Shanghai Jiaotong University(Science);2006年03期
13 Rui ZHANG;Hui MA;Yao LU;Yang LI;;Provably secure cloud storage for mobile networks with less computation and smaller overhead[J];Science China(Information Sciences);2017年12期
14 LI Yaofang;XIAO Jie;WU Bin;WEN Hong;YU Hongfang;YANG Shu;XIN Shanshan;GUO Jianing;;Delay-Differentiated Scheduling in Optical Packet Switches for Cloud Data Centers[J];中国通信;2015年08期
15 NIE Shiqiang;WU Weiguo;ZHANG Chi;ZHANG Chen;;PALES: Optimizing Secure Data Deletion in SSDs via Page Group and Reprogram Speedup[J];Chinese Journal of Electronics;2022年01期
16 Yuhang Liu;Mingfa Zhu;Limin Xiao;;Elastic pointer directory organization for scalable shared memory multiprocessors[J];Journal of Systems Engineering and Electronics;2014年01期
17 王明;张春熹;伊小素;;基于确定与随机Petri网的IEEE 1394b总线性能评价(英文)[J];中国通信;2013年02期
18 LI Ming;Andrey Lukyanenko;Sasu Tarkoma;Antti Yl-Jski;;数据中心网络中的MPTCP Incast(英文)[J];中国通信;2014年04期
中国重要会议论文全文数据库 前6条
1 LIN Wei;ZHANG Yan-yuan;LI Zhan-huai;;Data Storage Framework on Flash Memory using Object-based Storage Model[A];Proceedings of 2011 International Conference on Computer Science and Information Technology(ICCSIT 2011)[C];2011年
2 Faen Zhang;Xinyu Fan;Xiang Lei;Jiahong Wu;Jianfei Song;Jiashui Huang;Jingming Guo;Chao Tong;;Zero knowledge Proofs for Cloud Storage Integrity Checking[A];第三十九届中国控制会议论文集(7)[C];2020年
3 ;Port Informatization Based on Cloud Computing[A];Proceedings of 2010 National Vocational Education of Communications and Information Technology Conference (2010 NVCIC)[C];2010年
4 ;Air Ticketing System Model under Cloud Computing Platform[A];2011高等职业教育电子信息类专业学术暨教学研讨会论文集[C];2011年
5 Naijing Hu;Yingying Wang;;Analysis of building cloud-based smart finance platform of Shanghai[A];2013年教育技术与管理科学国际会议论文集[C];2013年
6 ;Typical Cloud Computing System Design[A];Information Technology and Computer Science—Proceedings of 2012 National Conference on Information Technology and Computer Science[C];2012年
中国硕士学位论文全文数据库 前1条
1 聂金(Jean Raphael Ngnie Sighom);关于云数据存储迁移的策略研究[D];杭州电子科技大学;2018年
 快捷付款方式  订购知网充值卡  订购热线  帮助中心
  • 400-819-9993
  • 010-62982499
  • 010-62783978