您当前所在位置: 首页 > 学者

吕智慧

  • 131浏览

  • 0点赞

  • 0收藏

  • 0分享

  • 61下载

  • 0评论

  • 引用

会议论文

InSTechAH: An Autoscaling Scheme for Hadoop in the Private Cloud

吕智慧Xueying Wang Zhihui Luv Jie Wu Tong ZhaoPatrick Hung

IEEE SCC 2015.:,-0001:

URL:

摘要/描述

As a key type of applications running in cloud environments, big data analytics are being generously hosted in virtualized platforms. However, in many cloud data centers, such data analytics clusters are not used efficiently and thereby cost extra overhead. The cost-effectiveness of such data analytics clusters in cloud data centers is the key concern of this paper. In this paper, we design, implement and evaluate the InSTechAH, an autoscale schemascheme for a Hadoop system in a private cloud, which attempts to improve the resource utilization in cloud data centers as well as to maintain required quality of services. In this system, we design the multilayer node model to reduce interference from other services by automatically scaling the clusters according to the autoscale algorithm we introduced. We then build the resource scheduling model which use prediction based scheduling method to reduce the cost brought by scaling. We evaluate our schemascheme partly on a real data trace and partly on simulation, with Hadoop as the parallel data analytics frameworks and OpenStack as the cloud management architecture, to show the efficiency of InSTechAH system.

【免责声明】以下全部内容由[吕智慧]上传于[2015年10月10日 11时49分40秒],版权归原创者所有。本文仅代表作者本人观点,与本网站无关。本网站对文中陈述、观点判断保持中立,不对所包含内容的准确性、可靠性或完整性提供任何明示或暗示的保证。请读者仅作参考,并请自行承担全部责任。

我要评论

全部评论 0

本学者其他成果

    同领域成果