一种海量数据存储解决方案与访问策略
首发时间:2016-01-07
摘要:近年来,越来越多的应用程序收集和存储大量影视数据在传统数据库中,使得影视数据分析的需求不断增加。随着影视大数据分析系统中业务表越来越多,表中的数据量也越来越大,海量数据的存储与访问对数据库造成了相当大的负载,数据处理能力和访问能力均遭遇瓶颈。 本文针对海量影视数据量快速增长的特点,提出了分库、分表、分区三层拆分模式,综合使用垂直和水平切分等多种解决方案将数据按照一定的规则切分到不同的库或表中,有效的缓解了对数据库的压力,提高了数据访问效率,在实际应用中取得了较好的效果。
关键词: 软件工程 海量数据存储 数据分片 分区 访问效率 ?????
For information in English, please click here
A Massive Data Storage Solution and Access Strategy
Abstract: In recent years, more and more applications have gathered and stored a large number of video data in the traditional database, making the demand for video data analysis continues to increase. As there is more and more business tables in the video system, the amount of data in the table is also growing. Massive data storage and access to the database caused considerable load, data processing ability and the ability to access all bottlenecks. In this paper, according to the rapid growth of massive video data volume, proposed database shard, table shard, table partition three layers split mode, and integrated use of vertical and horizontal sharding solution to split data to adifferent databases or tables. Effectively alleviate the pressure on the databases, improve the data access efficiency, in the practical application has achieved good results.
Keywords: Software Engineer Massive data Storage Sharding Partition Access Efficiency
基金:
论文图表:
引用
No.4672754111794414****
同行评议
勘误表
一种海量数据存储解决方案与访问策略
评论
全部评论0/1000