基于scribe和Hadoop的海量数据分析系统的设计与应用
首发时间:2011-11-25
摘要:随着互联网、移动互联网和物联网的发展,各种终端、信息收集器的数量和种类不断增加,每个人、世间万事万物每时每刻产生的大量数据,都在不断进入信息系统,等待存储、分析和充分利用。本文介绍了海量数据分析中遇到的问题,分析了scribe和hadoop系统在数据分析系统中的可靠性,设计了基于scribe和Hadoop的数据收集和分析系统,对该系统的性能进行了测试、分析和应用。
关键词: 计算机应用 Scribe Hadoop MapReduce HDFS
For information in English, please click here
Design and Application on Mass Data Analysis System Based On Scribe and Hadoop
Abstract:with the development of Internet, mobile Internet and development of Internet of things, a variety of terminal, information collector and the number of species increases ceaselessly, each of us, everything in the world always generate large quantities of data, are constantly into information system, for storage, analysis and make full use of. This paper introduces the problems encountered in the analysis of mass data, analysis of scribe and Hadoop system in the data analysis system of reliability, based on the design of the scribe and Hadoop data collection and analysis system, the performance of the system was tested, analysis and Application.
Keywords: Technology of Computer Application Scribe Hadoop MapReduce HDFS
基金:
论文图表:
引用
No.****
同行评议
共计0人参与
勘误表
基于scribe和Hadoop的海量数据分析系统的设计与应用
评论
全部评论0/1000