High Performance Secondary Index Design for Complex Queries

• 1、State Grid Shandong Electric Power Research Institute, Jinan, 250003
• 2、School of Electronic Information and Elecrical Engineering,Shanghai Jiao Tong University, Shanghai 200240

Abstract： Since the traditional relational database is difficult to cope with the massive data and properties produced by thousands of sensors in the smart grid, the HBase database of the new large data platform, as a column oriented key value storage database, has gradually become the mainstream large data platform database. ThoughHBase can support large data volume, but it is still difficult to cope with the demand of high frequency and short response time in power grid data analysis. In this study, we proposed a query oriented two level index scheme that can speed up the query. The experimental results show that when the two table connection queries are involved, our scheme can provide a minimum of 1.026 to the maximum 4.761 times the acceleration ratio compared to the classic two level index, when it involves three table connection queries, Our scheme provides a minimum of 1.797 to a maximum of 8.581 times the speed ratio of the classic two level index scheme. After further optimization, the scheme can also save much of the storage space of the index table. The two level indexing scheme proposed in this study has a good effect in terms of query performance and storage efficiency.

Keywords： Big Data Secondary Index Smart Grid