Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Database \ Why HBase need to build SQL engine layer     - The relationship between UNIX and Linux (Linux)

- Install Open vSwitch under CentOS 6.5 (Linux)

- Use install_updates upgrade GAMIT / GLOBK (Linux)

- Experience CoreCLR stack unwinding characteristics of initial implementation on Linux / Mac (Linux)

- Ubuntu security settings and tools (Linux)

- GRUB and Linux system repair (Linux)

- AppCode developed Mac OS X application or shared library experience summary (Programming)

- Use OpenWrt build WDS wireless network extension on V2 WHR-G300N (Linux)

- MariaDB 10.0.X, the dynamic column support JSON format to obtain data (Database)

- Install RAID 6 (Striping double distributed parity) (Linux)

- 7 JavaScript interview questions (Programming)

- Use virt-manager to create and manage virtual machines (Linux)

- Ubuntu 14.10 splash screen brightness settings (Linux)

- Java reflection Introduction (Programming)

- CentOS source installation GitLab Chinese Version (Server)

- Linux modify environment variables method (Linux)

- Oracle to read and modify the data block process (Database)

- The method of installing software under Ubuntu Linux (Linux)

- MySQL 5.7.10 source code for the latest version of the installation process in detail (Database)

- Lua non-blocking write log (Programming)

 
         
  Why HBase need to build SQL engine layer
     
  Add Date : 2018-11-21      
         
         
         
 

Existing SQL level solutions are usually not scalable, so when the data becomes large when there may be obstacles. But this case, as has been the emergence of NoSQL great degree of ease, and with NoSQL technology improvement and maturity, this situation will be solved fundamentally.

We know that different from the relational database NoSQL thing is NoSQL does not use SQL as a query language, SQL interface provided as to why the NoSQL data storage HBase, the following reasons:

1. Use language such as SQL so easy to understand, so that people can more easily use HBase.

2. Use SQL such as a higher level language to write, reducing the amount of code written.

3. When the query is executed, data access and SQL runtime plus a layer of abstraction can be so heavily optimized between execution. For example, for the GROUP BY query, use HBase in co-processor, the polymerization can be carried out on the server, rather than on the client side, doing so would greatly reduce the amount of data transferred between the client and the server. Alternatively, you can execute in parallel GROUP BY client, which is based on the scope of Xingjian to truncate scanning achieved. The results will be returned via the parallel execution faster. All of these optimization without user involvement, you can simply execute the query.

Based on HBase SQL engine to achieve

There are some in the industry at this stage to try on HBase SQL engine layer, there are already some of the more stable and realistic solutions.

1.Hive integration HBase

Hive and HBase integration feature from Hive0.6.0 version has begun to appear, the use of both external API interface to communicate with each other, communication is mainly rely hive_hbase-handler.jar Kit (Hive Storage Handlers). Because there is a relatively large HBase version changes, so not every version of the existing HBase and Hive can integrate version, so in the course special attention is consistency between the two versions.

2.Phoenix

Phoenix Salesforce.com by the open source Apache HBase is built on top of a SQL intermediate layer that allows developers to execute SQL queries on HBase. Phoenix is completely written in Java code is on Github, and provides a client can be embedded JDBC driver. For simple queries 10w to 100w line is, Phoenix be better than Hive.

3.Kundera

Kundera is a JPA2.0 object mapping framework compatible with NoSQL data stores. Kundera build on existing library, package the simple API, its main characteristics are:

1) support cross persistent data storage, which means that different users can use a single method of data storage to store and retrieve related entities.

2) can be well-managed affairs, while supporting EntityTransaction and Java Transaction API (JPA).

3) Compatible JPA2.0, strictly use JPA annotation object to the map data storage table.

4) currently supports NoSQL servers include: HBase, MongoDB, Redis, Neo4j like.

There are other solutions, such as: Lealone, hbase-sql, Impala, etc., or immature, or stop updating it, or has limitations. The readers are interested in, you can get to know yourself.

     
         
         
         
  More:      
 
- Standard and IO redirection (Linux)
- MySQL group_con cat_max_Len (Database)
- CentOS6.3 build a Python 3.3 environment to access Oracle 11gR2 (Database)
- JavaScript event handling Detailed (Programming)
- Django1.5 Custom User Model (Programming)
- Linux system security settings (Linux)
- Linux development environment to build and use the directory structure and file --Linux (Linux)
- RedHat / CentOS ext4 partition can not be formatted large supplementary ext4 formatting (Linux)
- Configuring ftp server and nfs server under Linux (Server)
- The Hill sorting algorithm (Programming)
- Three details reflect the Unix system security (Linux)
- VMware virtual machine operating system log Error in the RPC receive loop resolve (Linux)
- MariaDB 10 Multi-source replication (Database)
- Understand the security restore accidentally deleted critical system files (Linux)
- Installation of Ubuntu Make under Ubuntu 15.10 (Linux)
- To share Internet access through NAT mode under Virtual Linux VMware Workstation (Linux)
- Taught you how to install Ubuntu Linux (Linux)
- The Samba service does not have permission to access (Server)
- High-performance JavaScript DOM programming (Programming)
- Spring WebSocket Comments (Programming)
     
           
     
  CopyRight 2002-2020 newfreesoft.com, All Rights Reserved.