Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop virtualization performance comparison and tuning experience     - Ubuntu way of decompressing files (Linux)

- Reported too many open files Linux solutions (Server)

- How to install MySQL on Linux Dock (Database)

- Check with Hello World Docker installation (Server)

- Linux serial port driver test (Linux)

- Python 3.5 await / async (Programming)

- MySQL flip-flop (Database)

- Windows Server 2012 R2 Datacenter install SQL Server 2016 CTP (Database)

- Spring AOP for logging (Programming)

- OpenResty load balancing MySQL (Database)

- To create a full command line Android Build System (Linux)

- To build a private Docker registry (Server)

- Sublime Text 3 using summary (Linux)

- Binary tree and some basic operations with binary list (Programming)

- The Definitive Guide to Linux NAT network connection (Linux)

- Standardized UNIX command-line tool (Linux)

- Physical structure and process disk IO (Linux)

- Use this one-time password via SSH secure login Linux (Programming)

- Java reflection Introduction (Programming)

- CentOS7 install JDK (Linux)

 
         
  Hadoop virtualization performance comparison and tuning experience
     
  Add Date : 2018-11-21      
         
         
         
  Virtual injected into Hadoop unprecedented vigor, production management from the IT point of view, the following points:

- Hadoop and other resource consumption of different types of applications deployed along a shared data center can improve overall resource utilization;

Flexible virtual machine operation so that the user can dynamically created based on data center resources, expand their Hadoop cluster, you can narrow the current cluster, freeing resources to support other applications, if desired;

- Through virtualization architecture provides HA, FT integration, to avoid the traditional Hadoop clusters of single point of failure, coupled with the reliability of the data itself Hadoop, big data for enterprise applications to provide a reliable guarantee.

For these reasons, vSphere Big Data Extensions (BDE) to provide users with flexible deployment and management of Hadoop clusters provide effective support in a virtualized environment. Apart from these advantages, whether virtualization will hurt the performance of Hadoop to run it? To this end, we made performance comparison virtualization deployments and physical deployment of Hadoop clusters and optimization on the same scale, experiments show that virtualization Hadoop clusters can well support the production environment.

Performance comparison virtualized environment and physical environment

Figure 1 shows the deployment style tuning test, deploy a virtual machine on a single physical server only, Tasktracker and Datanode run together on the same node. Because each virtual node can use all server resources, facilitate Hadoop virtualization and the deployment of traditional physical environment do performance comparison and analysis. The test results are shown in Figure 2, the virtualization Hadoop relative performance comparison of the physical environment is almost flat.
At the same time, we put these experiments experience is built into vSphere BDE deployed Hadoop cluster configurations, the shielding performance optimization complexity. Although different data center and cluster configuration settings may result in different manifestations, where according to create, configure, extend Hadoop cluster order to share some common experiences with you
     
         
         
         
  More:      
 
- Java NIO The Glob mode Detailed (Programming)
- Linux, modify / etc / profile file (Linux)
- C ++ constant definition (Programming)
- Ubuntu 14.04 / Linux Mint 17 How to install the MintMenu 5.5.2 menu (Linux)
- Ubuntu15 core CLR (Server)
- Linux server alarms using Java (Server)
- Linux terminal program running in the background (Linux)
- In the case of using cgroups Ubuntu 14.04 and Docker (Linux)
- Oracle GoldenGate Installation and Configuration Tutorial Introduction (Database)
- Linux reserves the rest of the file to delete several (Linux)
- Memcache explain in detail (Server)
- Linux novice common commands (Linux)
- Oracle 12c PDB Analysis (Database)
- Difference between TCP and UDP protocols (Linux)
- Function Getting the Linux shell (Programming)
- for (int a: i) the use of the Java programming (Programming)
- RHEL 6.5 x86_64 CentOS yum configuration source (Linux)
- Use Epoll develop high-performance application server on Linux (Server)
- Python calls the API interface in several ways (Programming)
- Examples of safety testing system notes for RedHat Linux (Linux)
     
           
     
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.