Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop virtualization performance comparison and tuning experience     - How to create a new file system / partitions under Linux terminal (Linux)

- The YUM package management under Linux (Linux)

- Linux (RHEL6 CENTOS6 OLE6) VNC-SERVER Installation and Configuration (Server)

- Linux kernel netpoll framework netconsole (Linux)

- Linux process stack and process function stack frame (Linux)

- Oracle 11g RMAN virtual private directory (Database)

- OpenJDK7 source compiler installation on CentOS 6.5 (Linux)

- Graphics of Java Tools (Programming)

- MySQL service failed to start thinking of settlement under CentOS7 (Database)

- Oracle archive log size than the size of the online journal of the much smaller (Database)

- How to make a U disk to install Ubuntu (Linux)

- Ubuntu achieve initialization iptables (Linux)

- Python Multithreaded Programming (Programming)

- C ++ virtual functions Classic Insights (Programming)

- Formatting Java floating-point types (Programming)

- Use libpq under Ubuntu 14.04 (Linux)

- AngularJS achieve picture upload feature (Programming)

- 20 open source / commercial Linux server management control panel (Server)

- Java polymorphism and exception handling (Programming)

- Use PDFBox processing PDF documents (Linux)

 
         
  Hadoop virtualization performance comparison and tuning experience
     
  Add Date : 2018-11-21      
         
         
         
  Virtual injected into Hadoop unprecedented vigor, production management from the IT point of view, the following points:

- Hadoop and other resource consumption of different types of applications deployed along a shared data center can improve overall resource utilization;

Flexible virtual machine operation so that the user can dynamically created based on data center resources, expand their Hadoop cluster, you can narrow the current cluster, freeing resources to support other applications, if desired;

- Through virtualization architecture provides HA, FT integration, to avoid the traditional Hadoop clusters of single point of failure, coupled with the reliability of the data itself Hadoop, big data for enterprise applications to provide a reliable guarantee.

For these reasons, vSphere Big Data Extensions (BDE) to provide users with flexible deployment and management of Hadoop clusters provide effective support in a virtualized environment. Apart from these advantages, whether virtualization will hurt the performance of Hadoop to run it? To this end, we made performance comparison virtualization deployments and physical deployment of Hadoop clusters and optimization on the same scale, experiments show that virtualization Hadoop clusters can well support the production environment.

Performance comparison virtualized environment and physical environment

Figure 1 shows the deployment style tuning test, deploy a virtual machine on a single physical server only, Tasktracker and Datanode run together on the same node. Because each virtual node can use all server resources, facilitate Hadoop virtualization and the deployment of traditional physical environment do performance comparison and analysis. The test results are shown in Figure 2, the virtualization Hadoop relative performance comparison of the physical environment is almost flat.
At the same time, we put these experiments experience is built into vSphere BDE deployed Hadoop cluster configurations, the shielding performance optimization complexity. Although different data center and cluster configuration settings may result in different manifestations, where according to create, configure, extend Hadoop cluster order to share some common experiences with you
     
         
         
         
  More:      
 
- Analysis of C ++ exception mechanism (Programming)
- Run two MySQL service on one server (Database)
- Linux password file security issues detailed usage (Linux)
- grep command output highlighted word (Linux)
- Ubuntu how to install and use Objective-C (Linux)
- ORA-12547: TNS: lost contact error Solution (Database)
- Oracle 11g contraction table space error ORA-03297: file contains used data beyondrequested RESIZE value (Database)
- Linux command execution judge sentences -;, &&, || (Linux)
- Linux Security (Linux)
- Oracle 11g RAC automatically play GI PSU patch (11.2.0.4.8) (Database)
- Red Hat Enterprise Linux configuration VNC multi-user access methods (Linux)
- Android Application Development: an argument between Activity (Programming)
- Linux --- manual release system cache (Linux)
- MongoDB upgrade to 2.6 (Database)
- Linux package manager - yum (Linux)
- Oracle 11g statistics collection - collection of multi-column statistics (Database)
- Use read command to read user input (Programming)
- Use PuTTY to access the virtual machine Linux under Windows xp (Programming)
- Linux ACL permissions (Linux)
- Ubuntu 15.10 How to install TeamViewer 11 (Linux)
     
           
     
  CopyRight 2002-2020 newfreesoft.com, All Rights Reserved.