Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop virtualization performance comparison and tuning experience     - 14.04.3 Ubuntu configuration and successfully compiled source code Android 6.0 r1 (Programming)

- Use mod_wsgi Django application deployment (Server)

- MongoDB 3.2 Cluster Setup (Database)

- Linux / CentOS 7.0 installation and configuration under Tomcat 8.0 (Server)

- HAProxy Windows version of the compiler and its application in the CORS (Server)

- SSH mutual trust configuration (Server)

- Yii2 Advanced Version Copy New Project Problem Solved (Programming)

- Android Unzip the ZIP / GZIP data (based on the InflaterInputStream implementation) (Programming)

- Log4cplus logging facility configuration, installation, testing (Linux)

- About Auto Layout and frame (Programming)

- To teach you a trick to find the real IP address (Linux)

- Local port forwarding using iptables under linux (Server)

- RedHat Linux 6.4 install Oracle 10g error (Database)

- Sublime Text 3 (Linux)

- Oracle 11g em start newspaper site's security certificate has a solution to the problem (Database)

- CentOS iptables firewall configuration (Linux)

- Amazon EC2 server using Rsync + Inotify real-time synchronization (Server)

- Linux crontab commands and detailed usage examples (Linux)

- Ubuntu 14.04 compile and install Apache (Server)

- Good wireless network security information spread in the air (Linux)

 
         
  Hadoop virtualization performance comparison and tuning experience
     
  Add Date : 2018-11-21      
         
         
         
  Virtual injected into Hadoop unprecedented vigor, production management from the IT point of view, the following points:

- Hadoop and other resource consumption of different types of applications deployed along a shared data center can improve overall resource utilization;

Flexible virtual machine operation so that the user can dynamically created based on data center resources, expand their Hadoop cluster, you can narrow the current cluster, freeing resources to support other applications, if desired;

- Through virtualization architecture provides HA, FT integration, to avoid the traditional Hadoop clusters of single point of failure, coupled with the reliability of the data itself Hadoop, big data for enterprise applications to provide a reliable guarantee.

For these reasons, vSphere Big Data Extensions (BDE) to provide users with flexible deployment and management of Hadoop clusters provide effective support in a virtualized environment. Apart from these advantages, whether virtualization will hurt the performance of Hadoop to run it? To this end, we made performance comparison virtualization deployments and physical deployment of Hadoop clusters and optimization on the same scale, experiments show that virtualization Hadoop clusters can well support the production environment.

Performance comparison virtualized environment and physical environment

Figure 1 shows the deployment style tuning test, deploy a virtual machine on a single physical server only, Tasktracker and Datanode run together on the same node. Because each virtual node can use all server resources, facilitate Hadoop virtualization and the deployment of traditional physical environment do performance comparison and analysis. The test results are shown in Figure 2, the virtualization Hadoop relative performance comparison of the physical environment is almost flat.
At the same time, we put these experiments experience is built into vSphere BDE deployed Hadoop cluster configurations, the shielding performance optimization complexity. Although different data center and cluster configuration settings may result in different manifestations, where according to create, configure, extend Hadoop cluster order to share some common experiences with you
     
         
         
         
  More:      
 
- Build ASP.NET 5 development environment in Ubuntu (Server)
- Linux NFS FTP use (Server)
- Android in the coordinate system and a method to obtain the coordinates (Programming)
- AngularJS asynchronous service testing and Mocking (Programming)
- Run two MySQL service on one server (Database)
- Python Django model within the class meta Detailed (Programming)
- C # / iOS / Android Universal Encryption and decryption (Programming)
- Android use canvas board painting (Programming)
- Ubuntu apt-mirror established local private sources (Linux)
- Circular list of Java programming (Programming)
- Android custom title bar (Programming)
- MongoDB Installation under CentOS 6.6 (Database)
- Binary tree and some basic operations with binary list (Programming)
- What happens after the MySQL disk space is full (Database)
- Linux novice common commands (Linux)
- Swift used in the application to add a local push at the specified time (Programming)
- Linux beginners should know 12 commands (Linux)
- Git large file storage will help handle large binary files (Linux)
- Configuring a Linux operating system against syn attack (Linux)
- How to use scientific data Docker quickly configure the development environment (Server)
     
           
     
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.