Home PC Games Linux Windows Database Network Programming Server Mobile  
  Home \ Server \ Hadoop virtualization performance comparison and tuning experience     - Linux kernel TCP / IP parameters analysis and tuning (Linux)

- High-performance Linux system firewall detailed analysis of double-effect (Linux)

- Virtual Judge environment to build and configure under Ubuntu (Server)

- Linux Getting Started tutorial: Experience VirtualBox Virtual Machine chapter (Linux)

- To install JDK1.7 and compiler Hadoop-2.7.1 under CentOS7 (Server)

- LVM management parameters commonly used commands explained in detail (Linux)

- Packages with Snort intrusion monitoring light (Linux)

- Install Oracle JDK 8 and JVM class loading mechanism in Linux (Linux)

- Ftp user to create multiple virtual machines to support different access rights Examples (Server)

- Snapshot DataGuard (Database)

- Linux common network tools: batch scanning of hosting services netcat (Linux)

- Linux system server network security management tips (Linux)

- Build Nginx + uWSGI + Flask operating environment under CentOS 6.4 tutorial (Server)

- ethtool implementation framework and application in Linux (Linux)

- SecureCRT remote connection Ubuntu fails to solve the case (Linux)

- Impact test noatime Linux file access time (Linux)

- Ubuntu in Vim editor display processing method Chinese garbled (Linux)

- How to use the ps command to monitor progress in the implementation of Linux commands (Linux)

- iOS in the event delivery and the responder chain (Programming)

- MongoDB3.0.6 wiredtiger MMAPv1 (Database)

  Hadoop virtualization performance comparison and tuning experience
  Add Date : 2018-11-21      
  Virtual injected into Hadoop unprecedented vigor, production management from the IT point of view, the following points:

- Hadoop and other resource consumption of different types of applications deployed along a shared data center can improve overall resource utilization;

Flexible virtual machine operation so that the user can dynamically created based on data center resources, expand their Hadoop cluster, you can narrow the current cluster, freeing resources to support other applications, if desired;

- Through virtualization architecture provides HA, FT integration, to avoid the traditional Hadoop clusters of single point of failure, coupled with the reliability of the data itself Hadoop, big data for enterprise applications to provide a reliable guarantee.

For these reasons, vSphere Big Data Extensions (BDE) to provide users with flexible deployment and management of Hadoop clusters provide effective support in a virtualized environment. Apart from these advantages, whether virtualization will hurt the performance of Hadoop to run it? To this end, we made performance comparison virtualization deployments and physical deployment of Hadoop clusters and optimization on the same scale, experiments show that virtualization Hadoop clusters can well support the production environment.

Performance comparison virtualized environment and physical environment

Figure 1 shows the deployment style tuning test, deploy a virtual machine on a single physical server only, Tasktracker and Datanode run together on the same node. Because each virtual node can use all server resources, facilitate Hadoop virtualization and the deployment of traditional physical environment do performance comparison and analysis. The test results are shown in Figure 2, the virtualization Hadoop relative performance comparison of the physical environment is almost flat.
At the same time, we put these experiments experience is built into vSphere BDE deployed Hadoop cluster configurations, the shielding performance optimization complexity. Although different data center and cluster configuration settings may result in different manifestations, where according to create, configure, extend Hadoop cluster order to share some common experiences with you
- Ubuntu install Vendetta Online 14.04 (Linux)
- On event processing browser compatibility notes (Programming)
- Docker container plaintext password problem-solving way (Server)
- How to identify memory leaks in Java (Programming)
- Editor of the popular Linux Gvim (Linux)
- Linux tar compressed exclude a folder (Linux)
- Linux + Apache + PHP + Oracle based environment to build (Server)
- MySQL and Oracle time zone settings compare (Database)
- namespace mechanism Linux kernel analysis (Linux)
- The compiler installed Kaldi under Ubuntu 12.04 (Linux)
- CentOS 6.6 install JDK7 (Linux)
- 10 Codes of good practice PHP (Programming)
- To build Spring RestTemplate use HttpClient4 (Programming)
- CentOS7 install NTFS-3G driver (Linux)
- Linux system security Comments (Linux)
- Linux System Getting Started Learning: install software packages on Ubuntu and Fedora (Linux)
- CentOS replaces update source and Linux kernel compilation summary (Linux)
- Debian (Wheezy) Install Redmine 2.6 (Programming)
- After Oracle 11g dataguard failover rebuild the archive logs are not applied to be NO problem (Database)
- Hadoop 2.7.1 Installation and Configuration under RedHat Linux 6.5 (Server)
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.