Home PC Games Linux Windows Database Network Programming Server Mobile  
  Home \ Server \ Hadoop virtualization performance comparison and tuning experience     - PostgreSQL 9.4.3 Installation and Configuration under CentOS 6.5 (Database)

- Unity Greeter Badges: the lost session icon back to the login screen Ubuntu (Linux)

- Linux system started to learn: Teaches you install Ubuntu 15.04 on VirtualBox (Linux)

- Automatic and Manual Proxy Settings Switch GNOME Shell Extension Proxy Switcher Recommend (Linux)

- To setup NOTRACK and TRACK of conntrack in iptables (Linux)

- Installation Mesos + Marathon + Zookeeper under CentOS 7 (Server)

- Based on OpenSSL for HTTPS service configuration (Server)

- Performance issues under CentOS 6.5 VLAN devices (Linux)

- Intel Graphics Installer 1.0.3 released, support for Ubuntu (Linux)

- 5 tips to improve your Linux desktop security (Linux)

- Delay for the specified IP port analog network to send and receive packets on Linux (Linux)

- Linux common network tools: batch scanning of nmap hosting service (Linux)

- Android memory optimization of the disk cache (Linux)

- KVM add virtual disks (Linux)

- Which file system is most suitable for your Linux system (Linux)

- Zabbix configure DataGuard monitoring (Database)

- Udev: Device Manager for Linux Fundamentals (Linux)

- Linux operating system buffer overflow attacks Countermeasures (Linux)

- Linux system security settings after installation (Linux)

- GRUB and Linux system repair (Linux)

  Hadoop virtualization performance comparison and tuning experience
  Add Date : 2018-11-21      
  Virtual injected into Hadoop unprecedented vigor, production management from the IT point of view, the following points:

- Hadoop and other resource consumption of different types of applications deployed along a shared data center can improve overall resource utilization;

Flexible virtual machine operation so that the user can dynamically created based on data center resources, expand their Hadoop cluster, you can narrow the current cluster, freeing resources to support other applications, if desired;

- Through virtualization architecture provides HA, FT integration, to avoid the traditional Hadoop clusters of single point of failure, coupled with the reliability of the data itself Hadoop, big data for enterprise applications to provide a reliable guarantee.

For these reasons, vSphere Big Data Extensions (BDE) to provide users with flexible deployment and management of Hadoop clusters provide effective support in a virtualized environment. Apart from these advantages, whether virtualization will hurt the performance of Hadoop to run it? To this end, we made performance comparison virtualization deployments and physical deployment of Hadoop clusters and optimization on the same scale, experiments show that virtualization Hadoop clusters can well support the production environment.

Performance comparison virtualized environment and physical environment

Figure 1 shows the deployment style tuning test, deploy a virtual machine on a single physical server only, Tasktracker and Datanode run together on the same node. Because each virtual node can use all server resources, facilitate Hadoop virtualization and the deployment of traditional physical environment do performance comparison and analysis. The test results are shown in Figure 2, the virtualization Hadoop relative performance comparison of the physical environment is almost flat.
At the same time, we put these experiments experience is built into vSphere BDE deployed Hadoop cluster configurations, the shielding performance optimization complexity. Although different data center and cluster configuration settings may result in different manifestations, where according to create, configure, extend Hadoop cluster order to share some common experiences with you
- numpy and SciPy installation under Python for scientific computing package (Linux)
- Deployment Kubernetes manage Docker example cluster on Ubuntu (Server)
- Btrfs file system creation and their characteristics in Linux (Linux)
- Depth understanding of Python character set encoding (Programming)
- Ubuntu Linux use ufw or iptables firewall configuration (Linux)
- ORA-01157 & ORA-01110 Troubleshooting (Database)
- Set up MySQL master and slave servers under Ubuntu 14.04 (Server)
- Ubuntu 14.10 Apache installation and configuration (Server)
- Linux CPU Monitoring Index (Linux)
- Linux System Getting Started Learning: Change the name of the network interface on CentOS7 (Linux)
- Log analysis is done with Grafana Elasticsearch (Server)
- Linux boot process (Linux)
- How Datadog monitor Nginx (Server)
- How do you turn on and off IPv6 address on Fedora (Linux)
- Ubuntu derivative version of the user and how to install SmartGit / HG 6.0.0 (Linux)
- C # dynamic class notes --- (Dynamic) Applications (Programming)
- Teach you how to choose to install CentOS 6.5 installation package (Linux)
- VMware ghost Linux card error (Linux)
- Oracle PLS-00231 error analysis (Database)
- MySQL database under Linux to achieve automatic backup scheduled backup day (Database)
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.