Home PC Games Linux Windows Database Network Programming Server Mobile  
  Home \ Server \ Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)     - SSH without password (Linux)

- Build your own CA services: OpenSSL command line CA Quick Guide (Server)

- MongoDB replication instance (Database)

- On event processing browser compatibility notes (Programming)

- a virtual machine created migrated to host RHEL6.4 on Ubuntu 14.04 (Linux)

- Github Remote Assistance (Linux)

- Ubuntu 14.04 Fixed update information is outdated error (Linux)

- socket busy poll of Linux kernel 3.11 to avoid sleep switch (Linux)

- Security measures under Unix multi-user operating system (Linux)

- CentOS 6 adds disk quota limit (Linux)

- Linux disk management practices (Linux)

- Help you make Git Bisect (Linux)

- Linux loopback adapter Driven Design (Programming)

- MySQL high availability cluster fragmentation of deployment uses Cobar (Database)

- The wrong in Linux: too many open files (Linux)

- Ubuntu 14.04 modify environment variables (Linux)

- Those things packaged using Gradle to Android (Programming)

- OpenSUSE GPG Comments (Linux)

- IBM Data Studio to use ---- window displays all rows (Database)

- Java string equal size comparison (Programming)

  Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)
  Add Date : 2018-11-21      
  Recently been self Hadoop, today, take the time to set up a development environment, and organize written.

We must first look at Hadoop operating modes:

Stand-alone mode (standalone)

Stand-alone mode is the default mode of Hadoop. When you first unpack the source package Hadoop, Hadoop can not understand the hardware installation environment, they chose a conservative minimum configuration. In this default mode for all three XML files are empty. When the configuration file is empty, Hadoop completely run locally. Because no other nodes interact with the stand-alone mode is not used HDFS, Hadoop does not load any of the daemon. This mode is mainly used for application development and debugging logic MapReduce programs.

Pseudo-distribution pattern (Pseudo-Distributed Mode)

Pseudo-run Hadoop distribution pattern in the "single-node cluster" on which all daemons running on the same machine. This mode is on stand-alone mode increases the code debugging function that allows you to check memory usage, HDFS input and output, as well as interact with other daemons.

Fully distributed mode (Fully Distributed Mode)
1. Install JDK, and specify the default jdk versions of Oracle, the default installation directory is /usr/java/jdk1.7.0_45, hereinafter set it

 rpm -ivh jdk-7u51-linux-i586.rpm

vi jdk_install.sh
Finally source jdk_install.sh, complete configurations, view the configuration method java -version, make sure not openJDK.
 Modify environment variables, it is recommended to re-establish a shell script file in the etc / profile.d to install the jdk
 #This Is a shell file for Java Environment Installation
 export JAVA_HOME = / usr / java / jdk1.7.0_45
 PATH = $ JAVA_HOME / bin: $ PATH
 export JRE_HOME = $ JAVA_HOME / jre
 export CLASSPATH = /:. $ JAVA_HOME / lib: $ JAVA_HOME / jre / lib
2. Configure hadoop environment variable
 #set hadoop2.2.0 environment
 export HADOOP_HOME = / hadoop / hadoop-2.2.0
 export PATH = $ PATH: $ HADOOP_HOME / bin
 export PATH = $ PATH: $ HADOOP_HOME / sbin

 3.hadoop Unzip the package
 tar -zcvf hadoop-2.2.0.tar.gz
 4. Modify the XML file, the file hadoop hadoop file in the directory etc / hadoop, add the following content

Here is a set of namenode daatanode and storage paths.

The last to join jdk specified in hadoop-env.sh this file, the file finally add export JAVA_HOME = / usr / java / jdk1.7.0_45 is your jdk directory
- Fun music library in Linux using command line (Linux)
- CentOS 6.5 installation and deployment SVN 1.8.10 (Linux)
- ARM constant expression (Programming)
- Nginx request processing (Server)
- SUSE Linux firewall configuration notes (Linux)
- Java open source monitoring platform Zorka basic use (Linux)
- Timeout control related to Python threads and a simple application (Programming)
- X security settings in Ubuntu (Linux)
- MySQL development common query summary (Database)
- To install HDRMerge 0.4.3 under ubuntu (Linux)
- How to Install lightweight Budgie desktop on Ubuntu 14.04 (v8) (Linux)
- DRBD rapid installation and deployment (Server)
- Install apr support for Tomcat on Linux (Server)
- SSH without password (Linux)
- Large computer network security policy Experience (Linux)
- How to manage Vim plugin (Linux)
- Linux prohibit non-WHEEL user su command Detail (Linux)
- Install Python 3.3.4 under CentOS 6.4 (Linux)
- Talking about the implementation and the JVM garbage collection mechanism (Programming)
- Teamviewer not start in Linux (Linux)
  CopyRight 2002-2020 newfreesoft.com, All Rights Reserved.