Home PC Games Linux Windows Database Network Programming Server Mobile  
  Home \ Server \ Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)     - Automated Password Generator: Linux under a special password generator (Linux)

- Oracle RAC upgrade to problems encountered (Database)

- Linux initialization init systems - Systemd (Linux)

- Android use canvas board painting (Programming)

- C ++ in the elimination Wunused (Programming)

- Linux configuration startup mount: fstab file (Linux)

- Linux C programming and Shell Programming in the development of practical tools similarities summary (Programming)

- TPCC-MySQL Benchmark (Database)

- Examples of testing and installation Mesos on CentOS (Linux)

- Memcached installation, configuration and monitoring (Server)

- Object-C in the preparation of multi-parameter function parameter is omitted (Programming)

- Learning OpenCV: (VS2010-openCV2.4.3-win7 configuration instructions) (Linux)

- Use XtraBackup be physical standby database MySQL (Database)

- 10 Regulation of painless SQL Schema (Database)

- Ubuntu install Oracle 10g process and problem solution (Linux)

- Install apr support for Tomcat on Linux (Server)

- Linux System Getting Started Tutorial: How to find the maximum memory your system supports (Linux)

- Open log in Hibernate (Programming)

- Proxmox VE implement KVM OpenVZ virtualization cloud computing (Server)

- iOS Sensor Development - add to APP phone password, fingerprint security authentication (Programming)

  Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)
  Add Date : 2018-11-21      
  Recently been self Hadoop, today, take the time to set up a development environment, and organize written.

We must first look at Hadoop operating modes:

Stand-alone mode (standalone)

Stand-alone mode is the default mode of Hadoop. When you first unpack the source package Hadoop, Hadoop can not understand the hardware installation environment, they chose a conservative minimum configuration. In this default mode for all three XML files are empty. When the configuration file is empty, Hadoop completely run locally. Because no other nodes interact with the stand-alone mode is not used HDFS, Hadoop does not load any of the daemon. This mode is mainly used for application development and debugging logic MapReduce programs.

Pseudo-distribution pattern (Pseudo-Distributed Mode)

Pseudo-run Hadoop distribution pattern in the "single-node cluster" on which all daemons running on the same machine. This mode is on stand-alone mode increases the code debugging function that allows you to check memory usage, HDFS input and output, as well as interact with other daemons.

Fully distributed mode (Fully Distributed Mode)
1. Install JDK, and specify the default jdk versions of Oracle, the default installation directory is /usr/java/jdk1.7.0_45, hereinafter set it

 rpm -ivh jdk-7u51-linux-i586.rpm

vi jdk_install.sh
Finally source jdk_install.sh, complete configurations, view the configuration method java -version, make sure not openJDK.
 Modify environment variables, it is recommended to re-establish a shell script file in the etc / profile.d to install the jdk
 #This Is a shell file for Java Environment Installation
 export JAVA_HOME = / usr / java / jdk1.7.0_45
 PATH = $ JAVA_HOME / bin: $ PATH
 export JRE_HOME = $ JAVA_HOME / jre
 export CLASSPATH = /:. $ JAVA_HOME / lib: $ JAVA_HOME / jre / lib
2. Configure hadoop environment variable
 #set hadoop2.2.0 environment
 export HADOOP_HOME = / hadoop / hadoop-2.2.0
 export PATH = $ PATH: $ HADOOP_HOME / bin
 export PATH = $ PATH: $ HADOOP_HOME / sbin

 3.hadoop Unzip the package
 tar -zcvf hadoop-2.2.0.tar.gz
 4. Modify the XML file, the file hadoop hadoop file in the directory etc / hadoop, add the following content

Here is a set of namenode daatanode and storage paths.

The last to join jdk specified in hadoop-env.sh this file, the file finally add export JAVA_HOME = / usr / java / jdk1.7.0_45 is your jdk directory
- hexdump Linux command (Linux)
- Will Laravel become the most successful PHP framework? (Programming)
- Build Docker based MongoDB replication cluster environment (Database)
- Linux system font color change (Linux)
- dd command: do hard disk IO performance test (Linux)
- Five programming fallacy (Programming)
- MySQL master-slave database configuration and error handling Raiders (Database)
- Java regular expressions examples (Programming)
- Android float ball and boot from the start (Programming)
- Learning the Linux powerful network management capabilities (Linux)
- MySQL EXPLAIN SQL output description (Database)
- Linux Shell Scripting Interview Question (Linux)
- Openfire achieve load balancing cluster by Nginx (Server)
- Ubuntu compiler installation R Full Record (Linux)
- Debian users to install FFmpeg 2.2.2 (Linux)
- ORA-14400: inserted partition key does not map to any partition (Database)
- JDK installation and configuration environment variable under linuxb (Linux)
- Using Ruby to build a simple HTTP service and sass environment (Server)
- Python implementation Bursa transition model (Programming)
- Modify grub solve computer startup error: ERROR 17 (Linux)
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.