Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)     - LNMP summary of the issues common 502 Bad Gateway (Server)

- Oracle10g 64-bit installation solution in Windows 2008 Server R2 (Database)

- Oracle Client + PL SQL Developer enables remote access to the Oracle database (Database)

- Java Concurrency -volatile keywords (Programming)

- BackTrack (BT3, BT4) Linux installation tutorial (Linux)

- Node.js form --formidable (Programming)

- Hands to teach you to solve Ubuntu error message (Linux)

- C # compiler to achieve functional use in the runtime (Programming)

- Novice Advanced Ubuntu7.10 configured IP address (Linux)

- MySQL Basic tutorial: About varchar (N) (Database)

- Linux, how to filter, split, and merge pcap file (Linux)

- OpenGL shadow map (Programming)

- Father of Python: Why Python zero-based index (Programming)

- Ubuntu and Derivative Edition users install LMMS 0.4.15 (Linux)

- JavaScript prototype and the prototype chain (Programming)

- MySQL bulk insert data script (Database)

- How to install the Ruby runtime environment on Mac OS X (Linux)

- Boost notes --Asio - (1) a simple small example of synchronous communication (Programming)

- MySQL Error Code Complete (Database)

- Fatal NI connect error 12170 error in Alert Log (Database)

 
         
  Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)
     
  Add Date : 2018-11-21      
         
         
         
  Recently been self Hadoop, today, take the time to set up a development environment, and organize written.

We must first look at Hadoop operating modes:

Stand-alone mode (standalone)

Stand-alone mode is the default mode of Hadoop. When you first unpack the source package Hadoop, Hadoop can not understand the hardware installation environment, they chose a conservative minimum configuration. In this default mode for all three XML files are empty. When the configuration file is empty, Hadoop completely run locally. Because no other nodes interact with the stand-alone mode is not used HDFS, Hadoop does not load any of the daemon. This mode is mainly used for application development and debugging logic MapReduce programs.

Pseudo-distribution pattern (Pseudo-Distributed Mode)

Pseudo-run Hadoop distribution pattern in the "single-node cluster" on which all daemons running on the same machine. This mode is on stand-alone mode increases the code debugging function that allows you to check memory usage, HDFS input and output, as well as interact with other daemons.

Fully distributed mode (Fully Distributed Mode)
1. Install JDK, and specify the default jdk versions of Oracle, the default installation directory is /usr/java/jdk1.7.0_45, hereinafter set it

JAVA_HOME
 rpm -ivh jdk-7u51-linux-i586.rpm

vi jdk_install.sh
 
Finally source jdk_install.sh, complete configurations, view the configuration method java -version, make sure not openJDK.
 Modify environment variables, it is recommended to re-establish a shell script file in the etc / profile.d to install the jdk
 #This Is a shell file for Java Environment Installation
 export JAVA_HOME = / usr / java / jdk1.7.0_45
 PATH = $ JAVA_HOME / bin: $ PATH
 export JRE_HOME = $ JAVA_HOME / jre
 export CLASSPATH = /:. $ JAVA_HOME / lib: $ JAVA_HOME / jre / lib
 
2. Configure hadoop environment variable
 #set hadoop2.2.0 environment
 export HADOOP_HOME = / hadoop / hadoop-2.2.0
 export PATH = $ PATH: $ HADOOP_HOME / bin
 export PATH = $ PATH: $ HADOOP_HOME / sbin

 3.hadoop Unzip the package
 tar -zcvf hadoop-2.2.0.tar.gz
 4. Modify the XML file, the file hadoop hadoop file in the directory etc / hadoop, add the following content

Here is a set of namenode daatanode and storage paths.

The last to join jdk specified in hadoop-env.sh this file, the file finally add export JAVA_HOME = / usr / java / jdk1.7.0_45 is your jdk directory
     
         
         
         
  More:      
 
- Let OpenCV face detection score output codes (Programming)
- Ubuntu install OpenMPI (Linux)
- Storm how to assign tasks and load balancing (Programming)
- Installation and Configuration Tomcat environment CentOS 6.6 (Server)
- Linux server security - the web server configuration (Linux)
- The difference between Objective-C language nil, Nil, NULL, NSNull (Programming)
- Oracle 11g R2 RAC RMAN backup script example (Database)
- Node.js form --formidable (Programming)
- Spring Data JPA call a stored procedure examples (Programming)
- Java developers question (Programming)
- How to properly set up a Linux swap partition (Linux)
- impdp error ORA-39001, ORA-39000, ORA-31619 (Database)
- Detailed Linux su command to switch users Mistakes (Linux)
- Four Methods of Self - Learning Linux (Linux)
- CentOS 5.10 installed Oracle 11G R2 (Database)
- Initialization and starting process of Linux (Linux)
- Binding unofficial Google Drive and Ubuntu 14.04 LTS (Linux)
- Git uses a standard process (Linux)
- How to use the ps command to monitor progress in the implementation of Linux commands (Linux)
- PL / SQL how to make the program every few seconds to insert a data (Database)
     
           
     
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.