Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)     - phpinfo (): like phpinfo as a Python script (Programming)

- Fast Sort Algorithms (Programming)

- C ++: Postmodern systems programming language (Programming)

- Oracle TAF Analysis (Database)

- Print Linux system error codes (Linux)

- Linux Shell Understanding and Learning (Linux)

- Java memory-mapped file MappedByteBuffer (Programming)

- CentOS / Linux SELinux Close (Linux)

- Ubuntu 14.10 How to install office suite Calligra Suite 2.8.7 (Linux)

- MySQL concat function is SQL injection (Linux)

- 32-bit and 64-bit integer in PHP and MySQL range (Database)

- Amazon EC2 server using Rsync + Inotify real-time synchronization (Server)

- Manager Docker browser (Server)

- The most common and most effective security settings under linux (Linux)

- Oracle 11g users to create, authorize and import dmp file (Database)

- Ubuntu security settings and tools (Linux)

- HTTP and FTP TCP-FLOOD CC Attacks Analysis and Prevention solutions under CentOS 6.5 (Linux)

- Quick paging ROW_NUMBER conducted (Database)

- Guide: Trickle restrict application bandwidth usage (Linux)

- Linux based exercises, interview questions (Linux)

 
         
  Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)
     
  Add Date : 2018-11-21      
         
         
         
  Recently been self Hadoop, today, take the time to set up a development environment, and organize written.

We must first look at Hadoop operating modes:

Stand-alone mode (standalone)

Stand-alone mode is the default mode of Hadoop. When you first unpack the source package Hadoop, Hadoop can not understand the hardware installation environment, they chose a conservative minimum configuration. In this default mode for all three XML files are empty. When the configuration file is empty, Hadoop completely run locally. Because no other nodes interact with the stand-alone mode is not used HDFS, Hadoop does not load any of the daemon. This mode is mainly used for application development and debugging logic MapReduce programs.

Pseudo-distribution pattern (Pseudo-Distributed Mode)

Pseudo-run Hadoop distribution pattern in the "single-node cluster" on which all daemons running on the same machine. This mode is on stand-alone mode increases the code debugging function that allows you to check memory usage, HDFS input and output, as well as interact with other daemons.

Fully distributed mode (Fully Distributed Mode)
1. Install JDK, and specify the default jdk versions of Oracle, the default installation directory is /usr/java/jdk1.7.0_45, hereinafter set it

JAVA_HOME
 rpm -ivh jdk-7u51-linux-i586.rpm

vi jdk_install.sh
 
Finally source jdk_install.sh, complete configurations, view the configuration method java -version, make sure not openJDK.
 Modify environment variables, it is recommended to re-establish a shell script file in the etc / profile.d to install the jdk
 #This Is a shell file for Java Environment Installation
 export JAVA_HOME = / usr / java / jdk1.7.0_45
 PATH = $ JAVA_HOME / bin: $ PATH
 export JRE_HOME = $ JAVA_HOME / jre
 export CLASSPATH = /:. $ JAVA_HOME / lib: $ JAVA_HOME / jre / lib
 
2. Configure hadoop environment variable
 #set hadoop2.2.0 environment
 export HADOOP_HOME = / hadoop / hadoop-2.2.0
 export PATH = $ PATH: $ HADOOP_HOME / bin
 export PATH = $ PATH: $ HADOOP_HOME / sbin

 3.hadoop Unzip the package
 tar -zcvf hadoop-2.2.0.tar.gz
 4. Modify the XML file, the file hadoop hadoop file in the directory etc / hadoop, add the following content

Here is a set of namenode daatanode and storage paths.

The last to join jdk specified in hadoop-env.sh this file, the file finally add export JAVA_HOME = / usr / java / jdk1.7.0_45 is your jdk directory
     
         
         
         
  More:      
 
- Android development, may cause a memory leak problem (Programming)
- Oracle archive log deletion (Database)
- Ubuntu disable graphics card (Linux)
- CentOS6.6 ordinary users to use sudo command to borrow root user privileges (Linux)
- Ubuntu 14.04 LTS compiler installation R Source Code (Linux)
- Linux Creating a new user error Creating mailbox file: File exists (Linux)
- MySQL / MariaDB database master-slave replication (Database)
- Linux system performance and usage activity monitoring tools -Sysstat (Linux)
- Open container cluster management system architecture and components introduced Kubernetes (Server)
- Practical top command (Linux)
- Ubuntu comes with gedit editor to add Markdown preview widget (Linux)
- Oracle 10g New Features - Archive Compression (Database)
- CentOS iptables firewall enabled (Linux)
- MongoDB 2.6 deployment replica set + partitions (Database)
- Eclipse-ee Tomcat browser can not start Tomcat, and Web project service deployment (Server)
- Nagios (centreon) monitoring Linux Log (Server)
- Do you know how to build the Linux kernel (Programming)
- Ubuntu 14.04 / 13.10 users how to install Ubuntu Touch core applications (Linux)
- ogg start being given libnnz11.so: can not open shared object file (Database)
- Ambari and Hadoop configuration, management and monitoring of the project Getting (Server)
     
           
     
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.