Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)     - How MySQL tracking sql statement (Database)

- Java, boolean operators & =, | = ^ = use (Programming)

- Kibana Apache Password Authentication (Server)

- RedHat / CentOS ext4 partition can not be formatted large supplementary ext4 formatting (Linux)

- CentOS 6.4 installation environment to build Scrapy 0.22 (Linux)

- Java implementation chain store binary tree (Programming)

- DRBD installation configuration, working principle and Recovery (Server)

- CentOS 5.5 install ntop (Linux)

- How to Install Xombrero 1.6.4 (minimalist Web browser) on Ubuntu and Archlinux (Linux)

- How to configure chroot environment in Ubuntu 14.04 (Linux)

- Linux stand-alone OGG synchronous Oracle 11g DB test (Database)

- Boost - Memory Management - smart pointers (Programming)

- Git build a team development environment operating drills (Linux)

- MongoDB simple replication configuration (Database)

- Linux - Common process the command (Linux)

- linux remote control software (Linux)

- Ubuntu under VirtualBox virtual machine serial port settings (Linux)

- Zabbix monitors the status of TCP connections (Server)

- MySQL database under Linux to achieve automatic backup scheduled backup day (Database)

- Vmstat command Linux Performance Monitoring (Linux)

 
         
  Hadoop 2.2.0 installation development environment (standalone pseudo-distributed mode)
     
  Add Date : 2018-11-21      
         
         
         
  Recently been self Hadoop, today, take the time to set up a development environment, and organize written.

We must first look at Hadoop operating modes:

Stand-alone mode (standalone)

Stand-alone mode is the default mode of Hadoop. When you first unpack the source package Hadoop, Hadoop can not understand the hardware installation environment, they chose a conservative minimum configuration. In this default mode for all three XML files are empty. When the configuration file is empty, Hadoop completely run locally. Because no other nodes interact with the stand-alone mode is not used HDFS, Hadoop does not load any of the daemon. This mode is mainly used for application development and debugging logic MapReduce programs.

Pseudo-distribution pattern (Pseudo-Distributed Mode)

Pseudo-run Hadoop distribution pattern in the "single-node cluster" on which all daemons running on the same machine. This mode is on stand-alone mode increases the code debugging function that allows you to check memory usage, HDFS input and output, as well as interact with other daemons.

Fully distributed mode (Fully Distributed Mode)
1. Install JDK, and specify the default jdk versions of Oracle, the default installation directory is /usr/java/jdk1.7.0_45, hereinafter set it

JAVA_HOME
 rpm -ivh jdk-7u51-linux-i586.rpm

vi jdk_install.sh
 
Finally source jdk_install.sh, complete configurations, view the configuration method java -version, make sure not openJDK.
 Modify environment variables, it is recommended to re-establish a shell script file in the etc / profile.d to install the jdk
 #This Is a shell file for Java Environment Installation
 export JAVA_HOME = / usr / java / jdk1.7.0_45
 PATH = $ JAVA_HOME / bin: $ PATH
 export JRE_HOME = $ JAVA_HOME / jre
 export CLASSPATH = /:. $ JAVA_HOME / lib: $ JAVA_HOME / jre / lib
 
2. Configure hadoop environment variable
 #set hadoop2.2.0 environment
 export HADOOP_HOME = / hadoop / hadoop-2.2.0
 export PATH = $ PATH: $ HADOOP_HOME / bin
 export PATH = $ PATH: $ HADOOP_HOME / sbin

 3.hadoop Unzip the package
 tar -zcvf hadoop-2.2.0.tar.gz
 4. Modify the XML file, the file hadoop hadoop file in the directory etc / hadoop, add the following content

Here is a set of namenode daatanode and storage paths.

The last to join jdk specified in hadoop-env.sh this file, the file finally add export JAVA_HOME = / usr / java / jdk1.7.0_45 is your jdk directory
     
         
         
         
  More:      
 
- How to install Ubuntu applications Device 7 (Linux)
- Linux operating system buffer overflow attacks Countermeasures (Linux)
- GAMIT10.5 under CentOS installation (Linux)
- Cobbler automatic mass deployment of CentOS 6 and CentOS 7 (Linux)
- 5 steps to help you become a good Docker contributors (Linux)
- Ubuntu way of decompressing files (Linux)
- Linux file permissions to modify the command: chmod (Linux)
- extundelete: the Linux-based open source data recovery tools (Linux)
- KUbuntu / Ubuntu 14.04 (downgrade) installed SVN 1.7 (Linux)
- How to Install Sticky Notes on Ubuntu and Derivatives (Linux)
- MySQL 5.6 database code changes (Database)
- Efficient running Linux virtual machine Six Tips (Linux)
- SSH service configuration to use a certificate login Linux server (Server)
- grep command Series: grep command to search for multiple words (Linux)
- Linux start the process (Linux)
- NET Developers need to know some Linux commands (Linux)
- Spring AOP custom annotation way to achieve log management (Programming)
- The method of Linux into the rescue mode (Linux)
- Use JMS listener Oracle AQ, trigger the execution of Java programs in the database changes (Database)
- Linux platform Oracle MySQL connection (Database)
     
           
     
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.