Home PC Games Linux Windows Database Network Programming Server Mobile  
  Home \ Server \ How to install Hadoop on CentOS7     - Oracle 11g How dataguard master repository to Oracle single instance data recovery (Database)

- Unix / Linux commonly used to clean up disk space command (Linux)

- CentOS 6.6 permanent method to modify the DNS address (Linux)

- How to manage KVM virtual environments with command-line tools in Linux (Server)

- Macro Analysis Performance: PHP Performance Analysis and Experiment (Programming)

- Linux atomic operations and synchronization mechanisms (Programming)

- MNIST presentation and database conversion (Database)

- init level settings for Linux / etc / inittab file into six (restart) or does not support the level of solution (Linux)

- Android custom slideshow menu slidmenu (Programming)

- dd command: do hard disk IO performance test (Linux)

- Linux system package manager (rpm, yum, source packages installation) (Linux)

- JavaScript common array manipulation functions and usage (Programming)

- Use Visual Studio to compile and use WinGDB remote debugging embedded Linux programs (Programming)

- How to install Laravel PHP framework on CentOS 7 / Ubuntu 15.04 (Server)

- Linux C source code (Ascii HexToBinary: Converts hexadecimal string format ASCII codes) (Programming)

- Oracle 12CIN-memory in table spaces (Database)

- Qt signals and slots mechanism (Programming)

- Android Qemu GPS module (Programming)

- How to make Linux a non-root user uses less than 1024 ports (Linux)

- Using the Linux VNC service (Server)

  How to install Hadoop on CentOS7
  Add Date : 2018-11-21      
  Hadoop is a distributed system infrastructure, he enables users in distributed without knowing the underlying details of the development of distributed applications.

The important core Hadoop: HDFS and MapReduce. HDFS responsible for the storage, MapReduce responsible for the calculation.

The following describes how to install Hadoop focus:

In fact, do not bother to install Hadoop, several major condition precedent requires the following, if the following condition precedent somehow, according to the official website launch configuration is very simple.

1, Java runtime environment, we recommend that Sun releases

2, SSH public key authentication secret Free

Above environment get, the rest is just Hadoop configuration, this part of the configuration might have different versions in detail with reference to the official documentation.


VM: VMWare10.0.1 build-1379776

Operating System: CentOS7 64 bit

Install Java environment

Download: http: //www.Oracle.com/technetwork/cn/java/javase/downloads/jdk8-downloads-2133151-zhs.html

Own operating system version, select the appropriate download package according to the package if it is supported by rpm, rpm direct download, or use rpm address

rpm -ivh http://download.oracle.com/otn-pub/java/jdk/8u20-b26/jdk-8u20-linux-x64.rpm

JDK is continually updated, so the need to install the latest version of the JDK Quguan your own network to obtain the latest installation package rpm address.

Configuring SSH public key authentication secret Free

CentOS comes with a default openssh-server, openssh-clients and rsync, if your system does not, then look for its own installation.

Create a common account

Create hadoop (custom name) account, the password is also set to hadoop unified on all machines

useradd -d / home / hadoop -s / usr / bin / bash -g wheel hadoop

passwd hadoop

SSH configuration

vi / etc / ssh / sshd_config

Find the following three configuration items, and change the following settings. If a comment, just remove the front # uncomment the configuration.

RSAAuthentication yes

PubkeyAuthentication yes

# The default is to check both .ssh / authorized_keys and .ssh / authorized_keys2

# But this is overridden so installations will only check .ssh / authorized_keys

AuthorizedKeysFile .ssh / authorized_keys

.ssh / authorized_keys is the public key storage path.

Public key generation

With hadoop account login.

cd ~

ssh-keygen -t rsa -P ''

Save the resulting ~ / .ssh / id_rsa.pub file to ~ / .ssh / authorized_keys

cp ~ / .ssh / id_rsa.pub ~ / .ssh / authorized_keys

.ssh Directory using scp command to copy to the other machine, lazy approach so that all the machines are the same keys, shared public key.

scp ~ / .ssh / * hadoop @ slave1: ~ / .ssh /

Taken to ensure that ~ / .ssh / id_rsa access must be 600 to prohibit access to other users.

Hadoop installation

Referring to official configuration documentation
- Zabbix monitors the status of TCP connections (Server)
- Configuration based on open source Lucene Java development environment (Server)
- Linux system font color change (Linux)
- Wi-Fi hackers use to attack your seven methods (Linux)
- Android Studio interface-related settings (Linux)
- Using Libreoffice under ubuntu (Linux)
- Use pg_basebackup build PostgreSQL streaming replication environment (Database)
- Mac OS X 10.9 compiler OCI8 module (Programming)
- Use CutyCapt to convert HTML pages to png images on Linux (Linux)
- Linux program analysis tool: ldd and nm (Linux)
- To setup Cocos2dx project under Ubuntu (Linux)
- Ubuntu 15.04 installation Powercommands 2.0 (Linux)
- AngularJS achieve picture upload feature (Programming)
- Java rewrite equals method (Programming)
- Ubuntu installed racing game Speed Dreams 2.1 (Linux)
- Puppet 3.x installed on Debian 7 (Server)
- Varnish configuration language VCL and its built-in variables (Server)
- To configure parameter configuration and software installation and uninstallation under Linux (Linux)
- What is the Docker (Linux)
- Linux port mapping system (routing and forwarding) (Server)
  CopyRight 2002-2022 newfreesoft.com, All Rights Reserved.