Home PC Games Linux Windows Database Network Programming Server Mobile  
           
  Home \ Server \ java.net.NoRouteToHostException of Hadoop problem: no route to host     - CentOS 7.0 Close firewall is enabled by default iptables firewall (Linux)

- CentOS 6 compiling httpd-2.4.10 (Server)

- Node.js installed on Ubuntu Upstream version (Linux)

- MySQL server after an unexpected power outage can not start (Database)

- The easiest 11g Active DataGuard (ADG) to establish the configuration process (Database)

- Java to create a table in the database SYBase (Database)

- Recent Consolidation Using Linux security module (Linux)

- Linux with Windows Explorer as a security system (Linux)

- C ++ virtual functions Classic Insights (Programming)

- Oracle Data Guard LOG_ARCHIVE_DEST_n optional attribute parameters (Database)

- RPM package creation Getting Started (Linux)

- Bash How to read a file line by line (Programming)

- Linux performance monitoring - CPU, Memory, IO, Network (Linux)

- MySQL backup tool to back up mydumper (Database)

- Linux environmental performance data acquisition system (Linux)

- CentOS7 install JAVA notes (Linux)

- Using the Android interface in Parcelable (Programming)

- Lambda expressions of evolution (Programming)

- Linux System Getting Started Learning: Using yum to download the RPM package without installing (Linux)

- Open source backup software installed on Ubuntu Systemback 1.6.201 (Linux)

 
         
  java.net.NoRouteToHostException of Hadoop problem: no route to host
     
  Add Date : 2018-11-21      
         
         
         
  Hadoop startup encounter the following problems:
2015-08-02 19: 43: 20,771 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
 / ************************************************* ***********
 STARTUP_MSG: Starting DataNode
 STARTUP_MSG: host = slave1 / 192.168.198.21
 STARTUP_MSG: args = []
 STARTUP_MSG: version = 1.2.1
 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 -r 1503152; compiled by 'mattf' on Mon Jul 22 15:23:09 PDT 2013
 STARTUP_MSG: java = 1.7.0_79
 ************************************************** ********** /
 2015-08-02 19: 43: 20,902 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
 2015-08-02 19: 43: 20,910 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem, sub = Stats registered.
 2015-08-02 19: 43: 20,911 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second (s).
 2015-08-02 19: 43: 20,911 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started
 2015-08-02 19: 43: 21,033 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
 2015-08-02 19: 43: 21,036 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists!
 2015-08-02 19: 43: 30,237 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master / 192.168.198.20: 9000 Already tried 8 time (s); retry policy is RetryUpToMaximumCountWithFixedSleep (maxRetries = 10. , sleepTime = 1 SECONDS)
 2015-08-02 19: 43: 31,239 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master / 192.168.198.20:. 9000 Already tried 9 time (s); retry policy is RetryUpToMaximumCountWithFixedSleep (maxRetries = 10 , sleepTime = 1 SECONDS)
 2015-08-02 19: 43: 31,247 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Call to master / 192.168.198.20: 9000 failed on local exception: java.net.NoRouteToHostException : no route to host
at org.apache.hadoop.ipc.Client.wrapException (Client.java:1150)
at org.apache.hadoop.ipc.Client.call (Client.java:1118)
at org.apache.hadoop.ipc.RPC $ Invoker.invoke (RPC.java:229)
at com.sun.proxy. $ Proxy3.getProtocolVersion (Unknown Source)
at org.apache.hadoop.ipc.RPC.checkVersion (RPC.java:422)
at org.apache.hadoop.ipc.RPC.getProxy (RPC.java:414)
at org.apache.hadoop.ipc.RPC.getProxy (RPC.java:392)
at org.apache.hadoop.ipc.RPC.getProxy (RPC.java:374)
at org.apache.hadoop.ipc.RPC.getProxy (RPC.java:453)
at org.apache.hadoop.ipc.RPC.waitForProxy (RPC.java:335)
at org.apache.hadoop.ipc.RPC.waitForProxy (RPC.java:300)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode (DataNode.java:385)
at org.apache.hadoop.hdfs.server.datanode.DataNode. < init> (DataNode.java:321)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance (DataNode.java:1712)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode (DataNode.java:1651)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode (DataNode.java:1669)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain (DataNode.java:1795)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main (DataNode.java:1812)
 Caused by: java.net.NoRouteToHostException: no route to host

at sun.nio.ch.SocketChannelImpl.checkConnect (Native Method)

 


analysis:

This problem no route to host commonplace, either generally between namenode and datanode hostname itself on mutual ping ping nowhere, this probability is small, because all know that to ensure that the master and slaves nodes are able to communicate properly, it will be checked. It is most likely that a firewall is not closed, or because not view the status of the firewall, the firewall turned off so mistaken.


 solution:
(1) host name from the namenode host ping other slaves nodes (note the host name of the slaves nodes), If the ping fails, possibly because namenode node / etc / hosts not mapping between host name and IP address configuration, completion mappings between host names and IP addresses.


(2) from the host name datanode host ping master node (host name of note is the node), If the ping fails, possibly because datenode node / etc / hosts is not configured mappings between host names and IP addresses, to complete a hostname mapping between IP addresses.


(3) Check each machine node firewall is turned off (or set the firewall on, but for us the designated port open, best to turn off the firewall):

The following status for different versions of Linux firewall system checks, and turn off the firewall:

-------------------------------------------------- -------------

Ubuntu (ubuntu-12.04-desktop-amd64)

Check the status of firewall: ufw status

Turn off the firewall: ufw disable

-------------------------------------------------- -------------

CentOS6.0

Check firewall status: service iptables status

Turn off the firewall: chkconfig iptables off # boot does not start the firewall service

-------------------------------------------------- ------------

centos7.0 (default is to use the firewall as a firewall, if it does not change the iptables firewall, use the following command to view and turn off the firewall)


Check firewall status: firewall-cmd --state

Turn off the firewall: systemctl stop firewalld.service
     
         
         
         
  More:      
 
- Two network security scanning tools under ubuntu (Linux)
- Linux installation and configuration curl command tool (Linux)
- Configuring xdebug debugging environment in Ubuntu 14.04 under the PhpStorm (Linux)
- Linux environmental performance data acquisition system (Linux)
- To create someone else can not afford to delete the administrator user (Linux)
- To install file manager Nautilus 3.12.2 under ubuntu (Linux)
- Archlinux installation tutorial (Linux)
- How to view information about the installed version of CentOS (Linux)
- Python 3 for instructions encoded string conversion (Programming)
- Grub2 Boots the openSUSE installation image (Linux)
- Linux kernel netpoll framework netconsole (Linux)
- Linux systems for entry-learning - Install Go language in Linux (Linux)
- Xshell key authentication mechanism using a remote login Linux (Linux)
- Setup Qt development environment under Linux (Linux)
- Installation and deployment of MariaDB under CentOS (Database)
- Writing Better Bash build script 8 (Programming)
- Redhat 5 prohibit IPv6 (Linux)
- Spring AOP (Programming)
- Windows 8.1 hard drive to install Ubuntu 14.04 dual system reference tutorials and multi-drive Precautions (Linux)
- There are more than one server, there is reason to try cloud operating system (Server)
     
           
     
  CopyRight 2002-2020 newfreesoft.com, All Rights Reserved.