问题描述
- DataXceiver error processing unknown operation
- hadoop集群启动节点DataNode、NodeManager都可以正常启动，但查看日志
2015-12-01 16:31:09216 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Got finalize command for block pool BP-2032151256-192.168.18.139-1448951568590
2015-12-01 16:31:09222 INFO org.apache.hadoop.util.GSet: Computing capacity for map BlockMap
2015-12-01 16:31:09222 INFO org.apache.hadoop.util.GSet: VM type = 64-bit
2015-12-01 16:31:09223 INFO org.apache.hadoop.util.GSet: 0.5% max memory 889 MB = 4.4 MB
2015-12-01 16:31:09223 INFO org.apache.hadoop.util.GSet: capacity = 2^19 = 524288 entries
2015-12-01 16:31:09224 INFO org.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner: Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-2032151256-192.168.18.139-1448951568590
2015-12-01 16:31:09231 INFO org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Added bpid=BP-2032151256-192.168.18.139-1448951568590 to blockPoolScannerMap new size=1
2015-12-01 16:31:34169 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: data2:50010:DataXceiver error processing unknown operation src: /127.0.0.1:36068 dst: /127.0.0.1:50010
java.io.EOFException
at java.io.DataInputStream.readShort(DataInputStream.java:315)
at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:212)
at java.lang.Thread.run(Thread.java:744)
2015-12-01 16:32:34195 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: data2:50010:DataXceiver error processing unknown operation src: /127.0.0.1:36093 dst: /127.0.0.1:50010
java.io.EOFException
at java.io.DataInputStream.readShort(DataInputStream.java:315)
at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:212)
at java.lang.Thread.run(Thread.java:744)
4个节点有3个节点都报这个错，其中1个节点不报。请问各位这是什么原因？
解决方案
参见：https://issues.apache.org/jira/browse/HDFS-8738