You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@heron.apache.org by GitBox <gi...@apache.org> on 2020/03/09 11:24:57 UTC
[GitHub] [incubator-heron] dttlgotv opened a new issue #3482:
org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot
communicate with client version 3
dttlgotv opened a new issue #3482: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 3
URL: https://github.com/apache/incubator-heron/issues/3482
My simple hdfs codes is:
private String hdfsuri = "hdfs://localhost:9000";
FilesystemSink(String name) {
this.name = name;
}
/**
* The setup function is called before the sink is used. Any complex
* instantiation logic for the sink should go here.
*/
public void setup(Context context) {
// ====== Init HDFS File System Object
Configuration conf = new Configuration();
// Set FileSystem URI
conf.set("fs.defaultFS", hdfsuri);
// Because of Maven
conf.set("fs.hdfs.impl", org.apache.hadoop.hdfs.DistributedFileSystem.class.getName());
conf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());
// Set HADOOP user
System.setProperty("HADOOP_USER_NAME", "hdfs");
System.setProperty("hadoop.home.dir", "/");
//Get the filesystem - HDFS
try{
fs = FileSystem.get(URI.create(hdfsuri), conf);
}catch (Exception e){
e.printStackTrace();
}
}
I write a simple topology to use hdfs, but setup hdfs error is below like:
2020-03-09 19:07:45 +0800] [STDERR] stderr: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 3
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.ipc.Client.call(Client.java:740)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at com.sun.proxy.$Proxy0.getProtocolVersion(Unknown Source)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.examples.streamlet.KafkaHdfsTopology$FilesystemSink.setup(KafkaHdfsTopology.java:215)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.streamlet.impl.sinks.ComplexSink.prepare(ComplexSink.java:65)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.bolt.BoltInstance.init(BoltInstance.java:209)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave.startInstanceIfNeeded(Slave.java:243)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave.handleNewAssignment(Slave.java:194)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave.handleNewPhysicalPlan(Slave.java:384)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave.access$300(Slave.java:55)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave$1.run(Slave.java:124)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.common.basics.WakeableLooper.executeTasksOnWakeup(WakeableLooper.java:191)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.common.basics.WakeableLooper.runOnce(WakeableLooper.java:110)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.common.basics.WakeableLooper.loop(WakeableLooper.java:100)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at org.apache.heron.instance.Slave.run(Slave.java:201)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-03-09 19:07:45 +0800] [STDERR] stderr: at java.lang.Thread.run(Thread.java:748)
[2020-03-09 19:07:45 +0800] [信息] org.apache.heron.instance.Slave: Instance is started for non-stateful topology
[2020-03-09 19:07:49 +0800] [信息] org.apache.heron.common.network.HeronClient: Connecting to endpoint: /127.0.0.1:51352
[2020-03-09 19:07:49 +0800] [信息] org.apache.heron.network.MetricsManagerClient: Connected to Metrics Manager. Ready to send register request
[2020-03-09 19:07:49 +0800] [信息] org.apache.heron.network.MetricsManagerClient: We registered ourselves to the Metrics Manager
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services