You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@heron.apache.org by GitBox <gi...@apache.org> on 2020/03/09 11:24:57 UTC

[GitHub] [incubator-heron] dttlgotv opened a new issue #3482: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 3

dttlgotv opened a new issue #3482: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 3  
URL: https://github.com/apache/incubator-heron/issues/3482
 
 
   My simple hdfs codes is:
   private String hdfsuri = "hdfs://localhost:9000";
       FilesystemSink(String name) {
         this.name = name;
       }
   
       /**
        * The setup function is called before the sink is used. Any complex
        * instantiation logic for the sink should go here.
        */
       public void setup(Context context) {
           // ====== Init HDFS File System Object
           Configuration conf = new Configuration();
     // Set FileSystem URI
           conf.set("fs.defaultFS", hdfsuri);
     // Because of Maven
           conf.set("fs.hdfs.impl", org.apache.hadoop.hdfs.DistributedFileSystem.class.getName());
           conf.set("fs.file.impl", org.apache.hadoop.fs.LocalFileSystem.class.getName());
     // Set HADOOP user
           System.setProperty("HADOOP_USER_NAME", "hdfs");
           System.setProperty("hadoop.home.dir", "/");
     //Get the filesystem - HDFS
           try{
             fs = FileSystem.get(URI.create(hdfsuri), conf);
           }catch (Exception e){
             e.printStackTrace();
           }
         }
   
   
   I write a simple topology to use hdfs, but setup hdfs error is below like:
   2020-03-09 19:07:45 +0800] [STDERR] stderr: org.apache.hadoop.ipc.RemoteException: Server IPC version 9 cannot communicate with client version 3  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.ipc.Client.call(Client.java:740)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at com.sun.proxy.$Proxy0.getProtocolVersion(Unknown Source)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:106)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:207)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:170)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.examples.streamlet.KafkaHdfsTopology$FilesystemSink.setup(KafkaHdfsTopology.java:215)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.streamlet.impl.sinks.ComplexSink.prepare(ComplexSink.java:65)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.bolt.BoltInstance.init(BoltInstance.java:209)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave.startInstanceIfNeeded(Slave.java:243)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave.handleNewAssignment(Slave.java:194)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave.handleNewPhysicalPlan(Slave.java:384)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave.access$300(Slave.java:55)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave$1.run(Slave.java:124)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.common.basics.WakeableLooper.executeTasksOnWakeup(WakeableLooper.java:191)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.common.basics.WakeableLooper.runOnce(WakeableLooper.java:110)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.common.basics.WakeableLooper.loop(WakeableLooper.java:100)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at org.apache.heron.instance.Slave.run(Slave.java:201)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  
   [2020-03-09 19:07:45 +0800] [STDERR] stderr: 	at java.lang.Thread.run(Thread.java:748)  
   [2020-03-09 19:07:45 +0800] [信息] org.apache.heron.instance.Slave: Instance is started for non-stateful topology  
   [2020-03-09 19:07:49 +0800] [信息] org.apache.heron.common.network.HeronClient: Connecting to endpoint: /127.0.0.1:51352  
   [2020-03-09 19:07:49 +0800] [信息] org.apache.heron.network.MetricsManagerClient: Connected to Metrics Manager. Ready to send register request  
   [2020-03-09 19:07:49 +0800] [信息] org.apache.heron.network.MetricsManagerClient: We registered ourselves to the Metrics Manager  
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services