[GitHub] [incubator-hudi] wannaberich opened a new issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric;

[GitBox <gi...@apache.org>]

wannaberich opened a new issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric;
URL: https://github.com/apache/incubator-hudi/issues/877
 
 
   Hello everyone. 
   I'm trying to integrate apache hudi in our HDP 3.1.
   What I did:
   1) Downloaded **Release 0.4.7** zip
   2) Run **mvn clean install -DskipTests -DskipITs**
   3) Move all bundle jars from **incubator-hudi-hoodie-0.4.7/packaging** folder to my spark2-client/jars (spark, hive, hadoop-mr)
   4) Setup my zeppelin, added new interpreter and added spark.jars with directories to all these bundles.
   5) Try to run simple write job.
   6) Got this exception:
   
   ```
   java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric;
   	at org.apache.spark.network.util.NettyMemoryMetrics.registerMetrics(NettyMemoryMetrics.java:80)
   	at org.apache.spark.network.util.NettyMemoryMetrics.<init>(NettyMemoryMetrics.java:76)
   	at org.apache.spark.network.client.TransportClientFactory.<init>(TransportClientFactory.java:109)
   	at org.apache.spark.network.TransportContext.createClientFactory(TransportContext.java:99)
   	at org.apache.spark.rpc.netty.NettyRpcEnv.<init>(NettyRpcEnv.scala:71)
   	at org.apache.spark.rpc.netty.NettyRpcEnvFactory.create(NettyRpcEnv.scala:461)
   	at org.apache.spark.rpc.RpcEnv$.create(RpcEnv.scala:57)
   	at org.apache.spark.SparkEnv$.create(SparkEnv.scala:250)
   	at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:176)
   	at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:256)
   	at org.apache.spark.SparkContext.<init>(SparkContext.scala:423)
   	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2493)
   	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:934)
   	at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:925)
   	at scala.Option.getOrElse(Option.scala:121)
   	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:925)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.spark2CreateContext(BaseSparkScalaInterpreter.scala:233)
   	at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.createSparkContext(BaseSparkScalaInterpreter.scala:165)
   	at org.apache.zeppelin.spark.SparkScala211Interpreter.open(SparkScala211Interpreter.scala:87)
   	at org.apache.zeppelin.spark.NewSparkInterpreter.open(NewSparkInterpreter.java:102)
   	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:62)
   	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
   	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
   	at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
   	at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140)
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
   	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services