You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/08/17 09:37:19 UTC
[GitHub] [spark] wangyum commented on pull request #26533: [WIP][test-java11] Test Hadoop 2.7 with JDK 11
wangyum commented on pull request #26533:
URL: https://github.com/apache/spark/pull/26533#issuecomment-674774580
Another issue:
```
[b_carmel@carmeldevour002-715563 spark-3.0.0-bin]$ bin/spark-sql
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/b_carmel/yumwang/spark-3.1.0-SNAPSHOT-bin-benchmark-bloomfilter/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/apache/releases/hadoop-2.7.3.2.6.4-ebay.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/b_carmel/yumwang/spark-3.1.0-SNAPSHOT-bin-benchmark-bloomfilter/jars/spark-unsafe_2.12-3.1.0-SNAPSHOT.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Exception in thread "DataStreamer for file /tmp/hive-b_carmel/b_carmel/ff396890-3a46-4f2e-a93b-91de0eeefe0b/inuse.info" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'
at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41)
at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679)
at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315)
at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680)
Exception in thread "DataStreamer for file /user/b_carmel/.sparkStaging/application_1595573410068_7264/__spark_libs__7269177261298078316.zip" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'
at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41)
at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679)
at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315)
at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680)
Exception in thread "DataStreamer for file /user/b_carmel/.sparkStaging/application_1595573410068_7264/__spark_conf__.zip" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'
at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41)
at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679)
at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315)
at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680)
Spark master: yarn, Application Id: application_1595573410068_7264
```
More details: https://issues.apache.org/jira/browse/HADOOP-12760
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org