[GitHub] [orc] dongjoon-hyun commented on pull request #848: ORC-934: Add integration tests for Java bench

[GitBox <gi...@apache.org>]

dongjoon-hyun commented on pull request #848:
URL: https://github.com/apache/orc/pull/848#issuecomment-896485275


   Oh, interesting. Your PR reveals that our benchmark fails at Java 16+. This is really an invaluable test coverage!
   ```
   [WARN ] Problem opening checksum file: data/generated/sales/json.snappy.  Ignoring exception: 
   java.io.EOFException
   	at java.base/java.io.DataInputStream.readFully(DataInputStream.java:203)
   	at java.base/java.io.DataInputStream.readFully(DataInputStream.java:172)
   	at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:151)
   	at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346)
   	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
   	at org.apache.orc.bench.core.convert.json.JsonReader.<init>(JsonReader.java:59)
   	at org.apache.orc.bench.core.convert.GenerateVariants.createFileReader(GenerateVariants.java:90)
   	at org.apache.orc.bench.core.convert.ScanVariants.run(ScanVariants.java:88)
   	at org.apache.orc.bench.core.Driver.main(Driver.java:64)
   Error: Exception in thread "main" com.google.gson.JsonIOException: java.io.EOFException: End of input at line 1 column 1
   	at com.google.gson.JsonStreamParser.hasNext(JsonStreamParser.java:109)
   	at org.apache.orc.bench.core.convert.json.JsonReader.nextBatch(JsonReader.java:76)
   	at org.apache.orc.bench.core.convert.ScanVariants.run(ScanVariants.java:92)
   	at org.apache.orc.bench.core.Driver.main(Driver.java:64)
   Caused by: java.io.EOFException: End of input at line 1 column 1
   	at com.google.gson.stream.JsonReader.nextNonWhitespace(JsonReader.java:1377)
   	at com.google.gson.stream.JsonReader.consumeNonExecutePrefix(JsonReader.java:1514)
   	at com.google.gson.stream.JsonReader.doPeek(JsonReader.java:523)
   	at com.google.gson.stream.JsonReader.peek(JsonReader.java:414)
   	at com.google.gson.JsonStreamParser.hasNext(JsonStreamParser.java:105)
   	... 3 more
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@orc.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org