You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@orc.apache.org by do...@apache.org on 2020/08/11 18:13:33 UTC
[orc] branch branch-1.6 updated: ORC-658: Fix NoClassDefFoundError
during benchmark data generation (#535)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-1.6
in repository https://gitbox.apache.org/repos/asf/orc.git
The following commit(s) were added to refs/heads/branch-1.6 by this push:
new 3c1ef25 ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
3c1ef25 is described below
commit 3c1ef256878685a483b29b1069bdcc867b30cf1c
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Tue Aug 11 11:10:55 2020 -0700
ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
### What changes were proposed in this pull request?
This PR aims to add `hadoop-hdfs` dependency to `bench/core` module.
### Why are the changes needed?
This will fix `NoClassDefFoundError` error during data generation.
```
$ java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
[WARN ] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/client/HdfsDataOutputStream$SyncFlag
```
### How was this patch tested?
```
cd java/bench
mvn package
./fetch-data.sh
java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
```
(cherry picked from commit 84353fbfc447b06e0924024a8e03c1aaebd3e7a5)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
java/bench/core/pom.xml | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/java/bench/core/pom.xml b/java/bench/core/pom.xml
index e1b0147..40794cd 100644
--- a/java/bench/core/pom.xml
+++ b/java/bench/core/pom.xml
@@ -71,6 +71,10 @@
<artifactId>hadoop-common</artifactId>
</dependency>
<dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-hdfs</artifactId>
+ </dependency>
+ <dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-storage-api</artifactId>
</dependency>