You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@orc.apache.org by do...@apache.org on 2020/08/11 18:11:05 UTC
[orc] branch master updated: ORC-658: Fix NoClassDefFoundError
during benchmark data generation (#535)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/orc.git
The following commit(s) were added to refs/heads/master by this push:
new 84353fb ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
84353fb is described below
commit 84353fbfc447b06e0924024a8e03c1aaebd3e7a5
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Tue Aug 11 11:10:55 2020 -0700
ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
### What changes were proposed in this pull request?
This PR aims to add `hadoop-hdfs` dependency to `bench/core` module.
### Why are the changes needed?
This will fix `NoClassDefFoundError` error during data generation.
```
$ java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
[WARN ] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/client/HdfsDataOutputStream$SyncFlag
```
### How was this patch tested?
```
cd java/bench
mvn package
./fetch-data.sh
java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
```
---
java/bench/core/pom.xml | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/java/bench/core/pom.xml b/java/bench/core/pom.xml
index 136e2ae..15d9a4d 100644
--- a/java/bench/core/pom.xml
+++ b/java/bench/core/pom.xml
@@ -71,6 +71,10 @@
<artifactId>hadoop-common</artifactId>
</dependency>
<dependency>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-hdfs</artifactId>
+ </dependency>
+ <dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-storage-api</artifactId>
</dependency>