You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@orc.apache.org by do...@apache.org on 2020/08/11 18:13:33 UTC

[orc] branch branch-1.6 updated: ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-1.6
in repository https://gitbox.apache.org/repos/asf/orc.git


The following commit(s) were added to refs/heads/branch-1.6 by this push:
     new 3c1ef25  ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
3c1ef25 is described below

commit 3c1ef256878685a483b29b1069bdcc867b30cf1c
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Tue Aug 11 11:10:55 2020 -0700

    ORC-658: Fix NoClassDefFoundError during benchmark data generation (#535)
    
    ### What changes were proposed in this pull request?
    
    This PR aims to add `hadoop-hdfs` dependency to `bench/core` module.
    
    ### Why are the changes needed?
    
    This will fix `NoClassDefFoundError` error during data generation.
    ```
    $ java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
    [WARN ] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/client/HdfsDataOutputStream$SyncFlag
    ```
    
    ### How was this patch tested?
    
    ```
    cd java/bench
    mvn package
    ./fetch-data.sh
    java -jar core/target/orc-benchmarks-core-*-uber.jar generate data
    ```
    
    (cherry picked from commit 84353fbfc447b06e0924024a8e03c1aaebd3e7a5)
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 java/bench/core/pom.xml | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/java/bench/core/pom.xml b/java/bench/core/pom.xml
index e1b0147..40794cd 100644
--- a/java/bench/core/pom.xml
+++ b/java/bench/core/pom.xml
@@ -71,6 +71,10 @@
       <artifactId>hadoop-common</artifactId>
     </dependency>
     <dependency>
+      <groupId>org.apache.hadoop</groupId>
+      <artifactId>hadoop-hdfs</artifactId>
+    </dependency>
+    <dependency>
       <groupId>org.apache.hive</groupId>
       <artifactId>hive-storage-api</artifactId>
     </dependency>