You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@orc.apache.org by do...@apache.org on 2021/08/08 04:07:22 UTC
[orc] branch branch-1.7 updated: ORC-919: Spark bench objenesis
should be the same as Spark (#830)
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-1.7
in repository https://gitbox.apache.org/repos/asf/orc.git
The following commit(s) were added to refs/heads/branch-1.7 by this push:
new 8e189d8 ORC-919: Spark bench objenesis should be the same as Spark (#830)
8e189d8 is described below
commit 8e189d85a3f1fad03dab8806409ec07a994da14b
Author: William Hyun <wi...@apache.org>
AuthorDate: Sat Aug 7 21:06:28 2021 -0700
ORC-919: Spark bench objenesis should be the same as Spark (#830)
### What changes were proposed in this pull request?
This PR aims to use the same objenesis version as Spark in Spark benchmark.
### Why are the changes needed?
To fix the class not defined error seen below
```
java.lang.NoClassDefFoundError: org/objenesis/strategy/InstantiatorStrategy
at org.apache.orc.mapred.OrcInputFormat.setSearchArgument(OrcInputFormat.java:97)
at org.apache.orc.mapreduce.OrcInputFormat.setSearchArgument(OrcInputFormat.java:57)
at org.apache.spark.sql.execution.datasources.orc.OrcFileFormat.$anonfun$buildReaderWithPartitionValues$5(OrcFileFormat.scala:190)
```
### How was this patch tested?
Manual.
```
java -jar spark/target/orc-benchmarks-spark-1.8.0-SNAPSHOT.jar spark data -d sales -c snappy -f orc
```
(cherry picked from commit a5b1181609ec0e1508b7d9afea6166c1c73637ff)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
java/bench/spark/pom.xml | 7 +++++++
1 file changed, 7 insertions(+)
diff --git a/java/bench/spark/pom.xml b/java/bench/spark/pom.xml
index 4ab651e..bf08862 100644
--- a/java/bench/spark/pom.xml
+++ b/java/bench/spark/pom.xml
@@ -141,6 +141,13 @@
<artifactId>jackson-annotations</artifactId>
<version>${spark.jackson.version}</version>
</dependency>
+ <!-- This should be the same with Spark's dependency. -->
+ <dependency>
+ <groupId>org.objenesis</groupId>
+ <artifactId>objenesis</artifactId>
+ <version>2.6</version>
+ <scope>compile</scope>
+ </dependency>
</dependencies>
<build>