You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Rahil Chertara (Jira)" <ji...@apache.org> on 2023/01/24 22:05:00 UTC
[jira] [Created] (HUDI-5610) Hudi cli bundle Spark 3.2.0 startup issue.
Rahil Chertara created HUDI-5610:
------------------------------------
Summary: Hudi cli bundle Spark 3.2.0 startup issue.
Key: HUDI-5610
URL: https://issues.apache.org/jira/browse/HUDI-5610
Project: Apache Hudi
Issue Type: Task
Reporter: Rahil Chertara
It seems that the hudi cli bundle is not able to start up for spark 3.2.0, compared to spark 3.3.1. And will silently exit current like so
```
IR is /Users/ethan/Work/repo/hudi/packaging/hudi-cli-bundle
Client jar location not set, please set it in conf/hudi-env.sh
Running : java -cp /Users/ethan/Work/repo/hudi/packaging/hudi-cli-bundle/auxlib/*:/Users/ethan/Work/lib/spark-3.2.2-bin-hadoop3.2/*:/Users/ethan/Work/lib/spark-3.2.2-bin-hadoop3.2/jars/*:/Users/ethan/Work/repo/hudi/packaging/hudi-cli-bundle/conf:/etc/hadoop/conf:/etc/spark/conf:/Users/ethan/Work/repo/hudi/packaging/hudi-cli-bundle/target/hudi-cli-bundle_2.12-0.13.0-SNAPSHOT.jar:/Users/ethan/Work/repo/hudi/packaging/hudi-cli-bundle/../hudi-spark-bundle/target/hudi-spark3.3-bundle_2.12-0.13.0-SNAPSHOT.jar: -DSPARK_CONF_DIR=/etc/spark/conf -DHADOOP_CONF_DIR=/etc/hadoop/conf org.apache.hudi.cli.Main
Main called
log4j:WARN No appenders could be found for logger (org.jboss.logging).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
===================================================================
* ___ ___ *
* /\__\ ___ /\ \ ___ *
* / / / /\__\ / \ \ /\ \ *
* / /__/ / / / / /\ \ \ \ \ \ *
* / \ \ ___ / / / / / \ \__\ / \__\ *
* / /\ \ /\__\ / /__/ ___ / /__/ \ |__| / /\/__/ *
* \/ \ \/ / / \ \ \ /\__\ \ \ \ / / / /\/ / / *
* \ / / \ \ / / / \ \ / / / \ /__/ *
* / / / \ \/ / / \ \/ / / \ \__\ *
* / / / \ / / \ / / \/__/ *
* \/__/ \/__/ \/__/ Apache Hudi CLI *
* *
===================================================================
ethan@Ethans-MacBook-Pro ~/W/r/h/p/hudi-cli-bundle (cli-bundle-fix) [1]>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)