You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "alberttwong (via GitHub)" <gi...@apache.org> on 2024/09/06 21:49:28 UTC
[I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
alberttwong opened a new issue, #11910:
URL: https://github.com/apache/hudi/issues/11910
Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again. It's up to number 6 now.
**To Reproduce**
Steps to reproduce the behavior:
```
root@spark:/opt/hudicli# /opt/hudi/packaging/hudi-cli-bundle/hudi-cli-with-bundle.sh
DIR is /opt/hudi/packaging/hudi-cli-bundle
CLI_BUNDLE_JAR: /opt/hudicli/hudi-cli-bundle_2.12-0.15.0.jar
SPARK_BUNDLE_JAR: /opt/hudicli/hudi-spark3.4-bundle_2.12-0.15.0.jar
Downloading necessary auxiliary jars for Hudi CLI
--2024-09-06 21:47:52-- https://repo1.maven.org/maven2/org/glassfish/jakarta.el/3.0.3/jakarta.el-3.0.3.jar
Resolving repo1.maven.org (repo1.maven.org)... 199.232.196.209, 199.232.192.209, 2a04:4e42:4c::209, ...
Connecting to repo1.maven.org (repo1.maven.org)|199.232.196.209|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 237826 (232K) [application/java-archive]
Saving to: ‘auxlib/jakarta.el-3.0.3.jar.6’
jakarta.el-3.0.3.jar.6 100%[========================================================================================================================>] 232.25K --.-KB/s in 0.03s
2024-09-06 21:47:52 (7.04 MB/s) - ‘auxlib/jakarta.el-3.0.3.jar.6’ saved [237826/237826]
--2024-09-06 21:47:52-- https://repo1.maven.org/maven2/jakarta/el/jakarta.el-api/3.0.3/jakarta.el-api-3.0.3.jar
Resolving repo1.maven.org (repo1.maven.org)... 199.232.196.209, 199.232.192.209, 2a04:4e42:4c::209, ...
Connecting to repo1.maven.org (repo1.maven.org)|199.232.196.209|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 79816 (78K) [application/java-archive]
Saving to: ‘auxlib/jakarta.el-api-3.0.3.jar.6’
jakarta.el-api-3.0.3.jar.6 100%[========================================================================================================================>] 77.95K --.-KB/s in 0.04s
2024-09-06 21:47:53 (1.82 MB/s) - ‘auxlib/jakarta.el-api-3.0.3.jar.6’ saved [79816/79816]
Running : java -cp /opt/hudi/packaging/hudi-cli-bundle/conf:/opt/hudi/packaging/hudi-cli-bundle/auxlib/*:/spark/*:/spark/jars/*:/etc/hadoop/conf:/etc/spark/conf:/opt/hudicli/hudi-cli-bundle_2.12-0.15.0.jar:/opt/hudicli/hudi-spark3.4-bundle_2.12-0.15.0.jar:/opt/hudicli/hadoop-aws-2.10.2.jar:/opt/hudicli/aws-java-sdk-bundle-1.11.271.jar -DSPARK_CONF_DIR=/etc/spark/conf -DHADOOP_CONF_DIR=/etc/hadoop/conf org.apache.hudi.cli.Main
Main called
===================================================================
* ___ ___ *
* /\__\ ___ /\ \ ___ *
* / / / /\__\ / \ \ /\ \ *
* / /__/ / / / / /\ \ \ \ \ \ *
* / \ \ ___ / / / / / \ \__\ / \__\ *
* / /\ \ /\__\ / /__/ ___ / /__/ \ |__| / /\/__/ *
* \/ \ \/ / / \ \ \ /\__\ \ \ \ / / / /\/ / / *
* \ / / \ \ / / / \ \ / / / \ /__/ *
* / / / \ \/ / / \ \/ / / \ \__\ *
* / / / \ / / \ / / \/__/ *
* \/__/ \/__/ \/__/ Apache Hudi CLI *
* *
===================================================================
472 [main] INFO org.apache.hudi.cli.Main [] - Starting Main v0.15.0 using Java 1.8.0_422 on spark with PID 4138 (/opt/hudicli/hudi-cli-bundle_2.12-0.15.0.jar started by root in /opt/hudicli)
474 [main] INFO org.apache.hudi.cli.Main [] - No active profile set, falling back to 1 default profile: "default"
Table command getting loaded
Sep 06, 2024 9:47:54 PM org.jline.utils.Log logr
WARNING: The Parser of class org.springframework.shell.jline.ExtendedDefaultParser does not support the CompletingParsedLine interface. Completion with escaped or quoted words won't work correctly.
1127 [main] INFO org.apache.hudi.cli.Main [] - Started Main in 0.784 seconds (JVM running for 1.143)
```
**Expected behavior**
shouldn't happen.
**Environment Description**
* Hudi version :
* Spark version :
* Hive version :
* Hadoop version :
* Storage (HDFS/S3/GCS..) :
* Running on Docker? (yes/no) :
**Additional context**
Add any other context about the problem here.
**Stacktrace**
```Add the stacktrace of the error.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 closed issue #11910: [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again
URL: https://github.com/apache/hudi/issues/11910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "prabodh1194 (via GitHub)" <gi...@apache.org>.
prabodh1194 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2345214839
I had actually raised a PR for this sometime back, but couldn't follow through. Re-raising it now: https://github.com/apache/hudi/pull/11931
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2345384505
Fixed via #11931
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "prabodh1194 (via GitHub)" <gi...@apache.org>.
prabodh1194 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2345457969
@danny0405 will we push it to v0.15.x versions as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "prabodh1194 (via GitHub)" <gi...@apache.org>.
prabodh1194 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2347887775
do I need to create a PR for that?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2347845789
yeah, the 0.x-branch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [SUPPORT] Everytime you run hudi-cli-with-bundle.sh, it downloads jakarta over and over again [hudi]
Posted by "prabodh1194 (via GitHub)" <gi...@apache.org>.
prabodh1194 commented on issue #11910:
URL: https://github.com/apache/hudi/issues/11910#issuecomment-2347903972
@danny0405 please find the PR -- https://github.com/apache/hudi/pull/11940/files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org