You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/17 01:27:08 UTC
[GitHub] [hudi] peanut-chenzhong opened a new issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
peanut-chenzhong opened a new issue #2955:
URL: https://github.com/apache/hudi/issues/2955
**Describe the problem you faced**
When using hudi-cli.sh to manage hudi table, once we run the temp_* command, there won`t be any response print out for any other command.
**To Reproduce**
Steps to reproduce the behavior:
1.Run hudi-cli.sh.
2.Execute command： temp_query --sql 'show tables'.
3.Excute command：help.
4.The result won`t print out.
**Expected behavior**
The other commands` result won`t be compacted by temp command and print out normal as before.
**Environment Description**
* Hudi version : from 0.7 to 0.8
* Spark version : from 2.4.5 to 3.1.1
* Hive version : 3.1.0
* Hadoop version : 3.1.1
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no) :no
**Additional context**
List some info we found so far as below:
The issue behavior
This mainly caused by the log level is hard code to ERROR in SparkTempViewProvider.java
After we delete the hard code level the result can print our but there`s still some issue like below:
Sames after run temp command, the logHandler changed from JLineLogHandler to SLF4JBridgeHandler and we don`t know how to rollback.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-843079769
BTW， how can I change this label to awaiting-community-help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-859318504
@peanut-chenzhong If you are interested in contributing this PR, please pick up the JIRA, closing this issue due to inactivity
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-855200596
@peanut-chenzhong I've filed the JIRA here -> https://issues.apache.org/jira/browse/HUDI-1977 Do you mind creating a PR ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-841920232
@n3nash could you kindly review this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash closed issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash closed issue #2955:
URL: https://github.com/apache/hudi/issues/2955
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-851719277
@peanut-chenzhong Please read the contribution guide here -> https://hudi.apache.org/contributing to help create the PR to the master branch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-842814952
@n3nash Thanks for reply. There`s hard code log level 'ERROR' in SparkTempViewProvider so that the Info log result can`t be print.
If we remove the hard code log level, it can return "Query ran successfully!", but will be coverd by SLf4g format like below:
Because after run temp command, the log handler changed from JLineLogHandler to SLF4JBridgeHandler, this will impact some other command`s print result such as commit-rollback like I presented above yesterday.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash edited a comment on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash edited a comment on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-848104530
@peanut-chenzhong Can you please send a PR to the master branch for us to review ? Please create a corresponding JIRA issue for this as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-842000672
@peanut-chenzhong Yes, you are right. I am able to reproduce this issue. Do you mind taking a look at how to resolve this ? Good starting point is to check why "Query ran successfully!" is not returned at the end of `show tables` query. Let me know if you're unable to resolve it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-845794327
@n3nash Dear community supporter, we have fixed this issue in our local branch, how could we submit this enhance to master branch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-842000672
@peanut-chenzhong Yes, you are right. I am able to reproduce this issue. Do you mind taking a look at how to resolve this ? Good starting point is to check why "Query ran successfully!" is not returned at the end of `show tables` query. Let me know if you're unable to resolve it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-848104530
@peanut-chenzhong Can you please send a PR to the master branch for us to review ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong removed a comment on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong removed a comment on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-843079769
BTW， how can I change this label to awaiting-community-help?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] peanut-chenzhong commented on issue #2955: [SUPPORT]Log system conflict in Hudi-Cli after run temp_* command
Posted by GitBox <gi...@apache.org>.
peanut-chenzhong commented on issue #2955:
URL: https://github.com/apache/hudi/issues/2955#issuecomment-841920232
@n3nash could you kindly review this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org