You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/11/21 20:05:31 UTC
[GitHub] [hudi] nikita-sheremet-clearscale opened a new issue #4062: [SUPPORT] How debug hyve sync?
nikita-sheremet-clearscale opened a new issue #4062:
URL: https://github.com/apache/hudi/issues/4062
**To Reproduce**
Steps to reproduce the behavior:
1. read parquet files from s3 prefix
2. write parquet files to s3 prefix with enable-hive-sync option
**Expected behavior**
Table created in hive catalog
**Actual behavior**
Everything works but table was not created in hive (glue) glue catalog
**Environment Description**
* Hudi version : 0.9.0
* Spark version : 2.4.4
* Storage (HDFS/S3/GCS..) : s3
* Running on Docker? (yes/no) : no
**Additional context**
The kye problem that there are no error or debug logs about hive syncing. Is there a way to turn them on to see some info why table is not created?
Thank you in advance!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nikita-sheremet-clearscale closed issue #4062: [SUPPORT] How debug hive sync?
Posted by GitBox <gi...@apache.org>.
nikita-sheremet-clearscale closed issue #4062:
URL: https://github.com/apache/hudi/issues/4062
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nikita-sheremet-clearscale commented on issue #4062: [SUPPORT] How debug hive sync?
Posted by GitBox <gi...@apache.org>.
nikita-sheremet-clearscale commented on issue #4062:
URL: https://github.com/apache/hudi/issues/4062#issuecomment-991112752
@xushiyan
Many thanks for reply!
It turned out that logs appeared in intecase log not in step logs in EMR. E.g. to see logstatement you have to open EC2 isntaces list on EMR and check their logs instead of submitted application.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on issue #4062: [SUPPORT] How debug hive sync?
Posted by GitBox <gi...@apache.org>.
xushiyan commented on issue #4062:
URL: https://github.com/apache/hudi/issues/4062#issuecomment-981145793
@nikita-sheremet-clearscale can you show the exact configs you used and the environment? assume you're using deltastreamer, so can you show all the args too?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nikita-sheremet-clearscale commented on issue #4062: [SUPPORT] How debug hive sync?
Posted by GitBox <gi...@apache.org>.
nikita-sheremet-clearscale commented on issue #4062:
URL: https://github.com/apache/hudi/issues/4062#issuecomment-975185576
There are log statements in hudi sources like: `Starting commit :` but it does not appear in logs. Is there a way to turn it on?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org