You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "LegendOfGod (via GitHub)" <gi...@apache.org> on 2023/03/31 01:47:22 UTC
[GitHub] [hudi] LegendOfGod opened a new issue, #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
LegendOfGod opened a new issue, #8330:
URL: https://github.com/apache/hudi/issues/8330
**Describe the problem you faced**
I am using flinkcdc to sync data and HMS sync to hive as the same time;
When query RT table using sparksql,the result returns as expected;
When query RT table using hive,the result return less。and ro and rt table return same records.it seems cannot read log files and merge results;
**To Reproduce**
Steps to reproduce the behavior:
1.need sync hive mor table
2.using sparksql query
3.using hive query
**Expected behavior**
1.query RT table using hive can returan correct result
**Environment Description**
* Hudi version : 0.9.0
* Spark version :3.1.1
* Hive version :3.1.0
* Hadoop version :3.1.1
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no) :no
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] lqbFFF commented on issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "lqbFFF (via GitHub)" <gi...@apache.org>.
lqbFFF commented on issue #8330:
URL: https://github.com/apache/hudi/issues/8330#issuecomment-1493788593
> This is a known issue, take this doc for reference: https://www.yuque.com/yuzhao-my9fz/kb/kgv2rb?#%20%E3%80%8AHive%20On%20Hudi%E3%80%8B
I am using huawei mrs.I have feedbacked this question to their technician.They have comfirmed this question exists really and will try to fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] lqbFFF closed issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "lqbFFF (via GitHub)" <gi...@apache.org>.
lqbFFF closed issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
URL: https://github.com/apache/hudi/issues/8330
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LegendOfGod commented on issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "LegendOfGod (via GitHub)" <gi...@apache.org>.
LegendOfGod commented on issue #8330:
URL: https://github.com/apache/hudi/issues/8330#issuecomment-1491181177
sparksql-ro:10800 records
sparksql-rt:10900 records
hive-ro:10800 records
hive-rt:10800 records
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] lqbFFF commented on issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "lqbFFF (via GitHub)" <gi...@apache.org>.
lqbFFF commented on issue #8330:
URL: https://github.com/apache/hudi/issues/8330#issuecomment-1491348469
> This is a known issue, take this doc for reference: https://www.yuque.com/yuzhao-my9fz/kb/kgv2rb?#%20%E3%80%8AHive%20On%20Hudi%E3%80%8B
thanks。I will check doc steps and try again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8330:
URL: https://github.com/apache/hudi/issues/8330#issuecomment-1491249704
This is a known issue, take this doc for reference: https://www.yuque.com/yuzhao-my9fz/kb/kgv2rb?#%20%E3%80%8AHive%20On%20Hudi%E3%80%8B
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] LegendOfGod commented on issue #8330: [SUPPORT]RT tables records not same when using hive query and sparksql query
Posted by "LegendOfGod (via GitHub)" <gi...@apache.org>.
LegendOfGod commented on issue #8330:
URL: https://github.com/apache/hudi/issues/8330#issuecomment-1491185921
rt max( _hoodie_commit_time):
sparksql: 20230330160404
hive:20230330160403
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org