You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/01/04 06:34:11 UTC
[GitHub] [hudi] codope commented on issue #4154: [SUPPORT] INSERT OVERWRITE operation does not work when using Spark SQL
codope commented on issue #4154:
URL: https://github.com/apache/hudi/issues/4154#issuecomment-1004559852
@BenjMaq How did you sync to hive? My hunch is something went wrong while hive syncing. Using latest master and the script that @YannByron shared, I ran hive sync and could see the latest data from both hive and presto.
Gist: https://gist.github.com/codope/d42a6fb85ef081b3bcd94d4897a4481d
Hoodie Timeline:
```
root@adhoc-1:/opt# hadoop fs -ls /tmp/hudi/test_overwrite1/.hoodie
Found 11 items
drwxr-xr-x - root supergroup 0 2022-01-04 06:20 /tmp/hudi/test_overwrite1/.hoodie/.aux
drwxr-xr-x - root supergroup 0 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/.temp
-rw-r--r-- 1 root supergroup 1791 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/20220104062057294.commit
-rw-r--r-- 1 root supergroup 0 2022-01-04 06:20 /tmp/hudi/test_overwrite1/.hoodie/20220104062057294.commit.requested
-rw-r--r-- 1 root supergroup 1194 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/20220104062057294.inflight
-rw-r--r-- 1 root supergroup 1907 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/20220104062117644.replacecommit
-rw-r--r-- 1 root supergroup 1204 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/20220104062117644.replacecommit.inflight
-rw-r--r-- 1 root supergroup 0 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/20220104062117644.replacecommit.requested
drwxr-xr-x - root supergroup 0 2022-01-04 06:20 /tmp/hudi/test_overwrite1/.hoodie/archived
-rw-r--r-- 1 root supergroup 985 2022-01-04 06:20 /tmp/hudi/test_overwrite1/.hoodie/hoodie.properties
drwxr-xr-x - root supergroup 0 2022-01-04 06:21 /tmp/hudi/test_overwrite1/.hoodie/metadata
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org