You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/05 20:02:24 UTC
[GitHub] [hudi] pramodbiligiri commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules
pramodbiligiri commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1265279684
Tested that this build worked locally. Built this branch as follows and ran the sync. Results after sync pasted down below.
Build:
$ mvn -DskipTests -Dspark3.2 -Dscala-2.12 -Dcheckstyle.skip -Drat.skip clean install
Testing the sync (each file has 10 records):
```
Before Sync:
select max(id) from gcs_data;
+--------+
| _c0 |
+--------+
| 20370 |
+--------+
select max(name) from gcs_meta_hive;
+----------------------------------+
| _c0 |
+----------------------------------+
| country=IN/data-file-2040.jsonl |
+----------------------------------+
After Sync:
select max(id) from gcs_data;
+--------+
| _c0 |
+--------+
| 20450 |
+--------+
select max(name) from gcs_meta_hive;
+----------------------------------+
| _c0 |
+----------------------------------+
| country=IN/data-file-2045.jsonl |
+----------------------------------+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org