You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/01 04:43:58 UTC

[GitHub] [hudi] xushiyan opened a new pull request, #6846: [HUDI-4962] Move cloud dependencies to cloud modules

xushiyan opened a new pull request, #6846:
URL: https://github.com/apache/hudi/pull/6846

   ### Change Logs
   
   Move aws & gcp dependencies to the cloud modules respectively.
   
   ### Impact
   
   **Risk level: low**
   
   Affecting dev modules; No bundle dependencies change.
   
   ### Documentation Update
   
   NA
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] pramodbiligiri commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
pramodbiligiri commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1265279684

   Tested that this build worked locally. Built this branch as follows and ran the sync. Results after sync pasted down below.
   Build:
   $ mvn -DskipTests -Dspark3.2 -Dscala-2.12 -Dcheckstyle.skip -Drat.skip clean install
   
   Testing the sync (each file has 10 records):
   ```
   Before Sync:
   select max(id) from gcs_data;
   
   +--------+
   |  _c0   |
   +--------+
   | 20370  |
   +--------+
   
   select max(name) from gcs_meta_hive;
   +----------------------------------+
   |               _c0                |
   +----------------------------------+
   | country=IN/data-file-2040.jsonl  |
   +----------------------------------+
   
   
   After Sync:
   select max(id) from gcs_data;
   +--------+
   |  _c0   |
   +--------+
   | 20450  |
   +--------+
   
   select max(name) from gcs_meta_hive;
   +----------------------------------+
   |               _c0                |
   +----------------------------------+
   | country=IN/data-file-2045.jsonl  |
   +----------------------------------+
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264254907

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 41ce560cacf27b18c14672ef5650f285b271ce4a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947) 
   * 6137f878fb8c1bf572e53cc56624341a39893c31 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] codope merged pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
codope merged PR #6846:
URL: https://github.com/apache/hudi/pull/6846


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264256114

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11950",
       "triggerID" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 41ce560cacf27b18c14672ef5650f285b271ce4a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947) 
   * 6137f878fb8c1bf572e53cc56624341a39893c31 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11950) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264242919

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 41ce560cacf27b18c14672ef5650f285b271ce4a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264293012

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     }, {
       "hash" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11950",
       "triggerID" : "6137f878fb8c1bf572e53cc56624341a39893c31",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 6137f878fb8c1bf572e53cc56624341a39893c31 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11950) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264242268

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 41ce560cacf27b18c14672ef5650f285b271ce4a UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6846: [HUDI-4962] Move cloud dependencies to cloud modules

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6846:
URL: https://github.com/apache/hudi/pull/6846#issuecomment-1264254208

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947",
       "triggerID" : "41ce560cacf27b18c14672ef5650f285b271ce4a",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 41ce560cacf27b18c14672ef5650f285b271ce4a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11947) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org