You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2023/03/22 23:14:39 UTC

[GitHub] [hudi] yihua opened a new pull request, #8271: [HUDI-5941] Support savepoint call procedure with base path in Spark SQL

yihua opened a new pull request, #8271:
URL: https://github.com/apache/hudi/pull/8271

   ### Change Logs
   
   Before this PR, the savepoint-related call procedure can only take the table name stored in the catalog in Spark SQL.  This does not work with the temporary view (`df. createOrReplaceTempView(name)`).  See #7589 .  Relevant call procedure are:
   
   ```
   call create_savepoint(table => 'table_name', commit_time => 'commit_time')
   call show_savepoints(table => 'table_name')
   call delete_savepoint(table => 'table_name', instant_time => 'commit_time')
   call rollback_to_savepoint(table => 'table_name', instant_time => 'commit_time')
   ```
   
   This PR adds the support of using the base path of a Hudi table for savepoint call procedure in Spark SQL.  Users can now run the following new call procedure:
   ```
   call create_savepoint(path => '/table/path', commit_time => 'commit_time')
   call show_savepoints(path => '/table/path')
   call delete_savepoint(path => '/table/path', instant_time => 'commit_time')
   call rollback_to_savepoint(path => '/table/path', instant_time => 'commit_time')
   ```
   
   ### Impact
   
   Improves the usability of savepoint call procedure in Spark SQL.  New unit tests are added to make sure the call procedure works.
   
   ### Risk level
   
   none
   
   ### Documentation Update
   
   See HUDI-5974.
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8271: [HUDI-5941] Support savepoint call procedure with base path in Spark SQL

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8271:
URL: https://github.com/apache/hudi/pull/8271#issuecomment-1480405609

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * abf749861246d2fde6b307f306f1e4be68c08360 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8271: [HUDI-5941] Support savepoint call procedure with base path in Spark SQL

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8271:
URL: https://github.com/apache/hudi/pull/8271#issuecomment-1480411269

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15861",
       "triggerID" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * abf749861246d2fde6b307f306f1e4be68c08360 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15861) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #8271: [HUDI-5941] Support savepoint call procedure with base path in Spark SQL

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8271:
URL: https://github.com/apache/hudi/pull/8271#issuecomment-1480474007

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15861",
       "triggerID" : "abf749861246d2fde6b307f306f1e4be68c08360",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * abf749861246d2fde6b307f306f1e4be68c08360 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15861) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] codope merged pull request #8271: [HUDI-5941] Support savepoint call procedure with base path in Spark SQL

Posted by "codope (via GitHub)" <gi...@apache.org>.
codope merged PR #8271:
URL: https://github.com/apache/hudi/pull/8271


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org