You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/19 21:59:13 UTC

[GitHub] [hudi] prashantwason opened a new pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

prashantwason opened a new pull request #3508:
URL: https://github.com/apache/hudi/pull/3508


   ## Brief change log
   
   Adds a record level index which stores the mapping within the metadata table.
   
   Pre-requisite: Metadata Table version 2: https://github.com/apache/hudi/pull/3426
   
   ## Verify this pull request
   
   Unit tests to be added
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot removed a comment on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot removed a comment on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot edited a comment on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-961588223


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot removed a comment on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-971174149


   Hi @prashantwason, i see that this PR is marked as release-blocker but it seems legacy for a long time and not active in recent days, should we consider to move it into release 0.11 or something ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot edited a comment on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-902279757


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run travis` re-run the last Travis build
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-961588223


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] loukey-lj commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
loukey-lj commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-917794220


   org.apache.hudi.common.config.HoodieMetadataConfig#RECORD_LEVEL_INDEX_SHARD_COUNT_PROP  key name incorrect?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #3508: [HUDI-53] Adding a record level index based on the Metadata Table v2

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3508:
URL: https://github.com/apache/hudi/pull/3508#issuecomment-961588223


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822",
       "triggerID" : "730d7b8ee5443e26aeebff3737fa45cfd52f0820",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 730d7b8ee5443e26aeebff3737fa45cfd52f0820 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1822) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org