You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/10 23:28:13 UTC

[GitHub] [hudi] yihua opened a new pull request, #5284: [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator

yihua opened a new pull request, #5284:
URL: https://github.com/apache/hudi/pull/5284

   ## What is the purpose of the pull request
   
   This PR fixes the NullPointerException during reading Hudi log files in HoodieMetadataTableValidator, possibly due to empty or partial log files written by an inflight instant.
   
   ## Brief change log
   
     - Adds the logic to skip the check of a log file if the schema cannot be read or IOException happens.
   
   ## Verify this pull request
   
   This pull request is tested using a long-running HoodieMetadataTableValidator job to make sure that NPE is not thrown when empty or partial log files are present.
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #5284: [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5284:
URL: https://github.com/apache/hudi/pull/5284#issuecomment-1094409556

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e99f79ba26ca5ed244e8819989fc8ed93f55f094 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #5284: [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5284:
URL: https://github.com/apache/hudi/pull/5284#issuecomment-1094410133

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7968",
       "triggerID" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e99f79ba26ca5ed244e8819989fc8ed93f55f094 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7968) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #5284: [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5284:
URL: https://github.com/apache/hudi/pull/5284#issuecomment-1094432319

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7968",
       "triggerID" : "e99f79ba26ca5ed244e8819989fc8ed93f55f094",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * e99f79ba26ca5ed244e8819989fc8ed93f55f094 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7968) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua merged pull request #5284: [HUDI-3847] Fix NPE due to null schema in HoodieMetadataTableValidator

Posted by GitBox <gi...@apache.org>.
yihua merged PR #5284:
URL: https://github.com/apache/hudi/pull/5284


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org