You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/03/09 06:55:13 UTC

[GitHub] [hudi] yihua opened a new pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

yihua opened a new pull request #4997:
URL: https://github.com/apache/hudi/pull/4997


   ## What is the purpose of the pull request
   
   The latest master of Presto relies on hudi-presto-bundle, while current Presto releases rely on hudi-common and hudi-hadoop-mr 0.9.0, which are pulled in plugin/hive-hadoop2/ in the Docker setup, making it hard to test the latest changes in Hudi due to class conflict.
   
   As a temporary workaround, this PR removes `hudi-common-0.9.0.jar` and `hudi-hadoop-mr-0.9.0.jar` in `plugin/hive-hadoop2/` to avoid conflicts with latest hudi-presto-bundle.jar, which is copied from the build.  This PR also upgrades Presto to 0.271, so that the new presto docker image is pushed to `apachehudi/hudi-hadoop_2.8.4-prestobase_0.271:latest`.  In this way, if there is any issue with the changes in this PR, we can roll this back without any side effect.
   
   ## Brief change log
   
   - Removes `hudi-common-0.9.0.jar` and `hudi-hadoop-mr-0.9.0.jar` within `plugin/hive-hadoop2/` in `docker/hoodie/hadoop/prestobase/Dockerfile`
   - Upgrades Presto from 0.268 to 0.271 in Docker setup
   - Pushes new Presto Docker image to `apachehudi/hudi-hadoop_2.8.4-prestobase_0.271:latest`
   
   ## Verify this pull request
   
   This pull request is already covered by existing integration tests.
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4997:
URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062658411


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725",
       "triggerID" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5feb87b1f89732112cfd8073c1cc782c42b7504d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4997:
URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062610566


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5feb87b1f89732112cfd8073c1cc782c42b7504d UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua merged pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
yihua merged pull request #4997:
URL: https://github.com/apache/hudi/pull/4997


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4997:
URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062612133


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725",
       "triggerID" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5feb87b1f89732112cfd8073c1cc782c42b7504d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #4997:
URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062612133


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725",
       "triggerID" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5feb87b1f89732112cfd8073c1cc782c42b7504d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6725) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #4997:
URL: https://github.com/apache/hudi/pull/4997#issuecomment-1062610566


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "5feb87b1f89732112cfd8073c1cc782c42b7504d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 5feb87b1f89732112cfd8073c1cc782c42b7504d UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org