You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/09 06:27:55 UTC

[GitHub] [hudi] xicm opened a new pull request, #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

xicm opened a new pull request, #6642:
URL: https://github.com/apache/hudi/pull/6642

   ### Change Logs
   
   ORC version in hudi is 1.6.0 , while the version in spark 3.1 is 1.5.12. 
   I try to set orc.version to 1.5 in spark3.1 profile, there are other conflicts. So I copy and rename the orc dependencies to spark bundle. 
   ### Impact
   
   _Describe any public API or user-facing feature change or any performance impact._
   
   **Risk level: none | low | medium | high**
   
   low
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241689409

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264",
       "triggerID" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1241685971",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ed2886c63771a6ecd2f43a7c5576337aba9b89c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1242779135

   Got it.  I'll close this PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua closed pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
yihua closed pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1
URL: https://github.com/apache/hudi/pull/6642


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xicm commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
xicm commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241685971

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241677189

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264",
       "triggerID" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ed2886c63771a6ecd2f43a7c5576337aba9b89c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241600485

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ed2886c63771a6ecd2f43a7c5576337aba9b89c9 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241695173

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264",
       "triggerID" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "triggerType" : "PUSH"
     }, {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264",
       "triggerID" : "1241685971",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * ed2886c63771a6ecd2f43a7c5576337aba9b89c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1241606259

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264",
       "triggerID" : "ed2886c63771a6ecd2f43a7c5576337aba9b89c9",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * ed2886c63771a6ecd2f43a7c5576337aba9b89c9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11264) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xicm commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
xicm commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1242636995

   > @xicm #6227 addresses the ORC support in Spark 3 comprehensively. Could you check if that solves the problem?
   > 
   > cc @alexeykudinkin
   
   @yihua thanks, #6227 fixes the orc version and some unreasonable import, this PR is redundant.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on pull request #6642: [HUDI-4820] ORC dependency conflicts with spark 3.1

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6642:
URL: https://github.com/apache/hudi/pull/6642#issuecomment-1242631483

   @xicm #6227 addresses the ORC support in Spark 3 comprehensively.  Could you check if that solves the problem?
   
   cc @alexeykudinkin 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org