You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/17 07:56:59 UTC

[GitHub] [hudi] wangyum opened a new pull request, #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

wangyum opened a new pull request, #6707:
URL: https://github.com/apache/hudi/pull/6707

   ### Change Logs
   
   Spark 3.3.1 is voting. This PR is used to test Spark 3.3.1.
   
   ### Impact
   
   **low**
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on pull request #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1283547992

   @wangyum : may I know why its tagged as "WIP" (in the title)? is there anything pending to be addressed/added.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum commented on pull request #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1283595468

   @nsivabalan This is because Spark 3.3.1 is not officially released.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1288644145

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "d0381797611ba0c237f21eaccd33815231833897",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "d0381797611ba0c237f21eaccd33815231833897",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d0381797611ba0c237f21eaccd33815231833897 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] nsivabalan commented on pull request #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1283546536

   @rahil-c @YannByron : can you review this please. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1288660626

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "d0381797611ba0c237f21eaccd33815231833897",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12520",
       "triggerID" : "d0381797611ba0c237f21eaccd33815231833897",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d0381797611ba0c237f21eaccd33815231833897 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12520) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1292794532

   Yes. It's ready.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1294277443

   I'm very busy these days. @nsivabalan @tooptoop4 Please update by yourself.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum closed pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum closed pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1
URL: https://github.com/apache/hudi/pull/6707


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1288601503

   The Spark 3.3.1 vote passes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1289368256

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "d0381797611ba0c237f21eaccd33815231833897",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12520",
       "triggerID" : "d0381797611ba0c237f21eaccd33815231833897",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * d0381797611ba0c237f21eaccd33815231833897 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12520) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] tooptoop4 commented on pull request #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
tooptoop4 commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1288525134

   ready?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] xushiyan commented on pull request #6707: [HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
xushiyan commented on PR #6707:
URL: https://github.com/apache/hudi/pull/6707#issuecomment-1305352258

   Thanks @wangyum for the patch. This is done in https://github.com/apache/hudi/pull/7155


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] wangyum commented on a diff in pull request #6707: [WIP][HUDI-4871] Upgrade spark3.3 to Spark 3.3.1

Posted by GitBox <gi...@apache.org>.
wangyum commented on code in PR #6707:
URL: https://github.com/apache/hudi/pull/6707#discussion_r973556162


##########
pom.xml:
##########
@@ -1521,6 +1521,10 @@
       <id>confluent</id>
       <url>https://packages.confluent.io/maven/</url>
     </repository>
+    <repository>
+      <id>Spark-3.3.1</id>
+      <url>https://repository.apache.org/content/repositories/orgapachespark-1418</url>
+    </repository>

Review Comment:
   Will remove it if Spark 3.3.1 is officially released.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org