You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/22 20:23:47 UTC

[GitHub] [hudi] jonvex opened a new pull request, #6751: [MINOR] Fixes to make unit tests work on m1

jonvex opened a new pull request, #6751:
URL: https://github.com/apache/hudi/pull/6751

   ### Change Logs
   
   an older version of snappy that is incompatible with m1 was used in by a few dependencies. To fix we make spark version to be 2.4.8 and we add some exclusions so that the dependencies don't pull in the old version of snappy and use the newer one instead.
   
   ### Impact
   
   Unit tests should now work on m1
   
   **Risk level: low*
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1261280126

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1cbb28cc66b41ac261f387a94eab46dc079efd6b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686) 
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1255528987

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 158346cc320681c745909665038f2ecf0d22a947 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on pull request #6751: [HUDI-4972] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
yihua commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1350468029

   After revisiting this PR, I feel that this introduces the risk of building release artifacts with different versions of dependencies on M1 Macbook (note that the release manager needs to build the artifacts locally and push them to the staging area using the release script).  We should directly upgrade the versions without keeping two variants based on the OS/Arch.  [HUDI-5388](https://issues.apache.org/jira/browse/HUDI-5388) for followup.
   
   cc @nsivabalan @alexeykudinkin @xushiyan 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256876495

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b4f214f1c8e5592b590af131f519af093ebdb10c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651) 
   * 1cbb28cc66b41ac261f387a94eab46dc079efd6b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1255643899

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 158346cc320681c745909665038f2ecf0d22a947 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] yihua commented on a diff in pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
yihua commented on code in PR #6751:
URL: https://github.com/apache/hudi/pull/6751#discussion_r979165637


##########
packaging/hudi-utilities-bundle/pom.xml:
##########
@@ -376,6 +376,12 @@
       <groupId>org.apache.parquet</groupId>
       <artifactId>parquet-avro</artifactId>
       <scope>compile</scope>
+      <exclusions>
+        <exclusion>
+          <groupId>org.xerial.snappy</groupId>
+          <artifactId>snappy-java</artifactId>

Review Comment:
   does this break the snappy compression functionality in `hudi-utilities-bundle`?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1255534045

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 158346cc320681c745909665038f2ecf0d22a947 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256626216

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b4f214f1c8e5592b590af131f519af093ebdb10c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1261548286

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256620389

   have cancelled CI run for now. investigating CI flakiness. will trigger azure CI run once we fix the flakiness. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] jonvex commented on a diff in pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
jonvex commented on code in PR #6751:
URL: https://github.com/apache/hudi/pull/6751#discussion_r981287223


##########
packaging/hudi-utilities-bundle/pom.xml:
##########
@@ -376,6 +376,12 @@
       <groupId>org.apache.parquet</groupId>
       <artifactId>parquet-avro</artifactId>
       <scope>compile</scope>
+      <exclusions>
+        <exclusion>
+          <groupId>org.xerial.snappy</groupId>
+          <artifactId>snappy-java</artifactId>

Review Comment:
   No idea. Is there a good way to test? Any additional info you know about this would be helpful to me. Thanks



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1262765162

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854) 
   * c7a1d373796e8bfce040bd79a07f68ef6b7ffc59 UNKNOWN
   * 287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] jonvex commented on a diff in pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
jonvex commented on code in PR #6751:
URL: https://github.com/apache/hudi/pull/6751#discussion_r983960521


##########
packaging/hudi-utilities-bundle/pom.xml:
##########
@@ -376,6 +376,12 @@
       <groupId>org.apache.parquet</groupId>
       <artifactId>parquet-avro</artifactId>
       <scope>compile</scope>
+      <exclusions>
+        <exclusion>
+          <groupId>org.xerial.snappy</groupId>
+          <artifactId>snappy-java</artifactId>

Review Comment:
   We tested in TestHoodieSparkSqlWriter.scala and also added a param to getCommonParams that sets "hoodie.parquet.compression.codec" to snappy and ran all the tests and they all passed



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on a diff in pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #6751:
URL: https://github.com/apache/hudi/pull/6751#discussion_r984909707


##########
pom.xml:
##########
@@ -1997,6 +2016,19 @@
         </property>
       </activation>
     </profile>
+    <profile>
+      <id>m1-mac</id>
+      <properties>
+        <spark2.version>2.4.8</spark2.version>
+        <rocksdbjni.version>6.29.4.1</rocksdbjni.version>

Review Comment:
   can we also leave the snappy version as is for other profiles and use 1.1.8.3 just for mac m1 profile



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan merged pull request #6751: [HUDI-4972] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
nsivabalan merged PR #6751:
URL: https://github.com/apache/hudi/pull/6751


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1262772302

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11911",
       "triggerID" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854) 
   * c7a1d373796e8bfce040bd79a07f68ef6b7ffc59 UNKNOWN
   * 287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11911) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1262760469

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854) 
   * c7a1d373796e8bfce040bd79a07f68ef6b7ffc59 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256563371

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 158346cc320681c745909665038f2ecf0d22a947 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590) 
   * b4f214f1c8e5592b590af131f519af093ebdb10c UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1261286280

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1cbb28cc66b41ac261f387a94eab46dc079efd6b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686) 
   * afc44f21d6e5e644a2007fb2400bdbf0f1146890 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1263026731

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     }, {
       "hash" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11854",
       "triggerID" : "afc44f21d6e5e644a2007fb2400bdbf0f1146890",
       "triggerType" : "PUSH"
     }, {
       "hash" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "c7a1d373796e8bfce040bd79a07f68ef6b7ffc59",
       "triggerType" : "PUSH"
     }, {
       "hash" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11911",
       "triggerID" : "287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * c7a1d373796e8bfce040bd79a07f68ef6b7ffc59 UNKNOWN
   * 287c52c6da5eb75093f3c9f7bfd5bfaf0eeb9ac0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11911) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on a diff in pull request #6751: [HUDI-4972] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #6751:
URL: https://github.com/apache/hudi/pull/6751#discussion_r990326965


##########
packaging/hudi-utilities-bundle/pom.xml:
##########
@@ -376,6 +376,12 @@
       <groupId>org.apache.parquet</groupId>
       <artifactId>parquet-avro</artifactId>
       <scope>compile</scope>
+      <exclusions>
+        <exclusion>
+          <groupId>org.xerial.snappy</groupId>
+          <artifactId>snappy-java</artifactId>

Review Comment:
   we test this and things are good.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256909832

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 1cbb28cc66b41ac261f387a94eab46dc079efd6b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11686) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256571920

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 158346cc320681c745909665038f2ecf0d22a947 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590) 
   * b4f214f1c8e5592b590af131f519af093ebdb10c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #6751: [MINOR] Fixes to make unit tests work on m1

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6751:
URL: https://github.com/apache/hudi/pull/6751#issuecomment-1256875728

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "158346cc320681c745909665038f2ecf0d22a947",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11590",
       "triggerID" : "158346cc320681c745909665038f2ecf0d22a947",
       "triggerType" : "PUSH"
     }, {
       "hash" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "status" : "CANCELED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651",
       "triggerID" : "b4f214f1c8e5592b590af131f519af093ebdb10c",
       "triggerType" : "PUSH"
     }, {
       "hash" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1cbb28cc66b41ac261f387a94eab46dc079efd6b",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * b4f214f1c8e5592b590af131f519af093ebdb10c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11651) 
   * 1cbb28cc66b41ac261f387a94eab46dc079efd6b UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org