You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/27 00:14:20 UTC

[GitHub] [hudi] alexeykudinkin opened a new pull request, #5699: [WIP] Make sure partition values are taken from partition path

alexeykudinkin opened a new pull request, #5699:
URL: https://github.com/apache/hudi/pull/5699

   ## *Tips*
   - *Thank you very much for contributing to Apache Hudi.*
   - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
   
   ## What is the purpose of the pull request
   
   This change is essentially a fallback from 5364, which essentially made all COW tables treated as non-partitioned ones. In this PR we fallback by default to previously existing behavior where we'd append partition values as parsed from the partition path.
   
   ## Brief change log
   
    - Flip fallback configuration to true by default
    - Fix conditional incorrectly skipping parsing partition values
   
   ## Verify this pull request
   
   This pull request is already covered by existing tests, such as *(please describe tests)*.
   This pull request will also be manually tested.
   
   ## Committer checklist
   
    - [ ] Has a corresponding JIRA in PR title & commit
    
    - [ ] Commit message is descriptive of the change
    
    - [ ] CI is green
   
    - [ ] Necessary doc changes done or have another open PR
          
    - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139343445

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139346060

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139255863

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 55796feecde7c872f699a6474ad081726500764d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883268361


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala:
##########
@@ -108,9 +108,6 @@ case class HoodieFileIndex(spark: SparkSession,
    * @return list of PartitionDirectory containing partition to base files mapping
    */
   override def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory] = {
-    val convertedPartitionFilters =

Review Comment:
   MOR still does the conversion w/in the Relation itself



##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##########
@@ -399,7 +399,9 @@ abstract class HoodieBaseRelation(val sqlContext: SQLContext,
   protected def getPartitionColumnsAsInternalRow(file: FileStatus): InternalRow = {
     try {
       val tableConfig = metaClient.getTableConfig
-      if (shouldExtractPartitionValuesFromPartitionPath) {
+      if (partitionColumns.isEmpty) {

Review Comment:
   Reverted



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139311224

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] xushiyan commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883249801


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala:
##########
@@ -108,9 +108,6 @@ case class HoodieFileIndex(spark: SparkSession,
    * @return list of PartitionDirectory containing partition to base files mapping
    */
   override def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory] = {
-    val convertedPartitionFilters =

Review Comment:
   this also used in org.apache.hudi.MergeOnReadSnapshotRelation#collectFileSplits



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139231890

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9c5b1b3e02474e4da6d9cd610378d6f7055034f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956) 
   * 55796feecde7c872f699a6474ad081726500764d UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139183433

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9c5b1b3e02474e4da6d9cd610378d6f7055034f7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139253533

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 55796feecde7c872f699a6474ad081726500764d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] xushiyan commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
xushiyan commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883254416


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala:
##########
@@ -108,9 +108,6 @@ case class HoodieFileIndex(spark: SparkSession,
    * @return list of PartitionDirectory containing partition to base files mapping
    */
   override def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory] = {
-    val convertedPartitionFilters =

Review Comment:
   this means some behavior changes where users still set timestamp keygen for writing, but query the physical partition paths directly without any keygen settings. And also means `convertFilterForTimestampKeyGenerator()` won't be needed?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139306990

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139233205

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9c5b1b3e02474e4da6d9cd610378d6f7055034f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956) 
   * 55796feecde7c872f699a6474ad081726500764d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139205128

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9c5b1b3e02474e4da6d9cd610378d6f7055034f7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139182345

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 9c5b1b3e02474e4da6d9cd610378d6f7055034f7 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139325535

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139339582

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "CANCELED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 0000 Unknown: [CANCELED](TBD) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139343842

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139352911

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   * 49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883243990


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala:
##########
@@ -108,9 +108,6 @@ case class HoodieFileIndex(spark: SparkSession,
    * @return list of PartitionDirectory containing partition to base files mapping
    */
   override def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory] = {
-    val convertedPartitionFilters =

Review Comment:
   This has to be removed since now there partition values are populated from partition path as is, and therefore users will have to query them as they are -- no conversion is needed therefore



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139279042

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 55796feecde7c872f699a6474ad081726500764d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139375387

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966",
       "triggerID" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   * 49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139337444

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] nsivabalan commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883180511


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##########
@@ -399,7 +399,9 @@ abstract class HoodieBaseRelation(val sqlContext: SQLContext,
   protected def getPartitionColumnsAsInternalRow(file: FileStatus): InternalRow = {
     try {
       val tableConfig = metaClient.getTableConfig
-      if (shouldExtractPartitionValuesFromPartitionPath) {
+      if (partitionColumns.isEmpty) {

Review Comment:
   why are these required? I thought just flipping the config would suffice? 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139389007

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966",
       "triggerID" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   * 49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on code in PR #5699:
URL: https://github.com/apache/hudi/pull/5699#discussion_r883268941


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala:
##########
@@ -108,9 +108,6 @@ case class HoodieFileIndex(spark: SparkSession,
    * @return list of PartitionDirectory containing partition to base files mapping
    */
   override def listFiles(partitionFilters: Seq[Expression], dataFilters: Seq[Expression]): Seq[PartitionDirectory] = {
-    val convertedPartitionFilters =

Review Comment:
   @xushiyan this reverts us back to behavior we had in 0.10 for COW -- original columns will be overridden with partition values by Spark



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139276319

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 55796feecde7c872f699a6474ad081726500764d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139418004

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139343445",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966",
       "triggerID" : "49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "SUCCESS",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 49c0ebb6f3a8a40eb814266f4b3abf8ffbd6b488 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8966) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] xushiyan merged pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
xushiyan merged PR #5699:
URL: https://github.com/apache/hudi/pull/5699


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139305409

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139254732

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 55796feecde7c872f699a6474ad081726500764d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958) 
   * 10ce9e596c7180f8b7bd58df078058f6db4762af UNKNOWN
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] alexeykudinkin commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139302247

   @hudi-bot run azure


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139311365

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "UNKNOWN",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139313212

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8956",
       "triggerID" : "9c5b1b3e02474e4da6d9cd610378d6f7055034f7",
       "triggerType" : "PUSH"
     }, {
       "hash" : "55796feecde7c872f699a6474ad081726500764d",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8958",
       "triggerID" : "55796feecde7c872f699a6474ad081726500764d",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "10ce9e596c7180f8b7bd58df078058f6db4762af",
       "status" : "PENDING",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 10ce9e596c7180f8b7bd58df078058f6db4762af Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8961) 
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [hudi] hudi-bot commented on pull request #5699: [HUDI-4161] Make sure partition values are taken from partition path

Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5699:
URL: https://github.com/apache/hudi/pull/5699#issuecomment-1139341601

   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "DELETED",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "triggerType" : "PUSH"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "7d2c71ef91b4e091300e6155fd8bdb77c0c6b680",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962",
       "triggerID" : "1139325535",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139302247",
       "triggerType" : "MANUAL"
     }, {
       "hash" : "0000",
       "status" : "DELETED",
       "url" : "TBD",
       "triggerID" : "1139311224",
       "triggerType" : "MANUAL"
     } ]
   }-->
   ## CI report:
   
   * 7d2c71ef91b4e091300e6155fd8bdb77c0c6b680 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8962) 
   
   <details>
   <summary>Bot commands</summary>
     @hudi-bot supports the following commands:
   
    - `@hudi-bot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org