[GitHub] [hudi] nsivabalan commented on issue #4889: [SUPPORT] Clustering fails w/ latest master with col stats partition even after disabling metadata table

[GitBox <gi...@apache.org>]

nsivabalan commented on issue #4889:
URL: https://github.com/apache/hudi/issues/4889#issuecomment-1050384844


   excerpt from SparkRDDWRiteClient. last line here needs to be called only when metadata is enabled.
   ```
   // Update table's metadata (table)
         updateTableMetadata(table, metadata, clusteringInstant);
         // Update tables' metadata indexes
         // NOTE: This overlaps w/ metadata table (above) and will be reconciled in the future
        table.updateMetadataIndexes(context, writeStats, clusteringCommitTime);
   ````
   
   Also, do verify if we update metadata indexes for compaction. I did not see explicit calls in completeCompaction() method. Also, ensure we call only when metadata is enabled. 
   
   
   CC @codope @yihua 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org