You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/01 11:15:42 UTC

[GitHub] [hudi] codejoyan edited a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

codejoyan edited a comment on pull request #5153:
URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084662979


   Tested from spark-spell using the below steps:
   
   val basePath = "gs://udp-hudi-storage5/hudi_demo_dataset"
   val conf = new Configuration()
   val manifestFileUtil: ManifestFileUtil = ManifestFileUtil.builder().setConf(conf).setBasePath(basePath).build();
   manifestFileUtil.writeManifestFile
   
   bash-4.2$ gsutil cat gs://udp-hudi-storage5/hudi_demo_dataset/.hoodie/manifest/latest-snapshot.csv | head -5
   95e78133-08dd-4721-9c49-8fbe338589f0-0_621-10-1021_20210927173651.parquet
   1c01ddf1-41e8-43bf-94f3-9a75c9e39b21-0_1238-12-1638_20210927173651.parquet
   a021864b-d0b6-462a-8f47-6370668993d6-0_694-12-1094_20210927173651.parquet
   11815af9-6ed5-4f05-9b6b-7f79479f4f53-0_625-12-1025_20210927173651.parquet
   ef4fc799-9124-4656-8106-f0374590dde6-0_1151-12-1551_20210927173651.parquet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org