You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2019/07/18 19:45:36 UTC
[GitHub] [incubator-hudi] bvaradar commented on issue #764: Hoodie 0.4.7:
Error upserting bucketType UPDATE for partition #, No value present
bvaradar commented on issue #764: Hoodie 0.4.7: Error upserting bucketType UPDATE for partition #, No value present
URL: https://github.com/apache/incubator-hudi/issues/764#issuecomment-512960024
> @jackwang2 @amaranathv there are 3 issues here with different stack traces.
>
> @jackwang2 first issue you reported . is that gone? or you waiting for 0.4.7 to be fixed with issue below to try that?
>
> ```
> Caused by: java.util.NoSuchElementException: No value present
> at com.uber.hoodie.common.util.Option.get(Option.java:112)
> at com.uber.hoodie.io.HoodieMergeHandle.(HoodieMergeHandle.java:71)
> at com.uber.hoodie.table.HoodieCopyOnWriteTable.getUpdateHandle(HoodieCopyOnWriteTable.java:226)
> at com.uber.hoodie.table.HoodieCopyOnWriteTable.handleUpdate(HoodieCopyOnWriteTable.java:180)
> at com.uber.hoodie.table.HoodieCopyOnWriteTable.handleUpsertPartition(HoodieCopyOnWriteTable.java:263)
> ... 28 more
> ```
>
> @jackwang2 second issue (probably same as what you mentioned on slack?) . are you able to reproduce it? https://github.com/apache/incubator-hudi/blob/hoodie-0.4.7/hoodie-client/src/main/java/com/uber/hoodie/io/HoodieCommitArchiveLog.java#L279 seems its related to archiving CLEAN action. The schema for this has not changed in years. it looks like some corruption. are you able to print out `new String(commitTimeline.getInstantDetails(hoodieInstant).get())`, so we can see the bytes..
>
> ```
> Caused by: java.io.IOException: Not an Avro data fileat org.apache.avro.file.DataFileReader.openReader(DataFileReader.java:50)
> at com.uber.hoodie.common.util.AvroUtils.deserializeAvroMetadata(AvroUtils.java:215)
> at com.uber.hoodie.io.HoodieCommitArchiveLog.convertToAvroRecord(HoodieCommitArchiveLog.java:279)
> at com.uber.hoodie.io.HoodieCommitArchiveLog.archive(HoodieCommitArchiveLog.java:247)... 41 more
> 19/06/25 12:37:52 INFO SparkContext: Invoking stop() from shutdown hook
> ```
>
> @amaranathv your stack trace is different..
>
> ```
> Caused by: java.lang.IllegalArgumentException: Can not create a Path from an empty string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:130)
> at org.apache.hadoop.fs.Path.<init>(Path.java:138)
> at org.apache.hadoop.fs.Path.<init>(Path.java:92)
> at com.uber.hoodie.table.HoodieMergeOnReadTable.lambda$rollback$5(HoodieMergeOnReadTable.java:510)
> ```
>
> can you print out partitionPath below? It seems like its null .. Please check if your input has valid non-null partition paths.
>
> ```
> writer = HoodieLogFormat.newWriterBuilder().onParentPath(
> new Path(this.getMetaClient().getBasePath(), partitionPath))
> .withFileId(wStat.getFileId()).overBaseCommit(baseCommitTime)
> .withFs(this.metaClient.getFs())
> .withFileExtension(HoodieLogFile.DELTA_EXTENSION).build();
> ```
@jackwang2 : Are you still seeing this issue ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services