You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/09/16 23:24:00 UTC
[jira] [Commented] (HUDI-141) GCS : DeltaStreamer requiring
hoodie-spark bundle to run on Hadoop 2.9.2
[ https://issues.apache.org/jira/browse/HUDI-141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930960#comment-16930960 ]
Vinoth Chandar commented on HUDI-141:
-------------------------------------
Keeping this open to verify either me or someone else on GCS
> GCS : DeltaStreamer requiring hoodie-spark bundle to run on Hadoop 2.9.2
> ------------------------------------------------------------------------
>
> Key: HUDI-141
> URL: https://issues.apache.org/jira/browse/HUDI-141
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: deltastreamer
> Reporter: BALAJI VARADARAJAN
> Assignee: Vinoth Chandar
> Priority: Minor
> Labels: gcs-parity
>
> Error: Without the spark bundle, DeltaStreamer consistently hits
> “”””
> 696865d3-26b8-4e61-8f11-5d27de328892_0_20190502215141.parquet does not have a open stream. Cannot get the bytes written on the stream
> at com.uber.hoodie.io.storage.HoodieWrapperFileSystem.getBytesWritten(HoodieWrapperFileSystem.java:772)
> at com.uber.hoodie.io.storage.HoodieParquetWriter.canWrite(HoodieParquetWriter.java:95)
> at com.uber.hoodie.io.HoodieCreateHan
> “””
> _Status_: No solutions yet. Not sure if the problem is because of race-conditions. Currently the workaround is to add hoodie-spark bundle
--
This message was sent by Atlassian Jira
(v8.3.2#803003)