You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/10/21 00:37:00 UTC
[jira] [Closed] (HUDI-141) GCS : DeltaStreamer requiring
hoodie-spark bundle to run on Hadoop 2.9.2
[ https://issues.apache.org/jira/browse/HUDI-141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar closed HUDI-141.
-------------------------------
Resolution: Fixed
Verified things work on gcs
> GCS : DeltaStreamer requiring hoodie-spark bundle to run on Hadoop 2.9.2
> ------------------------------------------------------------------------
>
> Key: HUDI-141
> URL: https://issues.apache.org/jira/browse/HUDI-141
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: deltastreamer
> Reporter: Balaji Varadarajan
> Assignee: Vinoth Chandar
> Priority: Minor
> Labels: gcs-parity
>
> Error: Without the spark bundle, DeltaStreamer consistently hits
> “”””
> 696865d3-26b8-4e61-8f11-5d27de328892_0_20190502215141.parquet does not have a open stream. Cannot get the bytes written on the stream
> at com.uber.hoodie.io.storage.HoodieWrapperFileSystem.getBytesWritten(HoodieWrapperFileSystem.java:772)
> at com.uber.hoodie.io.storage.HoodieParquetWriter.canWrite(HoodieParquetWriter.java:95)
> at com.uber.hoodie.io.HoodieCreateHan
> “””
> _Status_: No solutions yet. Not sure if the problem is because of race-conditions. Currently the workaround is to add hoodie-spark bundle
--
This message was sent by Atlassian Jira
(v8.3.4#803005)