You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2019/11/08 16:14:00 UTC
[jira] [Comment Edited] (HUDI-15) Add a delete() API to
HoodieWriteClient as well as Spark datasource #531
[ https://issues.apache.org/jira/browse/HUDI-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970359#comment-16970359 ]
sivabalan narayanan edited comment on HUDI-15 at 11/8/19 4:13 PM:
------------------------------------------------------------------
Yes, there wasn't a necessity. I was able to get this done.
Schema: yes. you are right.
btw, I have put up a [PR|[https://github.com/apache/incubator-hudi/pull/1004]] to add delete api in HoodieWriteClient.
Will be working on DataSources next.
was (Author: shivnarayan):
Schema: yes. you are right.
btw, I have put up a [PR|[https://github.com/apache/incubator-hudi/pull/1004]] to add delete api in HoodieWriteClient.
Will be working on DataSources next.
> Add a delete() API to HoodieWriteClient as well as Spark datasource #531
> ------------------------------------------------------------------------
>
> Key: HUDI-15
> URL: https://issues.apache.org/jira/browse/HUDI-15
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: Spark datasource, Write Client
> Reporter: Vinoth Chandar
> Assignee: sivabalan narayanan
> Priority: Major
> Fix For: 0.5.1
>
>
> Delete API needs to be supported as first class citizen via DeltaStreamer, WriteClient and datasources. Currently there are two ways to delete, soft deletes and hard deletes - https://hudi.apache.org/writing_data.html#deletes. We need to ensure for hard deletes, we are able to leverage EmptyHoodieRecordPayload with just the HoodieKey and empty record value for deleting.
> [https://github.com/uber/hudi/issues/531]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)