You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2019/11/08 16:14:00 UTC

[jira] [Comment Edited] (HUDI-15) Add a delete() API to HoodieWriteClient as well as Spark datasource #531

    [ https://issues.apache.org/jira/browse/HUDI-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970359#comment-16970359 ] 

sivabalan narayanan edited comment on HUDI-15 at 11/8/19 4:13 PM:
------------------------------------------------------------------

Yes, there wasn't a necessity. I was able to get this done.

Schema: yes. you are right. 

btw, I have put up a [PR|[https://github.com/apache/incubator-hudi/pull/1004]] to add delete api in HoodieWriteClient. 

Will be working on DataSources next. 


was (Author: shivnarayan):
Schema: yes. you are right. 

btw, I have put up a [PR|[https://github.com/apache/incubator-hudi/pull/1004]] to add delete api in HoodieWriteClient. 

Will be working on DataSources next. 

> Add a delete() API to HoodieWriteClient as well as Spark datasource #531
> ------------------------------------------------------------------------
>
>                 Key: HUDI-15
>                 URL: https://issues.apache.org/jira/browse/HUDI-15
>             Project: Apache Hudi (incubating)
>          Issue Type: New Feature
>          Components: Spark datasource, Write Client
>            Reporter: Vinoth Chandar
>            Assignee: sivabalan narayanan
>            Priority: Major
>             Fix For: 0.5.1
>
>
> Delete API needs to be supported as first class citizen via DeltaStreamer, WriteClient and datasources. Currently there are two ways to delete, soft deletes and hard deletes - https://hudi.apache.org/writing_data.html#deletes. We need to ensure for hard deletes, we are able to leverage EmptyHoodieRecordPayload with just the HoodieKey and empty record value for deleting.
> [https://github.com/uber/hudi/issues/531]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)