You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@seatunnel.apache.org by xuepeng wang <wx...@gmail.com> on 2023/08/28 12:23:09 UTC

The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Issues Address*https://github.com/apache/seatunnel/issues/5390*
<https://github.com/apache/seatunnel/issues/5390>
Design document link
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by Lucifer Tyrant <ty...@apache.org>.

Could you please update a execution graph in STIP?

xuepeng wang <wx...@gmail.com> 于2023年8月29日周二 13:46写道：
>
> The function execution time of saveMode is after the sink is created, and
> the specific call is in . For example, in the execute(List>
> upstreamDataStreams) method of SinkExecuteProcessor, in the
> createSinkAction() method in MultipleTableJobConfigParser.
> Taking jdbcsink as an example, jdbcSink implements the SupportSaveMode
> interface, implements the method getSaveModeHandler(), and returns a
> DefaultSaveModeHandler instance. You can view the "Taking jdbcsink as an
> example" and "Code execution time" section in the design document
>
> Lucifer Tyrant <ty...@apache.org> 于2023年8月29日周二 11:12写道：
>
> > Hi xupeng,
> >
> > Thank you for your proposal. It looks like an exciting feature. Can
> > you explain the details for this feature? I can't see any useful
> > information for this. For example, the whole work process for save
> > mode? I only see the interface definition in the document.
> >
> > Chao Tian
> >
> > JUN GAO <ga...@apache.org> 于2023年8月28日周一 20:41写道：
> > >
> > > A little suggestion, can you add design document link to the issue
> > > https://github.com/apache/seatunnel/issues/5390 ?
> > >
> > > xuepeng wang <wx...@gmail.com> 于2023年8月28日周一 20:23写道：
> > >
> > > > Issues Address*https://github.com/apache/seatunnel/issues/5390*
> > > > <https://github.com/apache/seatunnel/issues/5390>
> > > > Design document link
> > > >
> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916
> > > >
> > >
> > >
> > > --
> > >
> > > Best Regards
> > >
> > > ------------
> > >
> > > EricJoy2048
> > > gaojun2048@gmail.com
> >

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by xuepeng wang <wx...@gmail.com>.

The function execution time of saveMode is after the sink is created, and
the specific call is in . For example, in the execute(List>
upstreamDataStreams) method of SinkExecuteProcessor, in the
createSinkAction() method in MultipleTableJobConfigParser.
Taking jdbcsink as an example, jdbcSink implements the SupportSaveMode
interface, implements the method getSaveModeHandler(), and returns a
DefaultSaveModeHandler instance. You can view the "Taking jdbcsink as an
example" and "Code execution time" section in the design document

Lucifer Tyrant <ty...@apache.org> 于2023年8月29日周二 11:12写道：

> Hi xupeng,
>
> Thank you for your proposal. It looks like an exciting feature. Can
> you explain the details for this feature? I can't see any useful
> information for this. For example, the whole work process for save
> mode? I only see the interface definition in the document.
>
> Chao Tian
>
> JUN GAO <ga...@apache.org> 于2023年8月28日周一 20:41写道：
> >
> > A little suggestion, can you add design document link to the issue
> > https://github.com/apache/seatunnel/issues/5390 ?
> >
> > xuepeng wang <wx...@gmail.com> 于2023年8月28日周一 20:23写道：
> >
> > > Issues Address*https://github.com/apache/seatunnel/issues/5390*
> > > <https://github.com/apache/seatunnel/issues/5390>
> > > Design document link
> > >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916
> > >
> >
> >
> > --
> >
> > Best Regards
> >
> > ------------
> >
> > EricJoy2048
> > gaojun2048@gmail.com
>

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by Lucifer Tyrant <ty...@apache.org>.

Hi xupeng,

Thank you for your proposal. It looks like an exciting feature. Can
you explain the details for this feature? I can't see any useful
information for this. For example, the whole work process for save
mode? I only see the interface definition in the document.

Chao Tian

JUN GAO <ga...@apache.org> 于2023年8月28日周一 20:41写道：
>
> A little suggestion, can you add design document link to the issue
> https://github.com/apache/seatunnel/issues/5390 ?
>
> xuepeng wang <wx...@gmail.com> 于2023年8月28日周一 20:23写道：
>
> > Issues Address*https://github.com/apache/seatunnel/issues/5390*
> > <https://github.com/apache/seatunnel/issues/5390>
> > Design document link
> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916
> >
>
>
> --
>
> Best Regards
>
> ------------
>
> EricJoy2048
> gaojun2048@gmail.com

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by JUN GAO <ga...@apache.org>.

A little suggestion, can you add design document link to the issue
https://github.com/apache/seatunnel/issues/5390 ?

xuepeng wang <wx...@gmail.com> 于2023年8月28日周一 20:23写道：

> Issues Address*https://github.com/apache/seatunnel/issues/5390*
> <https://github.com/apache/seatunnel/issues/5390>
> Design document link
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916
>


-- 

Best Regards

------------

EricJoy2048
gaojun2048@gmail.com

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by JUN GAO <ga...@apache.org>.

This seems to be a great proposal, and for the first time, a contributor
has put design documents on confluence, which is a great progress. I hope
more design documents can be shared through confluence in the future.



David Zollo <da...@gmail.com> 于2023年8月28日周一 20:25写道：

> Is it a feature proposal?
>
>
>
>
>
>
>
> Best Regards
>
> ---------------
> Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member
> David
> Linkedin: https://www.linkedin.com/in/davidzollo
> Twitter: @WorkflowEasy
> ---------------
>
> On Mon, Aug 28, 2023 at 8:23 PM xuepeng wang <wx...@gmail.com> wrote:
> >
> > Issues Address*https://github.com/apache/seatunnel/issues/5390*
> > <https://github.com/apache/seatunnel/issues/5390>
> > Design document link
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916
>


-- 

Best Regards

------------

EricJoy2048
gaojun2048@gmail.com

Re: The Sink terminal implements SaveMode functions (including SchemaSaveMode and DataSaveMode)

Posted by David Zollo <da...@gmail.com>.

Is it a feature proposal?







Best Regards

---------------
Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member
David
Linkedin: https://www.linkedin.com/in/davidzollo
Twitter: @WorkflowEasy
---------------

On Mon, Aug 28, 2023 at 8:23 PM xuepeng wang <wx...@gmail.com> wrote:
>
> Issues Address*https://github.com/apache/seatunnel/issues/5390*
> <https://github.com/apache/seatunnel/issues/5390>
> Design document link
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263427916