You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@seatunnel.apache.org by JUN GAO <ga...@apache.org> on 2022/12/28 09:18:40 UTC
[Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Hi,
Now seatunnel used many third party jar package, for example hadoop,
hadoop-aws. Sometimes these jars will conflict. I think we should create a
project to manage these conflicting jar packages separately and shade them.
What do you think?
--
Best Regards
------------
EricJoy2048
gaojun2048@gmail.com
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by hailin0 <wa...@apache.org>.
+1
JUN GAO <ga...@apache.org> 于2022年12月30日周五 12:14写道：
> No, seatunnel-shade repository will be released separately.
>
> Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 17:42写道：
>
> > Then I have a question:
> >
> > Does the repository need to follow the main repository when releasing
> > a new version?
> >
> > JUN GAO <ga...@apache.org> 于2022年12月29日周四 15:46写道：
> >
> > >
> > > Hi @Lucifer Tyrant
> > >
> > > Because we need release more shade jar (for example
> > > seatunnel-hadoop2-uber.jar, seatunnel-hadoop3-aws-3.1.4-uber.jar,
> > > seatunnel-hadoop2-aws-2.9.2-uber.jar). I think a separate project is
> more
> > > convenient for new version release.
> > >
> > > On the other hand, we need use <classifier>optional</classifier> in
> > > dependency, I don't think it is a good idea.
> > >
> > > Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 15:08写道：
> > >
> > > > Hi Jun,
> > > >
> > > > Do we need create a new project to do this work? I think sub module
> is
> > > > enough.
> > > >
> > > > Best wishes!
> > > > Chao Tian
> > > >
> > > > ethan liu <li...@gmail.com> 于2022年12月29日周四 12:46写道：
> > > > >
> > > > > +1
> > > > >
> > > > > CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
> > > > >
> > > > > > +1, we need this.
> > > > > >
> > > > > >
> > > > > > Best wishes！
> > > > > > Calvin Kirs
> > > > > >
> > > > > >
> > > > > > On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> > > > > > Hi,
> > > > > >
> > > > > > Now seatunnel used many third party jar package, for example
> > hadoop,
> > > > > > hadoop-aws. Sometimes these jars will conflict. I think we should
> > > > create a
> > > > > > project to manage these conflicting jar packages separately and
> > shade
> > > > them.
> > > > > >
> > > > > > What do you think?
> > > > > >
> > > > > > --
> > > > > >
> > > > > > Best Regards
> > > > > >
> > > > > > ------------
> > > > > >
> > > > > > EricJoy2048
> > > > > > gaojun2048@gmail.com
> > > > > >
> > > >
> > >
> > >
> > > --
> > >
> > > Best Regards
> > >
> > > ------------
> > >
> > > EricJoy2048
> > > gaojun2048@gmail.com
> >
>
>
> --
>
> Best Regards
>
> ------------
>
> EricJoy2048
> gaojun2048@gmail.com
>
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by JUN GAO <ga...@apache.org>.
No, seatunnel-shade repository will be released separately.
Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 17:42写道：
> Then I have a question:
>
> Does the repository need to follow the main repository when releasing
> a new version?
>
> JUN GAO <ga...@apache.org> 于2022年12月29日周四 15:46写道：
>
> >
> > Hi @Lucifer Tyrant
> >
> > Because we need release more shade jar (for example
> > seatunnel-hadoop2-uber.jar, seatunnel-hadoop3-aws-3.1.4-uber.jar,
> > seatunnel-hadoop2-aws-2.9.2-uber.jar). I think a separate project is more
> > convenient for new version release.
> >
> > On the other hand, we need use <classifier>optional</classifier> in
> > dependency, I don't think it is a good idea.
> >
> > Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 15:08写道：
> >
> > > Hi Jun,
> > >
> > > Do we need create a new project to do this work? I think sub module is
> > > enough.
> > >
> > > Best wishes!
> > > Chao Tian
> > >
> > > ethan liu <li...@gmail.com> 于2022年12月29日周四 12:46写道：
> > > >
> > > > +1
> > > >
> > > > CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
> > > >
> > > > > +1, we need this.
> > > > >
> > > > >
> > > > > Best wishes！
> > > > > Calvin Kirs
> > > > >
> > > > >
> > > > > On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> > > > > Hi,
> > > > >
> > > > > Now seatunnel used many third party jar package, for example
> hadoop,
> > > > > hadoop-aws. Sometimes these jars will conflict. I think we should
> > > create a
> > > > > project to manage these conflicting jar packages separately and
> shade
> > > them.
> > > > >
> > > > > What do you think?
> > > > >
> > > > > --
> > > > >
> > > > > Best Regards
> > > > >
> > > > > ------------
> > > > >
> > > > > EricJoy2048
> > > > > gaojun2048@gmail.com
> > > > >
> > >
> >
> >
> > --
> >
> > Best Regards
> >
> > ------------
> >
> > EricJoy2048
> > gaojun2048@gmail.com
>
--
Best Regards
------------
EricJoy2048
gaojun2048@gmail.com
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by Lucifer Tyrant <ty...@apache.org>.
Then I have a question:
Does the repository need to follow the main repository when releasing
a new version?
JUN GAO <ga...@apache.org> 于2022年12月29日周四 15:46写道：
>
> Hi @Lucifer Tyrant
>
> Because we need release more shade jar (for example
> seatunnel-hadoop2-uber.jar, seatunnel-hadoop3-aws-3.1.4-uber.jar,
> seatunnel-hadoop2-aws-2.9.2-uber.jar). I think a separate project is more
> convenient for new version release.
>
> On the other hand, we need use <classifier>optional</classifier> in
> dependency, I don't think it is a good idea.
>
> Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 15:08写道：
>
> > Hi Jun,
> >
> > Do we need create a new project to do this work? I think sub module is
> > enough.
> >
> > Best wishes!
> > Chao Tian
> >
> > ethan liu <li...@gmail.com> 于2022年12月29日周四 12:46写道：
> > >
> > > +1
> > >
> > > CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
> > >
> > > > +1, we need this.
> > > >
> > > >
> > > > Best wishes！
> > > > Calvin Kirs
> > > >
> > > >
> > > > On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> > > > Hi,
> > > >
> > > > Now seatunnel used many third party jar package, for example hadoop,
> > > > hadoop-aws. Sometimes these jars will conflict. I think we should
> > create a
> > > > project to manage these conflicting jar packages separately and shade
> > them.
> > > >
> > > > What do you think?
> > > >
> > > > --
> > > >
> > > > Best Regards
> > > >
> > > > ------------
> > > >
> > > > EricJoy2048
> > > > gaojun2048@gmail.com
> > > >
> >
>
>
> --
>
> Best Regards
>
> ------------
>
> EricJoy2048
> gaojun2048@gmail.com
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by JUN GAO <ga...@apache.org>.
Hi @Lucifer Tyrant
Because we need release more shade jar (for example
seatunnel-hadoop2-uber.jar, seatunnel-hadoop3-aws-3.1.4-uber.jar,
seatunnel-hadoop2-aws-2.9.2-uber.jar). I think a separate project is more
convenient for new version release.
On the other hand, we need use <classifier>optional</classifier> in
dependency, I don't think it is a good idea.
Lucifer Tyrant <ty...@apache.org> 于2022年12月29日周四 15:08写道：
> Hi Jun,
>
> Do we need create a new project to do this work? I think sub module is
> enough.
>
> Best wishes!
> Chao Tian
>
> ethan liu <li...@gmail.com> 于2022年12月29日周四 12:46写道：
> >
> > +1
> >
> > CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
> >
> > > +1, we need this.
> > >
> > >
> > > Best wishes！
> > > Calvin Kirs
> > >
> > >
> > > On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> > > Hi,
> > >
> > > Now seatunnel used many third party jar package, for example hadoop,
> > > hadoop-aws. Sometimes these jars will conflict. I think we should
> create a
> > > project to manage these conflicting jar packages separately and shade
> them.
> > >
> > > What do you think?
> > >
> > > --
> > >
> > > Best Regards
> > >
> > > ------------
> > >
> > > EricJoy2048
> > > gaojun2048@gmail.com
> > >
>
--
Best Regards
------------
EricJoy2048
gaojun2048@gmail.com
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by Lucifer Tyrant <ty...@apache.org>.
Hi Jun,
Do we need create a new project to do this work? I think sub module is enough.
Best wishes!
Chao Tian
ethan liu <li...@gmail.com> 于2022年12月29日周四 12:46写道：
>
> +1
>
> CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
>
> > +1, we need this.
> >
> >
> > Best wishes！
> > Calvin Kirs
> >
> >
> > On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> > Hi,
> >
> > Now seatunnel used many third party jar package, for example hadoop,
> > hadoop-aws. Sometimes these jars will conflict. I think we should create a
> > project to manage these conflicting jar packages separately and shade them.
> >
> > What do you think?
> >
> > --
> >
> > Best Regards
> >
> > ------------
> >
> > EricJoy2048
> > gaojun2048@gmail.com
> >
Re: [Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by ethan liu <li...@gmail.com>.
+1
CalvinKirs <ac...@163.com> 于2022年12月28日周三 17:26写道：
> +1, we need this.
>
>
> Best wishes！
> Calvin Kirs
>
>
> On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
> Hi,
>
> Now seatunnel used many third party jar package, for example hadoop,
> hadoop-aws. Sometimes these jars will conflict. I think we should create a
> project to manage these conflicting jar packages separately and shade them.
>
> What do you think?
>
> --
>
> Best Regards
>
> ------------
>
> EricJoy2048
> gaojun2048@gmail.com
>
Re:[Disscuss] Add seatunnel-shade project to manager seatunnel used shade and uber jar
Posted by CalvinKirs <ac...@163.com>.
+1, we need this.
Best wishes！
Calvin Kirs
On 12/28/2022 17:18，JUN GAO<ga...@apache.org> wrote：
Hi,
Now seatunnel used many third party jar package, for example hadoop,
hadoop-aws. Sometimes these jars will conflict. I think we should create a
project to manage these conflicting jar packages separately and shade them.
What do you think?
--
Best Regards
------------
EricJoy2048
gaojun2048@gmail.com