You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@dolphinscheduler.apache.org by JUN GAO <ga...@gmail.com> on 2020/07/09 13:18:43 UTC
Add repository incubator-dolphinscheduler-maven-plugin
Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
<le...@apache.org> @lgcareer2019@outlook.com <lg...@outlook.com>
We need to add a repository named incubator-dolphinscheduler-maven-plugin
for dolphinscheduler .
Can you help me with that?
The code of incubator-dolphinscheduler-maven-plugin is here
https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
That is the README about incubator-dolphinscheduler-maven-plugin:
This is a maven plugin for DolphinScheduler , It has three functions:
1.
It is allowed to add dolphinscheduler-plugin to the pom file. If
dolphinscheduler-plugin is added to the pom file, the DolphinScheduler
service will load this model as a DolphinScheduler plugin.
2.
Automatically check the model with dolphinscheduler-plugin added to the
pom file, and will automatically generate
META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler file
when compile.
3.
Automatically check DolphinScheduler's maven dependency. Especially the
dependencies used by plugins.
<https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin>Why
we need this maven plugin?
If we are running on the server deployment. Because the plug-ins are in the
corresponding plug-in directory, and the plug-in jar package has the
corresponding META-INF/services, there is no problem.
However, when we develop locally in IDE, we have no plug-ins dir and no
plug-ins jar file . If we want to test and debug the plugin code, we need
add the plugin module to the pom.xml of alert module ,But this violates the
original intention of SPI. So we can`t add the plug-in module to the alert
module as a dependency, So there will be a problem that the alert module
cannot find the plug-in classes.
With this maven plug-in, by scanning the pom file of the project ,The
pluginloader can find the module identified by dolphinscheduler-plugin,
then can load this module`s class files and its dependent third-party jars
from the target/classes dir of the plug-in module. This will debug locally.
--
DolphinScheduler(Incubator) PPMC
Jun Gao 高俊
gaojun2048@gmail.com
Re: Add repository incubator-dolphinscheduler-maven-plugin
Posted by JUN GAO <ga...@gmail.com>.
Thank you very much!
Sheng Wu <wu...@gmail.com> 于2020年7月15日周三 下午2:00写道：
> Created, good luck.
>
> Sheng Wu 吴晟
> Twitter, wusheng1108
>
>
> JUN GAO <ga...@gmail.com> 于2020年7月15日周三 下午12:59写道：
>
>> Hi.
>>
>> @Sheng Wu <wu...@gmail.com> :
>> Could you help us to create a new repository named
>> incubator-dolphinscheduler-maven-plugin?
>> through the following link:
>> https://gitbox.apache.org/setup/newrepo.html
>>
>> Thank you!
>>
>> lidong dai <da...@gmail.com> 于2020年7月11日周六 上午8:43写道：
>>
>>> I take your point, but I don't have permission to create repository
>>> named
>>> incubator-dolphinscheduler-maven-plugin. this need our mentor to help
>>>
>>> @Sheng Wu <wu...@gmail.com> :
>>> Could you help us to create a new repository named
>>> incubator-dolphinscheduler-maven-plugin?
>>> through the following link:
>>> https://gitbox.apache.org/setup/newrepo.html
>>>
>>>
>>>
>>> Best Regards
>>> ---------------
>>> DolphinScheduler(Incubator) PPMC
>>> Lidong Dai 代立冬
>>> dailidong66@gmail.com
>>> ---------------
>>>
>>>
>>> JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:21写道：
>>>
>>> > The incubator-dolphinscheduler-maven-plugin related issues are
>>> > https://github.com/apache/incubator-dolphinscheduler/issues/3049
>>> >
>>> >
>>> > JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:18写道：
>>> >
>>> > > Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
>>> > > <le...@apache.org> @lgcareer2019@outlook.com <
>>> > lgcareer2019@outlook.com>
>>> > >
>>> > >
>>> > > We need to add a repository named
>>> incubator-dolphinscheduler-maven-plugin
>>> > > for dolphinscheduler .
>>> > > Can you help me with that?
>>> > >
>>> > > The code of incubator-dolphinscheduler-maven-plugin is here
>>> > >
>>> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
>>> > >
>>> > > That is the README about incubator-dolphinscheduler-maven-plugin:
>>> > >
>>> > > This is a maven plugin for DolphinScheduler , It has three functions:
>>> > >
>>> > > 1.
>>> > >
>>> > > It is allowed to add dolphinscheduler-plugin to the pom file. If
>>> > > dolphinscheduler-plugin is added to the pom file, the
>>> DolphinScheduler
>>> > > service will load this model as a DolphinScheduler plugin.
>>> > > 2.
>>> > >
>>> > > Automatically check the model with dolphinscheduler-plugin added
>>> to
>>> > > the pom file, and will automatically generate
>>> > > META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler
>>> > file
>>> > > when compile.
>>> > > 3.
>>> > >
>>> > > Automatically check DolphinScheduler's maven dependency.
>>> Especially
>>> > > the dependencies used by plugins.
>>> > >
>>> > >
>>> > > <
>>> >
>>> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin
>>> > >Why
>>> > > we need this maven plugin?
>>> > >
>>> > > If we are running on the server deployment. Because the plug-ins are
>>> in
>>> > > the corresponding plug-in directory, and the plug-in jar package has
>>> the
>>> > > corresponding META-INF/services, there is no problem.
>>> > >
>>> > > However, when we develop locally in IDE, we have no plug-ins dir and
>>> no
>>> > > plug-ins jar file . If we want to test and debug the plugin code, we
>>> need
>>> > > add the plugin module to the pom.xml of alert module ,But this
>>> violates
>>> > the
>>> > > original intention of SPI. So we can`t add the plug-in module to the
>>> > alert
>>> > > module as a dependency, So there will be a problem that the alert
>>> module
>>> > > cannot find the plug-in classes.
>>> > >
>>> > > With this maven plug-in, by scanning the pom file of the project ,The
>>> > > pluginloader can find the module identified by
>>> dolphinscheduler-plugin,
>>> > > then can load this module`s class files and its dependent third-party
>>> > jars
>>> > > from the target/classes dir of the plug-in module. This will debug
>>> > locally.
>>> > >
>>> > > --
>>> > >
>>> > > DolphinScheduler(Incubator) PPMC
>>> > > Jun Gao 高俊
>>> > > gaojun2048@gmail.com
>>> > >
>>> > >
>>> >
>>> > --
>>> >
>>> > DolphinScheduler(Incubator) PPMC
>>> > Jun Gao 高俊
>>> > gaojun2048@gmail.com
>>> >
>>>
>>
>>
>> --
>>
>> DolphinScheduler(Incubator) PPMC
>> Jun Gao 高俊
>> gaojun2048@gmail.com
>>
>>
--
DolphinScheduler(Incubator) PPMC
Jun Gao 高俊
gaojun2048@gmail.com
Re: Add repository incubator-dolphinscheduler-maven-plugin
Posted by Sheng Wu <wu...@gmail.com>.
Created, good luck.
Sheng Wu 吴晟
Twitter, wusheng1108
JUN GAO <ga...@gmail.com> 于2020年7月15日周三 下午12:59写道：
> Hi.
>
> @Sheng Wu <wu...@gmail.com> :
> Could you help us to create a new repository named
> incubator-dolphinscheduler-maven-plugin?
> through the following link:
> https://gitbox.apache.org/setup/newrepo.html
>
> Thank you!
>
> lidong dai <da...@gmail.com> 于2020年7月11日周六 上午8:43写道：
>
>> I take your point, but I don't have permission to create repository named
>> incubator-dolphinscheduler-maven-plugin. this need our mentor to help
>>
>> @Sheng Wu <wu...@gmail.com> :
>> Could you help us to create a new repository named
>> incubator-dolphinscheduler-maven-plugin?
>> through the following link:
>> https://gitbox.apache.org/setup/newrepo.html
>>
>>
>>
>> Best Regards
>> ---------------
>> DolphinScheduler(Incubator) PPMC
>> Lidong Dai 代立冬
>> dailidong66@gmail.com
>> ---------------
>>
>>
>> JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:21写道：
>>
>> > The incubator-dolphinscheduler-maven-plugin related issues are
>> > https://github.com/apache/incubator-dolphinscheduler/issues/3049
>> >
>> >
>> > JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:18写道：
>> >
>> > > Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
>> > > <le...@apache.org> @lgcareer2019@outlook.com <
>> > lgcareer2019@outlook.com>
>> > >
>> > >
>> > > We need to add a repository named
>> incubator-dolphinscheduler-maven-plugin
>> > > for dolphinscheduler .
>> > > Can you help me with that?
>> > >
>> > > The code of incubator-dolphinscheduler-maven-plugin is here
>> > > https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
>> > >
>> > > That is the README about incubator-dolphinscheduler-maven-plugin:
>> > >
>> > > This is a maven plugin for DolphinScheduler , It has three functions:
>> > >
>> > > 1.
>> > >
>> > > It is allowed to add dolphinscheduler-plugin to the pom file. If
>> > > dolphinscheduler-plugin is added to the pom file, the
>> DolphinScheduler
>> > > service will load this model as a DolphinScheduler plugin.
>> > > 2.
>> > >
>> > > Automatically check the model with dolphinscheduler-plugin added to
>> > > the pom file, and will automatically generate
>> > > META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler
>> > file
>> > > when compile.
>> > > 3.
>> > >
>> > > Automatically check DolphinScheduler's maven dependency. Especially
>> > > the dependencies used by plugins.
>> > >
>> > >
>> > > <
>> >
>> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin
>> > >Why
>> > > we need this maven plugin?
>> > >
>> > > If we are running on the server deployment. Because the plug-ins are
>> in
>> > > the corresponding plug-in directory, and the plug-in jar package has
>> the
>> > > corresponding META-INF/services, there is no problem.
>> > >
>> > > However, when we develop locally in IDE, we have no plug-ins dir and
>> no
>> > > plug-ins jar file . If we want to test and debug the plugin code, we
>> need
>> > > add the plugin module to the pom.xml of alert module ,But this
>> violates
>> > the
>> > > original intention of SPI. So we can`t add the plug-in module to the
>> > alert
>> > > module as a dependency, So there will be a problem that the alert
>> module
>> > > cannot find the plug-in classes.
>> > >
>> > > With this maven plug-in, by scanning the pom file of the project ,The
>> > > pluginloader can find the module identified by
>> dolphinscheduler-plugin,
>> > > then can load this module`s class files and its dependent third-party
>> > jars
>> > > from the target/classes dir of the plug-in module. This will debug
>> > locally.
>> > >
>> > > --
>> > >
>> > > DolphinScheduler(Incubator) PPMC
>> > > Jun Gao 高俊
>> > > gaojun2048@gmail.com
>> > >
>> > >
>> >
>> > --
>> >
>> > DolphinScheduler(Incubator) PPMC
>> > Jun Gao 高俊
>> > gaojun2048@gmail.com
>> >
>>
>
>
> --
>
> DolphinScheduler(Incubator) PPMC
> Jun Gao 高俊
> gaojun2048@gmail.com
>
>
Re: Add repository incubator-dolphinscheduler-maven-plugin
Posted by JUN GAO <ga...@gmail.com>.
Hi.
@Sheng Wu <wu...@gmail.com> :
Could you help us to create a new repository named
incubator-dolphinscheduler-maven-plugin?
through the following link:
https://gitbox.apache.org/setup/newrepo.html
Thank you!
lidong dai <da...@gmail.com> 于2020年7月11日周六 上午8:43写道：
> I take your point, but I don't have permission to create repository named
> incubator-dolphinscheduler-maven-plugin. this need our mentor to help
>
> @Sheng Wu <wu...@gmail.com> :
> Could you help us to create a new repository named
> incubator-dolphinscheduler-maven-plugin?
> through the following link:
> https://gitbox.apache.org/setup/newrepo.html
>
>
>
> Best Regards
> ---------------
> DolphinScheduler(Incubator) PPMC
> Lidong Dai 代立冬
> dailidong66@gmail.com
> ---------------
>
>
> JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:21写道：
>
> > The incubator-dolphinscheduler-maven-plugin related issues are
> > https://github.com/apache/incubator-dolphinscheduler/issues/3049
> >
> >
> > JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:18写道：
> >
> > > Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
> > > <le...@apache.org> @lgcareer2019@outlook.com <
> > lgcareer2019@outlook.com>
> > >
> > >
> > > We need to add a repository named
> incubator-dolphinscheduler-maven-plugin
> > > for dolphinscheduler .
> > > Can you help me with that?
> > >
> > > The code of incubator-dolphinscheduler-maven-plugin is here
> > > https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
> > >
> > > That is the README about incubator-dolphinscheduler-maven-plugin:
> > >
> > > This is a maven plugin for DolphinScheduler , It has three functions:
> > >
> > > 1.
> > >
> > > It is allowed to add dolphinscheduler-plugin to the pom file. If
> > > dolphinscheduler-plugin is added to the pom file, the
> DolphinScheduler
> > > service will load this model as a DolphinScheduler plugin.
> > > 2.
> > >
> > > Automatically check the model with dolphinscheduler-plugin added to
> > > the pom file, and will automatically generate
> > > META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler
> > file
> > > when compile.
> > > 3.
> > >
> > > Automatically check DolphinScheduler's maven dependency. Especially
> > > the dependencies used by plugins.
> > >
> > >
> > > <
> >
> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin
> > >Why
> > > we need this maven plugin?
> > >
> > > If we are running on the server deployment. Because the plug-ins are in
> > > the corresponding plug-in directory, and the plug-in jar package has
> the
> > > corresponding META-INF/services, there is no problem.
> > >
> > > However, when we develop locally in IDE, we have no plug-ins dir and no
> > > plug-ins jar file . If we want to test and debug the plugin code, we
> need
> > > add the plugin module to the pom.xml of alert module ,But this violates
> > the
> > > original intention of SPI. So we can`t add the plug-in module to the
> > alert
> > > module as a dependency, So there will be a problem that the alert
> module
> > > cannot find the plug-in classes.
> > >
> > > With this maven plug-in, by scanning the pom file of the project ,The
> > > pluginloader can find the module identified by dolphinscheduler-plugin,
> > > then can load this module`s class files and its dependent third-party
> > jars
> > > from the target/classes dir of the plug-in module. This will debug
> > locally.
> > >
> > > --
> > >
> > > DolphinScheduler(Incubator) PPMC
> > > Jun Gao 高俊
> > > gaojun2048@gmail.com
> > >
> > >
> >
> > --
> >
> > DolphinScheduler(Incubator) PPMC
> > Jun Gao 高俊
> > gaojun2048@gmail.com
> >
>
--
DolphinScheduler(Incubator) PPMC
Jun Gao 高俊
gaojun2048@gmail.com
Re: Add repository incubator-dolphinscheduler-maven-plugin
Posted by lidong dai <da...@gmail.com>.
I take your point, but I don't have permission to create repository named
incubator-dolphinscheduler-maven-plugin. this need our mentor to help
@Sheng Wu <wu...@gmail.com> :
Could you help us to create a new repository named
incubator-dolphinscheduler-maven-plugin?
through the following link:
https://gitbox.apache.org/setup/newrepo.html
Best Regards
---------------
DolphinScheduler(Incubator) PPMC
Lidong Dai 代立冬
dailidong66@gmail.com
---------------
JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:21写道：
> The incubator-dolphinscheduler-maven-plugin related issues are
> https://github.com/apache/incubator-dolphinscheduler/issues/3049
>
>
> JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:18写道：
>
> > Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
> > <le...@apache.org> @lgcareer2019@outlook.com <
> lgcareer2019@outlook.com>
> >
> >
> > We need to add a repository named incubator-dolphinscheduler-maven-plugin
> > for dolphinscheduler .
> > Can you help me with that?
> >
> > The code of incubator-dolphinscheduler-maven-plugin is here
> > https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
> >
> > That is the README about incubator-dolphinscheduler-maven-plugin:
> >
> > This is a maven plugin for DolphinScheduler , It has three functions:
> >
> > 1.
> >
> > It is allowed to add dolphinscheduler-plugin to the pom file. If
> > dolphinscheduler-plugin is added to the pom file, the DolphinScheduler
> > service will load this model as a DolphinScheduler plugin.
> > 2.
> >
> > Automatically check the model with dolphinscheduler-plugin added to
> > the pom file, and will automatically generate
> > META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler
> file
> > when compile.
> > 3.
> >
> > Automatically check DolphinScheduler's maven dependency. Especially
> > the dependencies used by plugins.
> >
> >
> > <
> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin
> >Why
> > we need this maven plugin?
> >
> > If we are running on the server deployment. Because the plug-ins are in
> > the corresponding plug-in directory, and the plug-in jar package has the
> > corresponding META-INF/services, there is no problem.
> >
> > However, when we develop locally in IDE, we have no plug-ins dir and no
> > plug-ins jar file . If we want to test and debug the plugin code, we need
> > add the plugin module to the pom.xml of alert module ,But this violates
> the
> > original intention of SPI. So we can`t add the plug-in module to the
> alert
> > module as a dependency, So there will be a problem that the alert module
> > cannot find the plug-in classes.
> >
> > With this maven plug-in, by scanning the pom file of the project ,The
> > pluginloader can find the module identified by dolphinscheduler-plugin,
> > then can load this module`s class files and its dependent third-party
> jars
> > from the target/classes dir of the plug-in module. This will debug
> locally.
> >
> > --
> >
> > DolphinScheduler(Incubator) PPMC
> > Jun Gao 高俊
> > gaojun2048@gmail.com
> >
> >
>
> --
>
> DolphinScheduler(Incubator) PPMC
> Jun Gao 高俊
> gaojun2048@gmail.com
>
Re: Add repository incubator-dolphinscheduler-maven-plugin
Posted by JUN GAO <ga...@gmail.com>.
The incubator-dolphinscheduler-maven-plugin related issues are
https://github.com/apache/incubator-dolphinscheduler/issues/3049
JUN GAO <ga...@gmail.com> 于2020年7月9日周四 下午9:18写道：
> Hi @lidong dai <da...@gmail.com> @leonbao@apache.org
> <le...@apache.org> @lgcareer2019@outlook.com <lg...@outlook.com>
>
>
> We need to add a repository named incubator-dolphinscheduler-maven-plugin
> for dolphinscheduler .
> Can you help me with that?
>
> The code of incubator-dolphinscheduler-maven-plugin is here
> https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin
>
> That is the README about incubator-dolphinscheduler-maven-plugin:
>
> This is a maven plugin for DolphinScheduler , It has three functions:
>
> 1.
>
> It is allowed to add dolphinscheduler-plugin to the pom file. If
> dolphinscheduler-plugin is added to the pom file, the DolphinScheduler
> service will load this model as a DolphinScheduler plugin.
> 2.
>
> Automatically check the model with dolphinscheduler-plugin added to
> the pom file, and will automatically generate
> META-INF/services/org.apache.dolphinscheduler.spi.DolphinScheduler file
> when compile.
> 3.
>
> Automatically check DolphinScheduler's maven dependency. Especially
> the dependencies used by plugins.
>
>
> <https://github.com/gaojun2048/incubator-dolphinscheduler-maven-plugin#why-we-need-this-maven-plugin>Why
> we need this maven plugin?
>
> If we are running on the server deployment. Because the plug-ins are in
> the corresponding plug-in directory, and the plug-in jar package has the
> corresponding META-INF/services, there is no problem.
>
> However, when we develop locally in IDE, we have no plug-ins dir and no
> plug-ins jar file . If we want to test and debug the plugin code, we need
> add the plugin module to the pom.xml of alert module ,But this violates the
> original intention of SPI. So we can`t add the plug-in module to the alert
> module as a dependency, So there will be a problem that the alert module
> cannot find the plug-in classes.
>
> With this maven plug-in, by scanning the pom file of the project ,The
> pluginloader can find the module identified by dolphinscheduler-plugin,
> then can load this module`s class files and its dependent third-party jars
> from the target/classes dir of the plug-in module. This will debug locally.
>
> --
>
> DolphinScheduler(Incubator) PPMC
> Jun Gao 高俊
> gaojun2048@gmail.com
>
>
--
DolphinScheduler(Incubator) PPMC
Jun Gao 高俊
gaojun2048@gmail.com