You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Mathias Peters <ma...@gmx.org> on 2015/01/17 13:24:45 UTC
CLI: wait-Flag to schedule multiple jobs in a script
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
is there still a way to schedule jobs to the JobManager on after each
other?
I remember the "-w" flag in an earlier version for that. This seems to
be gone now, though.
How could one schedule jobs like that now?
Thanks and regards
Mathias
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQEcBAEBAgAGBQJUulSNAAoJEHj0VWOtoCa7RQ8H/inynJ9j/MSUpyBeg8MA7+/2
rvOgd2LTg+DfysJKzsUIyh87G+yMSqEF6/I0bGL6hqF53TspLa8PEqZxe/Cr1RPy
+SkQ5FERhKSHBDMQLGNItoqg1y6a5u9S8O6e/JGOpO5Lo9h0vame8+WoocKz9334
tmy3Gr/rTJHMjy0dgM1xQl+EKMJQVK1vUCeiyLqKWGwH3S5kvrpz+8y7XKmiWQN/
hZpVndDd7+ggc6oCsukoVzvmogTDu6zLdy4jtKaMGO3kPJU/cVxWNZvXlRPBKnEz
KtSoGYcPWqFtL/qt6x26nmRvNimGQ4hFX+tAOri+2AQnJ4E+2XN/zGj3CVDHXqU=
=xwce
-----END PGP SIGNATURE-----
Re: CLI: wait-Flag to schedule multiple jobs in a script
Posted by Robert Metzger <rm...@apache.org>.
Stephan or Till can probably elaborate better on that, but maybe you need
to add a "sleep 5" between submitting jobs. Maybe the slots are freed up
lazily .. or the reporting of the free slots doesn't happen directly.
On Sat, Jan 17, 2015 at 3:00 PM, Mathias Peters <ma...@gmx.org>
wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Thanks for the reply.
>
> I had some issues with running several jobs from a script yesterday.
> The jobs at the end of the script failed due to a lack of processing
> slots. I'll check the log files again, maybe there was another issue
> with the first job.
>
> Thanks
> Mathias
>
>
> On 17.01.2015 14:32, Alexander Alexandrov wrote:
> > The "wait" mode of execution seems to be the default now as of this
> > commit:
> >
> >
> https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c
> >
> > 2015-01-17 14:10 GMT+01:00 Mathias Peters
> > <ma...@gmx.org>:
> >
> > Yes but not at the current state. I checked out, just before
> > christmas last year and haven't merged yet.
> >
> > Mathias
> >
> >
> > On 17.01.2015 13:53, Alexander Alexandrov wrote:
> >>>> Are you looking at the master (0.9-SNAPSHOT) branch?
> >>>>
> >>>> 2015-01-17 13:24 GMT+01:00 Mathias Peters
> >>>> <ma...@gmx.org>:
> >>>>
> >>>> Hi,
> >>>>
> >>>> is there still a way to schedule jobs to the JobManager on
> >>>> after each other?
> >>>>
> >>>> I remember the "-w" flag in an earlier version for that. This
> >>>> seems to be gone now, though. How could one schedule jobs
> >>>> like that now?
> >>>>
> >>>> Thanks and regards Mathias
> >>>>>
> >>>>
> >
> >>
> >
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1
>
> iQEcBAEBAgAGBQJUumr2AAoJEHj0VWOtoCa7iSsIAKO8w2Q+1pKTJ4VXQ3jHMKx2
> STJJGf+xM7Zty+vXbUN+4fLsPNyZoTJt8fmigZ3xxbwj5CbSC2IOpye2arlVVEXV
> eFbb4ap3EOim7lZqGYTISNw7vPSTAmZdEvqJY6XNdSg3vVni70NbrEIKDe0rWnvE
> K4P2/gTGQi0a5JUBwesjbTdKlGYNHjGztUbm/q97g1rNdcD/zb3J5+RgMpoyk37h
> A7KmX1qjQepNUdbrotzPxvN9rmz5RTMNmURnBv/0u7lDopQOUE4t6HhUaZ94d18R
> 5UyOp7kPcuUSjmsx1kOYjCzZUsIsGi0dOtXv0PSDFFzFCjhoYO2MIEkNJh3W7nY=
> =7B/P
> -----END PGP SIGNATURE-----
>
Re: CLI: wait-Flag to schedule multiple jobs in a script
Posted by Mathias Peters <ma...@gmx.org>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Thanks for the reply.
I had some issues with running several jobs from a script yesterday.
The jobs at the end of the script failed due to a lack of processing
slots. I'll check the log files again, maybe there was another issue
with the first job.
Thanks
Mathias
On 17.01.2015 14:32, Alexander Alexandrov wrote:
> The "wait" mode of execution seems to be the default now as of this
> commit:
>
> https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c
>
> 2015-01-17 14:10 GMT+01:00 Mathias Peters
> <ma...@gmx.org>:
>
> Yes but not at the current state. I checked out, just before
> christmas last year and haven't merged yet.
>
> Mathias
>
>
> On 17.01.2015 13:53, Alexander Alexandrov wrote:
>>>> Are you looking at the master (0.9-SNAPSHOT) branch?
>>>>
>>>> 2015-01-17 13:24 GMT+01:00 Mathias Peters
>>>> <ma...@gmx.org>:
>>>>
>>>> Hi,
>>>>
>>>> is there still a way to schedule jobs to the JobManager on
>>>> after each other?
>>>>
>>>> I remember the "-w" flag in an earlier version for that. This
>>>> seems to be gone now, though. How could one schedule jobs
>>>> like that now?
>>>>
>>>> Thanks and regards Mathias
>>>>>
>>>>
>
>>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQEcBAEBAgAGBQJUumr2AAoJEHj0VWOtoCa7iSsIAKO8w2Q+1pKTJ4VXQ3jHMKx2
STJJGf+xM7Zty+vXbUN+4fLsPNyZoTJt8fmigZ3xxbwj5CbSC2IOpye2arlVVEXV
eFbb4ap3EOim7lZqGYTISNw7vPSTAmZdEvqJY6XNdSg3vVni70NbrEIKDe0rWnvE
K4P2/gTGQi0a5JUBwesjbTdKlGYNHjGztUbm/q97g1rNdcD/zb3J5+RgMpoyk37h
A7KmX1qjQepNUdbrotzPxvN9rmz5RTMNmURnBv/0u7lDopQOUE4t6HhUaZ94d18R
5UyOp7kPcuUSjmsx1kOYjCzZUsIsGi0dOtXv0PSDFFzFCjhoYO2MIEkNJh3W7nY=
=7B/P
-----END PGP SIGNATURE-----
Re: CLI: wait-Flag to schedule multiple jobs in a script
Posted by Alexander Alexandrov <al...@gmail.com>.
The "wait" mode of execution seems to be the default now as of this commit:
https://github.com/apache/flink/commit/f5e3a861ac1228335ee1b5a9a4527fffdf6b3b2c
2015-01-17 14:10 GMT+01:00 Mathias Peters <ma...@gmx.org>:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Yes but not at the current state.
> I checked out, just before christmas last year and haven't merged yet.
>
> Mathias
>
>
> On 17.01.2015 13:53, Alexander Alexandrov wrote:
> > Are you looking at the master (0.9-SNAPSHOT) branch?
> >
> > 2015-01-17 13:24 GMT+01:00 Mathias Peters
> > <ma...@gmx.org>:
> >
> > Hi,
> >
> > is there still a way to schedule jobs to the JobManager on after
> > each other?
> >
> > I remember the "-w" flag in an earlier version for that. This seems
> > to be gone now, though. How could one schedule jobs like that now?
> >
> > Thanks and regards Mathias
> >>
> >
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1
>
> iQEcBAEBAgAGBQJUul8qAAoJEHj0VWOtoCa7yR4IAKTqPgGrrzl7zjIR4+fs7kAl
> GMHDICvCOo9PJEaK7fxUx6yY9PXK+LDUyEamoW8clzk5BDTDd7uhNmdL+N65FV7o
> 26GS354xqFtLEZEVGGGwJeBlboshtYkvsrEYYqId+e7qDysvRkOmgkwuPReqR4Qk
> wLnLkwtfQ5GrspZYPY3HcTbfQOv697EjyoI9+C1fG+SV+R+f5yVkMgzoJyC0DF/J
> iTZkwIt16K+fjjZiYh6EoQWW1d3QO+tA24s22dk9rQTxKFifxThLfHn6+ta8XdRJ
> YwqR03SZJDsKEf+rFAF8MbDfCKN1odXB0In+u/jSqzJrPqCtYrRohjXdmGScibA=
> =dfsJ
> -----END PGP SIGNATURE-----
>
Re: CLI: wait-Flag to schedule multiple jobs in a script
Posted by Mathias Peters <ma...@gmx.org>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Yes but not at the current state.
I checked out, just before christmas last year and haven't merged yet.
Mathias
On 17.01.2015 13:53, Alexander Alexandrov wrote:
> Are you looking at the master (0.9-SNAPSHOT) branch?
>
> 2015-01-17 13:24 GMT+01:00 Mathias Peters
> <ma...@gmx.org>:
>
> Hi,
>
> is there still a way to schedule jobs to the JobManager on after
> each other?
>
> I remember the "-w" flag in an earlier version for that. This seems
> to be gone now, though. How could one schedule jobs like that now?
>
> Thanks and regards Mathias
>>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQEcBAEBAgAGBQJUul8qAAoJEHj0VWOtoCa7yR4IAKTqPgGrrzl7zjIR4+fs7kAl
GMHDICvCOo9PJEaK7fxUx6yY9PXK+LDUyEamoW8clzk5BDTDd7uhNmdL+N65FV7o
26GS354xqFtLEZEVGGGwJeBlboshtYkvsrEYYqId+e7qDysvRkOmgkwuPReqR4Qk
wLnLkwtfQ5GrspZYPY3HcTbfQOv697EjyoI9+C1fG+SV+R+f5yVkMgzoJyC0DF/J
iTZkwIt16K+fjjZiYh6EoQWW1d3QO+tA24s22dk9rQTxKFifxThLfHn6+ta8XdRJ
YwqR03SZJDsKEf+rFAF8MbDfCKN1odXB0In+u/jSqzJrPqCtYrRohjXdmGScibA=
=dfsJ
-----END PGP SIGNATURE-----
Re: CLI: wait-Flag to schedule multiple jobs in a script
Posted by Alexander Alexandrov <al...@gmail.com>.
Are you looking at the master (0.9-SNAPSHOT) branch?
2015-01-17 13:24 GMT+01:00 Mathias Peters <ma...@gmx.org>:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi,
>
> is there still a way to schedule jobs to the JobManager on after each
> other?
>
> I remember the "-w" flag in an earlier version for that. This seems to
> be gone now, though.
> How could one schedule jobs like that now?
>
> Thanks and regards
> Mathias
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1
>
> iQEcBAEBAgAGBQJUulSNAAoJEHj0VWOtoCa7RQ8H/inynJ9j/MSUpyBeg8MA7+/2
> rvOgd2LTg+DfysJKzsUIyh87G+yMSqEF6/I0bGL6hqF53TspLa8PEqZxe/Cr1RPy
> +SkQ5FERhKSHBDMQLGNItoqg1y6a5u9S8O6e/JGOpO5Lo9h0vame8+WoocKz9334
> tmy3Gr/rTJHMjy0dgM1xQl+EKMJQVK1vUCeiyLqKWGwH3S5kvrpz+8y7XKmiWQN/
> hZpVndDd7+ggc6oCsukoVzvmogTDu6zLdy4jtKaMGO3kPJU/cVxWNZvXlRPBKnEz
> KtSoGYcPWqFtL/qt6x26nmRvNimGQ4hFX+tAOri+2AQnJ4E+2XN/zGj3CVDHXqU=
> =xwce
> -----END PGP SIGNATURE-----
>