You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Martin Neumann <mn...@spotify.com> on 2014/08/27 13:06:24 UTC
switching to flink 0.7
Hej,
I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
trouble.
The functions such as FlatMap seemed to have moved and I cant find the
correct place.
how do I have to change the following line to get it to work (this worked
in 0.6)
*import org.apache.flink.api.java.functions.FlatMapFunction;*
Also (just as a side note) I saw that the package naming for maven has
changed:
*0.6-incubating-hadoop2-SNAPSHOT* ->
*0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
Was that intentional? It would be easier to work with if this is kept
consistent from one version to the next.
cheers Martin
Re: switching to flink 0.7
Posted by Fabian Hueske <fh...@apache.org>.
We decided to do many API changes with the first incubator release to
reduce the number of changes in future releases.
Some of the changes were done to enable support for Java 8 Lambda functions.
That meant of course breaking the code of our early adopters. Sorry for
that!
Fabian
2014-08-27 15:33 GMT+02:00 Martin Neumann <mn...@spotify.com>:
> Thanks for the help. I have it working now though its quite a bit of manual
> code change to get things working again.
>
> @Robert: My point was that "hadoop2" and "incubating" have swapped from the
> last to this version. My first try was to just update the version number in
> pom.xml but that failed for that reason.
>
> cheers Martin
>
>
> On Wed, Aug 27, 2014 at 3:24 PM, Robert Metzger <rm...@apache.org>
> wrote:
>
> > Hi Martin,
> >
> > I think there is a little error in your mail, the versions for 0.7 are
> > "0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
> > The "hadoop2" version names for the nightly builds were generated by a
> > script and I forgot to adopt the script to the "-incubating" version
> > string-change.
> > So the script was actually generating the wrong version string for quite
> > some time. While creating the release scripts and preparing the release,
> I
> > fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
> > versions) and the actual releases are in sync.
> >
> > Sorry for the inconvenience, but using nightly builds / SNAPSHOT version
> is
> > always a slippery road ;) We are trying to mitigate the issue by
> releasing
> > more often.
> >
> > Best,
> > Robert
> >
> >
> >
> >
> >
> > On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <
> > vasilikikalavri@gmail.com
> > > wrote:
> >
> > > Hi Martin,
> > >
> > > you'll find the FlatMapfunction and the rest of the *Function operators
> > > under "org.apache.flink.api.common.functions".
> > > Note that these are now interfaces.
> > > If you need to use open(), close() methods, then you can use the "rich"
> > > implementations, under "org.apache.flink.api.java.functions".
> > >
> > > This is the corresponding pull request:
> > > https://github.com/apache/incubator-flink/pull/85 and I think the
> change
> > > was already introduced in 0.6 :)
> > >
> > > Regards,
> > > V.
> > >
> > >
> > >
> > > On 27 August 2014 13:06, Martin Neumann <mn...@spotify.com> wrote:
> > >
> > > > Hej,
> > > >
> > > > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > > > trouble.
> > > > The functions such as FlatMap seemed to have moved and I cant find
> the
> > > > correct place.
> > > >
> > > > how do I have to change the following line to get it to work (this
> > worked
> > > > in 0.6)
> > > > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> > > >
> > > > Also (just as a side note) I saw that the package naming for maven
> has
> > > > changed:
> > > > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > > > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > > > Was that intentional? It would be easier to work with if this is kept
> > > > consistent from one version to the next.
> > > >
> > > > cheers Martin
> > > >
> > >
> >
>
Re: switching to flink 0.7
Posted by Martin Neumann <mn...@spotify.com>.
Thanks for the help. I have it working now though its quite a bit of manual
code change to get things working again.
@Robert: My point was that "hadoop2" and "incubating" have swapped from the
last to this version. My first try was to just update the version number in
pom.xml but that failed for that reason.
cheers Martin
On Wed, Aug 27, 2014 at 3:24 PM, Robert Metzger <rm...@apache.org> wrote:
> Hi Martin,
>
> I think there is a little error in your mail, the versions for 0.7 are
> "0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
> The "hadoop2" version names for the nightly builds were generated by a
> script and I forgot to adopt the script to the "-incubating" version
> string-change.
> So the script was actually generating the wrong version string for quite
> some time. While creating the release scripts and preparing the release, I
> fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
> versions) and the actual releases are in sync.
>
> Sorry for the inconvenience, but using nightly builds / SNAPSHOT version is
> always a slippery road ;) We are trying to mitigate the issue by releasing
> more often.
>
> Best,
> Robert
>
>
>
>
>
> On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <
> vasilikikalavri@gmail.com
> > wrote:
>
> > Hi Martin,
> >
> > you'll find the FlatMapfunction and the rest of the *Function operators
> > under "org.apache.flink.api.common.functions".
> > Note that these are now interfaces.
> > If you need to use open(), close() methods, then you can use the "rich"
> > implementations, under "org.apache.flink.api.java.functions".
> >
> > This is the corresponding pull request:
> > https://github.com/apache/incubator-flink/pull/85 and I think the change
> > was already introduced in 0.6 :)
> >
> > Regards,
> > V.
> >
> >
> >
> > On 27 August 2014 13:06, Martin Neumann <mn...@spotify.com> wrote:
> >
> > > Hej,
> > >
> > > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > > trouble.
> > > The functions such as FlatMap seemed to have moved and I cant find the
> > > correct place.
> > >
> > > how do I have to change the following line to get it to work (this
> worked
> > > in 0.6)
> > > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> > >
> > > Also (just as a side note) I saw that the package naming for maven has
> > > changed:
> > > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > > Was that intentional? It would be easier to work with if this is kept
> > > consistent from one version to the next.
> > >
> > > cheers Martin
> > >
> >
>
Re: switching to flink 0.7
Posted by Robert Metzger <rm...@apache.org>.
Hi Martin,
I think there is a little error in your mail, the versions for 0.7 are
"0.7-hadoop2-incubating-SNAPSHOT" and "0.7-incubating-SNAPSHOT".
The "hadoop2" version names for the nightly builds were generated by a
script and I forgot to adopt the script to the "-incubating" version
string-change.
So the script was actually generating the wrong version string for quite
some time. While creating the release scripts and preparing the release, I
fixed the script, now the versions for the nightly builds (aka -SNAPSHOT
versions) and the actual releases are in sync.
Sorry for the inconvenience, but using nightly builds / SNAPSHOT version is
always a slippery road ;) We are trying to mitigate the issue by releasing
more often.
Best,
Robert
On Wed, Aug 27, 2014 at 2:19 PM, Vasiliki Kalavri <vasilikikalavri@gmail.com
> wrote:
> Hi Martin,
>
> you'll find the FlatMapfunction and the rest of the *Function operators
> under "org.apache.flink.api.common.functions".
> Note that these are now interfaces.
> If you need to use open(), close() methods, then you can use the "rich"
> implementations, under "org.apache.flink.api.java.functions".
>
> This is the corresponding pull request:
> https://github.com/apache/incubator-flink/pull/85 and I think the change
> was already introduced in 0.6 :)
>
> Regards,
> V.
>
>
>
> On 27 August 2014 13:06, Martin Neumann <mn...@spotify.com> wrote:
>
> > Hej,
> >
> > I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> > trouble.
> > The functions such as FlatMap seemed to have moved and I cant find the
> > correct place.
> >
> > how do I have to change the following line to get it to work (this worked
> > in 0.6)
> > *import org.apache.flink.api.java.functions.FlatMapFunction;*
> >
> > Also (just as a side note) I saw that the package naming for maven has
> > changed:
> > *0.6-incubating-hadoop2-SNAPSHOT* ->
> > *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> > Was that intentional? It would be easier to work with if this is kept
> > consistent from one version to the next.
> >
> > cheers Martin
> >
>
Re: switching to flink 0.7
Posted by Vasiliki Kalavri <va...@gmail.com>.
Hi Martin,
you'll find the FlatMapfunction and the rest of the *Function operators
under "org.apache.flink.api.common.functions".
Note that these are now interfaces.
If you need to use open(), close() methods, then you can use the "rich"
implementations, under "org.apache.flink.api.java.functions".
This is the corresponding pull request:
https://github.com/apache/incubator-flink/pull/85 and I think the change
was already introduced in 0.6 :)
Regards,
V.
On 27 August 2014 13:06, Martin Neumann <mn...@spotify.com> wrote:
> Hej,
>
> I'm trying to switch from flink 0.6 to flink 0.7 and I'm running some
> trouble.
> The functions such as FlatMap seemed to have moved and I cant find the
> correct place.
>
> how do I have to change the following line to get it to work (this worked
> in 0.6)
> *import org.apache.flink.api.java.functions.FlatMapFunction;*
>
> Also (just as a side note) I saw that the package naming for maven has
> changed:
> *0.6-incubating-hadoop2-SNAPSHOT* ->
> *0.7-hadoop2-incubating-hadoop2-SNAPSHOT*
> Was that intentional? It would be easier to work with if this is kept
> consistent from one version to the next.
>
> cheers Martin
>