You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Ismaël Mejía <ie...@gmail.com> on 2020/04/21 20:25:23 UTC
Validates Runner on Java 11 and the Java SDK Harness
I have been working in recent days on enabling the CI tests for Java 11 in
Jenkins for Flink (based on latest release 1.10.x, already merged) and Spark
(based on upcoming release 3.x.x tested locally), so far we have good progress
for both classical runners with only one test failing the complete suite! So
soon we would be able to announce that we support Java 11 for our most popular
open source classical runners.
The next step is to tackle the portable validates runner tests, and when I
looked at those I realized that we are not publishing the Java SDK Harness based
on Java 11. I would like to know if someone might be interested on taking this
task so we can publish the Java 11 SDK Harness docker image too maybe as part of
the next release.
Anyone who knows the harness container part interested on creating a
JIRA and working on a fix for this?
Regards,
Ismaël
Re: Validates Runner on Java 11 and the Java SDK Harness
Posted by Ismaël Mejía <ie...@gmail.com>.
Just for info I found today that there was already a JIRA tracking the
Java 11 container created by Hannah
https://issues.apache.org/jira/browse/BEAM-8106
So this one is the preferred one to track because it is associated to
the complete Java 11 effort.
In other news Tyson contributed a fix today to the bytebuddy code
generation that made the missing Schema tests pass for Java 11.
So for the first time Flink passed the full Validates Runner tests on
Java 11 (for the classic runner at the moment)
as well as Spark in the upcoming 3.0 version (also classic runner for
the moment).
So I am finally optimistic that 2020 is going to be finally the year
we get full Java 11 support.
We are close, we are getting close!
On Thu, May 7, 2020 at 4:04 PM David Morávek <da...@gmail.com> wrote:
>
> Great effort Ismaël! ;) Can't wait to try this out :)
>
> On Thu, May 7, 2020 at 12:08 PM Ismaël Mejía <ie...@gmail.com> wrote:
>>
>> Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment
>> to track this.
>>
>> On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin <mi...@google.com> wrote:
>> >
>> > +Paweł Pasterz
>> >
>> > On Wed, Apr 22, 2020, 13:23 Pablo Estrada <pa...@google.com> wrote:
>> >>
>> >> +Mikhail Gryzykhin fyi : )
>> >>
>> >> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
>> >>>
>> >>> I have been working in recent days on enabling the CI tests for Java 11 in
>> >>> Jenkins for Flink (based on latest release 1.10.x, already merged) and Spark
>> >>> (based on upcoming release 3.x.x tested locally), so far we have good progress
>> >>> for both classical runners with only one test failing the complete suite! So
>> >>> soon we would be able to announce that we support Java 11 for our most popular
>> >>> open source classical runners.
>> >>>
>> >>> The next step is to tackle the portable validates runner tests, and when I
>> >>> looked at those I realized that we are not publishing the Java SDK Harness based
>> >>> on Java 11. I would like to know if someone might be interested on taking this
>> >>> task so we can publish the Java 11 SDK Harness docker image too maybe as part of
>> >>> the next release.
>> >>>
>> >>> Anyone who knows the harness container part interested on creating a
>> >>> JIRA and working on a fix for this?
>> >>>
>> >>> Regards,
>> >>> Ismaël
Re: Validates Runner on Java 11 and the Java SDK Harness
Posted by David Morávek <da...@gmail.com>.
Great effort Ismaël! ;) Can't wait to try this out :)
On Thu, May 7, 2020 at 12:08 PM Ismaël Mejía <ie...@gmail.com> wrote:
> Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment
> to track this.
>
> On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin <mi...@google.com>
> wrote:
> >
> > +Paweł Pasterz
> >
> > On Wed, Apr 22, 2020, 13:23 Pablo Estrada <pa...@google.com> wrote:
> >>
> >> +Mikhail Gryzykhin fyi : )
> >>
> >> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
> >>>
> >>> I have been working in recent days on enabling the CI tests for Java
> 11 in
> >>> Jenkins for Flink (based on latest release 1.10.x, already merged) and
> Spark
> >>> (based on upcoming release 3.x.x tested locally), so far we have good
> progress
> >>> for both classical runners with only one test failing the complete
> suite! So
> >>> soon we would be able to announce that we support Java 11 for our most
> popular
> >>> open source classical runners.
> >>>
> >>> The next step is to tackle the portable validates runner tests, and
> when I
> >>> looked at those I realized that we are not publishing the Java SDK
> Harness based
> >>> on Java 11. I would like to know if someone might be interested on
> taking this
> >>> task so we can publish the Java 11 SDK Harness docker image too maybe
> as part of
> >>> the next release.
> >>>
> >>> Anyone who knows the harness container part interested on creating a
> >>> JIRA and working on a fix for this?
> >>>
> >>> Regards,
> >>> Ismaël
>
Re: Validates Runner on Java 11 and the Java SDK Harness
Posted by Ismaël Mejía <ie...@gmail.com>.
Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment
to track this.
On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin <mi...@google.com> wrote:
>
> +Paweł Pasterz
>
> On Wed, Apr 22, 2020, 13:23 Pablo Estrada <pa...@google.com> wrote:
>>
>> +Mikhail Gryzykhin fyi : )
>>
>> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
>>>
>>> I have been working in recent days on enabling the CI tests for Java 11 in
>>> Jenkins for Flink (based on latest release 1.10.x, already merged) and Spark
>>> (based on upcoming release 3.x.x tested locally), so far we have good progress
>>> for both classical runners with only one test failing the complete suite! So
>>> soon we would be able to announce that we support Java 11 for our most popular
>>> open source classical runners.
>>>
>>> The next step is to tackle the portable validates runner tests, and when I
>>> looked at those I realized that we are not publishing the Java SDK Harness based
>>> on Java 11. I would like to know if someone might be interested on taking this
>>> task so we can publish the Java 11 SDK Harness docker image too maybe as part of
>>> the next release.
>>>
>>> Anyone who knows the harness container part interested on creating a
>>> JIRA and working on a fix for this?
>>>
>>> Regards,
>>> Ismaël
Re: Validates Runner on Java 11 and the Java SDK Harness
Posted by Mikhail Gryzykhin <mi...@google.com>.
+Paweł Pasterz <pa...@polidea.com>
On Wed, Apr 22, 2020, 13:23 Pablo Estrada <pa...@google.com> wrote:
> +Mikhail Gryzykhin <mi...@google.com> fyi : )
>
> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
>
>> I have been working in recent days on enabling the CI tests for Java 11 in
>> Jenkins for Flink (based on latest release 1.10.x, already merged) and
>> Spark
>> (based on upcoming release 3.x.x tested locally), so far we have good
>> progress
>> for both classical runners with only one test failing the complete suite!
>> So
>> soon we would be able to announce that we support Java 11 for our most
>> popular
>> open source classical runners.
>>
>> The next step is to tackle the portable validates runner tests, and when I
>> looked at those I realized that we are not publishing the Java SDK
>> Harness based
>> on Java 11. I would like to know if someone might be interested on taking
>> this
>> task so we can publish the Java 11 SDK Harness docker image too maybe as
>> part of
>> the next release.
>>
>> Anyone who knows the harness container part interested on creating a
>> JIRA and working on a fix for this?
>>
>> Regards,
>> Ismaël
>>
>
Re: Validates Runner on Java 11 and the Java SDK Harness
Posted by Pablo Estrada <pa...@google.com>.
+Mikhail Gryzykhin <mi...@google.com> fyi : )
On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
> I have been working in recent days on enabling the CI tests for Java 11 in
> Jenkins for Flink (based on latest release 1.10.x, already merged) and
> Spark
> (based on upcoming release 3.x.x tested locally), so far we have good
> progress
> for both classical runners with only one test failing the complete suite!
> So
> soon we would be able to announce that we support Java 11 for our most
> popular
> open source classical runners.
>
> The next step is to tackle the portable validates runner tests, and when I
> looked at those I realized that we are not publishing the Java SDK Harness
> based
> on Java 11. I would like to know if someone might be interested on taking
> this
> task so we can publish the Java 11 SDK Harness docker image too maybe as
> part of
> the next release.
>
> Anyone who knows the harness container part interested on creating a
> JIRA and working on a fix for this?
>
> Regards,
> Ismaël
>