You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by James Turton <dz...@apache.org> on 2021/09/20 11:27:01 UTC
New Docker images published automatically
Hi all
If you browse to https://hub.docker.com/r/apache/drill/tags, you'll see
that we've just started publishing the following new Docker images based
on snapshots of Drill master.
apache/drill:master-openjdk-8 (=master) snapshot of master running on
the openjdk:8 base image
apache/drill:master-openjdk-11 snapshot of master running on
the latest supported LTS OpenJDK base image
apache/drill:master-openjdk-14 snapshot of master running on
the latest supported OpenJDK base image
The latest *released* version of Drill, which remains recommended for
production deployments, is still
apache/drill:latest latest release running on the
openjdk:8 base image
Starting from the *next* release (1.20) we will also publish
apache/drill:latest-openjdk-8 (=latest) latest release running on the
openjdk:8 base image
apache/drill:latest-openjdk-11 latest release running on the
latest supported LTS OpenJDK base image
apache/drill:latest-openjdk-14 latest release running on the
latest supported OpenJDK base image
each of which will also be tagged by Drill version, so following tags
will be identical to those in the preceding paragraph
apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
openjdk:8 base image
apache/drill:1.20.0-openjdk-11 latest release running on the
latest supported LTS OpenJDK base image
apache/drill:1.20.0-openjdk-14 latest release running on the
latest supported OpenJDK base image
Coming back to what's different *today*, the short of it is that you
have containerised snapshots of master for testing unreleased code or
newer JDK images.
Regards
James
Re: New Docker images published automatically
Posted by James Turton <ja...@somecomputer.xyz.INVALID>.
Hi Rafael
All of OpenJDK 8, 11 and 14 are supported with Drill 1.19. Reasons to
use newer JDKs include benefiting from JVM enhancements (e.g. the new
garbage collectors) and being able to use new Java language features in
code that you will run in the Drill JVM, e.g. in your UDFs. Reasons to
use older JDKs mostly boil down to environmental constraints e.g. your
production environment has not yet been upgraded from OpenJDK 8, maybe
something is blocking the ops team from doing it. So the recommended
JDK version becomes a situational thing. E.g. I'm personally running
Drill on OpenJDK 11 because that's what default-jdk points to in Debian
right now.
On the question of Docker images specifically, an advantage of producing
images for each supported OpenJDK target is that we, and users, can
easily launch different Drill / OpenJDK combinations in a reproducible
way without reaching for a compiler or configuring test environments.
This enables all sorts of testing and comparisons between versions as we
investigate bugs, performance, etc.
James
On 2021/09/24 20:16, Rafael Jaimes III wrote:
> I was actually looking at this today and noticed that I was still running
> openjdk-8. What is the recommended version for running Drill 1.19?
> Is there any distinct advantage for creating images with different openjdk
> versions?
>
> Thx,
>
> On Mon, Sep 20, 2021 at 11:11 AM Ted Dunning <te...@gmail.com> wrote:
>
>> This is great news.
>>
>> Makes me think that these might be the best way to try Drill out as well,
>> especially where containers have low overhead (i.e. on Linux)
>>
>> On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
>>
>>> Hello James,
>>> Great work. Is it possible to add this NOTICE to Github wiki or docs of
>>> website?
>>>
>>>> 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
>>>>
>>>> Hi all
>>>>
>>>> If you browse to https://hub.docker.com/r/apache/drill/tags, you'll
>> see
>>> that we've just started publishing the following new Docker images based
>> on
>>> snapshots of Drill master.
>>>> apache/drill:master-openjdk-8 (=master) snapshot of master running on
>>> the openjdk:8 base image
>>>> apache/drill:master-openjdk-11 snapshot of master running on
>>> the latest supported LTS OpenJDK base image
>>>> apache/drill:master-openjdk-14 snapshot of master running on
>>> the latest supported OpenJDK base image
>>>> The latest *released* version of Drill, which remains recommended for
>>> production deployments, is still
>>>> apache/drill:latest latest release running on the
>>> openjdk:8 base image
>>>> Starting from the *next* release (1.20) we will also publish
>>>>
>>>> apache/drill:latest-openjdk-8 (=latest) latest release running on the
>>> openjdk:8 base image
>>>> apache/drill:latest-openjdk-11 latest release running on the
>>> latest supported LTS OpenJDK base image
>>>> apache/drill:latest-openjdk-14 latest release running on the
>>> latest supported OpenJDK base image
>>>> each of which will also be tagged by Drill version, so following tags
>>> will be identical to those in the preceding paragraph
>>>> apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
>>> openjdk:8 base image
>>>> apache/drill:1.20.0-openjdk-11 latest release running on the
>>> latest supported LTS OpenJDK base image
>>>> apache/drill:1.20.0-openjdk-14 latest release running on the
>>> latest supported OpenJDK base image
>>>> Coming back to what's different *today*, the short of it is that you
>>> have containerised snapshots of master for testing unreleased code or
>> newer
>>> JDK images.
>>>> Regards
>>>> James
>>>
Re: New Docker images published automatically
Posted by James Turton <ja...@somecomputer.xyz.INVALID>.
Hi Rafael
All of OpenJDK 8, 11 and 14 are supported with Drill 1.19. Reasons to
use newer JDKs include benefiting from JVM enhancements (e.g. the new
garbage collectors) and being able to use new Java language features in
code that you will run in the Drill JVM, e.g. in your UDFs. Reasons to
use older JDKs mostly boil down to environmental constraints e.g. your
production environment has not yet been upgraded from OpenJDK 8, maybe
something is blocking the ops team from doing it. So the recommended
JDK version becomes a situational thing. E.g. I'm personally running
Drill on OpenJDK 11 because that's what default-jdk points to in Debian
right now.
On the question of Docker images specifically, an advantage of producing
images for each supported OpenJDK target is that we, and users, can
easily launch different Drill / OpenJDK combinations in a reproducible
way without reaching for a compiler or configuring test environments.
This enables all sorts of testing and comparisons between versions as we
investigate bugs, performance, etc.
James
On 2021/09/24 20:16, Rafael Jaimes III wrote:
> I was actually looking at this today and noticed that I was still running
> openjdk-8. What is the recommended version for running Drill 1.19?
> Is there any distinct advantage for creating images with different openjdk
> versions?
>
> Thx,
>
> On Mon, Sep 20, 2021 at 11:11 AM Ted Dunning <te...@gmail.com> wrote:
>
>> This is great news.
>>
>> Makes me think that these might be the best way to try Drill out as well,
>> especially where containers have low overhead (i.e. on Linux)
>>
>> On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
>>
>>> Hello James,
>>> Great work. Is it possible to add this NOTICE to Github wiki or docs of
>>> website?
>>>
>>>> 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
>>>>
>>>> Hi all
>>>>
>>>> If you browse to https://hub.docker.com/r/apache/drill/tags, you'll
>> see
>>> that we've just started publishing the following new Docker images based
>> on
>>> snapshots of Drill master.
>>>> apache/drill:master-openjdk-8 (=master) snapshot of master running on
>>> the openjdk:8 base image
>>>> apache/drill:master-openjdk-11 snapshot of master running on
>>> the latest supported LTS OpenJDK base image
>>>> apache/drill:master-openjdk-14 snapshot of master running on
>>> the latest supported OpenJDK base image
>>>> The latest *released* version of Drill, which remains recommended for
>>> production deployments, is still
>>>> apache/drill:latest latest release running on the
>>> openjdk:8 base image
>>>> Starting from the *next* release (1.20) we will also publish
>>>>
>>>> apache/drill:latest-openjdk-8 (=latest) latest release running on the
>>> openjdk:8 base image
>>>> apache/drill:latest-openjdk-11 latest release running on the
>>> latest supported LTS OpenJDK base image
>>>> apache/drill:latest-openjdk-14 latest release running on the
>>> latest supported OpenJDK base image
>>>> each of which will also be tagged by Drill version, so following tags
>>> will be identical to those in the preceding paragraph
>>>> apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
>>> openjdk:8 base image
>>>> apache/drill:1.20.0-openjdk-11 latest release running on the
>>> latest supported LTS OpenJDK base image
>>>> apache/drill:1.20.0-openjdk-14 latest release running on the
>>> latest supported OpenJDK base image
>>>> Coming back to what's different *today*, the short of it is that you
>>> have containerised snapshots of master for testing unreleased code or
>> newer
>>> JDK images.
>>>> Regards
>>>> James
>>>
Re: New Docker images published automatically
Posted by Rafael Jaimes III <ra...@gmail.com>.
I was actually looking at this today and noticed that I was still running
openjdk-8. What is the recommended version for running Drill 1.19?
Is there any distinct advantage for creating images with different openjdk
versions?
Thx,
On Mon, Sep 20, 2021 at 11:11 AM Ted Dunning <te...@gmail.com> wrote:
> This is great news.
>
> Makes me think that these might be the best way to try Drill out as well,
> especially where containers have low overhead (i.e. on Linux)
>
> On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
>
> > Hello James,
> > Great work. Is it possible to add this NOTICE to Github wiki or docs of
> > website?
> >
> > > 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
> > >
> > > Hi all
> > >
> > > If you browse to https://hub.docker.com/r/apache/drill/tags, you'll
> see
> > that we've just started publishing the following new Docker images based
> on
> > snapshots of Drill master.
> > >
> > > apache/drill:master-openjdk-8 (=master) snapshot of master running on
> > the openjdk:8 base image
> > > apache/drill:master-openjdk-11 snapshot of master running on
> > the latest supported LTS OpenJDK base image
> > > apache/drill:master-openjdk-14 snapshot of master running on
> > the latest supported OpenJDK base image
> > >
> > > The latest *released* version of Drill, which remains recommended for
> > production deployments, is still
> > >
> > > apache/drill:latest latest release running on the
> > openjdk:8 base image
> > >
> > > Starting from the *next* release (1.20) we will also publish
> > >
> > > apache/drill:latest-openjdk-8 (=latest) latest release running on the
> > openjdk:8 base image
> > > apache/drill:latest-openjdk-11 latest release running on the
> > latest supported LTS OpenJDK base image
> > > apache/drill:latest-openjdk-14 latest release running on the
> > latest supported OpenJDK base image
> > >
> > > each of which will also be tagged by Drill version, so following tags
> > will be identical to those in the preceding paragraph
> > >
> > > apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
> > openjdk:8 base image
> > > apache/drill:1.20.0-openjdk-11 latest release running on the
> > latest supported LTS OpenJDK base image
> > > apache/drill:1.20.0-openjdk-14 latest release running on the
> > latest supported OpenJDK base image
> > >
> > > Coming back to what's different *today*, the short of it is that you
> > have containerised snapshots of master for testing unreleased code or
> newer
> > JDK images.
> > >
> > > Regards
> > > James
> >
> >
>
Re: New Docker images published automatically
Posted by Rafael Jaimes III <ra...@gmail.com>.
I was actually looking at this today and noticed that I was still running
openjdk-8. What is the recommended version for running Drill 1.19?
Is there any distinct advantage for creating images with different openjdk
versions?
Thx,
On Mon, Sep 20, 2021 at 11:11 AM Ted Dunning <te...@gmail.com> wrote:
> This is great news.
>
> Makes me think that these might be the best way to try Drill out as well,
> especially where containers have low overhead (i.e. on Linux)
>
> On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
>
> > Hello James,
> > Great work. Is it possible to add this NOTICE to Github wiki or docs of
> > website?
> >
> > > 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
> > >
> > > Hi all
> > >
> > > If you browse to https://hub.docker.com/r/apache/drill/tags, you'll
> see
> > that we've just started publishing the following new Docker images based
> on
> > snapshots of Drill master.
> > >
> > > apache/drill:master-openjdk-8 (=master) snapshot of master running on
> > the openjdk:8 base image
> > > apache/drill:master-openjdk-11 snapshot of master running on
> > the latest supported LTS OpenJDK base image
> > > apache/drill:master-openjdk-14 snapshot of master running on
> > the latest supported OpenJDK base image
> > >
> > > The latest *released* version of Drill, which remains recommended for
> > production deployments, is still
> > >
> > > apache/drill:latest latest release running on the
> > openjdk:8 base image
> > >
> > > Starting from the *next* release (1.20) we will also publish
> > >
> > > apache/drill:latest-openjdk-8 (=latest) latest release running on the
> > openjdk:8 base image
> > > apache/drill:latest-openjdk-11 latest release running on the
> > latest supported LTS OpenJDK base image
> > > apache/drill:latest-openjdk-14 latest release running on the
> > latest supported OpenJDK base image
> > >
> > > each of which will also be tagged by Drill version, so following tags
> > will be identical to those in the preceding paragraph
> > >
> > > apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
> > openjdk:8 base image
> > > apache/drill:1.20.0-openjdk-11 latest release running on the
> > latest supported LTS OpenJDK base image
> > > apache/drill:1.20.0-openjdk-14 latest release running on the
> > latest supported OpenJDK base image
> > >
> > > Coming back to what's different *today*, the short of it is that you
> > have containerised snapshots of master for testing unreleased code or
> newer
> > JDK images.
> > >
> > > Regards
> > > James
> >
> >
>
Re: New Docker images published automatically
Posted by James Turton <dz...@apache.org>.
@Ted: yes and the master-X series is quite handy for us to get users to
test whether an unreleased fix solves some issue they've reported.
@Cong: thanks and great point. I have just documented this expanded set
of image tags in https://drill.apache.org/docs/running-drill-on-docker/.
On 2021/09/20 17:10, Ted Dunning wrote:
> This is great news.
>
> Makes me think that these might be the best way to try Drill out as well,
> especially where containers have low overhead (i.e. on Linux)
>
> On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
>
>> Hello James,
>> Great work. Is it possible to add this NOTICE to Github wiki or docs of
>> website?
>>
Re: New Docker images published automatically
Posted by Ted Dunning <te...@gmail.com>.
This is great news.
Makes me think that these might be the best way to try Drill out as well,
especially where containers have low overhead (i.e. on Linux)
On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
> Hello James,
> Great work. Is it possible to add this NOTICE to Github wiki or docs of
> website?
>
> > 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
> >
> > Hi all
> >
> > If you browse to https://hub.docker.com/r/apache/drill/tags, you'll see
> that we've just started publishing the following new Docker images based on
> snapshots of Drill master.
> >
> > apache/drill:master-openjdk-8 (=master) snapshot of master running on
> the openjdk:8 base image
> > apache/drill:master-openjdk-11 snapshot of master running on
> the latest supported LTS OpenJDK base image
> > apache/drill:master-openjdk-14 snapshot of master running on
> the latest supported OpenJDK base image
> >
> > The latest *released* version of Drill, which remains recommended for
> production deployments, is still
> >
> > apache/drill:latest latest release running on the
> openjdk:8 base image
> >
> > Starting from the *next* release (1.20) we will also publish
> >
> > apache/drill:latest-openjdk-8 (=latest) latest release running on the
> openjdk:8 base image
> > apache/drill:latest-openjdk-11 latest release running on the
> latest supported LTS OpenJDK base image
> > apache/drill:latest-openjdk-14 latest release running on the
> latest supported OpenJDK base image
> >
> > each of which will also be tagged by Drill version, so following tags
> will be identical to those in the preceding paragraph
> >
> > apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
> openjdk:8 base image
> > apache/drill:1.20.0-openjdk-11 latest release running on the
> latest supported LTS OpenJDK base image
> > apache/drill:1.20.0-openjdk-14 latest release running on the
> latest supported OpenJDK base image
> >
> > Coming back to what's different *today*, the short of it is that you
> have containerised snapshots of master for testing unreleased code or newer
> JDK images.
> >
> > Regards
> > James
>
>
Re: New Docker images published automatically
Posted by Ted Dunning <te...@gmail.com>.
This is great news.
Makes me think that these might be the best way to try Drill out as well,
especially where containers have low overhead (i.e. on Linux)
On Mon, Sep 20, 2021 at 4:32 AM luoc <lu...@apache.org> wrote:
> Hello James,
> Great work. Is it possible to add this NOTICE to Github wiki or docs of
> website?
>
> > 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
> >
> > Hi all
> >
> > If you browse to https://hub.docker.com/r/apache/drill/tags, you'll see
> that we've just started publishing the following new Docker images based on
> snapshots of Drill master.
> >
> > apache/drill:master-openjdk-8 (=master) snapshot of master running on
> the openjdk:8 base image
> > apache/drill:master-openjdk-11 snapshot of master running on
> the latest supported LTS OpenJDK base image
> > apache/drill:master-openjdk-14 snapshot of master running on
> the latest supported OpenJDK base image
> >
> > The latest *released* version of Drill, which remains recommended for
> production deployments, is still
> >
> > apache/drill:latest latest release running on the
> openjdk:8 base image
> >
> > Starting from the *next* release (1.20) we will also publish
> >
> > apache/drill:latest-openjdk-8 (=latest) latest release running on the
> openjdk:8 base image
> > apache/drill:latest-openjdk-11 latest release running on the
> latest supported LTS OpenJDK base image
> > apache/drill:latest-openjdk-14 latest release running on the
> latest supported OpenJDK base image
> >
> > each of which will also be tagged by Drill version, so following tags
> will be identical to those in the preceding paragraph
> >
> > apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the
> openjdk:8 base image
> > apache/drill:1.20.0-openjdk-11 latest release running on the
> latest supported LTS OpenJDK base image
> > apache/drill:1.20.0-openjdk-14 latest release running on the
> latest supported OpenJDK base image
> >
> > Coming back to what's different *today*, the short of it is that you
> have containerised snapshots of master for testing unreleased code or newer
> JDK images.
> >
> > Regards
> > James
>
>
Re: New Docker images published automatically
Posted by luoc <lu...@apache.org>.
Hello James,
Great work. Is it possible to add this NOTICE to Github wiki or docs of website?
> 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
>
> Hi all
>
> If you browse to https://hub.docker.com/r/apache/drill/tags, you'll see that we've just started publishing the following new Docker images based on snapshots of Drill master.
>
> apache/drill:master-openjdk-8 (=master) snapshot of master running on the openjdk:8 base image
> apache/drill:master-openjdk-11 snapshot of master running on the latest supported LTS OpenJDK base image
> apache/drill:master-openjdk-14 snapshot of master running on the latest supported OpenJDK base image
>
> The latest *released* version of Drill, which remains recommended for production deployments, is still
>
> apache/drill:latest latest release running on the openjdk:8 base image
>
> Starting from the *next* release (1.20) we will also publish
>
> apache/drill:latest-openjdk-8 (=latest) latest release running on the openjdk:8 base image
> apache/drill:latest-openjdk-11 latest release running on the latest supported LTS OpenJDK base image
> apache/drill:latest-openjdk-14 latest release running on the latest supported OpenJDK base image
>
> each of which will also be tagged by Drill version, so following tags will be identical to those in the preceding paragraph
>
> apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the openjdk:8 base image
> apache/drill:1.20.0-openjdk-11 latest release running on the latest supported LTS OpenJDK base image
> apache/drill:1.20.0-openjdk-14 latest release running on the latest supported OpenJDK base image
>
> Coming back to what's different *today*, the short of it is that you have containerised snapshots of master for testing unreleased code or newer JDK images.
>
> Regards
> James
Re: New Docker images published automatically
Posted by luoc <lu...@apache.org>.
Hello James,
Great work. Is it possible to add this NOTICE to Github wiki or docs of website?
> 在 2021年9月20日，19:27，James Turton <dz...@apache.org> 写道：
>
> Hi all
>
> If you browse to https://hub.docker.com/r/apache/drill/tags, you'll see that we've just started publishing the following new Docker images based on snapshots of Drill master.
>
> apache/drill:master-openjdk-8 (=master) snapshot of master running on the openjdk:8 base image
> apache/drill:master-openjdk-11 snapshot of master running on the latest supported LTS OpenJDK base image
> apache/drill:master-openjdk-14 snapshot of master running on the latest supported OpenJDK base image
>
> The latest *released* version of Drill, which remains recommended for production deployments, is still
>
> apache/drill:latest latest release running on the openjdk:8 base image
>
> Starting from the *next* release (1.20) we will also publish
>
> apache/drill:latest-openjdk-8 (=latest) latest release running on the openjdk:8 base image
> apache/drill:latest-openjdk-11 latest release running on the latest supported LTS OpenJDK base image
> apache/drill:latest-openjdk-14 latest release running on the latest supported OpenJDK base image
>
> each of which will also be tagged by Drill version, so following tags will be identical to those in the preceding paragraph
>
> apache/drill:1.20.0-openjdk-8 (=latest) latest release running on the openjdk:8 base image
> apache/drill:1.20.0-openjdk-11 latest release running on the latest supported LTS OpenJDK base image
> apache/drill:1.20.0-openjdk-14 latest release running on the latest supported OpenJDK base image
>
> Coming back to what's different *today*, the short of it is that you have containerised snapshots of master for testing unreleased code or newer JDK images.
>
> Regards
> James