You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Josh Elser <el...@apache.org> on 2017/05/02 15:41:14 UTC
Sporadically failing precommit tasks
I've been running into an issue where the PreCommit job fails when
building the Yetus Docker image because it attempts to fetch a version
of Oracle JDK8 (8u121) where only a newer version is present (8u131).
I've seen my tasks [1] fail as well someone else's [2], but I've also
seen some others [3] [4] which don't appear to have issues. I've not
been able to determine why some builds run and others don't.
It seems related to Docker using a cached image that has a "stale"
aptitude cache, causing apt-get to try to pull the jdk8u121 package
instead of the new jdk8u131 package. I'm not really sure how best to
address it though. Thoughts?
- Josh
[1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
[2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
[3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
[4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Aha. That's an interesting point. I missed that the first time :)
Ted Yu wrote:
> [3] [4] are for master branch.
>
> Don't know why branch-1 testing is "special".
>
> On Tue, May 2, 2017 at 8:41 AM, Josh Elser<el...@apache.org> wrote:
>
>> I've been running into an issue where the PreCommit job fails when
>> building the Yetus Docker image because it attempts to fetch a version of
>> Oracle JDK8 (8u121) where only a newer version is present (8u131).
>>
>> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
>> some others [3] [4] which don't appear to have issues. I've not been able
>> to determine why some builds run and others don't.
>>
>> It seems related to Docker using a cached image that has a "stale"
>> aptitude cache, causing apt-get to try to pull the jdk8u121 package instead
>> of the new jdk8u131 package. I'm not really sure how best to address it
>> though. Thoughts?
>>
>> - Josh
>>
>> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
>> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
>> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
>> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>>
>
Re: Sporadically failing precommit tasks
Posted by Ted Yu <yu...@gmail.com>.
[3] [4] are for master branch.
Don't know why branch-1 testing is "special".
On Tue, May 2, 2017 at 8:41 AM, Josh Elser <el...@apache.org> wrote:
> I've been running into an issue where the PreCommit job fails when
> building the Yetus Docker image because it attempts to fetch a version of
> Oracle JDK8 (8u121) where only a newer version is present (8u131).
>
> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
> some others [3] [4] which don't appear to have issues. I've not been able
> to determine why some builds run and others don't.
>
> It seems related to Docker using a cached image that has a "stale"
> aptitude cache, causing apt-get to try to pull the jdk8u121 package instead
> of the new jdk8u131 package. I'm not really sure how best to address it
> though. Thoughts?
>
> - Josh
>
> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
(-cc dev@yetus, +bcc dev@yetus)
HBASE-17985 is committed and should do the trick.
Re-trigger QA if you had some JIRA issue blocked on this issue. If
anyone is still seeing failure, please leave a note on/re-open HBASE-17985.
Thanks!
Josh Elser wrote:
> Appears to have done the trick.
>
> https://builds.apache.org/job/PreCommit-HBASE-Build/6671/console
>
> Will open up a new issue just to fix this across the gamut.
>
> Thanks again, all.
>
> Josh Elser wrote:
>> Thanks, Allen (and Sean).
>>
>> Let me poke and I'll report back.
>>
>> Allen Wittenauer wrote:
>>> Hmmm. It's an interesting side-effect of how docker caches
>>> intermediate images:
>>>
>>> ===
>>>
>>> Step 10/35 : RUN apt-get -q update
>>> ---> Using cache
>>> ---> 79fd4a487c35
>>> Step 11/35 : RUN echo oracle-java7-installer
>>> shared/accepted-oracle-license-v1-1 select true | sudo
>>> /usr/bin/debconf-set-selections
>>> ---> Using cache
>>> ---> 516879ab5193
>>> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
>>> ---> Using cache
>>> ---> c3c88064dbd7
>>> Step 13/35 : RUN echo oracle-java8-installer
>>> shared/accepted-oracle-license-v1-1 select true | sudo
>>> /usr/bin/debconf-set-selections
>>> ---> Using cache
>>> ---> 98013d157fba
>>> Step 14/35 : RUN apt-get -q install --no-install-recommends -y
>>> oracle-java8-installer
>>>
>>> ===
>>>
>>> Step 10 should probably get merged into Step 12 and Step 14 then
>>> re-arranged a bit. e.g.,
>>>
>>> ===
>>> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1
>>> select true | sudo /usr/bin/debconf-set-selections
>>> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1
>>> select true | sudo /usr/bin/debconf-set-selections
>>> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
>>> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y
>>> oracle-java8-installer
>>> ===
>>>
>>> This would force the update and the image pull to be cached into the
>>> same intermediate.
>>>
>>> Although I've been thinking more and more that at least for the
>>> default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
(-cc dev@yetus, +bcc dev@yetus)
HBASE-17985 is committed and should do the trick.
Re-trigger QA if you had some JIRA issue blocked on this issue. If
anyone is still seeing failure, please leave a note on/re-open HBASE-17985.
Thanks!
Josh Elser wrote:
> Appears to have done the trick.
>
> https://builds.apache.org/job/PreCommit-HBASE-Build/6671/console
>
> Will open up a new issue just to fix this across the gamut.
>
> Thanks again, all.
>
> Josh Elser wrote:
>> Thanks, Allen (and Sean).
>>
>> Let me poke and I'll report back.
>>
>> Allen Wittenauer wrote:
>>> Hmmm. It's an interesting side-effect of how docker caches
>>> intermediate images:
>>>
>>> ===
>>>
>>> Step 10/35 : RUN apt-get -q update
>>> ---> Using cache
>>> ---> 79fd4a487c35
>>> Step 11/35 : RUN echo oracle-java7-installer
>>> shared/accepted-oracle-license-v1-1 select true | sudo
>>> /usr/bin/debconf-set-selections
>>> ---> Using cache
>>> ---> 516879ab5193
>>> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
>>> ---> Using cache
>>> ---> c3c88064dbd7
>>> Step 13/35 : RUN echo oracle-java8-installer
>>> shared/accepted-oracle-license-v1-1 select true | sudo
>>> /usr/bin/debconf-set-selections
>>> ---> Using cache
>>> ---> 98013d157fba
>>> Step 14/35 : RUN apt-get -q install --no-install-recommends -y
>>> oracle-java8-installer
>>>
>>> ===
>>>
>>> Step 10 should probably get merged into Step 12 and Step 14 then
>>> re-arranged a bit. e.g.,
>>>
>>> ===
>>> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1
>>> select true | sudo /usr/bin/debconf-set-selections
>>> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1
>>> select true | sudo /usr/bin/debconf-set-selections
>>> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
>>> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y
>>> oracle-java8-installer
>>> ===
>>>
>>> This would force the update and the image pull to be cached into the
>>> same intermediate.
>>>
>>> Although I've been thinking more and more that at least for the
>>> default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Appears to have done the trick.
https://builds.apache.org/job/PreCommit-HBASE-Build/6671/console
Will open up a new issue just to fix this across the gamut.
Thanks again, all.
Josh Elser wrote:
> Thanks, Allen (and Sean).
>
> Let me poke and I'll report back.
>
> Allen Wittenauer wrote:
>> Hmmm. It's an interesting side-effect of how docker caches
>> intermediate images:
>>
>> ===
>>
>> Step 10/35 : RUN apt-get -q update
>> ---> Using cache
>> ---> 79fd4a487c35
>> Step 11/35 : RUN echo oracle-java7-installer
>> shared/accepted-oracle-license-v1-1 select true | sudo
>> /usr/bin/debconf-set-selections
>> ---> Using cache
>> ---> 516879ab5193
>> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
>> ---> Using cache
>> ---> c3c88064dbd7
>> Step 13/35 : RUN echo oracle-java8-installer
>> shared/accepted-oracle-license-v1-1 select true | sudo
>> /usr/bin/debconf-set-selections
>> ---> Using cache
>> ---> 98013d157fba
>> Step 14/35 : RUN apt-get -q install --no-install-recommends -y
>> oracle-java8-installer
>>
>> ===
>>
>> Step 10 should probably get merged into Step 12 and Step 14 then
>> re-arranged a bit. e.g.,
>>
>> ===
>> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1
>> select true | sudo /usr/bin/debconf-set-selections
>> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1
>> select true | sudo /usr/bin/debconf-set-selections
>> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
>> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y
>> oracle-java8-installer
>> ===
>>
>> This would force the update and the image pull to be cached into the
>> same intermediate.
>>
>> Although I've been thinking more and more that at least for the
>> default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Appears to have done the trick.
https://builds.apache.org/job/PreCommit-HBASE-Build/6671/console
Will open up a new issue just to fix this across the gamut.
Thanks again, all.
Josh Elser wrote:
> Thanks, Allen (and Sean).
>
> Let me poke and I'll report back.
>
> Allen Wittenauer wrote:
>> Hmmm. It's an interesting side-effect of how docker caches
>> intermediate images:
>>
>> ===
>>
>> Step 10/35 : RUN apt-get -q update
>> ---> Using cache
>> ---> 79fd4a487c35
>> Step 11/35 : RUN echo oracle-java7-installer
>> shared/accepted-oracle-license-v1-1 select true | sudo
>> /usr/bin/debconf-set-selections
>> ---> Using cache
>> ---> 516879ab5193
>> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
>> ---> Using cache
>> ---> c3c88064dbd7
>> Step 13/35 : RUN echo oracle-java8-installer
>> shared/accepted-oracle-license-v1-1 select true | sudo
>> /usr/bin/debconf-set-selections
>> ---> Using cache
>> ---> 98013d157fba
>> Step 14/35 : RUN apt-get -q install --no-install-recommends -y
>> oracle-java8-installer
>>
>> ===
>>
>> Step 10 should probably get merged into Step 12 and Step 14 then
>> re-arranged a bit. e.g.,
>>
>> ===
>> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1
>> select true | sudo /usr/bin/debconf-set-selections
>> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1
>> select true | sudo /usr/bin/debconf-set-selections
>> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
>> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y
>> oracle-java8-installer
>> ===
>>
>> This would force the update and the image pull to be cached into the
>> same intermediate.
>>
>> Although I've been thinking more and more that at least for the
>> default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Thanks, Allen (and Sean).
Let me poke and I'll report back.
Allen Wittenauer wrote:
> Hmmm. It's an interesting side-effect of how docker caches intermediate images:
>
> ===
>
> Step 10/35 : RUN apt-get -q update
> ---> Using cache
> ---> 79fd4a487c35
> Step 11/35 : RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> ---> Using cache
> ---> 516879ab5193
> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
> ---> Using cache
> ---> c3c88064dbd7
> Step 13/35 : RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> ---> Using cache
> ---> 98013d157fba
> Step 14/35 : RUN apt-get -q install --no-install-recommends -y oracle-java8-installer
>
> ===
>
> Step 10 should probably get merged into Step 12 and Step 14 then re-arranged a bit. e.g.,
>
> ===
> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y oracle-java8-installer
> ===
>
> This would force the update and the image pull to be cached into the same intermediate.
>
> Although I've been thinking more and more that at least for the default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Thanks, Allen (and Sean).
Let me poke and I'll report back.
Allen Wittenauer wrote:
> Hmmm. It's an interesting side-effect of how docker caches intermediate images:
>
> ===
>
> Step 10/35 : RUN apt-get -q update
> ---> Using cache
> ---> 79fd4a487c35
> Step 11/35 : RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> ---> Using cache
> ---> 516879ab5193
> Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
> ---> Using cache
> ---> c3c88064dbd7
> Step 13/35 : RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> ---> Using cache
> ---> 98013d157fba
> Step 14/35 : RUN apt-get -q install --no-install-recommends -y oracle-java8-installer
>
> ===
>
> Step 10 should probably get merged into Step 12 and Step 14 then re-arranged a bit. e.g.,
>
> ===
> RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
> RUN apt-get -q update&& apt-get -q install -y oracle-java7-installer
> RUN apt-get -q update&& apt-get -q install --no-install-recommends -y oracle-java8-installer
> ===
>
> This would force the update and the image pull to be cached into the same intermediate.
>
> Although I've been thinking more and more that at least for the default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Allen Wittenauer <aw...@effectivemachines.com>.
Hmmm. It's an interesting side-effect of how docker caches intermediate images:
===
Step 10/35 : RUN apt-get -q update
---> Using cache
---> 79fd4a487c35
Step 11/35 : RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
---> Using cache
---> 516879ab5193
Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
---> Using cache
---> c3c88064dbd7
Step 13/35 : RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
---> Using cache
---> 98013d157fba
Step 14/35 : RUN apt-get -q install --no-install-recommends -y oracle-java8-installer
===
Step 10 should probably get merged into Step 12 and Step 14 then re-arranged a bit. e.g.,
===
RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
RUN apt-get -q update && apt-get -q install -y oracle-java7-installer
RUN apt-get -q update && apt-get -q install --no-install-recommends -y oracle-java8-installer
===
This would force the update and the image pull to be cached into the same intermediate.
Although I've been thinking more and more that at least for the default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Allen Wittenauer <aw...@effectivemachines.com>.
Hmmm. It's an interesting side-effect of how docker caches intermediate images:
===
Step 10/35 : RUN apt-get -q update
---> Using cache
---> 79fd4a487c35
Step 11/35 : RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
---> Using cache
---> 516879ab5193
Step 12/35 : RUN apt-get -q install -y oracle-java7-installer
---> Using cache
---> c3c88064dbd7
Step 13/35 : RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
---> Using cache
---> 98013d157fba
Step 14/35 : RUN apt-get -q install --no-install-recommends -y oracle-java8-installer
===
Step 10 should probably get merged into Step 12 and Step 14 then re-arranged a bit. e.g.,
===
RUN echo oracle-java7-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | sudo /usr/bin/debconf-set-selections
RUN apt-get -q update && apt-get -q install -y oracle-java7-installer
RUN apt-get -q update && apt-get -q install --no-install-recommends -y oracle-java8-installer
===
This would force the update and the image pull to be cached into the same intermediate.
Although I've been thinking more and more that at least for the default Yetus Dockerfile, we should probably switch to OpenJDK entirely.
Re: Sporadically failing precommit tasks
Posted by Sean Busbey <bu...@apache.org>.
That's my understanding, yes. Note that the dockerfile is per-branch
(we use that to e.g. change our java version IIRC)
On Tue, May 2, 2017 at 11:18 AM, Josh Elser <el...@apache.org> wrote:
> Thanks, Sean. That sounds like it might help (at least, given the little I
> understand).
>
> Can I just modify dev-support/docker/Dockerfile in my patch and that would
> be picked up?
>
>
> Sean Busbey wrote:
>>
>> +dev@yetus in case some other community has run into this.
>>
>> Yetus is supposed to age out images after a time. Do we know about how
>> long this has been happening?
>>
>> Maybe we could do a get-apt update before the install call?
>>
>> On Tue, May 2, 2017 at 10:41 AM, Josh Elser<el...@apache.org> wrote:
>>>
>>> I've been running into an issue where the PreCommit job fails when
>>> building
>>> the Yetus Docker image because it attempts to fetch a version of Oracle
>>> JDK8
>>> (8u121) where only a newer version is present (8u131).
>>>
>>> I've seen my tasks [1] fail as well someone else's [2], but I've also
>>> seen
>>> some others [3] [4] which don't appear to have issues. I've not been able
>>> to
>>> determine why some builds run and others don't.
>>>
>>> It seems related to Docker using a cached image that has a "stale"
>>> aptitude
>>> cache, causing apt-get to try to pull the jdk8u121 package instead of the
>>> new jdk8u131 package. I'm not really sure how best to address it though.
>>> Thoughts?
>>>
>>> - Josh
>>>
>>> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
>>> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
>>> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
>>> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>>
>>
>>
>>
>
Re: Sporadically failing precommit tasks
Posted by Sean Busbey <bu...@apache.org>.
That's my understanding, yes. Note that the dockerfile is per-branch
(we use that to e.g. change our java version IIRC)
On Tue, May 2, 2017 at 11:18 AM, Josh Elser <el...@apache.org> wrote:
> Thanks, Sean. That sounds like it might help (at least, given the little I
> understand).
>
> Can I just modify dev-support/docker/Dockerfile in my patch and that would
> be picked up?
>
>
> Sean Busbey wrote:
>>
>> +dev@yetus in case some other community has run into this.
>>
>> Yetus is supposed to age out images after a time. Do we know about how
>> long this has been happening?
>>
>> Maybe we could do a get-apt update before the install call?
>>
>> On Tue, May 2, 2017 at 10:41 AM, Josh Elser<el...@apache.org> wrote:
>>>
>>> I've been running into an issue where the PreCommit job fails when
>>> building
>>> the Yetus Docker image because it attempts to fetch a version of Oracle
>>> JDK8
>>> (8u121) where only a newer version is present (8u131).
>>>
>>> I've seen my tasks [1] fail as well someone else's [2], but I've also
>>> seen
>>> some others [3] [4] which don't appear to have issues. I've not been able
>>> to
>>> determine why some builds run and others don't.
>>>
>>> It seems related to Docker using a cached image that has a "stale"
>>> aptitude
>>> cache, causing apt-get to try to pull the jdk8u121 package instead of the
>>> new jdk8u131 package. I'm not really sure how best to address it though.
>>> Thoughts?
>>>
>>> - Josh
>>>
>>> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
>>> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
>>> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
>>> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>>
>>
>>
>>
>
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Thanks, Sean. That sounds like it might help (at least, given the little
I understand).
Can I just modify dev-support/docker/Dockerfile in my patch and that
would be picked up?
Sean Busbey wrote:
> +dev@yetus in case some other community has run into this.
>
> Yetus is supposed to age out images after a time. Do we know about how
> long this has been happening?
>
> Maybe we could do a get-apt update before the install call?
>
> On Tue, May 2, 2017 at 10:41 AM, Josh Elser<el...@apache.org> wrote:
>> I've been running into an issue where the PreCommit job fails when building
>> the Yetus Docker image because it attempts to fetch a version of Oracle JDK8
>> (8u121) where only a newer version is present (8u131).
>>
>> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
>> some others [3] [4] which don't appear to have issues. I've not been able to
>> determine why some builds run and others don't.
>>
>> It seems related to Docker using a cached image that has a "stale" aptitude
>> cache, causing apt-get to try to pull the jdk8u121 package instead of the
>> new jdk8u131 package. I'm not really sure how best to address it though.
>> Thoughts?
>>
>> - Josh
>>
>> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
>> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
>> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
>> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>
>
>
Re: Sporadically failing precommit tasks
Posted by Josh Elser <el...@apache.org>.
Thanks, Sean. That sounds like it might help (at least, given the little
I understand).
Can I just modify dev-support/docker/Dockerfile in my patch and that
would be picked up?
Sean Busbey wrote:
> +dev@yetus in case some other community has run into this.
>
> Yetus is supposed to age out images after a time. Do we know about how
> long this has been happening?
>
> Maybe we could do a get-apt update before the install call?
>
> On Tue, May 2, 2017 at 10:41 AM, Josh Elser<el...@apache.org> wrote:
>> I've been running into an issue where the PreCommit job fails when building
>> the Yetus Docker image because it attempts to fetch a version of Oracle JDK8
>> (8u121) where only a newer version is present (8u131).
>>
>> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
>> some others [3] [4] which don't appear to have issues. I've not been able to
>> determine why some builds run and others don't.
>>
>> It seems related to Docker using a cached image that has a "stale" aptitude
>> cache, causing apt-get to try to pull the jdk8u121 package instead of the
>> new jdk8u131 package. I'm not really sure how best to address it though.
>> Thoughts?
>>
>> - Josh
>>
>> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
>> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
>> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
>> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
>
>
>
Re: Sporadically failing precommit tasks
Posted by Sean Busbey <se...@gmail.com>.
+dev@yetus in case some other community has run into this.
Yetus is supposed to age out images after a time. Do we know about how
long this has been happening?
Maybe we could do a get-apt update before the install call?
On Tue, May 2, 2017 at 10:41 AM, Josh Elser <el...@apache.org> wrote:
> I've been running into an issue where the PreCommit job fails when building
> the Yetus Docker image because it attempts to fetch a version of Oracle JDK8
> (8u121) where only a newer version is present (8u131).
>
> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
> some others [3] [4] which don't appear to have issues. I've not been able to
> determine why some builds run and others don't.
>
> It seems related to Docker using a cached image that has a "stale" aptitude
> cache, causing apt-get to try to pull the jdk8u121 package instead of the
> new jdk8u131 package. I'm not really sure how best to address it though.
> Thoughts?
>
> - Josh
>
> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
--
Sean
Re: Sporadically failing precommit tasks
Posted by Sean Busbey <se...@gmail.com>.
+dev@yetus in case some other community has run into this.
Yetus is supposed to age out images after a time. Do we know about how
long this has been happening?
Maybe we could do a get-apt update before the install call?
On Tue, May 2, 2017 at 10:41 AM, Josh Elser <el...@apache.org> wrote:
> I've been running into an issue where the PreCommit job fails when building
> the Yetus Docker image because it attempts to fetch a version of Oracle JDK8
> (8u121) where only a newer version is present (8u131).
>
> I've seen my tasks [1] fail as well someone else's [2], but I've also seen
> some others [3] [4] which don't appear to have issues. I've not been able to
> determine why some builds run and others don't.
>
> It seems related to Docker using a cached image that has a "stale" aptitude
> cache, causing apt-get to try to pull the jdk8u121 package instead of the
> new jdk8u131 package. I'm not really sure how best to address it though.
> Thoughts?
>
> - Josh
>
> [1] https://builds.apache.org/job/PreCommit-HBASE-Build/6647/console
> [2] https://builds.apache.org/job/PreCommit-HBASE-Build/6663/console
> [3] https://builds.apache.org/job/PreCommit-HBASE-Build/6664/console
> [4] https://builds.apache.org/job/PreCommit-HBASE-Build/6665/console
--
Sean