You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Hyukjin Kwon <gu...@gmail.com> on 2020/07/02 03:50:31 UTC
Re: m2 cache issues in Jenkins?
Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
> done:
> -bash-4.1$ cd .m2
> -bash-4.1$ ls
> repository
> -bash-4.1$ time rm -rf *
>
> real 17m4.607s
> user 0m0.950s
> sys 0m18.816s
> -bash-4.1$
>
> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
> wrote:
>
>> ok, i've taken that worker offline and once the job running on it
>> finishes, i'll wipe the cache.
>>
>> in the future, please file a JIRA and assign it to me so i don't have to
>> track my work through emails to the dev@ list. ;)
>>
>> thanks!
>>
>> shane
>>
>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>> wrote:
>>
>>> The most recent one I noticed was
>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>> was run on amp-jenkins-worker-04.
>>>
>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>> wrote:
>>>
>>>> for those weird failures, it's super helpful to provide which workers
>>>> are showing these issues. :)
>>>>
>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>> we'll then potentially get blacklisted again if we download too many
>>>> packages from apache.org.
>>>>
>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>> wrote:
>>>>
>>>>> Hi Folks,
>>>>>
>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>> important?
>>>>>
>>>>> Cheers,
>>>>>
>>>>> Holden
>>>>>
>>>>> --
>>>>> Twitter: https://twitter.com/holdenkarau
>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>
>>>>
>>>>
>>>> --
>>>> Shane Knapp
>>>> Computer Guy / Voice of Reason
>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>> https://rise.cs.berkeley.edu
>>>>
>>>
>>>
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
>>
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
>
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>
Re: m2 cache issues in Jenkins?
Posted by shane knapp ☠ <sk...@berkeley.edu>.
ok, i'm gonna have to reboot all the workers tomorrow and wipe the m2
caches. it looks like zombie builds were lingering post-jenkins-wedging
and corrupting the repos.
fixed on -05.
On Mon, Jul 6, 2020 at 2:17 PM Jungtaek Lim <ka...@gmail.com>
wrote:
> Just encountered the same and it's worker-05 again. (You can find [error]
> in the console to see what's the problem. I guess jetty artifacts in the
> worker might be messed up.)
>
>
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125127/consoleFull
>
>
> On Tue, Jul 7, 2020 at 5:35 AM Jungtaek Lim <ka...@gmail.com>
> wrote:
>
>> Could this be a flaky or persistent issue? It failed with Scala gendoc
>> but it didn't fail with the part the PR modified. It ran from worker-05.
>>
>>
>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125121/consoleFull
>>
>> On Tue, Jul 7, 2020 at 2:10 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
>>
>>> i killed and retriggered the PRB jobs on 04, and wiped that workers' m2
>>> cache.
>>>
>>> On Mon, Jul 6, 2020 at 9:24 AM shane knapp ☠ <sk...@berkeley.edu>
>>> wrote:
>>>
>>>> once the jobs running on that worker are finished, yes.
>>>>
>>>> On Sun, Jul 5, 2020 at 7:41 PM Hyukjin Kwon <gu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Shane, can we remove .m2 in worker machine 4?
>>>>>
>>>>> 2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이
>>>>> 작성:
>>>>>
>>>>>> Looks like Jenkins service itself becomes unstable. It took
>>>>>> considerable time to just open the test report for a specific build, and
>>>>>> Jenkins doesn't pick the request on rebuild (retest this, please) in Github
>>>>>> comment.
>>>>>>
>>>>>> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Ah, okay. Actually there already is -
>>>>>>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>>>>>>
>>>>>>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>>
>>>>>>>> We don't I didn't file one originally, but Shane reminded me to in
>>>>>>>> the future.
>>>>>>>>
>>>>>>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Nope, do we have an existing ticket? I think we can reopen if
>>>>>>>>> there is.
>>>>>>>>>
>>>>>>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>>>>
>>>>>>>>>> Huh interesting that it’s the same worker. Have you filed a
>>>>>>>>>> ticket to Shane?
>>>>>>>>>>
>>>>>>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>>>>>>
>>>>>>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이
>>>>>>>>>>> 작성:
>>>>>>>>>>>
>>>>>>>>>>>> done:
>>>>>>>>>>>> -bash-4.1$ cd .m2
>>>>>>>>>>>> -bash-4.1$ ls
>>>>>>>>>>>> repository
>>>>>>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>>>>>>
>>>>>>>>>>>> real 17m4.607s
>>>>>>>>>>>> user 0m0.950s
>>>>>>>>>>>> sys 0m18.816s
>>>>>>>>>>>> -bash-4.1$
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <
>>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> ok, i've taken that worker offline and once the job running on
>>>>>>>>>>>>> it finishes, i'll wipe the cache.
>>>>>>>>>>>>>
>>>>>>>>>>>>> in the future, please file a JIRA and assign it to me so i
>>>>>>>>>>>>> don't have to track my work through emails to the dev@ list.
>>>>>>>>>>>>> ;)
>>>>>>>>>>>>>
>>>>>>>>>>>>> thanks!
>>>>>>>>>>>>>
>>>>>>>>>>>>> shane
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <
>>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> The most recent one I noticed was
>>>>>>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> for those weird failures, it's super helpful to provide
>>>>>>>>>>>>>>> which workers are showing these issues. :)
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the
>>>>>>>>>>>>>>> workers, as we'll then potentially get blacklisted again if we download too
>>>>>>>>>>>>>>> many packages from apache.org.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks
>>>>>>>>>>>>>>>> like it might be from the m2 cache. Would it be OK to clean it out? Or is
>>>>>>>>>>>>>>>> it important?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Holden
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>>>>> YouTube Live Streams:
>>>>>>>>>>>>>>>> https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>>> YouTube Live Streams:
>>>>>>>>>>>>>> https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>
>>>>>>>
>>>>
>>>> --
>>>> Shane Knapp
>>>> Computer Guy / Voice of Reason
>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>> https://rise.cs.berkeley.edu
>>>>
>>>
>>>
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>>
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: m2 cache issues in Jenkins?
Posted by Jungtaek Lim <ka...@gmail.com>.
Just encountered the same and it's worker-05 again. (You can find [error]
in the console to see what's the problem. I guess jetty artifacts in the
worker might be messed up.)
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125127/consoleFull
On Tue, Jul 7, 2020 at 5:35 AM Jungtaek Lim <ka...@gmail.com>
wrote:
> Could this be a flaky or persistent issue? It failed with Scala gendoc but
> it didn't fail with the part the PR modified. It ran from worker-05.
>
>
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125121/consoleFull
>
> On Tue, Jul 7, 2020 at 2:10 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
>
>> i killed and retriggered the PRB jobs on 04, and wiped that workers' m2
>> cache.
>>
>> On Mon, Jul 6, 2020 at 9:24 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
>>
>>> once the jobs running on that worker are finished, yes.
>>>
>>> On Sun, Jul 5, 2020 at 7:41 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>>
>>>> Shane, can we remove .m2 in worker machine 4?
>>>>
>>>> 2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이
>>>> 작성:
>>>>
>>>>> Looks like Jenkins service itself becomes unstable. It took
>>>>> considerable time to just open the test report for a specific build, and
>>>>> Jenkins doesn't pick the request on rebuild (retest this, please) in Github
>>>>> comment.
>>>>>
>>>>> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Ah, okay. Actually there already is -
>>>>>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>>>>>
>>>>>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>
>>>>>>> We don't I didn't file one originally, but Shane reminded me to in
>>>>>>> the future.
>>>>>>>
>>>>>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Nope, do we have an existing ticket? I think we can reopen if there
>>>>>>>> is.
>>>>>>>>
>>>>>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>>>
>>>>>>>>> Huh interesting that it’s the same worker. Have you filed a ticket
>>>>>>>>> to Shane?
>>>>>>>>>
>>>>>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>>>>>
>>>>>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이
>>>>>>>>>> 작성:
>>>>>>>>>>
>>>>>>>>>>> done:
>>>>>>>>>>> -bash-4.1$ cd .m2
>>>>>>>>>>> -bash-4.1$ ls
>>>>>>>>>>> repository
>>>>>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>>>>>
>>>>>>>>>>> real 17m4.607s
>>>>>>>>>>> user 0m0.950s
>>>>>>>>>>> sys 0m18.816s
>>>>>>>>>>> -bash-4.1$
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <
>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> ok, i've taken that worker offline and once the job running on
>>>>>>>>>>>> it finishes, i'll wipe the cache.
>>>>>>>>>>>>
>>>>>>>>>>>> in the future, please file a JIRA and assign it to me so i
>>>>>>>>>>>> don't have to track my work through emails to the dev@ list.
>>>>>>>>>>>> ;)
>>>>>>>>>>>>
>>>>>>>>>>>> thanks!
>>>>>>>>>>>>
>>>>>>>>>>>> shane
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <
>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> The most recent one I noticed was
>>>>>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the
>>>>>>>>>>>>>> workers, as we'll then potentially get blacklisted again if we download too
>>>>>>>>>>>>>> many packages from apache.org.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks
>>>>>>>>>>>>>>> like it might be from the m2 cache. Would it be OK to clean it out? Or is
>>>>>>>>>>>>>>> it important?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Holden
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>>>> YouTube Live Streams:
>>>>>>>>>>>>>>> https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Shane Knapp
>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>
>>>>>>
>>>
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>>
>>
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
>
Re: m2 cache issues in Jenkins?
Posted by Jungtaek Lim <ka...@gmail.com>.
Could this be a flaky or persistent issue? It failed with Scala gendoc but
it didn't fail with the part the PR modified. It ran from worker-05.
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125121/consoleFull
On Tue, Jul 7, 2020 at 2:10 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
> i killed and retriggered the PRB jobs on 04, and wiped that workers' m2
> cache.
>
> On Mon, Jul 6, 2020 at 9:24 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
>
>> once the jobs running on that worker are finished, yes.
>>
>> On Sun, Jul 5, 2020 at 7:41 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>>> Shane, can we remove .m2 in worker machine 4?
>>>
>>> 2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이
>>> 작성:
>>>
>>>> Looks like Jenkins service itself becomes unstable. It took
>>>> considerable time to just open the test report for a specific build, and
>>>> Jenkins doesn't pick the request on rebuild (retest this, please) in Github
>>>> comment.
>>>>
>>>> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Ah, okay. Actually there already is -
>>>>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>>>>
>>>>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>
>>>>>> We don't I didn't file one originally, but Shane reminded me to in
>>>>>> the future.
>>>>>>
>>>>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Nope, do we have an existing ticket? I think we can reopen if there
>>>>>>> is.
>>>>>>>
>>>>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>>
>>>>>>>> Huh interesting that it’s the same worker. Have you filed a ticket
>>>>>>>> to Shane?
>>>>>>>>
>>>>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>>>>
>>>>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이
>>>>>>>>> 작성:
>>>>>>>>>
>>>>>>>>>> done:
>>>>>>>>>> -bash-4.1$ cd .m2
>>>>>>>>>> -bash-4.1$ ls
>>>>>>>>>> repository
>>>>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>>>>
>>>>>>>>>> real 17m4.607s
>>>>>>>>>> user 0m0.950s
>>>>>>>>>> sys 0m18.816s
>>>>>>>>>> -bash-4.1$
>>>>>>>>>>
>>>>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <
>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>
>>>>>>>>>>> ok, i've taken that worker offline and once the job running on
>>>>>>>>>>> it finishes, i'll wipe the cache.
>>>>>>>>>>>
>>>>>>>>>>> in the future, please file a JIRA and assign it to me so i don't
>>>>>>>>>>> have to track my work through emails to the dev@ list. ;)
>>>>>>>>>>>
>>>>>>>>>>> thanks!
>>>>>>>>>>>
>>>>>>>>>>> shane
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <
>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> The most recent one I noticed was
>>>>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>>>>>
>>>>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the
>>>>>>>>>>>>> workers, as we'll then potentially get blacklisted again if we download too
>>>>>>>>>>>>> many packages from apache.org.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks
>>>>>>>>>>>>>> like it might be from the m2 cache. Would it be OK to clean it out? Or is
>>>>>>>>>>>>>> it important?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Holden
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>>> YouTube Live Streams:
>>>>>>>>>>>>>> https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Shane Knapp
>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Shane Knapp
>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>
>>>>>>>>> --
>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>
>>>>>
>>
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
>
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>
Re: m2 cache issues in Jenkins?
Posted by shane knapp ☠ <sk...@berkeley.edu>.
i killed and retriggered the PRB jobs on 04, and wiped that workers' m2
cache.
On Mon, Jul 6, 2020 at 9:24 AM shane knapp ☠ <sk...@berkeley.edu> wrote:
> once the jobs running on that worker are finished, yes.
>
> On Sun, Jul 5, 2020 at 7:41 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>
>> Shane, can we remove .m2 in worker machine 4?
>>
>> 2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이
>> 작성:
>>
>>> Looks like Jenkins service itself becomes unstable. It took considerable
>>> time to just open the test report for a specific build, and Jenkins doesn't
>>> pick the request on rebuild (retest this, please) in Github comment.
>>>
>>> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>>
>>>> Ah, okay. Actually there already is -
>>>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>>>
>>>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>
>>>>> We don't I didn't file one originally, but Shane reminded me to in the
>>>>> future.
>>>>>
>>>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Nope, do we have an existing ticket? I think we can reopen if there
>>>>>> is.
>>>>>>
>>>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>>
>>>>>>> Huh interesting that it’s the same worker. Have you filed a ticket
>>>>>>> to Shane?
>>>>>>>
>>>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>>>
>>>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>>>>>>
>>>>>>>>> done:
>>>>>>>>> -bash-4.1$ cd .m2
>>>>>>>>> -bash-4.1$ ls
>>>>>>>>> repository
>>>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>>>
>>>>>>>>> real 17m4.607s
>>>>>>>>> user 0m0.950s
>>>>>>>>> sys 0m18.816s
>>>>>>>>> -bash-4.1$
>>>>>>>>>
>>>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <
>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>
>>>>>>>>>> ok, i've taken that worker offline and once the job running on it
>>>>>>>>>> finishes, i'll wipe the cache.
>>>>>>>>>>
>>>>>>>>>> in the future, please file a JIRA and assign it to me so i don't
>>>>>>>>>> have to track my work through emails to the dev@ list. ;)
>>>>>>>>>>
>>>>>>>>>> thanks!
>>>>>>>>>>
>>>>>>>>>> shane
>>>>>>>>>>
>>>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <
>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>
>>>>>>>>>>> The most recent one I noticed was
>>>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>>>>
>>>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers,
>>>>>>>>>>>> as we'll then potentially get blacklisted again if we download too many
>>>>>>>>>>>> packages from apache.org.
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks like
>>>>>>>>>>>>> it might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>>>>>>> important?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Holden
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Shane Knapp
>>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Shane Knapp
>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Shane Knapp
>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>
>>>>>>>> --
>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Twitter: https://twitter.com/holdenkarau
>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>
>>>>
>
> --
> Shane Knapp
> Computer Guy / Voice of Reason
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: m2 cache issues in Jenkins?
Posted by shane knapp ☠ <sk...@berkeley.edu>.
once the jobs running on that worker are finished, yes.
On Sun, Jul 5, 2020 at 7:41 PM Hyukjin Kwon <gu...@gmail.com> wrote:
> Shane, can we remove .m2 in worker machine 4?
>
> 2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이 작성:
>
>> Looks like Jenkins service itself becomes unstable. It took considerable
>> time to just open the test report for a specific build, and Jenkins doesn't
>> pick the request on rebuild (retest this, please) in Github comment.
>>
>> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>>> Ah, okay. Actually there already is -
>>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>>
>>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>
>>>> We don't I didn't file one originally, but Shane reminded me to in the
>>>> future.
>>>>
>>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Nope, do we have an existing ticket? I think we can reopen if there is.
>>>>>
>>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>>
>>>>>> Huh interesting that it’s the same worker. Have you filed a ticket to
>>>>>> Shane?
>>>>>>
>>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>>
>>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>>>>>
>>>>>>>> done:
>>>>>>>> -bash-4.1$ cd .m2
>>>>>>>> -bash-4.1$ ls
>>>>>>>> repository
>>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>>
>>>>>>>> real 17m4.607s
>>>>>>>> user 0m0.950s
>>>>>>>> sys 0m18.816s
>>>>>>>> -bash-4.1$
>>>>>>>>
>>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> ok, i've taken that worker offline and once the job running on it
>>>>>>>>> finishes, i'll wipe the cache.
>>>>>>>>>
>>>>>>>>> in the future, please file a JIRA and assign it to me so i don't
>>>>>>>>> have to track my work through emails to the dev@ list. ;)
>>>>>>>>>
>>>>>>>>> thanks!
>>>>>>>>>
>>>>>>>>> shane
>>>>>>>>>
>>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <
>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>
>>>>>>>>>> The most recent one I noticed was
>>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>>
>>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>>
>>>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>>>
>>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers,
>>>>>>>>>>> as we'll then potentially get blacklisted again if we download too many
>>>>>>>>>>> packages from apache.org.
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>>
>>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks like
>>>>>>>>>>>> it might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>>>>>> important?
>>>>>>>>>>>>
>>>>>>>>>>>> Cheers,
>>>>>>>>>>>>
>>>>>>>>>>>> Holden
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Shane Knapp
>>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Shane Knapp
>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Shane Knapp
>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>
>>>>>>> --
>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>
>>>>>
>>>>
>>>> --
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
--
Shane Knapp
Computer Guy / Voice of Reason
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: m2 cache issues in Jenkins?
Posted by Hyukjin Kwon <gu...@gmail.com>.
Shane, can we remove .m2 in worker machine 4?
2020년 7월 3일 (금) 오전 8:18, Jungtaek Lim <ka...@gmail.com>님이 작성:
> Looks like Jenkins service itself becomes unstable. It took considerable
> time to just open the test report for a specific build, and Jenkins doesn't
> pick the request on rebuild (retest this, please) in Github comment.
>
> On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>
>> Ah, okay. Actually there already is -
>> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>>
>> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>
>>> We don't I didn't file one originally, but Shane reminded me to in the
>>> future.
>>>
>>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>>
>>>> Nope, do we have an existing ticket? I think we can reopen if there is.
>>>>
>>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>>
>>>>> Huh interesting that it’s the same worker. Have you filed a ticket to
>>>>> Shane?
>>>>>
>>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>>
>>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>>>>
>>>>>>> done:
>>>>>>> -bash-4.1$ cd .m2
>>>>>>> -bash-4.1$ ls
>>>>>>> repository
>>>>>>> -bash-4.1$ time rm -rf *
>>>>>>>
>>>>>>> real 17m4.607s
>>>>>>> user 0m0.950s
>>>>>>> sys 0m18.816s
>>>>>>> -bash-4.1$
>>>>>>>
>>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> ok, i've taken that worker offline and once the job running on it
>>>>>>>> finishes, i'll wipe the cache.
>>>>>>>>
>>>>>>>> in the future, please file a JIRA and assign it to me so i don't
>>>>>>>> have to track my work through emails to the dev@ list. ;)
>>>>>>>>
>>>>>>>> thanks!
>>>>>>>>
>>>>>>>> shane
>>>>>>>>
>>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> The most recent one I noticed was
>>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>>
>>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <
>>>>>>>>> sknapp@berkeley.edu> wrote:
>>>>>>>>>
>>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>>
>>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers,
>>>>>>>>>> as we'll then potentially get blacklisted again if we download too many
>>>>>>>>>> packages from apache.org.
>>>>>>>>>>
>>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <
>>>>>>>>>> holden@pigscanfly.ca> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Folks,
>>>>>>>>>>>
>>>>>>>>>>> I've been see some weird failures on Jenkins and it looks like
>>>>>>>>>>> it might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>>>>> important?
>>>>>>>>>>>
>>>>>>>>>>> Cheers,
>>>>>>>>>>>
>>>>>>>>>>> Holden
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Shane Knapp
>>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Shane Knapp
>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Shane Knapp
>>>>>>> Computer Guy / Voice of Reason
>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>
>>>>>> --
>>>>> Twitter: https://twitter.com/holdenkarau
>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>
>>>>
>>>
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
Re: m2 cache issues in Jenkins?
Posted by Jungtaek Lim <ka...@gmail.com>.
Looks like Jenkins service itself becomes unstable. It took considerable
time to just open the test report for a specific build, and Jenkins doesn't
pick the request on rebuild (retest this, please) in Github comment.
On Thu, Jul 2, 2020 at 2:12 PM Hyukjin Kwon <gu...@gmail.com> wrote:
> Ah, okay. Actually there already is -
> https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
>
> 2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>
>> We don't I didn't file one originally, but Shane reminded me to in the
>> future.
>>
>> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>>> Nope, do we have an existing ticket? I think we can reopen if there is.
>>>
>>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>>
>>>> Huh interesting that it’s the same worker. Have you filed a ticket to
>>>> Shane?
>>>>
>>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>>
>>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>>>
>>>>>> done:
>>>>>> -bash-4.1$ cd .m2
>>>>>> -bash-4.1$ ls
>>>>>> repository
>>>>>> -bash-4.1$ time rm -rf *
>>>>>>
>>>>>> real 17m4.607s
>>>>>> user 0m0.950s
>>>>>> sys 0m18.816s
>>>>>> -bash-4.1$
>>>>>>
>>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>> wrote:
>>>>>>
>>>>>>> ok, i've taken that worker offline and once the job running on it
>>>>>>> finishes, i'll wipe the cache.
>>>>>>>
>>>>>>> in the future, please file a JIRA and assign it to me so i don't
>>>>>>> have to track my work through emails to the dev@ list. ;)
>>>>>>>
>>>>>>> thanks!
>>>>>>>
>>>>>>> shane
>>>>>>>
>>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> The most recent one I noticed was
>>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>>
>>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>>> workers are showing these issues. :)
>>>>>>>>>
>>>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>>>>>>> we'll then potentially get blacklisted again if we download too many
>>>>>>>>> packages from apache.org.
>>>>>>>>>
>>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Folks,
>>>>>>>>>>
>>>>>>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>>>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>>>> important?
>>>>>>>>>>
>>>>>>>>>> Cheers,
>>>>>>>>>>
>>>>>>>>>> Holden
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Shane Knapp
>>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Shane Knapp
>>>>>>> Computer Guy / Voice of Reason
>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Shane Knapp
>>>>>> Computer Guy / Voice of Reason
>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>> https://rise.cs.berkeley.edu
>>>>>>
>>>>> --
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
Re: m2 cache issues in Jenkins?
Posted by Hyukjin Kwon <gu...@gmail.com>.
Ah, okay. Actually there already is -
https://issues.apache.org/jira/browse/SPARK-31693. I am reopening.
2020년 7월 2일 (목) 오후 2:06, Holden Karau <ho...@pigscanfly.ca>님이 작성:
> We don't I didn't file one originally, but Shane reminded me to in the
> future.
>
> On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>
>> Nope, do we have an existing ticket? I think we can reopen if there is.
>>
>> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>>
>>> Huh interesting that it’s the same worker. Have you filed a ticket to
>>> Shane?
>>>
>>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>>
>>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>>
>>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>>
>>>>> done:
>>>>> -bash-4.1$ cd .m2
>>>>> -bash-4.1$ ls
>>>>> repository
>>>>> -bash-4.1$ time rm -rf *
>>>>>
>>>>> real 17m4.607s
>>>>> user 0m0.950s
>>>>> sys 0m18.816s
>>>>> -bash-4.1$
>>>>>
>>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>> wrote:
>>>>>
>>>>>> ok, i've taken that worker offline and once the job running on it
>>>>>> finishes, i'll wipe the cache.
>>>>>>
>>>>>> in the future, please file a JIRA and assign it to me so i don't have
>>>>>> to track my work through emails to the dev@ list. ;)
>>>>>>
>>>>>> thanks!
>>>>>>
>>>>>> shane
>>>>>>
>>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>>>>> wrote:
>>>>>>
>>>>>>> The most recent one I noticed was
>>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>>> was run on amp-jenkins-worker-04.
>>>>>>>
>>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>>> workers are showing these issues. :)
>>>>>>>>
>>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>>>>>> we'll then potentially get blacklisted again if we download too many
>>>>>>>> packages from apache.org.
>>>>>>>>
>>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Folks,
>>>>>>>>>
>>>>>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>>> important?
>>>>>>>>>
>>>>>>>>> Cheers,
>>>>>>>>>
>>>>>>>>> Holden
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Shane Knapp
>>>>>>>> Computer Guy / Voice of Reason
>>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Shane Knapp
>>>>>> Computer Guy / Voice of Reason
>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>> https://rise.cs.berkeley.edu
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Shane Knapp
>>>>> Computer Guy / Voice of Reason
>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>> https://rise.cs.berkeley.edu
>>>>>
>>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
Re: m2 cache issues in Jenkins?
Posted by Holden Karau <ho...@pigscanfly.ca>.
We don't I didn't file one originally, but Shane reminded me to in the
future.
On Wed, Jul 1, 2020 at 9:44 PM Hyukjin Kwon <gu...@gmail.com> wrote:
> Nope, do we have an existing ticket? I think we can reopen if there is.
>
> 2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
>
>> Huh interesting that it’s the same worker. Have you filed a ticket to
>> Shane?
>>
>> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>>
>>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>>
>>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>>
>>>> done:
>>>> -bash-4.1$ cd .m2
>>>> -bash-4.1$ ls
>>>> repository
>>>> -bash-4.1$ time rm -rf *
>>>>
>>>> real 17m4.607s
>>>> user 0m0.950s
>>>> sys 0m18.816s
>>>> -bash-4.1$
>>>>
>>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>>> wrote:
>>>>
>>>>> ok, i've taken that worker offline and once the job running on it
>>>>> finishes, i'll wipe the cache.
>>>>>
>>>>> in the future, please file a JIRA and assign it to me so i don't have
>>>>> to track my work through emails to the dev@ list. ;)
>>>>>
>>>>> thanks!
>>>>>
>>>>> shane
>>>>>
>>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>>>> wrote:
>>>>>
>>>>>> The most recent one I noticed was
>>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>>> was run on amp-jenkins-worker-04.
>>>>>>
>>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>>> wrote:
>>>>>>
>>>>>>> for those weird failures, it's super helpful to provide which
>>>>>>> workers are showing these issues. :)
>>>>>>>
>>>>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>>>>> we'll then potentially get blacklisted again if we download too many
>>>>>>> packages from apache.org.
>>>>>>>
>>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Folks,
>>>>>>>>
>>>>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>>> important?
>>>>>>>>
>>>>>>>> Cheers,
>>>>>>>>
>>>>>>>> Holden
>>>>>>>>
>>>>>>>> --
>>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Shane Knapp
>>>>>>> Computer Guy / Voice of Reason
>>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>>> https://rise.cs.berkeley.edu
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Shane Knapp
>>>>> Computer Guy / Voice of Reason
>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>> https://rise.cs.berkeley.edu
>>>>>
>>>>
>>>>
>>>> --
>>>> Shane Knapp
>>>> Computer Guy / Voice of Reason
>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>> https://rise.cs.berkeley.edu
>>>>
>>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
--
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau
Re: m2 cache issues in Jenkins?
Posted by Hyukjin Kwon <gu...@gmail.com>.
Nope, do we have an existing ticket? I think we can reopen if there is.
2020년 7월 2일 (목) 오후 1:43, Holden Karau <ho...@pigscanfly.ca>님이 작성:
> Huh interesting that it’s the same worker. Have you filed a ticket to
> Shane?
>
> On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com> wrote:
>
>> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>>
>> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>>
>>> done:
>>> -bash-4.1$ cd .m2
>>> -bash-4.1$ ls
>>> repository
>>> -bash-4.1$ time rm -rf *
>>>
>>> real 17m4.607s
>>> user 0m0.950s
>>> sys 0m18.816s
>>> -bash-4.1$
>>>
>>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>>> wrote:
>>>
>>>> ok, i've taken that worker offline and once the job running on it
>>>> finishes, i'll wipe the cache.
>>>>
>>>> in the future, please file a JIRA and assign it to me so i don't have
>>>> to track my work through emails to the dev@ list. ;)
>>>>
>>>> thanks!
>>>>
>>>> shane
>>>>
>>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>>> wrote:
>>>>
>>>>> The most recent one I noticed was
>>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>>> was run on amp-jenkins-worker-04.
>>>>>
>>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>>>> wrote:
>>>>>
>>>>>> for those weird failures, it's super helpful to provide which workers
>>>>>> are showing these issues. :)
>>>>>>
>>>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>>>> we'll then potentially get blacklisted again if we download too many
>>>>>> packages from apache.org.
>>>>>>
>>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Folks,
>>>>>>>
>>>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>>> important?
>>>>>>>
>>>>>>> Cheers,
>>>>>>>
>>>>>>> Holden
>>>>>>>
>>>>>>> --
>>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Shane Knapp
>>>>>> Computer Guy / Voice of Reason
>>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>>> https://rise.cs.berkeley.edu
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Twitter: https://twitter.com/holdenkarau
>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>
>>>>
>>>>
>>>> --
>>>> Shane Knapp
>>>> Computer Guy / Voice of Reason
>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>> https://rise.cs.berkeley.edu
>>>>
>>>
>>>
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
Re: m2 cache issues in Jenkins?
Posted by Holden Karau <ho...@pigscanfly.ca>.
Huh interesting that it’s the same worker. Have you filed a ticket to Shane?
On Wed, Jul 1, 2020 at 8:50 PM Hyukjin Kwon <gu...@gmail.com> wrote:
> Hm .. seems this is happening again in amp-jenkins-worker-04 ;(.
>
> 2020년 6월 25일 (목) 오전 3:15, shane knapp ☠ <sk...@berkeley.edu>님이 작성:
>
>> done:
>> -bash-4.1$ cd .m2
>> -bash-4.1$ ls
>> repository
>> -bash-4.1$ time rm -rf *
>>
>> real 17m4.607s
>> user 0m0.950s
>> sys 0m18.816s
>> -bash-4.1$
>>
>> On Wed, Jun 24, 2020 at 10:50 AM shane knapp ☠ <sk...@berkeley.edu>
>> wrote:
>>
>>> ok, i've taken that worker offline and once the job running on it
>>> finishes, i'll wipe the cache.
>>>
>>> in the future, please file a JIRA and assign it to me so i don't have to
>>> track my work through emails to the dev@ list. ;)
>>>
>>> thanks!
>>>
>>> shane
>>>
>>> On Wed, Jun 24, 2020 at 10:48 AM Holden Karau <ho...@pigscanfly.ca>
>>> wrote:
>>>
>>>> The most recent one I noticed was
>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124437/console which
>>>> was run on amp-jenkins-worker-04.
>>>>
>>>> On Wed, Jun 24, 2020 at 10:44 AM shane knapp ☠ <sk...@berkeley.edu>
>>>> wrote:
>>>>
>>>>> for those weird failures, it's super helpful to provide which workers
>>>>> are showing these issues. :)
>>>>>
>>>>> i'd rather not wipe all of the m2 caches on all of the workers, as
>>>>> we'll then potentially get blacklisted again if we download too many
>>>>> packages from apache.org.
>>>>>
>>>>> On Tue, Jun 23, 2020 at 5:58 PM Holden Karau <ho...@pigscanfly.ca>
>>>>> wrote:
>>>>>
>>>>>> Hi Folks,
>>>>>>
>>>>>> I've been see some weird failures on Jenkins and it looks like it
>>>>>> might be from the m2 cache. Would it be OK to clean it out? Or is it
>>>>>> important?
>>>>>>
>>>>>> Cheers,
>>>>>>
>>>>>> Holden
>>>>>>
>>>>>> --
>>>>>> Twitter: https://twitter.com/holdenkarau
>>>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Shane Knapp
>>>>> Computer Guy / Voice of Reason
>>>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>>> https://rise.cs.berkeley.edu
>>>>>
>>>>
>>>>
>>>> --
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
>>>
>>> --
>>> Shane Knapp
>>> Computer Guy / Voice of Reason
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>>>
>>
>>
>> --
>> Shane Knapp
>> Computer Guy / Voice of Reason
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
> --
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau