You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Cheolsoo Park <pi...@gmail.com> on 2015/09/04 20:09:15 UTC

Flaky test in DAGSchedulerSuite?

Hi devs,

I noticed this test case fails intermittently in Jenkins.

For eg, see the following builds-
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41991/
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/

The test failed in different PRs, and the failure looks unrelated to
changes in the PRs. Looks like the test was added by the following commit-

commit 80e2568b25780a7094199239da8ad6cfb6efc9f7
Author: Imran Rashid <ir...@cloudera.com>
Date:   Mon Jul 20 10:28:32 2015 -0700
    [SPARK-8103][core] DAGScheduler should not submit multiple concurrent
attempts for a stag

Thanks!
Cheolsoo

Re: Flaky test in DAGSchedulerSuite?

Posted by Andrew Or <an...@databricks.com>.
(merge into master, thanks for the quick fix Pete).

2015-09-04 15:58 GMT-07:00 Cheolsoo Park <pi...@gmail.com>:

> Thank you Pete!
>
> On Fri, Sep 4, 2015 at 1:40 PM, Pete Robbins <ro...@gmail.com> wrote:
>
>> raised https://issues.apache.org/jira/browse/SPARK-10454 and PR
>>
>> On 4 September 2015 at 21:24, Pete Robbins <ro...@gmail.com> wrote:
>>
>>> I've also just hit this and was about to raise a JIRA for this if there
>>> isn't one already. I have a simple fix.
>>>
>>> On 4 September 2015 at 19:09, Cheolsoo Park <pi...@gmail.com>
>>> wrote:
>>>
>>>> Hi devs,
>>>>
>>>> I noticed this test case fails intermittently in Jenkins.
>>>>
>>>> For eg, see the following builds-
>>>>
>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41991/
>>>>
>>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/
>>>>
>>>> The test failed in different PRs, and the failure looks unrelated to
>>>> changes in the PRs. Looks like the test was added by the following commit-
>>>>
>>>> commit 80e2568b25780a7094199239da8ad6cfb6efc9f7
>>>> Author: Imran Rashid <ir...@cloudera.com>
>>>> Date:   Mon Jul 20 10:28:32 2015 -0700
>>>>     [SPARK-8103][core] DAGScheduler should not submit multiple
>>>> concurrent attempts for a stag
>>>>
>>>> Thanks!
>>>> Cheolsoo
>>>>
>>>
>>>
>>
>

Re: Flaky test in DAGSchedulerSuite?

Posted by Cheolsoo Park <pi...@gmail.com>.
Thank you Pete!

On Fri, Sep 4, 2015 at 1:40 PM, Pete Robbins <ro...@gmail.com> wrote:

> raised https://issues.apache.org/jira/browse/SPARK-10454 and PR
>
> On 4 September 2015 at 21:24, Pete Robbins <ro...@gmail.com> wrote:
>
>> I've also just hit this and was about to raise a JIRA for this if there
>> isn't one already. I have a simple fix.
>>
>> On 4 September 2015 at 19:09, Cheolsoo Park <pi...@gmail.com> wrote:
>>
>>> Hi devs,
>>>
>>> I noticed this test case fails intermittently in Jenkins.
>>>
>>> For eg, see the following builds-
>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41991/
>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/
>>>
>>> The test failed in different PRs, and the failure looks unrelated to
>>> changes in the PRs. Looks like the test was added by the following commit-
>>>
>>> commit 80e2568b25780a7094199239da8ad6cfb6efc9f7
>>> Author: Imran Rashid <ir...@cloudera.com>
>>> Date:   Mon Jul 20 10:28:32 2015 -0700
>>>     [SPARK-8103][core] DAGScheduler should not submit multiple
>>> concurrent attempts for a stag
>>>
>>> Thanks!
>>> Cheolsoo
>>>
>>
>>
>

Re: Flaky test in DAGSchedulerSuite?

Posted by Pete Robbins <ro...@gmail.com>.
raised https://issues.apache.org/jira/browse/SPARK-10454 and PR

On 4 September 2015 at 21:24, Pete Robbins <ro...@gmail.com> wrote:

> I've also just hit this and was about to raise a JIRA for this if there
> isn't one already. I have a simple fix.
>
> On 4 September 2015 at 19:09, Cheolsoo Park <pi...@gmail.com> wrote:
>
>> Hi devs,
>>
>> I noticed this test case fails intermittently in Jenkins.
>>
>> For eg, see the following builds-
>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41991/
>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/
>>
>> The test failed in different PRs, and the failure looks unrelated to
>> changes in the PRs. Looks like the test was added by the following commit-
>>
>> commit 80e2568b25780a7094199239da8ad6cfb6efc9f7
>> Author: Imran Rashid <ir...@cloudera.com>
>> Date:   Mon Jul 20 10:28:32 2015 -0700
>>     [SPARK-8103][core] DAGScheduler should not submit multiple concurrent
>> attempts for a stag
>>
>> Thanks!
>> Cheolsoo
>>
>
>

Re: Flaky test in DAGSchedulerSuite?

Posted by Pete Robbins <ro...@gmail.com>.
I've also just hit this and was about to raise a JIRA for this if there
isn't one already. I have a simple fix.

On 4 September 2015 at 19:09, Cheolsoo Park <pi...@gmail.com> wrote:

> Hi devs,
>
> I noticed this test case fails intermittently in Jenkins.
>
> For eg, see the following builds-
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41991/
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/
>
> The test failed in different PRs, and the failure looks unrelated to
> changes in the PRs. Looks like the test was added by the following commit-
>
> commit 80e2568b25780a7094199239da8ad6cfb6efc9f7
> Author: Imran Rashid <ir...@cloudera.com>
> Date:   Mon Jul 20 10:28:32 2015 -0700
>     [SPARK-8103][core] DAGScheduler should not submit multiple concurrent
> attempts for a stag
>
> Thanks!
> Cheolsoo
>