You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Ted Yu <yu...@gmail.com> on 2015/11/13 20:17:52 UTC
SparkPullRequestBuilder coverage
Hi,
I noticed that SparkPullRequestBuilder completes much faster than maven
Jenkins build.
From
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45871/consoleFull
, I couldn't get exact time the builder started but looks like the duration
was around 20 minutes.
From
https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/4099/console
:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:42 h
Can someone enlighten me on the sets of tests executed by
SparkPullRequestBuilder ?
BTW I noticed that recent Jenkins builds were not in good shape:
https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/
Comments are welcome.
Re: SparkPullRequestBuilder coverage
Posted by Reynold Xin <rx...@databricks.com>.
Yes. And those have been happening too.
On Fri, Nov 13, 2015 at 12:09 PM, Ted Yu <yu...@gmail.com> wrote:
> Can I assume that for any particular test, if it passes reliably on SparkPullRequestBuilder,
> it should pass on maven Jenkins ?
>
> If so, should flaky test(s) be disabled, strengthened and enabled again ?
>
> Cheers
>
> On Fri, Nov 13, 2015 at 11:20 AM, Reynold Xin <rx...@databricks.com> wrote:
>
>> It only runs tests that are impacted by the change. E.g. if you only
>> modify SQL, it won't run the core or streaming tests.
>>
>>
>> On Fri, Nov 13, 2015 at 11:17 AM, Ted Yu <yu...@gmail.com> wrote:
>>
>>> Hi,
>>> I noticed that SparkPullRequestBuilder completes much faster than maven
>>> Jenkins build.
>>>
>>> From
>>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45871/consoleFull
>>> , I couldn't get exact time the builder started but looks like the duration
>>> was around 20 minutes.
>>>
>>> From
>>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/4099/console
>>> :
>>>
>>> [INFO] ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO] ------------------------------------------------------------------------
>>> [INFO] Total time: 01:42 h
>>>
>>>
>>> Can someone enlighten me on the sets of tests executed by SparkPullRequestBuilder ?
>>>
>>>
>>> BTW I noticed that recent Jenkins builds were not in good shape:
>>>
>>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/
>>>
>>>
>>> Comments are welcome.
>>>
>>>
>>
>
Re: SparkPullRequestBuilder coverage
Posted by Ted Yu <yu...@gmail.com>.
Can I assume that for any particular test, if it passes reliably on
SparkPullRequestBuilder,
it should pass on maven Jenkins ?
If so, should flaky test(s) be disabled, strengthened and enabled again ?
Cheers
On Fri, Nov 13, 2015 at 11:20 AM, Reynold Xin <rx...@databricks.com> wrote:
> It only runs tests that are impacted by the change. E.g. if you only
> modify SQL, it won't run the core or streaming tests.
>
>
> On Fri, Nov 13, 2015 at 11:17 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Hi,
>> I noticed that SparkPullRequestBuilder completes much faster than maven
>> Jenkins build.
>>
>> From
>> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45871/consoleFull
>> , I couldn't get exact time the builder started but looks like the duration
>> was around 20 minutes.
>>
>> From
>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/4099/console
>> :
>>
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 01:42 h
>>
>>
>> Can someone enlighten me on the sets of tests executed by SparkPullRequestBuilder ?
>>
>>
>> BTW I noticed that recent Jenkins builds were not in good shape:
>>
>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/
>>
>>
>> Comments are welcome.
>>
>>
>
Re: SparkPullRequestBuilder coverage
Posted by Reynold Xin <rx...@databricks.com>.
It only runs tests that are impacted by the change. E.g. if you only modify
SQL, it won't run the core or streaming tests.
On Fri, Nov 13, 2015 at 11:17 AM, Ted Yu <yu...@gmail.com> wrote:
> Hi,
> I noticed that SparkPullRequestBuilder completes much faster than maven
> Jenkins build.
>
> From
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45871/consoleFull
> , I couldn't get exact time the builder started but looks like the duration
> was around 20 minutes.
>
> From
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/4099/console
> :
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 01:42 h
>
>
> Can someone enlighten me on the sets of tests executed by SparkPullRequestBuilder ?
>
>
> BTW I noticed that recent Jenkins builds were not in good shape:
>
> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/
>
>
> Comments are welcome.
>
>