You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Herman van Hövell tot Westerflier <hv...@questtec.nl> on 2016/01/16 00:19:08 UTC

Are we running SparkR tests in Jenkins?

Hi all,

I just noticed the following log entry in Jenkins:

========================================================================
> Running SparkR tests
> ========================================================================
> Running R applications through 'sparkR' is not supported as of Spark 2.0.
> Use ./bin/spark-submit <R file>


Are we still running R tests? Or just saying that this will be deprecated?

Kind regards,

Herman van Hövell tot Westerflier

RE: Are we running SparkR tests in Jenkins?

Posted by Felix Cheung <fe...@hotmail.com>.
I think that breaks sparkR, the commandline script, and Jenkins, in which run-test.sh is calling sparkR.
I'll work on this - since this also affects my PR #10652...
 
Date: Fri, 15 Jan 2016 15:33:13 -0800
Subject: Re: Are we running SparkR tests in Jenkins?
From: zjffdu@gmail.com
To: shivaram@eecs.berkeley.edu
CC: rxin@databricks.com; hvanhovell@questtec.nl; dev@spark.apache.org; shivaram.venkataraman@gmail.com

Created https://issues.apache.org/jira/browse/SPARK-12846

On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhang <zj...@gmail.com> wrote:
 Right, I forget the documentation, will create a follow up jira.  
On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <sh...@eecs.berkeley.edu> wrote:
Ah I see. I wasn't aware of that PR. We should do a find and replace

in all the documentation and rest of the repository as well.



Shivaram



On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:

> +Shivaram

>

> Ah damn - we should fix it.

>

> This was broken by https://github.com/apache/spark/pull/10658 - which

> removed a functionality that has been deprecated since Spark 1.0.

>

>

>

>

>

> On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier

> <hv...@questtec.nl> wrote:

>>

>> Hi all,

>>

>> I just noticed the following log entry in Jenkins:

>>

>>> ========================================================================

>>> Running SparkR tests

>>> ========================================================================

>>> Running R applications through 'sparkR' is not supported as of Spark 2.0.

>>> Use ./bin/spark-submit <R file>

>>

>>

>> Are we still running R tests? Or just saying that this will be deprecated?

>>

>> Kind regards,

>>

>> Herman van Hövell tot Westerflier

>>

>



---------------------------------------------------------------------

To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org

For additional commands, e-mail: dev-help@spark.apache.org





-- 
Best Regards

Jeff Zhang



-- 
Best Regards

Jeff Zhang
 		 	   		  

Re: Are we running SparkR tests in Jenkins?

Posted by Jeff Zhang <zj...@gmail.com>.
Created https://issues.apache.org/jira/browse/SPARK-12846


On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhang <zj...@gmail.com> wrote:

>  Right, I forget the documentation, will create a follow up jira.
>
> On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <
> shivaram@eecs.berkeley.edu> wrote:
>
>> Ah I see. I wasn't aware of that PR. We should do a find and replace
>> in all the documentation and rest of the repository as well.
>>
>> Shivaram
>>
>> On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
>> > +Shivaram
>> >
>> > Ah damn - we should fix it.
>> >
>> > This was broken by https://github.com/apache/spark/pull/10658 - which
>> > removed a functionality that has been deprecated since Spark 1.0.
>> >
>> >
>> >
>> >
>> >
>> > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
>> > <hv...@questtec.nl> wrote:
>> >>
>> >> Hi all,
>> >>
>> >> I just noticed the following log entry in Jenkins:
>> >>
>> >>>
>> ========================================================================
>> >>> Running SparkR tests
>> >>>
>> ========================================================================
>> >>> Running R applications through 'sparkR' is not supported as of Spark
>> 2.0.
>> >>> Use ./bin/spark-submit <R file>
>> >>
>> >>
>> >> Are we still running R tests? Or just saying that this will be
>> deprecated?
>> >>
>> >> Kind regards,
>> >>
>> >> Herman van Hövell tot Westerflier
>> >>
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>



-- 
Best Regards

Jeff Zhang

Re: Are we running SparkR tests in Jenkins?

Posted by Jeff Zhang <zj...@gmail.com>.
 Right, I forget the documentation, will create a follow up jira.

On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:

> Ah I see. I wasn't aware of that PR. We should do a find and replace
> in all the documentation and rest of the repository as well.
>
> Shivaram
>
> On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
> > +Shivaram
> >
> > Ah damn - we should fix it.
> >
> > This was broken by https://github.com/apache/spark/pull/10658 - which
> > removed a functionality that has been deprecated since Spark 1.0.
> >
> >
> >
> >
> >
> > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
> > <hv...@questtec.nl> wrote:
> >>
> >> Hi all,
> >>
> >> I just noticed the following log entry in Jenkins:
> >>
> >>>
> ========================================================================
> >>> Running SparkR tests
> >>>
> ========================================================================
> >>> Running R applications through 'sparkR' is not supported as of Spark
> 2.0.
> >>> Use ./bin/spark-submit <R file>
> >>
> >>
> >> Are we still running R tests? Or just saying that this will be
> deprecated?
> >>
> >> Kind regards,
> >>
> >> Herman van Hövell tot Westerflier
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>


-- 
Best Regards

Jeff Zhang

Re: Are we running SparkR tests in Jenkins?

Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Ah I see. I wasn't aware of that PR. We should do a find and replace
in all the documentation and rest of the repository as well.

Shivaram

On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
> +Shivaram
>
> Ah damn - we should fix it.
>
> This was broken by https://github.com/apache/spark/pull/10658 - which
> removed a functionality that has been deprecated since Spark 1.0.
>
>
>
>
>
> On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
> <hv...@questtec.nl> wrote:
>>
>> Hi all,
>>
>> I just noticed the following log entry in Jenkins:
>>
>>> ========================================================================
>>> Running SparkR tests
>>> ========================================================================
>>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>>> Use ./bin/spark-submit <R file>
>>
>>
>> Are we still running R tests? Or just saying that this will be deprecated?
>>
>> Kind regards,
>>
>> Herman van Hövell tot Westerflier
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Re: Are we running SparkR tests in Jenkins?

Posted by Reynold Xin <rx...@databricks.com>.
+Shivaram

Ah damn - we should fix it.

This was broken by https://github.com/apache/spark/pull/10658 - which
removed a functionality that has been deprecated since Spark 1.0.





On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier <
hvanhovell@questtec.nl> wrote:

> Hi all,
>
> I just noticed the following log entry in Jenkins:
>
> ========================================================================
>> Running SparkR tests
>> ========================================================================
>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>> Use ./bin/spark-submit <R file>
>
>
> Are we still running R tests? Or just saying that this will be deprecated?
>
> Kind regards,
>
> Herman van Hövell tot Westerflier
>
>

Re: Are we running SparkR tests in Jenkins?

Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Yes - we should be running R tests AFAIK. That error message is a
deprecation warning about the script `bin/sparkR` which needs to be
changed in https://github.com/apache/spark/blob/7cd7f2202547224593517b392f56e49e4c94cabc/R/run-tests.sh#L26
to bin/spark-submit.

Thanks
Shivaram

On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
<hv...@questtec.nl> wrote:
> Hi all,
>
> I just noticed the following log entry in Jenkins:
>
>> ========================================================================
>> Running SparkR tests
>> ========================================================================
>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>> Use ./bin/spark-submit <R file>
>
>
> Are we still running R tests? Or just saying that this will be deprecated?
>
> Kind regards,
>
> Herman van Hövell tot Westerflier
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org