You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Herman van Hövell tot Westerflier <hv...@questtec.nl> on 2016/01/16 00:19:08 UTC
Are we running SparkR tests in Jenkins?
Hi all,
I just noticed the following log entry in Jenkins:
========================================================================
> Running SparkR tests
> ========================================================================
> Running R applications through 'sparkR' is not supported as of Spark 2.0.
> Use ./bin/spark-submit <R file>
Are we still running R tests? Or just saying that this will be deprecated?
Kind regards,
Herman van Hövell tot Westerflier
RE: Are we running SparkR tests in Jenkins?
Posted by Felix Cheung <fe...@hotmail.com>.
I think that breaks sparkR, the commandline script, and Jenkins, in which run-test.sh is calling sparkR.
I'll work on this - since this also affects my PR #10652...
Date: Fri, 15 Jan 2016 15:33:13 -0800
Subject: Re: Are we running SparkR tests in Jenkins?
From: zjffdu@gmail.com
To: shivaram@eecs.berkeley.edu
CC: rxin@databricks.com; hvanhovell@questtec.nl; dev@spark.apache.org; shivaram.venkataraman@gmail.com
Created https://issues.apache.org/jira/browse/SPARK-12846
On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhang <zj...@gmail.com> wrote:
Right, I forget the documentation, will create a follow up jira.
On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <sh...@eecs.berkeley.edu> wrote:
Ah I see. I wasn't aware of that PR. We should do a find and replace
in all the documentation and rest of the repository as well.
Shivaram
On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
> +Shivaram
>
> Ah damn - we should fix it.
>
> This was broken by https://github.com/apache/spark/pull/10658 - which
> removed a functionality that has been deprecated since Spark 1.0.
>
>
>
>
>
> On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
> <hv...@questtec.nl> wrote:
>>
>> Hi all,
>>
>> I just noticed the following log entry in Jenkins:
>>
>>> ========================================================================
>>> Running SparkR tests
>>> ========================================================================
>>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>>> Use ./bin/spark-submit <R file>
>>
>>
>> Are we still running R tests? Or just saying that this will be deprecated?
>>
>> Kind regards,
>>
>> Herman van Hövell tot Westerflier
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
Re: Are we running SparkR tests in Jenkins?
Posted by Jeff Zhang <zj...@gmail.com>.
Created https://issues.apache.org/jira/browse/SPARK-12846
On Fri, Jan 15, 2016 at 3:29 PM, Jeff Zhang <zj...@gmail.com> wrote:
> Right, I forget the documentation, will create a follow up jira.
>
> On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <
> shivaram@eecs.berkeley.edu> wrote:
>
>> Ah I see. I wasn't aware of that PR. We should do a find and replace
>> in all the documentation and rest of the repository as well.
>>
>> Shivaram
>>
>> On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
>> > +Shivaram
>> >
>> > Ah damn - we should fix it.
>> >
>> > This was broken by https://github.com/apache/spark/pull/10658 - which
>> > removed a functionality that has been deprecated since Spark 1.0.
>> >
>> >
>> >
>> >
>> >
>> > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
>> > <hv...@questtec.nl> wrote:
>> >>
>> >> Hi all,
>> >>
>> >> I just noticed the following log entry in Jenkins:
>> >>
>> >>>
>> ========================================================================
>> >>> Running SparkR tests
>> >>>
>> ========================================================================
>> >>> Running R applications through 'sparkR' is not supported as of Spark
>> 2.0.
>> >>> Use ./bin/spark-submit <R file>
>> >>
>> >>
>> >> Are we still running R tests? Or just saying that this will be
>> deprecated?
>> >>
>> >> Kind regards,
>> >>
>> >> Herman van Hövell tot Westerflier
>> >>
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
Re: Are we running SparkR tests in Jenkins?
Posted by Jeff Zhang <zj...@gmail.com>.
Right, I forget the documentation, will create a follow up jira.
On Fri, Jan 15, 2016 at 3:23 PM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:
> Ah I see. I wasn't aware of that PR. We should do a find and replace
> in all the documentation and rest of the repository as well.
>
> Shivaram
>
> On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
> > +Shivaram
> >
> > Ah damn - we should fix it.
> >
> > This was broken by https://github.com/apache/spark/pull/10658 - which
> > removed a functionality that has been deprecated since Spark 1.0.
> >
> >
> >
> >
> >
> > On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
> > <hv...@questtec.nl> wrote:
> >>
> >> Hi all,
> >>
> >> I just noticed the following log entry in Jenkins:
> >>
> >>>
> ========================================================================
> >>> Running SparkR tests
> >>>
> ========================================================================
> >>> Running R applications through 'sparkR' is not supported as of Spark
> 2.0.
> >>> Use ./bin/spark-submit <R file>
> >>
> >>
> >> Are we still running R tests? Or just saying that this will be
> deprecated?
> >>
> >> Kind regards,
> >>
> >> Herman van Hövell tot Westerflier
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
--
Best Regards
Jeff Zhang
Re: Are we running SparkR tests in Jenkins?
Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Ah I see. I wasn't aware of that PR. We should do a find and replace
in all the documentation and rest of the repository as well.
Shivaram
On Fri, Jan 15, 2016 at 3:20 PM, Reynold Xin <rx...@databricks.com> wrote:
> +Shivaram
>
> Ah damn - we should fix it.
>
> This was broken by https://github.com/apache/spark/pull/10658 - which
> removed a functionality that has been deprecated since Spark 1.0.
>
>
>
>
>
> On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
> <hv...@questtec.nl> wrote:
>>
>> Hi all,
>>
>> I just noticed the following log entry in Jenkins:
>>
>>> ========================================================================
>>> Running SparkR tests
>>> ========================================================================
>>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>>> Use ./bin/spark-submit <R file>
>>
>>
>> Are we still running R tests? Or just saying that this will be deprecated?
>>
>> Kind regards,
>>
>> Herman van Hövell tot Westerflier
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Are we running SparkR tests in Jenkins?
Posted by Reynold Xin <rx...@databricks.com>.
+Shivaram
Ah damn - we should fix it.
This was broken by https://github.com/apache/spark/pull/10658 - which
removed a functionality that has been deprecated since Spark 1.0.
On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier <
hvanhovell@questtec.nl> wrote:
> Hi all,
>
> I just noticed the following log entry in Jenkins:
>
> ========================================================================
>> Running SparkR tests
>> ========================================================================
>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>> Use ./bin/spark-submit <R file>
>
>
> Are we still running R tests? Or just saying that this will be deprecated?
>
> Kind regards,
>
> Herman van Hövell tot Westerflier
>
>
Re: Are we running SparkR tests in Jenkins?
Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Yes - we should be running R tests AFAIK. That error message is a
deprecation warning about the script `bin/sparkR` which needs to be
changed in https://github.com/apache/spark/blob/7cd7f2202547224593517b392f56e49e4c94cabc/R/run-tests.sh#L26
to bin/spark-submit.
Thanks
Shivaram
On Fri, Jan 15, 2016 at 3:19 PM, Herman van Hövell tot Westerflier
<hv...@questtec.nl> wrote:
> Hi all,
>
> I just noticed the following log entry in Jenkins:
>
>> ========================================================================
>> Running SparkR tests
>> ========================================================================
>> Running R applications through 'sparkR' is not supported as of Spark 2.0.
>> Use ./bin/spark-submit <R file>
>
>
> Are we still running R tests? Or just saying that this will be deprecated?
>
> Kind regards,
>
> Herman van Hövell tot Westerflier
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org