You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by canan chen <cc...@gmail.com> on 2015/08/16 04:40:47 UTC
TestSQLContext compilation error when run SparkPi in Intellij ?
I import the spark source code to intellij, and want to run SparkPi in
intellij, but meet the folliwing weird compilation error? I googled it and
sbt clean doesn't work for me. I am not sure whether anyone else has meet
this issue also, any help is appreciated
Error:scalac:
while compiling:
/Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala
during phase: jvm
library version: version 2.10.4
compiler version: version 2.10.4
reconstructed args: -nobootcp -javabootclasspath : -deprecation -feature
-classpath
Re: TestSQLContext compilation error when run SparkPi in Intellij ?
Posted by canan chen <cc...@gmail.com>.
Thanks Andrew.
On Sun, Aug 16, 2015 at 1:53 PM, Andrew Or <an...@databricks.com> wrote:
> Hi Canan, TestSQLContext is no longer a singleton but now a class. It is
> never meant to be a fully public API, but if you wish to use it you can
> just instantiate a new one:
>
> val sqlContext = new TestSQLContext
>
> or just create a new SQLContext from a SparkContext.
>
> -Andrew
>
> 2015-08-15 20:33 GMT-07:00 canan chen <cc...@gmail.com>:
>
>> I am not sure other people's spark debugging environment ( I mean for the
>> master branch) , Anyone can share his experience ?
>>
>>
>> On Sun, Aug 16, 2015 at 10:40 AM, canan chen <cc...@gmail.com> wrote:
>>
>>> I import the spark source code to intellij, and want to run SparkPi in
>>> intellij, but meet the folliwing weird compilation error? I googled it and
>>> sbt clean doesn't work for me. I am not sure whether anyone else has meet
>>> this issue also, any help is appreciated
>>>
>>> Error:scalac:
>>> while compiling:
>>> /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala
>>> during phase: jvm
>>> library version: version 2.10.4
>>> compiler version: version 2.10.4
>>> reconstructed args: -nobootcp -javabootclasspath : -deprecation
>>> -feature -classpath
>>>
>>
>>
>
Re: TestSQLContext compilation error when run SparkPi in Intellij ?
Posted by Andrew Or <an...@databricks.com>.
Hi Canan, TestSQLContext is no longer a singleton but now a class. It is
never meant to be a fully public API, but if you wish to use it you can
just instantiate a new one:
val sqlContext = new TestSQLContext
or just create a new SQLContext from a SparkContext.
-Andrew
2015-08-15 20:33 GMT-07:00 canan chen <cc...@gmail.com>:
> I am not sure other people's spark debugging environment ( I mean for the
> master branch) , Anyone can share his experience ?
>
>
> On Sun, Aug 16, 2015 at 10:40 AM, canan chen <cc...@gmail.com> wrote:
>
>> I import the spark source code to intellij, and want to run SparkPi in
>> intellij, but meet the folliwing weird compilation error? I googled it and
>> sbt clean doesn't work for me. I am not sure whether anyone else has meet
>> this issue also, any help is appreciated
>>
>> Error:scalac:
>> while compiling:
>> /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala
>> during phase: jvm
>> library version: version 2.10.4
>> compiler version: version 2.10.4
>> reconstructed args: -nobootcp -javabootclasspath : -deprecation
>> -feature -classpath
>>
>
>
Re: TestSQLContext compilation error when run SparkPi in Intellij ?
Posted by canan chen <cc...@gmail.com>.
I am not sure other people's spark debugging environment ( I mean for the
master branch) , Anyone can share his experience ?
On Sun, Aug 16, 2015 at 10:40 AM, canan chen <cc...@gmail.com> wrote:
> I import the spark source code to intellij, and want to run SparkPi in
> intellij, but meet the folliwing weird compilation error? I googled it and
> sbt clean doesn't work for me. I am not sure whether anyone else has meet
> this issue also, any help is appreciated
>
> Error:scalac:
> while compiling:
> /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala
> during phase: jvm
> library version: version 2.10.4
> compiler version: version 2.10.4
> reconstructed args: -nobootcp -javabootclasspath : -deprecation -feature
> -classpath
>