You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mrql.apache.org by "Leonidas Fegaras (JIRA)" <ji...@apache.org> on 2014/01/27 01:12:38 UTC
[jira] [Resolved] (MRQL-26) Support for Spark 0.8.1
[ https://issues.apache.org/jira/browse/MRQL-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leonidas Fegaras resolved MRQL-26.
----------------------------------
Resolution: Fixed
MRQL-26.patch applied
> Support for Spark 0.8.1
> -----------------------
>
> Key: MRQL-26
> URL: https://issues.apache.org/jira/browse/MRQL-26
> Project: MRQL
> Issue Type: Improvement
> Components: Run-Time/Spark
> Reporter: Leonidas Fegaras
> Assignee: Leonidas Fegaras
> Priority: Minor
> Attachments: MRQL-26.patch
>
>
> Changed the MRQL run-time engine to support Spark 0.8.1. (The TaskContext constructor in Spark 0.8.1 has changed.) This is incompatible with Spark 0.8.0. I am attaching MRQL-26.patch for approval.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
Re: [jira] [Resolved] (MRQL-26) Support for Spark 0.8.1
Posted by Leonidas Fegaras <fe...@cse.uta.edu>.
Thanks Mark,
I will post your patch on JIRA.
Leonidas
On 02/02/2014 04:30 PM, Mark Hamstra wrote:
> FYI, Apache Spark 0.9.0 is now available, and it's just a two-line diff to
> get MRQL to build using that version:
>
> diff --git i/Spark/pom.xml w/Spark/pom.xml
> index 06882a09a5..8a8efa415d 100644
> --- i/Spark/pom.xml
> +++ w/Spark/pom.xml
> @@ -45,7 +45,7 @@
> </dependency>
> <dependency>
> <groupId>org.apache.spark</groupId>
> - <artifactId>spark-core_2.9.3</artifactId>
> + <artifactId>spark-core_2.10</artifactId>
> <version>${spark.version}</version>
> </dependency>
> </dependencies>
> diff --git i/pom.xml w/pom.xml
> index 20b8de1df9..ef41abd8d7 100644
> --- i/pom.xml
> +++ w/pom.xml
> @@ -46,7 +46,7 @@
> <properties>
> <hadoop.version>1.0.3</hadoop.version>
> <hama.version>0.6.3</hama.version>
> - <spark.version>0.8.1-incubating</spark.version>
> + <spark.version>0.9.0-incubating</spark.version>
> </properties>
>
>
>
> On Sun, Jan 26, 2014 at 4:12 PM, Leonidas Fegaras (JIRA) <ji...@apache.org>wrote:
>
>> [
>> https://issues.apache.org/jira/browse/MRQL-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>>
>> Leonidas Fegaras resolved MRQL-26.
>> ----------------------------------
>>
>> Resolution: Fixed
>>
>> MRQL-26.patch applied
>>
>>> Support for Spark 0.8.1
>>> -----------------------
>>>
>>> Key: MRQL-26
>>> URL: https://issues.apache.org/jira/browse/MRQL-26
>>> Project: MRQL
>>> Issue Type: Improvement
>>> Components: Run-Time/Spark
>>> Reporter: Leonidas Fegaras
>>> Assignee: Leonidas Fegaras
>>> Priority: Minor
>>> Attachments: MRQL-26.patch
>>>
>>>
>>> Changed the MRQL run-time engine to support Spark 0.8.1. (The
>> TaskContext constructor in Spark 0.8.1 has changed.) This is incompatible
>> with Spark 0.8.0. I am attaching MRQL-26.patch for approval.
>>
>>
>>
>> --
>> This message was sent by Atlassian JIRA
>> (v6.1.5#6160)
>>
> .
>
Re: [jira] [Resolved] (MRQL-26) Support for Spark 0.8.1
Posted by Mark Hamstra <ma...@clearstorydata.com>.
FYI, Apache Spark 0.9.0 is now available, and it's just a two-line diff to
get MRQL to build using that version:
diff --git i/Spark/pom.xml w/Spark/pom.xml
index 06882a09a5..8a8efa415d 100644
--- i/Spark/pom.xml
+++ w/Spark/pom.xml
@@ -45,7 +45,7 @@
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
- <artifactId>spark-core_2.9.3</artifactId>
+ <artifactId>spark-core_2.10</artifactId>
<version>${spark.version}</version>
</dependency>
</dependencies>
diff --git i/pom.xml w/pom.xml
index 20b8de1df9..ef41abd8d7 100644
--- i/pom.xml
+++ w/pom.xml
@@ -46,7 +46,7 @@
<properties>
<hadoop.version>1.0.3</hadoop.version>
<hama.version>0.6.3</hama.version>
- <spark.version>0.8.1-incubating</spark.version>
+ <spark.version>0.9.0-incubating</spark.version>
</properties>
On Sun, Jan 26, 2014 at 4:12 PM, Leonidas Fegaras (JIRA) <ji...@apache.org>wrote:
>
> [
> https://issues.apache.org/jira/browse/MRQL-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Leonidas Fegaras resolved MRQL-26.
> ----------------------------------
>
> Resolution: Fixed
>
> MRQL-26.patch applied
>
> > Support for Spark 0.8.1
> > -----------------------
> >
> > Key: MRQL-26
> > URL: https://issues.apache.org/jira/browse/MRQL-26
> > Project: MRQL
> > Issue Type: Improvement
> > Components: Run-Time/Spark
> > Reporter: Leonidas Fegaras
> > Assignee: Leonidas Fegaras
> > Priority: Minor
> > Attachments: MRQL-26.patch
> >
> >
> > Changed the MRQL run-time engine to support Spark 0.8.1. (The
> TaskContext constructor in Spark 0.8.1 has changed.) This is incompatible
> with Spark 0.8.0. I am attaching MRQL-26.patch for approval.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.1.5#6160)
>