You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by William Li <a-...@expedia.com> on 2015/10/22 18:48:37 UTC
Maven Repository Hosting for Spark SQL 1.5.1
Hi - I tried to download the Spark SQL 2.10 and version 1.5.1 from Intellij using the maven library:
-Project Structure
-Global Library, click on the + to select Maven Repository
-Type in org.apache.spark to see the list.
-The list result only shows version up to spark-sql_2.10-1.1.1
-I tried to manually typed in the version 1.5.1 but it doesn't download the correct list of files needed.
I can't see the 1.5.1 version. So there seems to be some problem because Intellij reported that org.apache.spark:spark-sql_2.10-1.5.1 is not available or not complete.
Does anyone know who to contact to verify that?
Thanks,
William.
Re: Maven Repository Hosting for Spark SQL 1.5.1
Posted by William Li <a-...@expedia.com>.
Thanks Sean. I did that but didn¹t seem to help. However, I manually
downloaded both the pom and jar files from the site, and then run through
mvn dependency:purge-local-repository to clean up the local repo (+ re
download them all). All are good and then the error went away.
Thanks a lot for your help!
William.
On 10/22/15, 1:44 PM, "Sean Owen" <so...@cloudera.com> wrote:
>Maven, in general, does some local caching to avoid htting the repo
>every time. It's possible this is why you're not seeing 1.5.1. On the
>command line you can for example add "mvn -U ..." Not sure of the
>equivalent in IntelliJ, but it will be updating the same repo IJ sees.
>Try that. The repo definitely has 1.5.1 as you can see.
>
>On Thu, Oct 22, 2015 at 11:44 AM, William Li <a-...@expedia.com> wrote:
>> Thanks Deenar for your response. I am able to get the version 1.5.0 and
>> other lower version, they all fine but just not the 1.5.1. It¹s hard to
>> believe it¹s proxy settings settings.
>>
>> What is interesting is that the Intellij does a few things when
>>downloading
>> this jar: putting into .m2 repository, creating pom etc. It was able to
>>do
>> that successfully for all other version but not 1.5.1
>>
>> I tred to download the jar manually and run the maven install, it also
>> errored out to say this packing is incomplete.
>>
>>
>> From: Deenar Toraskar <de...@gmail.com>
>> Date: Thursday, October 22, 2015 at 10:36 AM
>> To: William Li <a-...@expedia.com>
>> Cc: "user@spark.apache.org" <us...@spark.apache.org>
>> Subject: Re: Maven Repository Hosting for Spark SQL 1.5.1
>>
>> I can see this artifact in public repos
>> http://mvnrepository.com/artifact/org.apache.spark/spark-sql_2.10/1.5.1
>>
>>
>>http://central.maven.org/maven2/org/apache/spark/spark-sql_2.10/1.5.1/spa
>>rk-sql_2.10-1.5.1.jar
>>
>> check your proxy settings or the list of repos you are using.
>>
>> Deenar
>>
>> On 22 October 2015 at 17:48, William Li <a-...@expedia.com> wrote:
>>>
>>>
>>> Hi I tried to download the Spark SQL 2.10 and version 1.5.1 from
>>> Intellij using the maven library:
>>>
>>> -Project Structure
>>> -Global Library, click on the + to select Maven Repository
>>> -Type in org.apache.spark to see the list.
>>> -The list result only shows version up to spark-sql_2.10-1.1.1
>>> -I tried to manually typed in the version 1.5.1 but it doesn¹t download
>>> the correct list of files needed.
>>>
>>> I can¹t see the 1.5.1 version. So there seems to be some problem
>>>because
>>> Intellij reported that org.apache.spark:spark-sql_2.10-1.5.1 is not
>>> available or not complete.
>>>
>>> Does anyone know who to contact to verify that?
>>>
>>>
>>> Thanks,
>>>
>>> William.
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Maven Repository Hosting for Spark SQL 1.5.1
Posted by Sean Owen <so...@cloudera.com>.
Maven, in general, does some local caching to avoid htting the repo
every time. It's possible this is why you're not seeing 1.5.1. On the
command line you can for example add "mvn -U ..." Not sure of the
equivalent in IntelliJ, but it will be updating the same repo IJ sees.
Try that. The repo definitely has 1.5.1 as you can see.
On Thu, Oct 22, 2015 at 11:44 AM, William Li <a-...@expedia.com> wrote:
> Thanks Deenar for your response. I am able to get the version 1.5.0 and
> other lower version, they all fine but just not the 1.5.1. It’s hard to
> believe it’s proxy settings settings.
>
> What is interesting is that the Intellij does a few things when downloading
> this jar: putting into .m2 repository, creating pom etc. It was able to do
> that successfully for all other version but not 1.5.1
>
> I tred to download the jar manually and run the maven install, it also
> errored out to say this packing is incomplete.
>
>
> From: Deenar Toraskar <de...@gmail.com>
> Date: Thursday, October 22, 2015 at 10:36 AM
> To: William Li <a-...@expedia.com>
> Cc: "user@spark.apache.org" <us...@spark.apache.org>
> Subject: Re: Maven Repository Hosting for Spark SQL 1.5.1
>
> I can see this artifact in public repos
> http://mvnrepository.com/artifact/org.apache.spark/spark-sql_2.10/1.5.1
>
> http://central.maven.org/maven2/org/apache/spark/spark-sql_2.10/1.5.1/spark-sql_2.10-1.5.1.jar
>
> check your proxy settings or the list of repos you are using.
>
> Deenar
>
> On 22 October 2015 at 17:48, William Li <a-...@expedia.com> wrote:
>>
>>
>> Hi – I tried to download the Spark SQL 2.10 and version 1.5.1 from
>> Intellij using the maven library:
>>
>> -Project Structure
>> -Global Library, click on the + to select Maven Repository
>> -Type in org.apache.spark to see the list.
>> -The list result only shows version up to spark-sql_2.10-1.1.1
>> -I tried to manually typed in the version 1.5.1 but it doesn’t download
>> the correct list of files needed.
>>
>> I can’t see the 1.5.1 version. So there seems to be some problem because
>> Intellij reported that org.apache.spark:spark-sql_2.10-1.5.1 is not
>> available or not complete.
>>
>> Does anyone know who to contact to verify that?
>>
>>
>> Thanks,
>>
>> William.
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Maven Repository Hosting for Spark SQL 1.5.1
Posted by William Li <a-...@expedia.com>.
Thanks Deenar for your response. I am able to get the version 1.5.0 and other lower version, they all fine but just not the 1.5.1. It's hard to believe it's proxy settings settings.
What is interesting is that the Intellij does a few things when downloading this jar: putting into .m2 repository, creating pom etc. It was able to do that successfully for all other version but not 1.5.1
I tred to download the jar manually and run the maven install, it also errored out to say this packing is incomplete.
From: Deenar Toraskar <de...@gmail.com>>
Date: Thursday, October 22, 2015 at 10:36 AM
To: William Li <a-...@expedia.com>>
Cc: "user@spark.apache.org<ma...@spark.apache.org>" <us...@spark.apache.org>>
Subject: Re: Maven Repository Hosting for Spark SQL 1.5.1
I can see this artifact in public repos http://mvnrepository.com/artifact/org.apache.spark/spark-sql_2.10/1.5.1
http://central.maven.org/maven2/org/apache/spark/spark-sql_2.10/1.5.1/spark-sql_2.10-1.5.1.jar
check your proxy settings or the list of repos you are using.
Deenar
On 22 October 2015 at 17:48, William Li <a-...@expedia.com>> wrote:
Hi - I tried to download the Spark SQL 2.10 and version 1.5.1 from Intellij using the maven library:
-Project Structure
-Global Library, click on the + to select Maven Repository
-Type in org.apache.spark to see the list.
-The list result only shows version up to spark-sql_2.10-1.1.1
-I tried to manually typed in the version 1.5.1 but it doesn't download the correct list of files needed.
I can't see the 1.5.1 version. So there seems to be some problem because Intellij reported that org.apache.spark:spark-sql_2.10-1.5.1 is not available or not complete.
Does anyone know who to contact to verify that?
Thanks,
William.
Re: Maven Repository Hosting for Spark SQL 1.5.1
Posted by Deenar Toraskar <de...@gmail.com>.
I can see this artifact in public repos
http://mvnrepository.com/artifact/org.apache.spark/spark-sql_2.10/1.5.1
http://central.maven.org/maven2/org/apache/spark/spark-sql_2.10/1.5.1/spark-sql_2.10-1.5.1.jar
check your proxy settings or the list of repos you are using.
Deenar
On 22 October 2015 at 17:48, William Li <a-...@expedia.com> wrote:
>
> Hi – I tried to download the Spark SQL 2.10 and version 1.5.1 from
> Intellij using the maven library:
>
> -Project Structure
> -Global Library, click on the + to select Maven Repository
> -Type in org.apache.spark to see the list.
> -The list result only shows version up to spark-sql_2.10-1.1.1
> -I tried to manually typed in the version 1.5.1 but it doesn’t download
> the correct list of files needed.
>
> I can’t see the 1.5.1 version. So there seems to be some problem because
> Intellij reported that org.apache.spark:spark-sql_2.10-1.5.1 is not
> available or not complete.
>
> Does anyone know who to contact to verify that?
>
>
> Thanks,
>
> William.
>