You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Yiou Li <li...@gmail.com> on 2014/04/16 21:03:30 UTC
sbt assembly error
Hi all,
I am trying to build spark assembly using sbt and got connection error when
resolving dependencies:
I tried web browser and wget some of the dependency links in the error and
also got 404 error too.
This happened to the following branches:
spark-0.8.1-incubating
spark-0.9.1
spark-0.9.1-bin-hadoop2
Can somebody please kindly advise?
Best,
Leo
Launching sbt from sbt/sbt-launch-0.12.4.jar
[info] Loading project definition from
/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project/project
[info] Loading project definition from
/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project
[info] Set current project to root (in build
file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/)
[info] Updating
{file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/}core...
[info] Resolving org.slf4j#slf4j-log4j12;1.7.2 ...
[error] Server access Error: Connection timed out url=
https://oss.sonatype.org/content/repositories/snapshots/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
[error] Server access Error: Connection timed out url=
https://oss.sonatype.org/service/local/staging/deploy/maven2/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
[info] Resolving commons-daemon#commons-daemon;1.0.10 ...
[error] Server access Error: Connection timed out url=
https://oss.sonatype.org/content/repositories/snapshots/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
[error] Server access Error: Connection timed out url=
https://oss.sonatype.org/service/local/staging/deploy/maven2/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
[error] Server access Error: Connection timed out url=
https://repository.cloudera.com/artifactory/cloudera-repos/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
[info] Resolving org.apache.commons#commons-parent;23 ...
[error] Server access Error: Connection timed out url=
https://oss.sonatype.org/content/repositories/snapshots/org/apache/commons/commons-parent/23/commons-parent-23.pom
(truncated)
Re: sbt assembly error
Posted by Azuryy Yu <az...@gmail.com>.
It is only network issue. you have some network limited access in China.
On Thu, Apr 17, 2014 at 2:27 PM, Sean Owen <so...@cloudera.com> wrote:
> The error is "Connection timed out", not 404. The build references
> many repos, and only one will contain any given artifact. You are
> seeing it fail through trying many different repos, many of which
> don't even have the artifact either, but that's not the underlying
> cause.
>
> FWIW I can build the assembly just fine and I suspect there is no
> noise on this since others can too.
>
> wget does not have the same proxy settings that SBT / Maven would use,
> and the issue may be HTTPS connections.
>
> That said it could be a transient network problem. I was going to
> suggest that maybe something in the SBT build changed recently -- it's
> a little weird that it's trying snapshot repos? -- but you are looking
> at a very recent 0.9.1.
>
> Try HEAD to confirm?
>
>
> On Wed, Apr 16, 2014 at 11:36 PM, Yiou Li <li...@gmail.com> wrote:
> > Hi Sean,
> >
> > It's true that the sbt is trying different links but ALL of them have
> > connections issue (which is actually 404 File not found error) and the
> build
> > process takes forever connecting different links..
> >
> > I don't think it's a proxy issue because my other projects (other than
> > spark) builds well and I can wget things like wget www.yahoo.com.
> >
> > I am surprised that there is not much noise raised on this issue --- at
> > least on the most recent spark release.
> >
> > Best,
> > Leo
> >
>
Re: sbt assembly error
Posted by Sean Owen <so...@cloudera.com>.
The error is "Connection timed out", not 404. The build references
many repos, and only one will contain any given artifact. You are
seeing it fail through trying many different repos, many of which
don't even have the artifact either, but that's not the underlying
cause.
FWIW I can build the assembly just fine and I suspect there is no
noise on this since others can too.
wget does not have the same proxy settings that SBT / Maven would use,
and the issue may be HTTPS connections.
That said it could be a transient network problem. I was going to
suggest that maybe something in the SBT build changed recently -- it's
a little weird that it's trying snapshot repos? -- but you are looking
at a very recent 0.9.1.
Try HEAD to confirm?
On Wed, Apr 16, 2014 at 11:36 PM, Yiou Li <li...@gmail.com> wrote:
> Hi Sean,
>
> It's true that the sbt is trying different links but ALL of them have
> connections issue (which is actually 404 File not found error) and the build
> process takes forever connecting different links..
>
> I don't think it's a proxy issue because my other projects (other than
> spark) builds well and I can wget things like wget www.yahoo.com.
>
> I am surprised that there is not much noise raised on this issue --- at
> least on the most recent spark release.
>
> Best,
> Leo
>
Re: sbt assembly error
Posted by Yiou Li <li...@gmail.com>.
Hi Sean,
It's true that the sbt is trying different links but ALL of them have
connections issue (which is actually 404 File not found error) and the
build process takes forever connecting different links..
I don't think it's a proxy issue because my other projects (other than
spark) builds well and I can wget things like wget www.yahoo.com.
I am surprised that there is not much noise raised on this issue --- at
least on the most recent spark release.
Best,
Leo
On Wed, Apr 16, 2014 at 12:46 PM, Sean Owen <so...@cloudera.com> wrote:
> This is just a red herring. You are seeing the build fail to contact
> many repos it knows about, including ones that do not have a given
> artifact.
>
> This is almost always a symptom of network connectivity problem, like
> perhaps a proxy in between, esp. one that breaks HTTPS connections.
> You may need to fix your proxy settings for Maven locally.
> --
> Sean Owen | Director, Data Science | London
>
>
> On Wed, Apr 16, 2014 at 8:32 PM, Arpit Tak <ar...@sigmoidanalytics.com>
> wrote:
> > Its because , there is no sl4f directory exists there.... may be they
> > updating it .....
> > https://oss.sonatype.org/content/repositories/snapshots/org/
> >
> > Hard luck .... try after some time...
> >
> > Regards,
> > Arpit
> >
> >
> > On Thu, Apr 17, 2014 at 12:33 AM, Yiou Li <li...@gmail.com> wrote:
> >>
> >> Hi all,
> >>
> >> I am trying to build spark assembly using sbt and got connection error
> >> when resolving dependencies:
> >>
> >> I tried web browser and wget some of the dependency links in the error
> and
> >> also got 404 error too.
> >>
> >> This happened to the following branches:
> >> spark-0.8.1-incubating
> >> spark-0.9.1
> >> spark-0.9.1-bin-hadoop2
> >>
> >> Can somebody please kindly advise?
> >>
> >> Best,
> >> Leo
> >>
> >>
> >> Launching sbt from sbt/sbt-launch-0.12.4.jar
> >> [info] Loading project definition from
> >>
> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project/project
> >> [info] Loading project definition from
> >> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project
> >> [info] Set current project to root (in build
> >> file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/)
> >> [info] Updating
> >>
> {file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/}core...
> >> [info] Resolving org.slf4j#slf4j-log4j12;1.7.2 ...
> >> [error] Server access Error: Connection timed out
> >> url=
> https://oss.sonatype.org/content/repositories/snapshots/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
> >> [error] Server access Error: Connection timed out
> >> url=
> https://oss.sonatype.org/service/local/staging/deploy/maven2/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
> >> [info] Resolving commons-daemon#commons-daemon;1.0.10 ...
> >> [error] Server access Error: Connection timed out
> >> url=
> https://oss.sonatype.org/content/repositories/snapshots/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> >> [error] Server access Error: Connection timed out
> >> url=
> https://oss.sonatype.org/service/local/staging/deploy/maven2/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> >> [error] Server access Error: Connection timed out
> >> url=
> https://repository.cloudera.com/artifactory/cloudera-repos/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> >> [info] Resolving org.apache.commons#commons-parent;23 ...
> >> [error] Server access Error: Connection timed out
> >> url=
> https://oss.sonatype.org/content/repositories/snapshots/org/apache/commons/commons-parent/23/commons-parent-23.pom
> >>
> >> (truncated)
> >
> >
>
Re: sbt assembly error
Posted by Sean Owen <so...@cloudera.com>.
This is just a red herring. You are seeing the build fail to contact
many repos it knows about, including ones that do not have a given
artifact.
This is almost always a symptom of network connectivity problem, like
perhaps a proxy in between, esp. one that breaks HTTPS connections.
You may need to fix your proxy settings for Maven locally.
--
Sean Owen | Director, Data Science | London
On Wed, Apr 16, 2014 at 8:32 PM, Arpit Tak <ar...@sigmoidanalytics.com> wrote:
> Its because , there is no sl4f directory exists there.... may be they
> updating it .....
> https://oss.sonatype.org/content/repositories/snapshots/org/
>
> Hard luck .... try after some time...
>
> Regards,
> Arpit
>
>
> On Thu, Apr 17, 2014 at 12:33 AM, Yiou Li <li...@gmail.com> wrote:
>>
>> Hi all,
>>
>> I am trying to build spark assembly using sbt and got connection error
>> when resolving dependencies:
>>
>> I tried web browser and wget some of the dependency links in the error and
>> also got 404 error too.
>>
>> This happened to the following branches:
>> spark-0.8.1-incubating
>> spark-0.9.1
>> spark-0.9.1-bin-hadoop2
>>
>> Can somebody please kindly advise?
>>
>> Best,
>> Leo
>>
>>
>> Launching sbt from sbt/sbt-launch-0.12.4.jar
>> [info] Loading project definition from
>> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project/project
>> [info] Loading project definition from
>> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project
>> [info] Set current project to root (in build
>> file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/)
>> [info] Updating
>> {file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/}core...
>> [info] Resolving org.slf4j#slf4j-log4j12;1.7.2 ...
>> [error] Server access Error: Connection timed out
>> url=https://oss.sonatype.org/content/repositories/snapshots/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
>> [error] Server access Error: Connection timed out
>> url=https://oss.sonatype.org/service/local/staging/deploy/maven2/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
>> [info] Resolving commons-daemon#commons-daemon;1.0.10 ...
>> [error] Server access Error: Connection timed out
>> url=https://oss.sonatype.org/content/repositories/snapshots/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
>> [error] Server access Error: Connection timed out
>> url=https://oss.sonatype.org/service/local/staging/deploy/maven2/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
>> [error] Server access Error: Connection timed out
>> url=https://repository.cloudera.com/artifactory/cloudera-repos/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
>> [info] Resolving org.apache.commons#commons-parent;23 ...
>> [error] Server access Error: Connection timed out
>> url=https://oss.sonatype.org/content/repositories/snapshots/org/apache/commons/commons-parent/23/commons-parent-23.pom
>>
>> (truncated)
>
>
Re: sbt assembly error
Posted by Arpit Tak <ar...@sigmoidanalytics.com>.
Its because , there is no sl4f directory exists there.... may be they
updating it .....
https://oss.sonatype.org/content/repositories/snapshots/org/
Hard luck .... try after some time...
Regards,
Arpit
On Thu, Apr 17, 2014 at 12:33 AM, Yiou Li <li...@gmail.com> wrote:
> Hi all,
>
> I am trying to build spark assembly using sbt and got connection error
> when resolving dependencies:
>
> I tried web browser and wget some of the dependency links in the error and
> also got 404 error too.
>
> This happened to the following branches:
> spark-0.8.1-incubating
> spark-0.9.1
> spark-0.9.1-bin-hadoop2
>
> Can somebody please kindly advise?
>
> Best,
> Leo
>
>
> Launching sbt from sbt/sbt-launch-0.12.4.jar
> [info] Loading project definition from
> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project/project
> [info] Loading project definition from
> /home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/project
> [info] Set current project to root (in build
> file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/)
> [info] Updating
> {file:/home/leo/workspace_spark/spark-core/spark-0.9.1-bin-hadoop2/}core...
> [info] Resolving org.slf4j#slf4j-log4j12;1.7.2 ...
> [error] Server access Error: Connection timed out url=
> https://oss.sonatype.org/content/repositories/snapshots/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
> [error] Server access Error: Connection timed out url=
> https://oss.sonatype.org/service/local/staging/deploy/maven2/org/slf4j/slf4j-log4j12/1.7.2/slf4j-log4j12-1.7.2.pom
> [info] Resolving commons-daemon#commons-daemon;1.0.10 ...
> [error] Server access Error: Connection timed out url=
> https://oss.sonatype.org/content/repositories/snapshots/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> [error] Server access Error: Connection timed out url=
> https://oss.sonatype.org/service/local/staging/deploy/maven2/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> [error] Server access Error: Connection timed out url=
> https://repository.cloudera.com/artifactory/cloudera-repos/commons-daemon/commons-daemon/1.0.10/commons-daemon-1.0.10.pom
> [info] Resolving org.apache.commons#commons-parent;23 ...
> [error] Server access Error: Connection timed out url=
> https://oss.sonatype.org/content/repositories/snapshots/org/apache/commons/commons-parent/23/commons-parent-23.pom
>
> (truncated)
>