回复： [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted

[witgo <wi...@qq.com>]

Need a parameter "-Phadoop-2.3"

eg:

./make-distribution.sh -Dhadoop.version=2.3.0-cdh5.0.2 -Dyarn.version=2.3.0-cdh5.0.2 -Phadoop-2.3 -Pyarn 
 







------------------ 原始邮件 ------------------
发件人: "Debasish Das"<de...@gmail.com>; 
发送时间: 2014年8月8日(星期五) 下午3:18
收件人: "Patrick Wendell"<pw...@gmail.com>; 
抄送: "dev"<de...@spark.apache.org>; 
主题: Re: [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted



Hi Patrick,

I am testing the 1.1 branch but I see lot of protobuf warnings while
building the jars:

[warn] Class com.google.protobuf.Parser not found - continuing with a stub.

[warn] Class com.google.protobuf.Parser not found - continuing with a stub.

[warn] Class com.google.protobuf.Parser not found - continuing with a stub.

[warn] Class com.google.protobuf.Parser not found - continuing with a stub.

I am compiling for 2.3.0cdh5.0.2...Later when running the jobs I am getting
a protobuf error:

Exception in thread "main" java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$AddBlockRequestProto
overrides final method
getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;

Is there a protobuf issue on this branch ?

Also on the branch at least I am noticing the following:

Welcome to

      ____              __

     / __/__  ___ _____/ /__

    _\ \/ _ \/ _ `/ __/  '_/

   /___/ .__/\_,_/_/ /_/\_\   version 1.0.0-SNAPSHOT

      /_/

Won't it be 1.1.0-SNAPSHOT ?

Thanks.

Deb


On Wed, Aug 6, 2014 at 11:24 PM, Patrick Wendell <pw...@gmail.com> wrote:

> Minor correction: the encoded URL in the staging repo link was wrong.
> The correct repo is:
> https://repository.apache.org/content/repositories/orgapachespark-1025/
>
>
> On Wed, Aug 6, 2014 at 11:23 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> >
> > Hi All,
> >
> > I've packaged and published a snapshot release of Spark 1.1 for testing.
> This is being distributed to the community for QA and preview purposes. It
> is not yet an official RC for voting. Going forward, we'll do preview
> releases like this for testing ahead of official votes.
> >
> > The tag of this release is v1.1.0-snapshot1 (commit d428d8):
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
> >
> > The release files, including signatures, digests, etc can be found at:
> > http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1025/
> >
> > NOTE: Due to SPARK-2899, docs are not yet available for this release.
> Docs will be posted ASAP.
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>