You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Patrick Wendell <pw...@gmail.com> on 2014/08/07 08:23:19 UTC
[SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Hi All,
I've packaged and published a snapshot release of Spark 1.1 for testing.
This is being distributed to the community for QA and preview purposes. It
is not yet an official RC for voting. Going forward, we'll do preview
releases like this for testing ahead of official votes.
The tag of this release is v1.1.0-snapshot1 (commit d428d8):
*https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
<https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0>*
The release files, including signatures, digests, etc can be found at:
*http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
<http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/>*
Release artifacts are signed with the following key:
*https://people.apache.org/keys/committer/pwendell.asc
<https://people.apache.org/keys/committer/pwendell.asc>*
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1025/
<https://repository.apache.org/content/repositories/orgapachespark-1024/>
NOTE: Due to SPARK-2899, docs are not yet available for this release. Docs
will be posted ASAP.
To learn more about Apache Spark, please see
http://spark.apache.org/
Re: [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Posted by Prashant Sharma <sc...@gmail.com>.
Yeah this should be changed. You can change the banner in the repl,
printWelcome function. Mind sending a PR ?
I think this should be a one place change in the future (Not sure how
feasible it is). Volunteers ?
Prashant Sharma
On Fri, Aug 8, 2014 at 12:48 PM, Debasish Das <de...@gmail.com>
wrote:
> Hi Patrick,
>
> I am testing the 1.1 branch but I see lot of protobuf warnings while
> building the jars:
>
> [warn] Class com.google.protobuf.Parser not found - continuing with a stub.
>
> [warn] Class com.google.protobuf.Parser not found - continuing with a stub.
>
> [warn] Class com.google.protobuf.Parser not found - continuing with a stub.
>
> [warn] Class com.google.protobuf.Parser not found - continuing with a stub.
>
> I am compiling for 2.3.0cdh5.0.2...Later when running the jobs I am getting
> a protobuf error:
>
> Exception in thread "main" java.lang.VerifyError: class
>
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$AddBlockRequestProto
> overrides final method
> getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
>
> Is there a protobuf issue on this branch ?
>
> Also on the branch at least I am noticing the following:
>
> Welcome to
>
> ____ __
>
> / __/__ ___ _____/ /__
>
> _\ \/ _ \/ _ `/ __/ '_/
>
> /___/ .__/\_,_/_/ /_/\_\ version 1.0.0-SNAPSHOT
>
> /_/
>
> Won't it be 1.1.0-SNAPSHOT ?
>
> Thanks.
>
> Deb
>
>
> On Wed, Aug 6, 2014 at 11:24 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > Minor correction: the encoded URL in the staging repo link was wrong.
> > The correct repo is:
> > https://repository.apache.org/content/repositories/orgapachespark-1025/
> >
> >
> > On Wed, Aug 6, 2014 at 11:23 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> > >
> > > Hi All,
> > >
> > > I've packaged and published a snapshot release of Spark 1.1 for
> testing.
> > This is being distributed to the community for QA and preview purposes.
> It
> > is not yet an official RC for voting. Going forward, we'll do preview
> > releases like this for testing ahead of official votes.
> > >
> > > The tag of this release is v1.1.0-snapshot1 (commit d428d8):
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
> > >
> > > The release files, including signatures, digests, etc can be found at:
> > > http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/pwendell.asc
> > >
> > > The staging repository for this release can be found at:
> > >
> https://repository.apache.org/content/repositories/orgapachespark-1025/
> > >
> > > NOTE: Due to SPARK-2899, docs are not yet available for this release.
> > Docs will be posted ASAP.
> > >
> > > To learn more about Apache Spark, please see
> > > http://spark.apache.org/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
> >
>
回复： [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Posted by witgo <wi...@qq.com>.
Need a parameter "-Phadoop-2.3"
eg:
./make-distribution.sh -Dhadoop.version=2.3.0-cdh5.0.2 -Dyarn.version=2.3.0-cdh5.0.2 -Phadoop-2.3 -Pyarn
------------------ 原始邮件 ------------------
发件人: "Debasish Das"<de...@gmail.com>;
发送时间: 2014年8月8日(星期五) 下午3:18
收件人: "Patrick Wendell"<pw...@gmail.com>;
抄送: "dev"<de...@spark.apache.org>;
主题: Re: [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Hi Patrick,
I am testing the 1.1 branch but I see lot of protobuf warnings while
building the jars:
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
I am compiling for 2.3.0cdh5.0.2...Later when running the jobs I am getting
a protobuf error:
Exception in thread "main" java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$AddBlockRequestProto
overrides final method
getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
Is there a protobuf issue on this branch ?
Also on the branch at least I am noticing the following:
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.0.0-SNAPSHOT
/_/
Won't it be 1.1.0-SNAPSHOT ?
Thanks.
Deb
On Wed, Aug 6, 2014 at 11:24 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Minor correction: the encoded URL in the staging repo link was wrong.
> The correct repo is:
> https://repository.apache.org/content/repositories/orgapachespark-1025/
>
>
> On Wed, Aug 6, 2014 at 11:23 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> >
> > Hi All,
> >
> > I've packaged and published a snapshot release of Spark 1.1 for testing.
> This is being distributed to the community for QA and preview purposes. It
> is not yet an official RC for voting. Going forward, we'll do preview
> releases like this for testing ahead of official votes.
> >
> > The tag of this release is v1.1.0-snapshot1 (commit d428d8):
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
> >
> > The release files, including signatures, digests, etc can be found at:
> > http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1025/
> >
> > NOTE: Due to SPARK-2899, docs are not yet available for this release.
> Docs will be posted ASAP.
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Posted by Debasish Das <de...@gmail.com>.
Hi Patrick,
I am testing the 1.1 branch but I see lot of protobuf warnings while
building the jars:
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
[warn] Class com.google.protobuf.Parser not found - continuing with a stub.
I am compiling for 2.3.0cdh5.0.2...Later when running the jobs I am getting
a protobuf error:
Exception in thread "main" java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$AddBlockRequestProto
overrides final method
getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
Is there a protobuf issue on this branch ?
Also on the branch at least I am noticing the following:
Welcome to
____ __
/ __/__ ___ _____/ /__
_\ \/ _ \/ _ `/ __/ '_/
/___/ .__/\_,_/_/ /_/\_\ version 1.0.0-SNAPSHOT
/_/
Won't it be 1.1.0-SNAPSHOT ?
Thanks.
Deb
On Wed, Aug 6, 2014 at 11:24 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Minor correction: the encoded URL in the staging repo link was wrong.
> The correct repo is:
> https://repository.apache.org/content/repositories/orgapachespark-1025/
>
>
> On Wed, Aug 6, 2014 at 11:23 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> >
> > Hi All,
> >
> > I've packaged and published a snapshot release of Spark 1.1 for testing.
> This is being distributed to the community for QA and preview purposes. It
> is not yet an official RC for voting. Going forward, we'll do preview
> releases like this for testing ahead of official votes.
> >
> > The tag of this release is v1.1.0-snapshot1 (commit d428d8):
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
> >
> > The release files, including signatures, digests, etc can be found at:
> > http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1025/
> >
> > NOTE: Due to SPARK-2899, docs are not yet available for this release.
> Docs will be posted ASAP.
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted
Posted by Patrick Wendell <pw...@gmail.com>.
Minor correction: the encoded URL in the staging repo link was wrong.
The correct repo is:
https://repository.apache.org/content/repositories/orgapachespark-1025/
On Wed, Aug 6, 2014 at 11:23 PM, Patrick Wendell <pw...@gmail.com> wrote:
>
> Hi All,
>
> I've packaged and published a snapshot release of Spark 1.1 for testing. This is being distributed to the community for QA and preview purposes. It is not yet an official RC for voting. Going forward, we'll do preview releases like this for testing ahead of official votes.
>
> The tag of this release is v1.1.0-snapshot1 (commit d428d8):
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d428d88418d385d1d04e1b0adcb6b068efe9c7b0
>
> The release files, including signatures, digests, etc can be found at:
> http://people.apache.org/~pwendell/spark-1.1.0-snapshot1/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1025/
>
> NOTE: Due to SPARK-2899, docs are not yet available for this release. Docs will be posted ASAP.
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org