You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Nick Dimiduk <nd...@gmail.com> on 2014/03/11 20:07:33 UTC
Publish 0.99.0-SNAPSHOT to Apache snapshots
Jeffrey and I are looking at publishing an updated snapshot artifact to
facilitate Phoenix build/testing. I'm looking at the instructions here [0].
I've not done thing before, but it looks well documented.
Any objections? We'll pursue it later this afternoon.
-n
[0]: http://hbase.apache.org/book.html#maven.snapshot
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
Snapshot pushed. I need to leave for meetup now, will try out downstreamer
tomorrow.
On Wednesday, March 12, 2014, Nick Dimiduk <nd...@gmail.com> wrote:
> Spinning one now.
>
> On Wednesday, March 12, 2014, Stack <stack@duboce.net<javascript:_e(%7B%7D,'cvml','stack@duboce.net');>>
> wrote:
>
>> On Wed, Mar 12, 2014 at 3:52 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>>
>> > On Wed, Mar 12, 2014 at 3:46 PM, Stack <st...@duboce.net> wrote:
>> >
>> > > Is it in the published SNAPSHOT pom?
>> > >
>> >
>>
>> Push a new SNAPSHOT? Let me know if you want me to do it sir.
>> St.Ack
>>
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
Downstreamer tested with `mvn -U`, works correctly now. Sorry for the
confusion.
-n
On Wed, Mar 12, 2014 at 4:36 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> Spinning one now.
>
>
> On Wednesday, March 12, 2014, Stack <st...@duboce.net> wrote:
>
>> On Wed, Mar 12, 2014 at 3:52 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>>
>> > On Wed, Mar 12, 2014 at 3:46 PM, Stack <st...@duboce.net> wrote:
>> >
>> > > Is it in the published SNAPSHOT pom?
>> > >
>> >
>>
>> Push a new SNAPSHOT? Let me know if you want me to do it sir.
>> St.Ack
>>
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
Spinning one now.
On Wednesday, March 12, 2014, Stack <st...@duboce.net> wrote:
> On Wed, Mar 12, 2014 at 3:52 PM, Nick Dimiduk <ndimiduk@gmail.com<javascript:;>>
> wrote:
>
> > On Wed, Mar 12, 2014 at 3:46 PM, Stack <stack@duboce.net <javascript:;>>
> wrote:
> >
> > > Is it in the published SNAPSHOT pom?
> > >
> >
>
> Push a new SNAPSHOT? Let me know if you want me to do it sir.
> St.Ack
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Stack <st...@duboce.net>.
On Wed, Mar 12, 2014 at 3:52 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> On Wed, Mar 12, 2014 at 3:46 PM, Stack <st...@duboce.net> wrote:
>
> > Is it in the published SNAPSHOT pom?
> >
>
Push a new SNAPSHOT? Let me know if you want me to do it sir.
St.Ack
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
On Wed, Mar 12, 2014 at 3:46 PM, Stack <st...@duboce.net> wrote:
> Is it in the published SNAPSHOT pom?
>
Yes, that appears to be the case. The snapshot I published did not
have HBASE-10601.
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Stack <st...@duboce.net>.
On Wed, Mar 12, 2014 at 3:35 PM, Ted Yu <yu...@gmail.com> wrote:
> Here is my analysis:
>
> MiniDFSCluster.java is in hadoop-minicluster module.
> If pom.xml points to hadoop 2.3, MiniDFSCluster.java would reference
> StorageType.java
> which was added on 2014-01-06.
> StorageType.java was not in hadoop 2.2 release, hence the exception.
>
Where is the 'analysis'? How is hadoop 2.2. being picked up? Why is '
org.apache.hbase:hbase-server:test-jar:tests:0.99.0-SNAPSHOT:test' picking
up 2.2? Is it in the published SNAPSHOT pom? If so, why?
St.Ack
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Ted Yu <yu...@gmail.com>.
Here is my analysis:
MiniDFSCluster.java is in hadoop-minicluster module.
If pom.xml points to hadoop 2.3, MiniDFSCluster.java would reference
StorageType.java
which was added on 2014-01-06.
StorageType.java was not in hadoop 2.2 release, hence the exception.
Cheers
On Wed, Mar 12, 2014 at 2:47 PM, Ted Yu <yu...@gmail.com> wrote:
> I can reproduce the following locally.
>
> [INFO] +- org.apache.hbase:hbase-server:test-jar:tests:0.99.0-SNAPSHOT:test
> ...
> [INFO] | \- org.apache.hadoop:hadoop-hdfs:jar:2.2.0:test
> ...
> [INFO] +- org.apache.hadoop:hadoop-minicluster:jar:2.3.0:test
> ...
> [INFO] | +- org.apache.hadoop:hadoop-hdfs:test-jar:tests:2.3.0:test
>
> Could the dependency difference play a role here ?
>
>
> On Tue, Mar 11, 2014 at 5:35 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>
>>
>> -------------------------------------------------------------------------------
>> Test set: org.hbase.downstreamer.TestHBaseMiniCluster
>>
>> -------------------------------------------------------------------------------
>> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.311 sec
>> <<< FAILURE!
>> testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster)
>> Time elapsed: 1.249 sec <<< ERROR!
>> java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/StorageType
>> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:603)
>> at
>>
>> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:516)
>> at
>>
>> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:845)
>> at
>>
>> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:770)
>> at
>>
>> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:741)
>> at
>>
>> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:710)
>> at
>>
>> org.hbase.downstreamer.TestHBaseMiniCluster.testSpinUpMiniHBaseCluster(TestHBaseMiniCluster.java:23)
>>
>>
>>
>> On Tue, Mar 11, 2014 at 5:32 PM, Ted Yu <yu...@gmail.com> wrote:
>>
>> > Nick:
>> > Can you provide more of the stack trace for the failed test ?
>> >
>> > Thanks
>> >
>> >
>> > On Tue, Mar 11, 2014 at 5:01 PM, Nick Dimiduk <nd...@gmail.com>
>> wrote:
>> >
>> > > Looks like everything worked as documented. I verified using the
>> > > hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0.
>> > When
>> > > I set hadoop.version to 2.3.0, the test fails:
>> > >
>> > > Tests in error:
>> > >
>> > testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster):
>> > > org/apache/hadoop/hdfs/StorageType
>> > >
>> > >
>> > >
>> > >
>> > > On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <jo...@cloudera.com>
>> > wrote:
>> > >
>> > > > Go for it. A minor nits on the docs that got me was that
>> > > > repository.apache.org is a web login, not ssh. :)
>> > > >
>> > > > Jon.
>> > > >
>> > > >
>> > > > On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <enis.soz@gmail.com
>> >
>> > > > wrote:
>> > > >
>> > > > > Go ahead!
>> > > > >
>> > > > >
>> > > > > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <
>> ndimiduk@gmail.com>
>> > > > wrote:
>> > > > >
>> > > > > > Jeffrey and I are looking at publishing an updated snapshot
>> > artifact
>> > > to
>> > > > > > facilitate Phoenix build/testing. I'm looking at the
>> instructions
>> > > here
>> > > > > [0].
>> > > > > > I've not done thing before, but it looks well documented.
>> > > > > >
>> > > > > > Any objections? We'll pursue it later this afternoon.
>> > > > > >
>> > > > > > -n
>> > > > > >
>> > > > > > [0]: http://hbase.apache.org/book.html#maven.snapshot
>> > > > > >
>> > > > >
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > // Jonathan Hsieh (shay)
>> > > > // HBase Tech Lead, Software Engineer, Cloudera
>> > > > // jon@cloudera.com // @jmhsieh
>> > > >
>> > >
>> >
>>
>
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Ted Yu <yu...@gmail.com>.
I can reproduce the following locally.
[INFO] +- org.apache.hbase:hbase-server:test-jar:tests:0.99.0-SNAPSHOT:test
...
[INFO] | \- org.apache.hadoop:hadoop-hdfs:jar:2.2.0:test
...
[INFO] +- org.apache.hadoop:hadoop-minicluster:jar:2.3.0:test
...
[INFO] | +- org.apache.hadoop:hadoop-hdfs:test-jar:tests:2.3.0:test
Could the dependency difference play a role here ?
On Tue, Mar 11, 2014 at 5:35 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>
> -------------------------------------------------------------------------------
> Test set: org.hbase.downstreamer.TestHBaseMiniCluster
>
> -------------------------------------------------------------------------------
> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.311 sec
> <<< FAILURE!
> testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster)
> Time elapsed: 1.249 sec <<< ERROR!
> java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/StorageType
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:603)
> at
>
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:516)
> at
>
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:845)
> at
>
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:770)
> at
>
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:741)
> at
>
> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:710)
> at
>
> org.hbase.downstreamer.TestHBaseMiniCluster.testSpinUpMiniHBaseCluster(TestHBaseMiniCluster.java:23)
>
>
>
> On Tue, Mar 11, 2014 at 5:32 PM, Ted Yu <yu...@gmail.com> wrote:
>
> > Nick:
> > Can you provide more of the stack trace for the failed test ?
> >
> > Thanks
> >
> >
> > On Tue, Mar 11, 2014 at 5:01 PM, Nick Dimiduk <nd...@gmail.com>
> wrote:
> >
> > > Looks like everything worked as documented. I verified using the
> > > hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0.
> > When
> > > I set hadoop.version to 2.3.0, the test fails:
> > >
> > > Tests in error:
> > >
> > testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster):
> > > org/apache/hadoop/hdfs/StorageType
> > >
> > >
> > >
> > >
> > > On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <jo...@cloudera.com>
> > wrote:
> > >
> > > > Go for it. A minor nits on the docs that got me was that
> > > > repository.apache.org is a web login, not ssh. :)
> > > >
> > > > Jon.
> > > >
> > > >
> > > > On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <en...@gmail.com>
> > > > wrote:
> > > >
> > > > > Go ahead!
> > > > >
> > > > >
> > > > > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <ndimiduk@gmail.com
> >
> > > > wrote:
> > > > >
> > > > > > Jeffrey and I are looking at publishing an updated snapshot
> > artifact
> > > to
> > > > > > facilitate Phoenix build/testing. I'm looking at the instructions
> > > here
> > > > > [0].
> > > > > > I've not done thing before, but it looks well documented.
> > > > > >
> > > > > > Any objections? We'll pursue it later this afternoon.
> > > > > >
> > > > > > -n
> > > > > >
> > > > > > [0]: http://hbase.apache.org/book.html#maven.snapshot
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > // Jonathan Hsieh (shay)
> > > > // HBase Tech Lead, Software Engineer, Cloudera
> > > > // jon@cloudera.com // @jmhsieh
> > > >
> > >
> >
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
-------------------------------------------------------------------------------
Test set: org.hbase.downstreamer.TestHBaseMiniCluster
-------------------------------------------------------------------------------
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.311 sec
<<< FAILURE!
testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster)
Time elapsed: 1.249 sec <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/StorageType
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:603)
at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:516)
at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:845)
at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:770)
at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:741)
at
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:710)
at
org.hbase.downstreamer.TestHBaseMiniCluster.testSpinUpMiniHBaseCluster(TestHBaseMiniCluster.java:23)
On Tue, Mar 11, 2014 at 5:32 PM, Ted Yu <yu...@gmail.com> wrote:
> Nick:
> Can you provide more of the stack trace for the failed test ?
>
> Thanks
>
>
> On Tue, Mar 11, 2014 at 5:01 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>
> > Looks like everything worked as documented. I verified using the
> > hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0.
> When
> > I set hadoop.version to 2.3.0, the test fails:
> >
> > Tests in error:
> >
> testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster):
> > org/apache/hadoop/hdfs/StorageType
> >
> >
> >
> >
> > On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <jo...@cloudera.com>
> wrote:
> >
> > > Go for it. A minor nits on the docs that got me was that
> > > repository.apache.org is a web login, not ssh. :)
> > >
> > > Jon.
> > >
> > >
> > > On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <en...@gmail.com>
> > > wrote:
> > >
> > > > Go ahead!
> > > >
> > > >
> > > > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <nd...@gmail.com>
> > > wrote:
> > > >
> > > > > Jeffrey and I are looking at publishing an updated snapshot
> artifact
> > to
> > > > > facilitate Phoenix build/testing. I'm looking at the instructions
> > here
> > > > [0].
> > > > > I've not done thing before, but it looks well documented.
> > > > >
> > > > > Any objections? We'll pursue it later this afternoon.
> > > > >
> > > > > -n
> > > > >
> > > > > [0]: http://hbase.apache.org/book.html#maven.snapshot
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > // Jonathan Hsieh (shay)
> > > // HBase Tech Lead, Software Engineer, Cloudera
> > > // jon@cloudera.com // @jmhsieh
> > >
> >
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Ted Yu <yu...@gmail.com>.
Nick:
Can you provide more of the stack trace for the failed test ?
Thanks
On Tue, Mar 11, 2014 at 5:01 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> Looks like everything worked as documented. I verified using the
> hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0. When
> I set hadoop.version to 2.3.0, the test fails:
>
> Tests in error:
> testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster):
> org/apache/hadoop/hdfs/StorageType
>
>
>
>
> On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
>
> > Go for it. A minor nits on the docs that got me was that
> > repository.apache.org is a web login, not ssh. :)
> >
> > Jon.
> >
> >
> > On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <en...@gmail.com>
> > wrote:
> >
> > > Go ahead!
> > >
> > >
> > > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <nd...@gmail.com>
> > wrote:
> > >
> > > > Jeffrey and I are looking at publishing an updated snapshot artifact
> to
> > > > facilitate Phoenix build/testing. I'm looking at the instructions
> here
> > > [0].
> > > > I've not done thing before, but it looks well documented.
> > > >
> > > > Any objections? We'll pursue it later this afternoon.
> > > >
> > > > -n
> > > >
> > > > [0]: http://hbase.apache.org/book.html#maven.snapshot
> > > >
> > >
> >
> >
> >
> > --
> > // Jonathan Hsieh (shay)
> > // HBase Tech Lead, Software Engineer, Cloudera
> > // jon@cloudera.com // @jmhsieh
> >
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Nick Dimiduk <nd...@gmail.com>.
Looks like everything worked as documented. I verified using the
hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0. When
I set hadoop.version to 2.3.0, the test fails:
Tests in error:
testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster):
org/apache/hadoop/hdfs/StorageType
On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <jo...@cloudera.com> wrote:
> Go for it. A minor nits on the docs that got me was that
> repository.apache.org is a web login, not ssh. :)
>
> Jon.
>
>
> On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <en...@gmail.com>
> wrote:
>
> > Go ahead!
> >
> >
> > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <nd...@gmail.com>
> wrote:
> >
> > > Jeffrey and I are looking at publishing an updated snapshot artifact to
> > > facilitate Phoenix build/testing. I'm looking at the instructions here
> > [0].
> > > I've not done thing before, but it looks well documented.
> > >
> > > Any objections? We'll pursue it later this afternoon.
> > >
> > > -n
> > >
> > > [0]: http://hbase.apache.org/book.html#maven.snapshot
> > >
> >
>
>
>
> --
> // Jonathan Hsieh (shay)
> // HBase Tech Lead, Software Engineer, Cloudera
> // jon@cloudera.com // @jmhsieh
>
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Jonathan Hsieh <jo...@cloudera.com>.
Go for it. A minor nits on the docs that got me was that
repository.apache.org is a web login, not ssh. :)
Jon.
On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <en...@gmail.com> wrote:
> Go ahead!
>
>
> On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>
> > Jeffrey and I are looking at publishing an updated snapshot artifact to
> > facilitate Phoenix build/testing. I'm looking at the instructions here
> [0].
> > I've not done thing before, but it looks well documented.
> >
> > Any objections? We'll pursue it later this afternoon.
> >
> > -n
> >
> > [0]: http://hbase.apache.org/book.html#maven.snapshot
> >
>
--
// Jonathan Hsieh (shay)
// HBase Tech Lead, Software Engineer, Cloudera
// jon@cloudera.com // @jmhsieh
Re: Publish 0.99.0-SNAPSHOT to Apache snapshots
Posted by Enis Söztutar <en...@gmail.com>.
Go ahead!
On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> Jeffrey and I are looking at publishing an updated snapshot artifact to
> facilitate Phoenix build/testing. I'm looking at the instructions here [0].
> I've not done thing before, but it looks well documented.
>
> Any objections? We'll pursue it later this afternoon.
>
> -n
>
> [0]: http://hbase.apache.org/book.html#maven.snapshot
>