You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Tom White <to...@cloudera.com> on 2011/08/13 01:18:57 UTC
Mavenizing the HDFS build
The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
to be committed, so unless there are any objections I will do so on
Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
I'll also create a script to convert patches to the new layout, and
switch over the Jenkins jobs that test and build HDFS.
Cheers,
Tom
Re: Mavenizing the HDFS build
Posted by "Aaron T. Myers" <at...@cloudera.com>.
I believe these JIRAs should address those issues:
https://issues.apache.org/jira/browse/HADOOP-7563
https://issues.apache.org/jira/browse/HDFS-2277
--
Aaron T. Myers
Software Engineer, Cloudera
On Mon, Aug 22, 2011 at 1:16 PM, Thomas Graves <tg...@yahoo-inc.com>wrote:
> What is the expected way to run from the tarballs?
>
> It seems if I just untar them so they are in their separate directories (
> hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
> hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
> HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to. Certain
> things like hadoop-config.sh are in libexec and it expects them in bin,
> things in hdfs bin it looks for in common bin, things are in sbin but it
> wants them in bin, it now can't seem to find the hdfs jars, etc..
> Hopefully
> I'm missing something simple to make this work?
>
> Thanks,
> Tom Graves
>
> On 8/19/11 12:55 PM, "Tom White" <to...@cloudera.com> wrote:
>
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> >> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> >> mavenization changes tomorrow (Friday) at 9am PDT.
> >>
> >> Cheers,
> >> Tom
> >>
> >> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> >>> Thanks Tom.
> >>>
> >>> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and
> >>> should be done by tmrw.
> >>>
> >>> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> >>>
> >>>> Hi Arun,
> >>>>
> >>>> I'm fine with that. When do you expect to start the vote?
> >>>>
> >>>> Cheers,
> >>>> Tom
> >>>>
> >>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> >>>> wrote:
> >>>>> Hi Tom,
> >>>>>
> >>>>> Can I request you to wait on this commit until we merge MR-279? As
> Vinod
> >>>>> pointed out in his mail to mapreduce-dev@ we are very close to
> getting the
> >>>>> merge done. We should call a vote asap. By holding off it the mvn
> patch it
> >>>>> will save us a bit of time - we spent at more than a couple of days
> on
> >>>>> resolving after the common mvn'ization.
> >>>>>
> >>>>> Thanks for understanding.
> >>>>>
> >>>>> Arun
> >>>>>
> >>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> >>>>>
> >>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> >>>>>> to be committed, so unless there are any objections I will do so on
> >>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> >>>>>>
> >>>>>> I'll also create a script to convert patches to the new layout, and
> >>>>>> switch over the Jenkins jobs that test and build HDFS.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Tom
> >>>>>
> >>>>>
> >>>
> >>>
> >>
>
>
Re: Mavenizing the HDFS build
Posted by "Aaron T. Myers" <at...@cloudera.com>.
I believe these JIRAs should address those issues:
https://issues.apache.org/jira/browse/HADOOP-7563
https://issues.apache.org/jira/browse/HDFS-2277
--
Aaron T. Myers
Software Engineer, Cloudera
On Mon, Aug 22, 2011 at 1:16 PM, Thomas Graves <tg...@yahoo-inc.com>wrote:
> What is the expected way to run from the tarballs?
>
> It seems if I just untar them so they are in their separate directories (
> hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
> hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
> HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to. Certain
> things like hadoop-config.sh are in libexec and it expects them in bin,
> things in hdfs bin it looks for in common bin, things are in sbin but it
> wants them in bin, it now can't seem to find the hdfs jars, etc..
> Hopefully
> I'm missing something simple to make this work?
>
> Thanks,
> Tom Graves
>
> On 8/19/11 12:55 PM, "Tom White" <to...@cloudera.com> wrote:
>
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> >> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> >> mavenization changes tomorrow (Friday) at 9am PDT.
> >>
> >> Cheers,
> >> Tom
> >>
> >> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> >>> Thanks Tom.
> >>>
> >>> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and
> >>> should be done by tmrw.
> >>>
> >>> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> >>>
> >>>> Hi Arun,
> >>>>
> >>>> I'm fine with that. When do you expect to start the vote?
> >>>>
> >>>> Cheers,
> >>>> Tom
> >>>>
> >>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> >>>> wrote:
> >>>>> Hi Tom,
> >>>>>
> >>>>> Can I request you to wait on this commit until we merge MR-279? As
> Vinod
> >>>>> pointed out in his mail to mapreduce-dev@ we are very close to
> getting the
> >>>>> merge done. We should call a vote asap. By holding off it the mvn
> patch it
> >>>>> will save us a bit of time - we spent at more than a couple of days
> on
> >>>>> resolving after the common mvn'ization.
> >>>>>
> >>>>> Thanks for understanding.
> >>>>>
> >>>>> Arun
> >>>>>
> >>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> >>>>>
> >>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> >>>>>> to be committed, so unless there are any objections I will do so on
> >>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> >>>>>>
> >>>>>> I'll also create a script to convert patches to the new layout, and
> >>>>>> switch over the Jenkins jobs that test and build HDFS.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Tom
> >>>>>
> >>>>>
> >>>
> >>>
> >>
>
>
Re: Mavenizing the HDFS build
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Cos,
Thanks for catching that, I've missed that AOP was being used for 2
different things.
Alejandro
On Fri, Aug 19, 2011 at 11:37 AM, Konstantin Boudnik <co...@apache.org> wrote:
> Right, Common has the tracking for AOP FI tests. There's Herrior work
> (system
> cluster tests) which is separate from FI although is using the same
> technology.
>
> My point was that HDFS ticket doesn't have any traces of it which makes me
> wonder if it has been removed or else. I see your point and I'll add new
> subtasks to the JIRAs.
>
> Cos
>
> On Fri, Aug 19, 2011 at 11:26AM, Alejandro Abdelnur wrote:
> > Hey Cos,
> >
> > Given the size of the Mavenization work we broke into several pieces and
> we
> > are working them incrementally.
> >
> > Because of that some disruption is happening to some parts of the build
> and
> > components.
> >
> > There is a JIRA open for the AOP stuff (
> > https://issues.apache.org/jira/browse/HADOOP-7481).
> >
> > There you've indicated you'd take a stab at it. Given that you are
> familiar
> > with AOP and how it is used in Hadoop, I guess you are the best person to
> > take care of this part of the puzzle.
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org>
> wrote:
> >
> > > I see that the whole AOP stuff has been taken out along with Herriot
> work.
> > > I don't see any discussion about this on the JIRA. Neither I don't see
> any
> > > tickets created to track the effort (but a subtask for FI tests in
> > > HADOOP-7412).
> > >
> > > Any reason we are missing a big chunk of validation infrastructure in
> the
> > > mavenized build?
> > >
> > > Cos
> > >
> > > On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > > > HDFS-2096 is now committed to trunk. The instructions for building
> > > > HDFS can be found in the top-level BUILDING.txt file.
> > > >
> > > > I added a script to
> https://issues.apache.org/jira/browse/HADOOP-7500
> > > > to help with migrating HDFS patches to the new layout.
> > > >
> > > > There are a few follow-up patches that need doing soon (e.g.
> > > > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > > > folks from doing development as usual.
> > > >
> > > > Thanks to everyone who helped with this!
> > > >
> > > > Cheers,
> > > > Tom
> > > >
> > > > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com>
> wrote:
> > > > > Now that MR-279 has been merged into trunk, I plan to commit the
> HDFS
> > > > > mavenization changes tomorrow (Friday) at 9am PDT.
> > > > >
> > > > > Cheers,
> > > > > Tom
> > > > >
> > > > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <
> acm@hortonworks.com>
> > > wrote:
> > > > >> Thanks Tom.
> > > > >>
> > > > >> I'm running the final set of tests with the 'MR-279 rebased on
> trunk'
> > > and should be done by tmrw.
> > > > >>
> > > > >> Also, can you guys please ensure that secure HDFS works after
> > > mvn'ization?
> > > > >>
> > > > >> thanks,
> > > > >> Arun
> > > > >>
> > > > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > > > >>
> > > > >>> Hi Arun,
> > > > >>>
> > > > >>> I'm fine with that. When do you expect to start the vote?
> > > > >>>
> > > > >>> Cheers,
> > > > >>> Tom
> > > > >>>
> > > > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <
> acm@hortonworks.com>
> > > wrote:
> > > > >>>> Hi Tom,
> > > > >>>>
> > > > >>>> ═Can I request you to wait on this commit until we merge MR-279?
> As
> > > Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> > > getting the merge done. We should call a vote asap. By holding off it
> the
> > > mvn patch it will save us a bit of time - we spent at more than a
> couple of
> > > days on resolving after the common mvn'ization.
> > > > >>>>
> > > > >>>> ═Thanks for understanding.
> > > > >>>>
> > > > >>>> Arun
> > > > >>>>
> > > > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > > > >>>>
> > > > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> > > ready
> > > > >>>>> to be committed, so unless there are any objections I will do
> so on
> > > > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > > > >>>>>
> > > > >>>>> I'll also create a script to convert patches to the new layout,
> and
> > > > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > > > >>>>>
> > > > >>>>> Cheers,
> > > > >>>>> Tom
> > > > >>>>
> > > > >>>>
> > > > >>
> > > > >>
> > > > >
> > >
>
Re: Mavenizing the HDFS build
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Cos,
Thanks for catching that, I've missed that AOP was being used for 2
different things.
Alejandro
On Fri, Aug 19, 2011 at 11:37 AM, Konstantin Boudnik <co...@apache.org> wrote:
> Right, Common has the tracking for AOP FI tests. There's Herrior work
> (system
> cluster tests) which is separate from FI although is using the same
> technology.
>
> My point was that HDFS ticket doesn't have any traces of it which makes me
> wonder if it has been removed or else. I see your point and I'll add new
> subtasks to the JIRAs.
>
> Cos
>
> On Fri, Aug 19, 2011 at 11:26AM, Alejandro Abdelnur wrote:
> > Hey Cos,
> >
> > Given the size of the Mavenization work we broke into several pieces and
> we
> > are working them incrementally.
> >
> > Because of that some disruption is happening to some parts of the build
> and
> > components.
> >
> > There is a JIRA open for the AOP stuff (
> > https://issues.apache.org/jira/browse/HADOOP-7481).
> >
> > There you've indicated you'd take a stab at it. Given that you are
> familiar
> > with AOP and how it is used in Hadoop, I guess you are the best person to
> > take care of this part of the puzzle.
> >
> > Thanks.
> >
> > Alejandro
> >
> > On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org>
> wrote:
> >
> > > I see that the whole AOP stuff has been taken out along with Herriot
> work.
> > > I don't see any discussion about this on the JIRA. Neither I don't see
> any
> > > tickets created to track the effort (but a subtask for FI tests in
> > > HADOOP-7412).
> > >
> > > Any reason we are missing a big chunk of validation infrastructure in
> the
> > > mavenized build?
> > >
> > > Cos
> > >
> > > On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > > > HDFS-2096 is now committed to trunk. The instructions for building
> > > > HDFS can be found in the top-level BUILDING.txt file.
> > > >
> > > > I added a script to
> https://issues.apache.org/jira/browse/HADOOP-7500
> > > > to help with migrating HDFS patches to the new layout.
> > > >
> > > > There are a few follow-up patches that need doing soon (e.g.
> > > > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > > > folks from doing development as usual.
> > > >
> > > > Thanks to everyone who helped with this!
> > > >
> > > > Cheers,
> > > > Tom
> > > >
> > > > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com>
> wrote:
> > > > > Now that MR-279 has been merged into trunk, I plan to commit the
> HDFS
> > > > > mavenization changes tomorrow (Friday) at 9am PDT.
> > > > >
> > > > > Cheers,
> > > > > Tom
> > > > >
> > > > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <
> acm@hortonworks.com>
> > > wrote:
> > > > >> Thanks Tom.
> > > > >>
> > > > >> I'm running the final set of tests with the 'MR-279 rebased on
> trunk'
> > > and should be done by tmrw.
> > > > >>
> > > > >> Also, can you guys please ensure that secure HDFS works after
> > > mvn'ization?
> > > > >>
> > > > >> thanks,
> > > > >> Arun
> > > > >>
> > > > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > > > >>
> > > > >>> Hi Arun,
> > > > >>>
> > > > >>> I'm fine with that. When do you expect to start the vote?
> > > > >>>
> > > > >>> Cheers,
> > > > >>> Tom
> > > > >>>
> > > > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <
> acm@hortonworks.com>
> > > wrote:
> > > > >>>> Hi Tom,
> > > > >>>>
> > > > >>>> ═Can I request you to wait on this commit until we merge MR-279?
> As
> > > Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> > > getting the merge done. We should call a vote asap. By holding off it
> the
> > > mvn patch it will save us a bit of time - we spent at more than a
> couple of
> > > days on resolving after the common mvn'ization.
> > > > >>>>
> > > > >>>> ═Thanks for understanding.
> > > > >>>>
> > > > >>>> Arun
> > > > >>>>
> > > > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > > > >>>>
> > > > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> > > ready
> > > > >>>>> to be committed, so unless there are any objections I will do
> so on
> > > > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > > > >>>>>
> > > > >>>>> I'll also create a script to convert patches to the new layout,
> and
> > > > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > > > >>>>>
> > > > >>>>> Cheers,
> > > > >>>>> Tom
> > > > >>>>
> > > > >>>>
> > > > >>
> > > > >>
> > > > >
> > >
>
Re: Mavenizing the HDFS build
Posted by Konstantin Boudnik <co...@apache.org>.
Right, Common has the tracking for AOP FI tests. There's Herrior work (system
cluster tests) which is separate from FI although is using the same
technology.
My point was that HDFS ticket doesn't have any traces of it which makes me
wonder if it has been removed or else. I see your point and I'll add new
subtasks to the JIRAs.
Cos
On Fri, Aug 19, 2011 at 11:26AM, Alejandro Abdelnur wrote:
> Hey Cos,
>
> Given the size of the Mavenization work we broke into several pieces and we
> are working them incrementally.
>
> Because of that some disruption is happening to some parts of the build and
> components.
>
> There is a JIRA open for the AOP stuff (
> https://issues.apache.org/jira/browse/HADOOP-7481).
>
> There you've indicated you'd take a stab at it. Given that you are familiar
> with AOP and how it is used in Hadoop, I guess you are the best person to
> take care of this part of the puzzle.
>
> Thanks.
>
> Alejandro
>
> On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org> wrote:
>
> > I see that the whole AOP stuff has been taken out along with Herriot work.
> > I don't see any discussion about this on the JIRA. Neither I don't see any
> > tickets created to track the effort (but a subtask for FI tests in
> > HADOOP-7412).
> >
> > Any reason we are missing a big chunk of validation infrastructure in the
> > mavenized build?
> >
> > Cos
> >
> > On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > > HDFS-2096 is now committed to trunk. The instructions for building
> > > HDFS can be found in the top-level BUILDING.txt file.
> > >
> > > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > > to help with migrating HDFS patches to the new layout.
> > >
> > > There are a few follow-up patches that need doing soon (e.g.
> > > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > > folks from doing development as usual.
> > >
> > > Thanks to everyone who helped with this!
> > >
> > > Cheers,
> > > Tom
> > >
> > > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > > > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > > > mavenization changes tomorrow (Friday) at 9am PDT.
> > > >
> > > > Cheers,
> > > > Tom
> > > >
> > > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> > wrote:
> > > >> Thanks Tom.
> > > >>
> > > >> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> > and should be done by tmrw.
> > > >>
> > > >> Also, can you guys please ensure that secure HDFS works after
> > mvn'ization?
> > > >>
> > > >> thanks,
> > > >> Arun
> > > >>
> > > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > > >>
> > > >>> Hi Arun,
> > > >>>
> > > >>> I'm fine with that. When do you expect to start the vote?
> > > >>>
> > > >>> Cheers,
> > > >>> Tom
> > > >>>
> > > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> > wrote:
> > > >>>> Hi Tom,
> > > >>>>
> > > >>>> ═Can I request you to wait on this commit until we merge MR-279? As
> > Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> > getting the merge done. We should call a vote asap. By holding off it the
> > mvn patch it will save us a bit of time - we spent at more than a couple of
> > days on resolving after the common mvn'ization.
> > > >>>>
> > > >>>> ═Thanks for understanding.
> > > >>>>
> > > >>>> Arun
> > > >>>>
> > > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > > >>>>
> > > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> > ready
> > > >>>>> to be committed, so unless there are any objections I will do so on
> > > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > > >>>>>
> > > >>>>> I'll also create a script to convert patches to the new layout, and
> > > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > > >>>>>
> > > >>>>> Cheers,
> > > >>>>> Tom
> > > >>>>
> > > >>>>
> > > >>
> > > >>
> > > >
> >
Re: Mavenizing the HDFS build
Posted by Konstantin Boudnik <co...@apache.org>.
Right, Common has the tracking for AOP FI tests. There's Herrior work (system
cluster tests) which is separate from FI although is using the same
technology.
My point was that HDFS ticket doesn't have any traces of it which makes me
wonder if it has been removed or else. I see your point and I'll add new
subtasks to the JIRAs.
Cos
On Fri, Aug 19, 2011 at 11:26AM, Alejandro Abdelnur wrote:
> Hey Cos,
>
> Given the size of the Mavenization work we broke into several pieces and we
> are working them incrementally.
>
> Because of that some disruption is happening to some parts of the build and
> components.
>
> There is a JIRA open for the AOP stuff (
> https://issues.apache.org/jira/browse/HADOOP-7481).
>
> There you've indicated you'd take a stab at it. Given that you are familiar
> with AOP and how it is used in Hadoop, I guess you are the best person to
> take care of this part of the puzzle.
>
> Thanks.
>
> Alejandro
>
> On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org> wrote:
>
> > I see that the whole AOP stuff has been taken out along with Herriot work.
> > I don't see any discussion about this on the JIRA. Neither I don't see any
> > tickets created to track the effort (but a subtask for FI tests in
> > HADOOP-7412).
> >
> > Any reason we are missing a big chunk of validation infrastructure in the
> > mavenized build?
> >
> > Cos
> >
> > On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > > HDFS-2096 is now committed to trunk. The instructions for building
> > > HDFS can be found in the top-level BUILDING.txt file.
> > >
> > > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > > to help with migrating HDFS patches to the new layout.
> > >
> > > There are a few follow-up patches that need doing soon (e.g.
> > > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > > folks from doing development as usual.
> > >
> > > Thanks to everyone who helped with this!
> > >
> > > Cheers,
> > > Tom
> > >
> > > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > > > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > > > mavenization changes tomorrow (Friday) at 9am PDT.
> > > >
> > > > Cheers,
> > > > Tom
> > > >
> > > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> > wrote:
> > > >> Thanks Tom.
> > > >>
> > > >> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> > and should be done by tmrw.
> > > >>
> > > >> Also, can you guys please ensure that secure HDFS works after
> > mvn'ization?
> > > >>
> > > >> thanks,
> > > >> Arun
> > > >>
> > > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > > >>
> > > >>> Hi Arun,
> > > >>>
> > > >>> I'm fine with that. When do you expect to start the vote?
> > > >>>
> > > >>> Cheers,
> > > >>> Tom
> > > >>>
> > > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> > wrote:
> > > >>>> Hi Tom,
> > > >>>>
> > > >>>> ═Can I request you to wait on this commit until we merge MR-279? As
> > Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> > getting the merge done. We should call a vote asap. By holding off it the
> > mvn patch it will save us a bit of time - we spent at more than a couple of
> > days on resolving after the common mvn'ization.
> > > >>>>
> > > >>>> ═Thanks for understanding.
> > > >>>>
> > > >>>> Arun
> > > >>>>
> > > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > > >>>>
> > > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> > ready
> > > >>>>> to be committed, so unless there are any objections I will do so on
> > > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > > >>>>>
> > > >>>>> I'll also create a script to convert patches to the new layout, and
> > > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > > >>>>>
> > > >>>>> Cheers,
> > > >>>>> Tom
> > > >>>>
> > > >>>>
> > > >>
> > > >>
> > > >
> >
Re: Mavenizing the HDFS build
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Hey Cos,
Given the size of the Mavenization work we broke into several pieces and we
are working them incrementally.
Because of that some disruption is happening to some parts of the build and
components.
There is a JIRA open for the AOP stuff (
https://issues.apache.org/jira/browse/HADOOP-7481).
There you've indicated you'd take a stab at it. Given that you are familiar
with AOP and how it is used in Hadoop, I guess you are the best person to
take care of this part of the puzzle.
Thanks.
Alejandro
On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org> wrote:
> I see that the whole AOP stuff has been taken out along with Herriot work.
> I don't see any discussion about this on the JIRA. Neither I don't see any
> tickets created to track the effort (but a subtask for FI tests in
> HADOOP-7412).
>
> Any reason we are missing a big chunk of validation infrastructure in the
> mavenized build?
>
> Cos
>
> On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > > mavenization changes tomorrow (Friday) at 9am PDT.
> > >
> > > Cheers,
> > > Tom
> > >
> > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> > >> Thanks Tom.
> > >>
> > >> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and should be done by tmrw.
> > >>
> > >> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > >>
> > >>> Hi Arun,
> > >>>
> > >>> I'm fine with that. When do you expect to start the vote?
> > >>>
> > >>> Cheers,
> > >>> Tom
> > >>>
> > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> > >>>> Hi Tom,
> > >>>>
> > >>>> ═Can I request you to wait on this commit until we merge MR-279? As
> Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> getting the merge done. We should call a vote asap. By holding off it the
> mvn patch it will save us a bit of time - we spent at more than a couple of
> days on resolving after the common mvn'ization.
> > >>>>
> > >>>> ═Thanks for understanding.
> > >>>>
> > >>>> Arun
> > >>>>
> > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > >>>>
> > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> > >>>>> to be committed, so unless there are any objections I will do so on
> > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > >>>>>
> > >>>>> I'll also create a script to convert patches to the new layout, and
> > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > >>>>>
> > >>>>> Cheers,
> > >>>>> Tom
> > >>>>
> > >>>>
> > >>
> > >>
> > >
>
Re: Mavenizing the HDFS build
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Hey Cos,
Given the size of the Mavenization work we broke into several pieces and we
are working them incrementally.
Because of that some disruption is happening to some parts of the build and
components.
There is a JIRA open for the AOP stuff (
https://issues.apache.org/jira/browse/HADOOP-7481).
There you've indicated you'd take a stab at it. Given that you are familiar
with AOP and how it is used in Hadoop, I guess you are the best person to
take care of this part of the puzzle.
Thanks.
Alejandro
On Fri, Aug 19, 2011 at 11:09 AM, Konstantin Boudnik <co...@apache.org> wrote:
> I see that the whole AOP stuff has been taken out along with Herriot work.
> I don't see any discussion about this on the JIRA. Neither I don't see any
> tickets created to track the effort (but a subtask for FI tests in
> HADOOP-7412).
>
> Any reason we are missing a big chunk of validation infrastructure in the
> mavenized build?
>
> Cos
>
> On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > > mavenization changes tomorrow (Friday) at 9am PDT.
> > >
> > > Cheers,
> > > Tom
> > >
> > > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> > >> Thanks Tom.
> > >>
> > >> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and should be done by tmrw.
> > >>
> > >> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> > >>
> > >>> Hi Arun,
> > >>>
> > >>> I'm fine with that. When do you expect to start the vote?
> > >>>
> > >>> Cheers,
> > >>> Tom
> > >>>
> > >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
> wrote:
> > >>>> Hi Tom,
> > >>>>
> > >>>> ═Can I request you to wait on this commit until we merge MR-279? As
> Vinod pointed out in his mail to mapreduce-dev@ we are very close to
> getting the merge done. We should call a vote asap. By holding off it the
> mvn patch it will save us a bit of time - we spent at more than a couple of
> days on resolving after the common mvn'ization.
> > >>>>
> > >>>> ═Thanks for understanding.
> > >>>>
> > >>>> Arun
> > >>>>
> > >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> > >>>>
> > >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> > >>>>> to be committed, so unless there are any objections I will do so on
> > >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> > >>>>>
> > >>>>> I'll also create a script to convert patches to the new layout, and
> > >>>>> switch over the Jenkins jobs that test and build HDFS.
> > >>>>>
> > >>>>> Cheers,
> > >>>>> Tom
> > >>>>
> > >>>>
> > >>
> > >>
> > >
>
Re: Mavenizing the HDFS build
Posted by Konstantin Boudnik <co...@apache.org>.
I see that the whole AOP stuff has been taken out along with Herriot work.
I don't see any discussion about this on the JIRA. Neither I don't see any
tickets created to track the effort (but a subtask for FI tests in
HADOOP-7412).
Any reason we are missing a big chunk of validation infrastructure in the
mavenized build?
Cos
On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> HDFS-2096 is now committed to trunk. The instructions for building
> HDFS can be found in the top-level BUILDING.txt file.
>
> I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> to help with migrating HDFS patches to the new layout.
>
> There are a few follow-up patches that need doing soon (e.g.
> HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> folks from doing development as usual.
>
> Thanks to everyone who helped with this!
>
> Cheers,
> Tom
>
> On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > mavenization changes tomorrow (Friday) at 9am PDT.
> >
> > Cheers,
> > Tom
> >
> > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> >> Thanks Tom.
> >>
> >> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
> >>
> >> Also, can you guys please ensure that secure HDFS works after mvn'ization?
> >>
> >> thanks,
> >> Arun
> >>
> >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> >>
> >>> Hi Arun,
> >>>
> >>> I'm fine with that. When do you expect to start the vote?
> >>>
> >>> Cheers,
> >>> Tom
> >>>
> >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> >>>> Hi Tom,
> >>>>
> >>>> ═Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
> >>>>
> >>>> ═Thanks for understanding.
> >>>>
> >>>> Arun
> >>>>
> >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> >>>>
> >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
> >>>>> to be committed, so unless there are any objections I will do so on
> >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> >>>>>
> >>>>> I'll also create a script to convert patches to the new layout, and
> >>>>> switch over the Jenkins jobs that test and build HDFS.
> >>>>>
> >>>>> Cheers,
> >>>>> Tom
> >>>>
> >>>>
> >>
> >>
> >
Re: Mavenizing the HDFS build
Posted by Konstantin Boudnik <co...@apache.org>.
I see that the whole AOP stuff has been taken out along with Herriot work.
I don't see any discussion about this on the JIRA. Neither I don't see any
tickets created to track the effort (but a subtask for FI tests in
HADOOP-7412).
Any reason we are missing a big chunk of validation infrastructure in the
mavenized build?
Cos
On Fri, Aug 19, 2011 at 10:55AM, Tom White wrote:
> HDFS-2096 is now committed to trunk. The instructions for building
> HDFS can be found in the top-level BUILDING.txt file.
>
> I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> to help with migrating HDFS patches to the new layout.
>
> There are a few follow-up patches that need doing soon (e.g.
> HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> folks from doing development as usual.
>
> Thanks to everyone who helped with this!
>
> Cheers,
> Tom
>
> On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> > Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> > mavenization changes tomorrow (Friday) at 9am PDT.
> >
> > Cheers,
> > Tom
> >
> > On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> >> Thanks Tom.
> >>
> >> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
> >>
> >> Also, can you guys please ensure that secure HDFS works after mvn'ization?
> >>
> >> thanks,
> >> Arun
> >>
> >> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> >>
> >>> Hi Arun,
> >>>
> >>> I'm fine with that. When do you expect to start the vote?
> >>>
> >>> Cheers,
> >>> Tom
> >>>
> >>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> >>>> Hi Tom,
> >>>>
> >>>> ═Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
> >>>>
> >>>> ═Thanks for understanding.
> >>>>
> >>>> Arun
> >>>>
> >>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> >>>>
> >>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
> >>>>> to be committed, so unless there are any objections I will do so on
> >>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> >>>>>
> >>>>> I'll also create a script to convert patches to the new layout, and
> >>>>> switch over the Jenkins jobs that test and build HDFS.
> >>>>>
> >>>>> Cheers,
> >>>>> Tom
> >>>>
> >>>>
> >>
> >>
> >
RE: Mavenizing the HDFS build
Posted by Jim Falgout <ji...@pervasive.com>.
Nice job! Built right out of the box. Thanks for the instructions, very clear and concise.
-----Original Message-----
From: Tom White [mailto:tom@cloudera.com]
Sent: Friday, August 19, 2011 12:56 PM
To: hdfs-dev@hadoop.apache.org
Cc: mapreduce-dev@hadoop.apache.org
Subject: Re: Mavenizing the HDFS build
HDFS-2096 is now committed to trunk. The instructions for building HDFS can be found in the top-level BUILDING.txt file.
I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
to help with migrating HDFS patches to the new layout.
There are a few follow-up patches that need doing soon (e.g.
HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop folks from doing development as usual.
Thanks to everyone who helped with this!
Cheers,
Tom
On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
>>>>> ready to be committed, so unless there are any objections I will
>>>>> do so on Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout,
>>>>> and switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
>
RE: Mavenizing the HDFS build
Posted by Jim Falgout <ji...@pervasive.com>.
Nice job! Built right out of the box. Thanks for the instructions, very clear and concise.
-----Original Message-----
From: Tom White [mailto:tom@cloudera.com]
Sent: Friday, August 19, 2011 12:56 PM
To: hdfs-dev@hadoop.apache.org
Cc: mapreduce-dev@hadoop.apache.org
Subject: Re: Mavenizing the HDFS build
HDFS-2096 is now committed to trunk. The instructions for building HDFS can be found in the top-level BUILDING.txt file.
I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
to help with migrating HDFS patches to the new layout.
There are a few follow-up patches that need doing soon (e.g.
HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop folks from doing development as usual.
Thanks to everyone who helped with this!
Cheers,
Tom
On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
>>>>> ready to be committed, so unless there are any objections I will
>>>>> do so on Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout,
>>>>> and switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
>
Re: Mavenizing the HDFS build
Posted by Thomas Graves <tg...@yahoo-inc.com>.
What is the expected way to run from the tarballs?
It seems if I just untar them so they are in their separate directories (
hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to. Certain
things like hadoop-config.sh are in libexec and it expects them in bin,
things in hdfs bin it looks for in common bin, things are in sbin but it
wants them in bin, it now can't seem to find the hdfs jars, etc.. Hopefully
I'm missing something simple to make this work?
Thanks,
Tom Graves
On 8/19/11 12:55 PM, "Tom White" <to...@cloudera.com> wrote:
> HDFS-2096 is now committed to trunk. The instructions for building
> HDFS can be found in the top-level BUILDING.txt file.
>
> I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> to help with migrating HDFS patches to the new layout.
>
> There are a few follow-up patches that need doing soon (e.g.
> HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> folks from doing development as usual.
>
> Thanks to everyone who helped with this!
>
> Cheers,
> Tom
>
> On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
>> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
>> mavenization changes tomorrow (Friday) at 9am PDT.
>>
>> Cheers,
>> Tom
>>
>> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>> Thanks Tom.
>>>
>>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and
>>> should be done by tmrw.
>>>
>>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>>
>>> thanks,
>>> Arun
>>>
>>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>>
>>>> Hi Arun,
>>>>
>>>> I'm fine with that. When do you expect to start the vote?
>>>>
>>>> Cheers,
>>>> Tom
>>>>
>>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
>>>> wrote:
>>>>> Hi Tom,
>>>>>
>>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod
>>>>> pointed out in his mail to mapreduce-dev@ we are very close to getting the
>>>>> merge done. We should call a vote asap. By holding off it the mvn patch it
>>>>> will save us a bit of time - we spent at more than a couple of days on
>>>>> resolving after the common mvn'ization.
>>>>>
>>>>> Thanks for understanding.
>>>>>
>>>>> Arun
>>>>>
>>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>>
>>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>>> to be committed, so unless there are any objections I will do so on
>>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>>
>>>>>> I'll also create a script to convert patches to the new layout, and
>>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>>
>>>>>> Cheers,
>>>>>> Tom
>>>>>
>>>>>
>>>
>>>
>>
Re: Mavenizing the HDFS build
Posted by Thomas Graves <tg...@yahoo-inc.com>.
What is the expected way to run from the tarballs?
It seems if I just untar them so they are in their separate directories (
hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to. Certain
things like hadoop-config.sh are in libexec and it expects them in bin,
things in hdfs bin it looks for in common bin, things are in sbin but it
wants them in bin, it now can't seem to find the hdfs jars, etc.. Hopefully
I'm missing something simple to make this work?
Thanks,
Tom Graves
On 8/19/11 12:55 PM, "Tom White" <to...@cloudera.com> wrote:
> HDFS-2096 is now committed to trunk. The instructions for building
> HDFS can be found in the top-level BUILDING.txt file.
>
> I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> to help with migrating HDFS patches to the new layout.
>
> There are a few follow-up patches that need doing soon (e.g.
> HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> folks from doing development as usual.
>
> Thanks to everyone who helped with this!
>
> Cheers,
> Tom
>
> On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
>> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
>> mavenization changes tomorrow (Friday) at 9am PDT.
>>
>> Cheers,
>> Tom
>>
>> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>> Thanks Tom.
>>>
>>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and
>>> should be done by tmrw.
>>>
>>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>>
>>> thanks,
>>> Arun
>>>
>>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>>
>>>> Hi Arun,
>>>>
>>>> I'm fine with that. When do you expect to start the vote?
>>>>
>>>> Cheers,
>>>> Tom
>>>>
>>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com>
>>>> wrote:
>>>>> Hi Tom,
>>>>>
>>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod
>>>>> pointed out in his mail to mapreduce-dev@ we are very close to getting the
>>>>> merge done. We should call a vote asap. By holding off it the mvn patch it
>>>>> will save us a bit of time - we spent at more than a couple of days on
>>>>> resolving after the common mvn'ization.
>>>>>
>>>>> Thanks for understanding.
>>>>>
>>>>> Arun
>>>>>
>>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>>
>>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>>> to be committed, so unless there are any objections I will do so on
>>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>>
>>>>>> I'll also create a script to convert patches to the new layout, and
>>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>>
>>>>>> Cheers,
>>>>>> Tom
>>>>>
>>>>>
>>>
>>>
>>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
HDFS-2096 is now committed to trunk. The instructions for building
HDFS can be found in the top-level BUILDING.txt file.
I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
to help with migrating HDFS patches to the new layout.
There are a few follow-up patches that need doing soon (e.g.
HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
folks from doing development as usual.
Thanks to everyone who helped with this!
Cheers,
Tom
On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>> to be committed, so unless there are any objections I will do so on
>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout, and
>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
>
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
+1, thanks for helping out by waiting on MR-279 - much appreciated!
Arun
On Aug 18, 2011, at 11:30 AM, Tom White wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>> to be committed, so unless there are any objections I will do so on
>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout, and
>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
HDFS-2096 is now committed to trunk. The instructions for building
HDFS can be found in the top-level BUILDING.txt file.
I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
to help with migrating HDFS patches to the new layout.
There are a few follow-up patches that need doing soon (e.g.
HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
folks from doing development as usual.
Thanks to everyone who helped with this!
Cheers,
Tom
On Thu, Aug 18, 2011 at 11:30 AM, Tom White <to...@cloudera.com> wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>> to be committed, so unless there are any objections I will do so on
>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout, and
>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
>
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
+1, thanks for helping out by waiting on MR-279 - much appreciated!
Arun
On Aug 18, 2011, at 11:30 AM, Tom White wrote:
> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> mavenization changes tomorrow (Friday) at 9am PDT.
>
> Cheers,
> Tom
>
> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>
>> thanks,
>> Arun
>>
>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>
>>> Hi Arun,
>>>
>>> I'm fine with that. When do you expect to start the vote?
>>>
>>> Cheers,
>>> Tom
>>>
>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>>> Hi Tom,
>>>>
>>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>>
>>>> Thanks for understanding.
>>>>
>>>> Arun
>>>>
>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>
>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>> to be committed, so unless there are any objections I will do so on
>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>
>>>>> I'll also create a script to convert patches to the new layout, and
>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>
>>>>
>>
>>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
Now that MR-279 has been merged into trunk, I plan to commit the HDFS
mavenization changes tomorrow (Friday) at 9am PDT.
Cheers,
Tom
On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> Thanks Tom.
>
> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>
> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>
> thanks,
> Arun
>
> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>
>> Hi Arun,
>>
>> I'm fine with that. When do you expect to start the vote?
>>
>> Cheers,
>> Tom
>>
>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>> Hi Tom,
>>>
>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>
>>> Thanks for understanding.
>>>
>>> Arun
>>>
>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>
>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>> to be committed, so unless there are any objections I will do so on
>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>
>>>> I'll also create a script to convert patches to the new layout, and
>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>
>>>> Cheers,
>>>> Tom
>>>
>>>
>
>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
Now that MR-279 has been merged into trunk, I plan to commit the HDFS
mavenization changes tomorrow (Friday) at 9am PDT.
Cheers,
Tom
On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> Thanks Tom.
>
> I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
>
> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>
> thanks,
> Arun
>
> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>
>> Hi Arun,
>>
>> I'm fine with that. When do you expect to start the vote?
>>
>> Cheers,
>> Tom
>>
>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>>> Hi Tom,
>>>
>>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>>
>>> Thanks for understanding.
>>>
>>> Arun
>>>
>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>
>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>> to be committed, so unless there are any objections I will do so on
>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>
>>>> I'll also create a script to convert patches to the new layout, and
>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>
>>>> Cheers,
>>>> Tom
>>>
>>>
>
>
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
Thanks Tom.
I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
Also, can you guys please ensure that secure HDFS works after mvn'ization?
thanks,
Arun
On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> Hi Arun,
>
> I'm fine with that. When do you expect to start the vote?
>
> Cheers,
> Tom
>
> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Hi Tom,
>>
>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>
>> Thanks for understanding.
>>
>> Arun
>>
>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>
>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>> to be committed, so unless there are any objections I will do so on
>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>
>>> I'll also create a script to convert patches to the new layout, and
>>> switch over the Jenkins jobs that test and build HDFS.
>>>
>>> Cheers,
>>> Tom
>>
>>
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
Thanks Tom.
I'm running the final set of tests with the 'MR-279 rebased on trunk' and should be done by tmrw.
Also, can you guys please ensure that secure HDFS works after mvn'ization?
thanks,
Arun
On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> Hi Arun,
>
> I'm fine with that. When do you expect to start the vote?
>
> Cheers,
> Tom
>
> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
>> Hi Tom,
>>
>> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>>
>> Thanks for understanding.
>>
>> Arun
>>
>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>
>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>> to be committed, so unless there are any objections I will do so on
>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>
>>> I'll also create a script to convert patches to the new layout, and
>>> switch over the Jenkins jobs that test and build HDFS.
>>>
>>> Cheers,
>>> Tom
>>
>>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
Hi Arun,
I'm fine with that. When do you expect to start the vote?
Cheers,
Tom
On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> Hi Tom,
>
> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>
> Thanks for understanding.
>
> Arun
>
> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>
>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>> to be committed, so unless there are any objections I will do so on
>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>
>> I'll also create a script to convert patches to the new layout, and
>> switch over the Jenkins jobs that test and build HDFS.
>>
>> Cheers,
>> Tom
>
>
Re: Mavenizing the HDFS build
Posted by Tom White <to...@cloudera.com>.
Hi Arun,
I'm fine with that. When do you expect to start the vote?
Cheers,
Tom
On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> Hi Tom,
>
> Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
>
> Thanks for understanding.
>
> Arun
>
> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>
>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>> to be committed, so unless there are any objections I will do so on
>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>
>> I'll also create a script to convert patches to the new layout, and
>> switch over the Jenkins jobs that test and build HDFS.
>>
>> Cheers,
>> Tom
>
>
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
Hi Tom,
Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
Thanks for understanding.
Arun
On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
> to be committed, so unless there are any objections I will do so on
> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>
> I'll also create a script to convert patches to the new layout, and
> switch over the Jenkins jobs that test and build HDFS.
>
> Cheers,
> Tom
Re: Mavenizing the HDFS build
Posted by Arun C Murthy <ac...@hortonworks.com>.
Hi Tom,
Can I request you to wait on this commit until we merge MR-279? As Vinod pointed out in his mail to mapreduce-dev@ we are very close to getting the merge done. We should call a vote asap. By holding off it the mvn patch it will save us a bit of time - we spent at more than a couple of days on resolving after the common mvn'ization.
Thanks for understanding.
Arun
On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
> to be committed, so unless there are any objections I will do so on
> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>
> I'll also create a script to convert patches to the new layout, and
> switch over the Jenkins jobs that test and build HDFS.
>
> Cheers,
> Tom