You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Wangda Tan <wh...@gmail.com> on 2016/10/01 16:37:31 UTC
Maven build: YARN timeline service downloading maven-metadata from
personal repository?
Hi YARN-dev,
(cc common-dev),
YARN timeline service currently sometimes downloads maven-metadata.xml from
a personal apache site, log looks like:
[INFO] ------------------------------------------------------------
------------
[INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
[INFO] ------------------------------------------------------------
------------
Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
0.0-alpha2-SNAPSHOT/maven-metadata.xml
...
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
...
Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
I noticed this happens for a while, I'm not sure if it causes by my local
environment or not.
I don't know if it could be a potential security issue, and this
significantly slows my build, typically "mvn -DskipTests clean install"
runs 1-2 mins on my laptop, but when it downloads files from "~garyh" link,
it takes 8-9 mins.
Please let me know if you also see this happens.
Thanks,
Wangda
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
Among hbase releases (1.1.x, 1.2.y), root pom.xml contains "ghelmling.testing"
repo.
There is no such repo in 1.3 branch but there hasn't been a 1.3 release yet.
We can drop the repo in 1.1 and 1.2 branches.
Cheers
On Sat, Oct 1, 2016 at 1:37 PM, Sangjin Lee <sj...@apache.org> wrote:
> We should raise a JIRA. I suspect this is more of an hbase issue. I believe
> it's coming from the hbase pom that contains a definition of that repo
> (named "ghelmling.testing"). This would entail upgrading to a later version
> of hbase that removes this repo. I don't think this is a major issue, but
> it would be good to keep track of this. Wangda, could you kindly file a
> JIRA for this?
>
> I'm also cc'ing Gary to see if he is aware of a release that does not have
> the repo definition.
>
> Sangjin
>
> On Sat, Oct 1, 2016 at 9:37 AM, Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi YARN-dev,
> >
> > (cc common-dev),
> >
> > YARN timeline service currently sometimes downloads maven-metadata.xml
> from
> > a personal apache site, log looks like:
> >
> > [INFO] ------------------------------------------------------------
> > ------------
> > [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> > [INFO] ------------------------------------------------------------
> > ------------
> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >
> > I noticed this happens for a while, I'm not sure if it causes by my local
> > environment or not.
> >
> > I don't know if it could be a potential security issue, and this
> > significantly slows my build, typically "mvn -DskipTests clean install"
> > runs 1-2 mins on my laptop, but when it downloads files from "~garyh"
> link,
> > it takes 8-9 mins.
> >
> > Please let me know if you also see this happens.
> >
> > Thanks,
> > Wangda
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
Among hbase releases (1.1.x, 1.2.y), root pom.xml contains "ghelmling.testing"
repo.
There is no such repo in 1.3 branch but there hasn't been a 1.3 release yet.
We can drop the repo in 1.1 and 1.2 branches.
Cheers
On Sat, Oct 1, 2016 at 1:37 PM, Sangjin Lee <sj...@apache.org> wrote:
> We should raise a JIRA. I suspect this is more of an hbase issue. I believe
> it's coming from the hbase pom that contains a definition of that repo
> (named "ghelmling.testing"). This would entail upgrading to a later version
> of hbase that removes this repo. I don't think this is a major issue, but
> it would be good to keep track of this. Wangda, could you kindly file a
> JIRA for this?
>
> I'm also cc'ing Gary to see if he is aware of a release that does not have
> the repo definition.
>
> Sangjin
>
> On Sat, Oct 1, 2016 at 9:37 AM, Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi YARN-dev,
> >
> > (cc common-dev),
> >
> > YARN timeline service currently sometimes downloads maven-metadata.xml
> from
> > a personal apache site, log looks like:
> >
> > [INFO] ------------------------------------------------------------
> > ------------
> > [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> > [INFO] ------------------------------------------------------------
> > ------------
> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >
> > I noticed this happens for a while, I'm not sure if it causes by my local
> > environment or not.
> >
> > I don't know if it could be a potential security issue, and this
> > significantly slows my build, typically "mvn -DskipTests clean install"
> > runs 1-2 mins on my laptop, but when it downloads files from "~garyh"
> link,
> > it takes 8-9 mins.
> >
> > Please let me know if you also see this happens.
> >
> > Thanks,
> > Wangda
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@apache.org>.
We should raise a JIRA. I suspect this is more of an hbase issue. I believe
it's coming from the hbase pom that contains a definition of that repo
(named "ghelmling.testing"). This would entail upgrading to a later version
of hbase that removes this repo. I don't think this is a major issue, but
it would be good to keep track of this. Wangda, could you kindly file a
JIRA for this?
I'm also cc'ing Gary to see if he is aware of a release that does not have
the repo definition.
Sangjin
On Sat, Oct 1, 2016 at 9:37 AM, Wangda Tan <wh...@gmail.com> wrote:
> Hi YARN-dev,
>
> (cc common-dev),
>
> YARN timeline service currently sometimes downloads maven-metadata.xml from
> a personal apache site, log looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> I noticed this happens for a while, I'm not sure if it causes by my local
> environment or not.
>
> I don't know if it could be a potential security issue, and this
> significantly slows my build, typically "mvn -DskipTests clean install"
> runs 1-2 mins on my laptop, but when it downloads files from "~garyh" link,
> it takes 8-9 mins.
>
> Please let me know if you also see this happens.
>
> Thanks,
> Wangda
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
Just performed a clean build on my MacBook:
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [
0.952 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [
1.838 s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [
2.308 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [
0.514 s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [
0.365 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [
0.024 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [
0.062 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 02:39 min
[INFO] Finished at: 2016-12-13T14:48:46-08:00
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=512M; support was removed in 8.0
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5;
2015-11-10T08:41:47-08:00)
Maven home: /Users/tyu/apache-maven-3.3.9
Java version: 1.8.0_91, vendor: Oracle Corporation
I can try on other machines if I have time.
On Tue, Dec 13, 2016 at 2:43 PM, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> Li). But I'm still experiencing slow build of ATSv2 component:
>
> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> 1.378 s]
> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> 10.559 s]
> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> 6.993 s]
> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> 0.057 s]
> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> 2.266 s]
> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> 4.075 s]
> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> 0.924 s]
> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> 1.549 s]
> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [05:14
> min]
> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> 8.554 s]
> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> 1.561 s]
> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> 1.321 s]
> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> 0.843 s]
> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> 0.949 s]
> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> 3.137 s]
> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> 0.055 s]
> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> 0.807 s]
> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> 0.602 s]
> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> 0.060 s]
> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> 0.910 s]
> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> 0.072 s]
> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> 0.749 s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 06:02 min
>
> This doesn't happen every time when I run build on latest Hadoop trunk, but
> I can often see this happens.
>
> Thoughts about how to solve it?
>
> Thanks,
> Wangda
>
>
>
> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
>
> > Thanks Wangda.
> >
> > To answer Steve's question, I don't think maven downloads anything from
> > that location (it's a very old content). It just does a wasted effort by
> > hitting this repo.
> >
> > On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
> >
> >> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>
> >> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>
> >> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >> > HBase JIRA later.
> >> >
> >> > Regards,
> >> > Wangda
> >> >
> >> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com>
> >> > wrote:
> >> >
> >> >> HBase really ought to have a profile for D/Ling from somewhere like
> >> this,
> >> >> and, perhaps, list the ASF snapsphot repo first
> >> >>
> >> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >> >> >
> >> >> > Hi YARN-dev,
> >> >> >
> >> >> > (cc common-dev),
> >> >> >
> >> >> > YARN timeline service currently sometimes downloads
> >> maven-metadata.xml
> >> >> from
> >> >> > a personal apache site, log looks like:
> >> >> >
> >> >> > [INFO] ------------------------------
> ------------------------------
> >> >> > ------------
> >> >> > [INFO] Building Apache Hadoop YARN Timeline Service
> >> >> 3.0.0-alpha2-SNAPSHOT
> >> >> > [INFO] ------------------------------
> ------------------------------
> >> >> > ------------
> >> >> > Downloading: http://conjars.org/repo/org/ap
> >> ache/hadoop/hadoop-client/3.
> >> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> > ...
> >> >> > Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> > ...
> >> >> > Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> >
> >> >> > I noticed this happens for a while, I'm not sure if it causes by my
> >> >> local
> >> >>
> >> >> is it actually D/Lin'g the files? Or is it looking for them and then
> >> >> going on to try the next repo?
> >> >>
> >> >
> >> >
> >>
> >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
Just performed a clean build on my MacBook:
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [
0.952 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [
1.838 s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [
2.308 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [
0.514 s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [
0.365 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [
0.024 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [
0.062 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 02:39 min
[INFO] Finished at: 2016-12-13T14:48:46-08:00
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=512M; support was removed in 8.0
Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5;
2015-11-10T08:41:47-08:00)
Maven home: /Users/tyu/apache-maven-3.3.9
Java version: 1.8.0_91, vendor: Oracle Corporation
I can try on other machines if I have time.
On Tue, Dec 13, 2016 at 2:43 PM, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> Li). But I'm still experiencing slow build of ATSv2 component:
>
> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> 1.378 s]
> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> 10.559 s]
> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> 6.993 s]
> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> 0.057 s]
> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> 2.266 s]
> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> 4.075 s]
> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> 0.924 s]
> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> 1.549 s]
> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [05:14
> min]
> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> 8.554 s]
> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> 1.561 s]
> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> 1.321 s]
> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> 0.843 s]
> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> 0.949 s]
> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> 3.137 s]
> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> 0.055 s]
> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> 0.807 s]
> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> 0.602 s]
> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> 0.060 s]
> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> 0.910 s]
> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> 0.072 s]
> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> 0.749 s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 06:02 min
>
> This doesn't happen every time when I run build on latest Hadoop trunk, but
> I can often see this happens.
>
> Thoughts about how to solve it?
>
> Thanks,
> Wangda
>
>
>
> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
>
> > Thanks Wangda.
> >
> > To answer Steve's question, I don't think maven downloads anything from
> > that location (it's a very old content). It just does a wasted effort by
> > hitting this repo.
> >
> > On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
> >
> >> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>
> >> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>
> >> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >> > HBase JIRA later.
> >> >
> >> > Regards,
> >> > Wangda
> >> >
> >> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com>
> >> > wrote:
> >> >
> >> >> HBase really ought to have a profile for D/Ling from somewhere like
> >> this,
> >> >> and, perhaps, list the ASF snapsphot repo first
> >> >>
> >> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >> >> >
> >> >> > Hi YARN-dev,
> >> >> >
> >> >> > (cc common-dev),
> >> >> >
> >> >> > YARN timeline service currently sometimes downloads
> >> maven-metadata.xml
> >> >> from
> >> >> > a personal apache site, log looks like:
> >> >> >
> >> >> > [INFO] ------------------------------
> ------------------------------
> >> >> > ------------
> >> >> > [INFO] Building Apache Hadoop YARN Timeline Service
> >> >> 3.0.0-alpha2-SNAPSHOT
> >> >> > [INFO] ------------------------------
> ------------------------------
> >> >> > ------------
> >> >> > Downloading: http://conjars.org/repo/org/ap
> >> ache/hadoop/hadoop-client/3.
> >> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> > ...
> >> >> > Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> > ...
> >> >> > Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >> >
> >> >> > I noticed this happens for a while, I'm not sure if it causes by my
> >> >> local
> >> >>
> >> >> is it actually D/Lin'g the files? Or is it looking for them and then
> >> >> going on to try the next repo?
> >> >>
> >> >
> >> >
> >>
> >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Li Lu <ll...@hortonworks.com>.
Let’s remove the Phoenix dependency if that’s blocking builds now. The offline aggregator can be added later.
Li Lu
On Dec 13, 2016, at 23:27, Joep Rottinghuis <jo...@twitter.com>> wrote:
What I'm concerned we can remove the Phoenix dependency, since it isn't really used right now and deal with adding it in later.
However, there is PhoenixOfflineAggregationWriterImpl.java which does import import org.apache.phoenix.util.PropertiesUtil;
If everybody is cool to remove that for now, then we can deal with Phoenix as and when we're ready to add the offline aggregation.
Cheers,
Joep
On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <vc...@twitter.com>> wrote:
Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs 1.2.0. Or we think about adding in the Phoenix dependency later.
Thanks
Vrushali
On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com>> wrote:
bq. out of which 1.2.4 is released
Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
FYI
On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com>> wrote:
According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
1.2.4 or later.
Sangjin
On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
vchannapattan@twitter.com<ma...@twitter.com>> wrote:
> Yes, I think bumping up the hbase version to 1.2 should help with this
> build time taken issue. I will start looking into this upgrade right
> away.
>
> Thanks
> Vrushali
>
> > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com>> wrote:
> >
> > I could not reproduce this issue locally but this may be related to some
> local maven repos. This may be related to the private repo issues of HBase?
> If this is the case, bumping up hbase dependency version of YARN timeline
> module might be helpful?
> >
> > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> >
> > Li Lu
> >
> >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>> wrote:
> >>
> >> Hi folks,
> >>
> >> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> >> Li). But I'm still experiencing slow build of ATSv2 component:
> >>
> >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> >> 1.378 s]
> >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> >> 10.559 s]
> >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> >> 6.993 s]
> >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> >> 0.057 s]
> >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> >> 2.266 s]
> >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> >> 4.075 s]
> >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> >> 0.924 s]
> >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> >> 1.549 s]
> >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> [05:14
> >> min]
> >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> >> 8.554 s]
> >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> >> 1.561 s]
> >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> >> 1.321 s]
> >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> >> 0.843 s]
> >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> >> 0.949 s]
> >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> >> 3.137 s]
> >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> >> 0.055 s]
> >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> >> 0.807 s]
> >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> >> 0.602 s]
> >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> >> 0.060 s]
> >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> >> 0.910 s]
> >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> >> 0.072 s]
> >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> >> 0.749 s]
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] Total time: 06:02 min
> >>
> >> This doesn't happen every time when I run build on latest Hadoop trunk,
> but
> >> I can often see this happens.
> >>
> >> Thoughts about how to solve it?
> >>
> >> Thanks,
> >> Wangda
> >>
> >>
> >>
> >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>> wrote:
> >>>
> >>> Thanks Wangda.
> >>>
> >>> To answer Steve's question, I don't think maven downloads anything from
> >>> that location (it's a very old content). It just does a wasted effort
> by
> >>> hitting this repo.
> >>>
> >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>>
> wrote:
> >>>>
> >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>>>
> >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>>
> wrote:
> >>>>>
> >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >>>>> HBase JIRA later.
> >>>>>
> >>>>> Regards,
> >>>>> Wangda
> >>>>>
> >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com<ma...@hortonworks.com>>
> >>>>> wrote:
> >>>>>
> >>>>>> HBase really ought to have a profile for D/Ling from somewhere like
> >>>> this,
> >>>>>> and, perhaps, list the ASF snapsphot repo first
> >>>>>>
> >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>> wrote:
> >>>>>>>
> >>>>>>> Hi YARN-dev,
> >>>>>>>
> >>>>>>> (cc common-dev),
> >>>>>>>
> >>>>>>> YARN timeline service currently sometimes downloads
> >>>> maven-metadata.xml
> >>>>>> from
> >>>>>>> a personal apache site, log looks like:
> >>>>>>>
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> >>>>>> 3.0.0-alpha2-SNAPSHOT
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> Downloading: http://conjars.org/repo/org/ap
> >>>> ache/hadoop/hadoop-client/3.
> >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>>
> >>>>>>> I noticed this happens for a while, I'm not sure if it causes by my
> >>>>>> local
> >>>>>>
> >>>>>> is it actually D/Lin'g the files? Or is it looking for them and then
> >>>>>> going on to try the next repo?
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Li Lu <ll...@hortonworks.com>.
Let’s remove the Phoenix dependency if that’s blocking builds now. The offline aggregator can be added later.
Li Lu
On Dec 13, 2016, at 23:27, Joep Rottinghuis <jo...@twitter.com>> wrote:
What I'm concerned we can remove the Phoenix dependency, since it isn't really used right now and deal with adding it in later.
However, there is PhoenixOfflineAggregationWriterImpl.java which does import import org.apache.phoenix.util.PropertiesUtil;
If everybody is cool to remove that for now, then we can deal with Phoenix as and when we're ready to add the offline aggregation.
Cheers,
Joep
On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <vc...@twitter.com>> wrote:
Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs 1.2.0. Or we think about adding in the Phoenix dependency later.
Thanks
Vrushali
On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com>> wrote:
bq. out of which 1.2.4 is released
Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
FYI
On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com>> wrote:
According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
1.2.4 or later.
Sangjin
On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
vchannapattan@twitter.com<ma...@twitter.com>> wrote:
> Yes, I think bumping up the hbase version to 1.2 should help with this
> build time taken issue. I will start looking into this upgrade right
> away.
>
> Thanks
> Vrushali
>
> > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com>> wrote:
> >
> > I could not reproduce this issue locally but this may be related to some
> local maven repos. This may be related to the private repo issues of HBase?
> If this is the case, bumping up hbase dependency version of YARN timeline
> module might be helpful?
> >
> > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> >
> > Li Lu
> >
> >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>> wrote:
> >>
> >> Hi folks,
> >>
> >> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> >> Li). But I'm still experiencing slow build of ATSv2 component:
> >>
> >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> >> 1.378 s]
> >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> >> 10.559 s]
> >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> >> 6.993 s]
> >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> >> 0.057 s]
> >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> >> 2.266 s]
> >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> >> 4.075 s]
> >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> >> 0.924 s]
> >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> >> 1.549 s]
> >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> [05:14
> >> min]
> >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> >> 8.554 s]
> >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> >> 1.561 s]
> >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> >> 1.321 s]
> >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> >> 0.843 s]
> >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> >> 0.949 s]
> >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> >> 3.137 s]
> >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> >> 0.055 s]
> >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> >> 0.807 s]
> >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> >> 0.602 s]
> >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> >> 0.060 s]
> >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> >> 0.910 s]
> >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> >> 0.072 s]
> >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> >> 0.749 s]
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] Total time: 06:02 min
> >>
> >> This doesn't happen every time when I run build on latest Hadoop trunk,
> but
> >> I can often see this happens.
> >>
> >> Thoughts about how to solve it?
> >>
> >> Thanks,
> >> Wangda
> >>
> >>
> >>
> >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>> wrote:
> >>>
> >>> Thanks Wangda.
> >>>
> >>> To answer Steve's question, I don't think maven downloads anything from
> >>> that location (it's a very old content). It just does a wasted effort
> by
> >>> hitting this repo.
> >>>
> >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>>
> wrote:
> >>>>
> >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>>>
> >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>>
> wrote:
> >>>>>
> >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >>>>> HBase JIRA later.
> >>>>>
> >>>>> Regards,
> >>>>> Wangda
> >>>>>
> >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com<ma...@hortonworks.com>>
> >>>>> wrote:
> >>>>>
> >>>>>> HBase really ought to have a profile for D/Ling from somewhere like
> >>>> this,
> >>>>>> and, perhaps, list the ASF snapsphot repo first
> >>>>>>
> >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>> wrote:
> >>>>>>>
> >>>>>>> Hi YARN-dev,
> >>>>>>>
> >>>>>>> (cc common-dev),
> >>>>>>>
> >>>>>>> YARN timeline service currently sometimes downloads
> >>>> maven-metadata.xml
> >>>>>> from
> >>>>>>> a personal apache site, log looks like:
> >>>>>>>
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> >>>>>> 3.0.0-alpha2-SNAPSHOT
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> Downloading: http://conjars.org/repo/org/ap
> >>>> ache/hadoop/hadoop-client/3.
> >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>>
> >>>>>>> I noticed this happens for a while, I'm not sure if it causes by my
> >>>>>> local
> >>>>>>
> >>>>>> is it actually D/Lin'g the files? Or is it looking for them and then
> >>>>>> going on to try the next repo?
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Sangjin, I tried to switch to a different repository and it works
fine for me now. Maybe there was some intermittent connection issues of
repository.apache.org.
Apologize for the noise.
Wangda
On Wed, Dec 14, 2016 at 4:37 PM, Sangjin Lee <sj...@apache.org> wrote:
> Wait. The errors you're seeing have nothing to do with this or
> HBASE-16749. You seem to be hitting an issue with connecting to
> repository.apache.org. The original issue was with hitting
> http://people.apache.org/~garyh/mvn. This seems to be a different issue.
> Could you please drill into what's happening?
>
> On Wed, Dec 14, 2016 at 11:01 AM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Thanks folks for reply, I tried to change some parameters of maven (like
>> useCache=true), but it still doesn't work.
>>
>> The output looks like:
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
>> [INFO] ------------------------------------------------------------
>> ------------
>> Downloading: https://repository.apache.org/content/repositories/releases/
>> org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.0.
>> 0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://oss.sonatype.org/content/repositories/snapshots/org/
>> apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/had
>> oop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/hadoop
>> -client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache.snapshots.https
>> (https://repository.apache.org/content/repositories/snapshots
>> <https://repository.apache.org/content/repositories/snapshots>): Connect to
>> repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache release
>> (https://repository.apache.org/content/repositories/releases/
>> <https://repository.apache.org/content/repositories/releases/>): Connect to
>> repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache snapshot
>> (https://repository.apache.org/content/repositories/snapshots/
>> <https://repository.apache.org/content/repositories/snapshots/>): Connect
>> to repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache.snapshots (http://repository.apache.org/snapshots
>> <http://repository.apache.org/snapshots>): Connect to
>> repository.apache.org:80 <http://repository.apache.org:80>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> Downloading: https://repository.apache.org/content/repositories/releases/
>> org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-
>> SNAPSHOT/maven-metadata.xml
>> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-mapreduce-
>> client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://oss.sonatype.org/content/repositories/snapshots/org/
>> apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/had
>> oop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>
>> Is there any other configurations I could try to workaround the issue?
>>
>> Thanks,
>> Wangda
>>
>>
>> On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <
>> vrushali@twitter.com> wrote:
>>
>>> Yes, let's continue the discussion on jira
>>> https://issues.apache.org/jira/browse/YARN-5976
>>>
>>> I have captured this thread there as well.
>>>
>>> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
>>> wrote:
>>>
>>>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>>>> really used right now and deal with adding it in later.
>>>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>>>> import import org.apache.phoenix.util.PropertiesUtil;
>>>>
>>>> If everybody is cool to remove that for now, then we can deal with
>>>> Phoenix as and when we're ready to add the offline aggregation.
>>>>
>>>> Cheers,
>>>>
>>>> Joep
>>>>
>>>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>>>> vchannapattan@twitter.com> wrote:
>>>>
>>>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>>>
>>>>> Thanks
>>>>> Vrushali
>>>>>
>>>>>
>>>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>>>
>>>>> bq. out of which 1.2.4 is released
>>>>>
>>>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>>>
>>>>> FYI
>>>>>
>>>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>>>
>>>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8
>>>>>> (out of
>>>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade
>>>>>> to
>>>>>> 1.2.4 or later.
>>>>>>
>>>>>>
>>>>>> Sangjin
>>>>>>
>>>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>>>> vchannapattan@twitter.com> wrote:
>>>>>>
>>>>>> > Yes, I think bumping up the hbase version to 1.2 should help with
>>>>>> this
>>>>>> > build time taken issue. I will start looking into this upgrade right
>>>>>> > away.
>>>>>> >
>>>>>> > Thanks
>>>>>> > Vrushali
>>>>>> >
>>>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>>>> > >
>>>>>> > > I could not reproduce this issue locally but this may be related
>>>>>> to some
>>>>>> > local maven repos. This may be related to the private repo issues
>>>>>> of HBase?
>>>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>>>> timeline
>>>>>> > module might be helpful?
>>>>>> > >
>>>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to
>>>>>> bump up
>>>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>>>> Thanks!
>>>>>> > >
>>>>>> > > Li Lu
>>>>>> > >
>>>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>
>>>>>> wrote:
>>>>>> > >>
>>>>>> > >> Hi folks,
>>>>>> > >>
>>>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is
>>>>>> updated (per
>>>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>>>> > >>
>>>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>>>> SUCCESS [
>>>>>> > >> 1.378 s]
>>>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>>>> SUCCESS [
>>>>>> > >> 10.559 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>>>> SUCCESS [
>>>>>> > >> 6.993 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>>>> SUCCESS [
>>>>>> > >> 0.057 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>>>> SUCCESS [
>>>>>> > >> 2.266 s]
>>>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>>>> SUCCESS [
>>>>>> > >> 4.075 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>>>> SUCCESS [
>>>>>> > >> 0.924 s]
>>>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>>>> SUCCESS [
>>>>>> > >> 1.549 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................
>>>>>> SUCCESS
>>>>>> > [05:14
>>>>>> > >> min]
>>>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>>>> SUCCESS [
>>>>>> > >> 8.554 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>>>> SUCCESS [
>>>>>> > >> 1.561 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>>>> SUCCESS [
>>>>>> > >> 1.321 s]
>>>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>>>> SUCCESS [
>>>>>> > >> 0.843 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>>>> SUCCESS [
>>>>>> > >> 0.949 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>>>> SUCCESS [
>>>>>> > >> 3.137 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>>>> SUCCESS [
>>>>>> > >> 0.055 s]
>>>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>>>> SUCCESS [
>>>>>> > >> 0.807 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>>>> SUCCESS [
>>>>>> > >> 0.602 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>>>> SUCCESS [
>>>>>> > >> 0.060 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>>>> SUCCESS [
>>>>>> > >> 0.910 s]
>>>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>>>> SUCCESS [
>>>>>> > >> 0.072 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>>>> SUCCESS [
>>>>>> > >> 0.749 s]
>>>>>> > >> [INFO]
>>>>>> > >> ------------------------------------------------------------
>>>>>> > ------------
>>>>>> > >> [INFO] BUILD SUCCESS
>>>>>> > >> [INFO]
>>>>>> > >> ------------------------------------------------------------
>>>>>> > ------------
>>>>>> > >> [INFO] Total time: 06:02 min
>>>>>> > >>
>>>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>>>> trunk,
>>>>>> > but
>>>>>> > >> I can often see this happens.
>>>>>> > >>
>>>>>> > >> Thoughts about how to solve it?
>>>>>> > >>
>>>>>> > >> Thanks,
>>>>>> > >> Wangda
>>>>>> > >>
>>>>>> > >>
>>>>>> > >>
>>>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>>>> wrote:
>>>>>> > >>>
>>>>>> > >>> Thanks Wangda.
>>>>>> > >>>
>>>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>>>> anything from
>>>>>> > >>> that location (it's a very old content). It just does a wasted
>>>>>> effort
>>>>>> > by
>>>>>> > >>> hitting this repo.
>>>>>> > >>>
>>>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <
>>>>>> wheeleast@gmail.com>
>>>>>> > wrote:
>>>>>> > >>>>
>>>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>>>> > >>>>
>>>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>>>> wheeleast@gmail.com>
>>>>>> > wrote:
>>>>>> > >>>>>
>>>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I
>>>>>> will file a
>>>>>> > >>>>> HBase JIRA later.
>>>>>> > >>>>>
>>>>>> > >>>>> Regards,
>>>>>> > >>>>> Wangda
>>>>>> > >>>>>
>>>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>>>> > stevel@hortonworks.com>
>>>>>> > >>>>> wrote:
>>>>>> > >>>>>
>>>>>> > >>>>>> HBase really ought to have a profile for D/Ling from
>>>>>> somewhere like
>>>>>> > >>>> this,
>>>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>>>> > >>>>>>
>>>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>>>> wrote:
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> Hi YARN-dev,
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> (cc common-dev),
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>>>> > >>>> maven-metadata.xml
>>>>>> > >>>>>> from
>>>>>> > >>>>>>> a personal apache site, log looks like:
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> [INFO] ------------------------------
>>>>>> > ------------------------------
>>>>>> > >>>>>>> ------------
>>>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>>>> > >>>>>>> [INFO] ------------------------------
>>>>>> > ------------------------------
>>>>>> > >>>>>>> ------------
>>>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>> ...
>>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>>> > garyh/mvn/org/apache/hadoop/
>>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>> ...
>>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>>> > garyh/mvn/org/apache/hadoop/
>>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it
>>>>>> causes by my
>>>>>> > >>>>>> local
>>>>>> > >>>>>>
>>>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>>>> and then
>>>>>> > >>>>>> going on to try the next repo?
>>>>>> > >>>>>>
>>>>>> > >>>>>
>>>>>> > >>>>>
>>>>>> > >>>>
>>>>>> > >>>
>>>>>> > >>>
>>>>>> > >
>>>>>> >
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Sangjin, I tried to switch to a different repository and it works
fine for me now. Maybe there was some intermittent connection issues of
repository.apache.org.
Apologize for the noise.
Wangda
On Wed, Dec 14, 2016 at 4:37 PM, Sangjin Lee <sj...@apache.org> wrote:
> Wait. The errors you're seeing have nothing to do with this or
> HBASE-16749. You seem to be hitting an issue with connecting to
> repository.apache.org. The original issue was with hitting
> http://people.apache.org/~garyh/mvn. This seems to be a different issue.
> Could you please drill into what's happening?
>
> On Wed, Dec 14, 2016 at 11:01 AM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Thanks folks for reply, I tried to change some parameters of maven (like
>> useCache=true), but it still doesn't work.
>>
>> The output looks like:
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
>> [INFO] ------------------------------------------------------------
>> ------------
>> Downloading: https://repository.apache.org/content/repositories/releases/
>> org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.0.
>> 0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://oss.sonatype.org/content/repositories/snapshots/org/
>> apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/had
>> oop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/hadoop
>> -client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache.snapshots.https
>> (https://repository.apache.org/content/repositories/snapshots
>> <https://repository.apache.org/content/repositories/snapshots>): Connect to
>> repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache release
>> (https://repository.apache.org/content/repositories/releases/
>> <https://repository.apache.org/content/repositories/releases/>): Connect to
>> repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache snapshot
>> (https://repository.apache.org/content/repositories/snapshots/
>> <https://repository.apache.org/content/repositories/snapshots/>): Connect
>> to repository.apache.org:443 <http://repository.apache.org:443>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> *[WARNING] Could not transfer metadata
>> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> from/to apache.snapshots (http://repository.apache.org/snapshots
>> <http://repository.apache.org/snapshots>): Connect to
>> repository.apache.org:80 <http://repository.apache.org:80>
>> [repository.apache.org/207.244.88.143
>> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
>> Downloading: https://repository.apache.org/content/repositories/releases/
>> org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-
>> SNAPSHOT/maven-metadata.xml
>> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-mapreduce-
>> client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://repository.apache.org/content/repositories/snapshots
>> /org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: https://oss.sonatype.org/content/repositories/snapshots/org/
>> apache/hadoop/hadoop-mapreduce-client-app/3.0.0-
>> alpha2-SNAPSHOT/maven-metadata.xml
>> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/had
>> oop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>
>> Is there any other configurations I could try to workaround the issue?
>>
>> Thanks,
>> Wangda
>>
>>
>> On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <
>> vrushali@twitter.com> wrote:
>>
>>> Yes, let's continue the discussion on jira
>>> https://issues.apache.org/jira/browse/YARN-5976
>>>
>>> I have captured this thread there as well.
>>>
>>> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
>>> wrote:
>>>
>>>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>>>> really used right now and deal with adding it in later.
>>>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>>>> import import org.apache.phoenix.util.PropertiesUtil;
>>>>
>>>> If everybody is cool to remove that for now, then we can deal with
>>>> Phoenix as and when we're ready to add the offline aggregation.
>>>>
>>>> Cheers,
>>>>
>>>> Joep
>>>>
>>>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>>>> vchannapattan@twitter.com> wrote:
>>>>
>>>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>>>
>>>>> Thanks
>>>>> Vrushali
>>>>>
>>>>>
>>>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>>>
>>>>> bq. out of which 1.2.4 is released
>>>>>
>>>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>>>
>>>>> FYI
>>>>>
>>>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>>>
>>>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8
>>>>>> (out of
>>>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade
>>>>>> to
>>>>>> 1.2.4 or later.
>>>>>>
>>>>>>
>>>>>> Sangjin
>>>>>>
>>>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>>>> vchannapattan@twitter.com> wrote:
>>>>>>
>>>>>> > Yes, I think bumping up the hbase version to 1.2 should help with
>>>>>> this
>>>>>> > build time taken issue. I will start looking into this upgrade right
>>>>>> > away.
>>>>>> >
>>>>>> > Thanks
>>>>>> > Vrushali
>>>>>> >
>>>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>>>> > >
>>>>>> > > I could not reproduce this issue locally but this may be related
>>>>>> to some
>>>>>> > local maven repos. This may be related to the private repo issues
>>>>>> of HBase?
>>>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>>>> timeline
>>>>>> > module might be helpful?
>>>>>> > >
>>>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to
>>>>>> bump up
>>>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>>>> Thanks!
>>>>>> > >
>>>>>> > > Li Lu
>>>>>> > >
>>>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>
>>>>>> wrote:
>>>>>> > >>
>>>>>> > >> Hi folks,
>>>>>> > >>
>>>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is
>>>>>> updated (per
>>>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>>>> > >>
>>>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>>>> SUCCESS [
>>>>>> > >> 1.378 s]
>>>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>>>> SUCCESS [
>>>>>> > >> 10.559 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>>>> SUCCESS [
>>>>>> > >> 6.993 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>>>> SUCCESS [
>>>>>> > >> 0.057 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>>>> SUCCESS [
>>>>>> > >> 2.266 s]
>>>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>>>> SUCCESS [
>>>>>> > >> 4.075 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>>>> SUCCESS [
>>>>>> > >> 0.924 s]
>>>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>>>> SUCCESS [
>>>>>> > >> 1.549 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................
>>>>>> SUCCESS
>>>>>> > [05:14
>>>>>> > >> min]
>>>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>>>> SUCCESS [
>>>>>> > >> 8.554 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>>>> SUCCESS [
>>>>>> > >> 1.561 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>>>> SUCCESS [
>>>>>> > >> 1.321 s]
>>>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>>>> SUCCESS [
>>>>>> > >> 0.843 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>>>> SUCCESS [
>>>>>> > >> 0.949 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>>>> SUCCESS [
>>>>>> > >> 3.137 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>>>> SUCCESS [
>>>>>> > >> 0.055 s]
>>>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>>>> SUCCESS [
>>>>>> > >> 0.807 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>>>> SUCCESS [
>>>>>> > >> 0.602 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>>>> SUCCESS [
>>>>>> > >> 0.060 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>>>> SUCCESS [
>>>>>> > >> 0.910 s]
>>>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>>>> SUCCESS [
>>>>>> > >> 0.072 s]
>>>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>>>> SUCCESS [
>>>>>> > >> 0.749 s]
>>>>>> > >> [INFO]
>>>>>> > >> ------------------------------------------------------------
>>>>>> > ------------
>>>>>> > >> [INFO] BUILD SUCCESS
>>>>>> > >> [INFO]
>>>>>> > >> ------------------------------------------------------------
>>>>>> > ------------
>>>>>> > >> [INFO] Total time: 06:02 min
>>>>>> > >>
>>>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>>>> trunk,
>>>>>> > but
>>>>>> > >> I can often see this happens.
>>>>>> > >>
>>>>>> > >> Thoughts about how to solve it?
>>>>>> > >>
>>>>>> > >> Thanks,
>>>>>> > >> Wangda
>>>>>> > >>
>>>>>> > >>
>>>>>> > >>
>>>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>>>> wrote:
>>>>>> > >>>
>>>>>> > >>> Thanks Wangda.
>>>>>> > >>>
>>>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>>>> anything from
>>>>>> > >>> that location (it's a very old content). It just does a wasted
>>>>>> effort
>>>>>> > by
>>>>>> > >>> hitting this repo.
>>>>>> > >>>
>>>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <
>>>>>> wheeleast@gmail.com>
>>>>>> > wrote:
>>>>>> > >>>>
>>>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>>>> > >>>>
>>>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>>>> wheeleast@gmail.com>
>>>>>> > wrote:
>>>>>> > >>>>>
>>>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I
>>>>>> will file a
>>>>>> > >>>>> HBase JIRA later.
>>>>>> > >>>>>
>>>>>> > >>>>> Regards,
>>>>>> > >>>>> Wangda
>>>>>> > >>>>>
>>>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>>>> > stevel@hortonworks.com>
>>>>>> > >>>>> wrote:
>>>>>> > >>>>>
>>>>>> > >>>>>> HBase really ought to have a profile for D/Ling from
>>>>>> somewhere like
>>>>>> > >>>> this,
>>>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>>>> > >>>>>>
>>>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>>>> wrote:
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> Hi YARN-dev,
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> (cc common-dev),
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>>>> > >>>> maven-metadata.xml
>>>>>> > >>>>>> from
>>>>>> > >>>>>>> a personal apache site, log looks like:
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> [INFO] ------------------------------
>>>>>> > ------------------------------
>>>>>> > >>>>>>> ------------
>>>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>>>> > >>>>>>> [INFO] ------------------------------
>>>>>> > ------------------------------
>>>>>> > >>>>>>> ------------
>>>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>> ...
>>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>>> > garyh/mvn/org/apache/hadoop/
>>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>> ...
>>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>>> > garyh/mvn/org/apache/hadoop/
>>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>>> > >>>>>>>
>>>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it
>>>>>> causes by my
>>>>>> > >>>>>> local
>>>>>> > >>>>>>
>>>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>>>> and then
>>>>>> > >>>>>> going on to try the next repo?
>>>>>> > >>>>>>
>>>>>> > >>>>>
>>>>>> > >>>>>
>>>>>> > >>>>
>>>>>> > >>>
>>>>>> > >>>
>>>>>> > >
>>>>>> >
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@apache.org>.
Wait. The errors you're seeing have nothing to do with this or HBASE-16749.
You seem to be hitting an issue with connecting to repository.apache.org.
The original issue was with hitting http://people.apache.org/~garyh/mvn.
This seems to be a different issue. Could you please drill into what's
happening?
On Wed, Dec 14, 2016 at 11:01 AM, Wangda Tan <wh...@gmail.com> wrote:
> Thanks folks for reply, I tried to change some parameters of maven (like
> useCache=true), but it still doesn't work.
>
> The output looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: https://repository.apache.org/content/repositories/releases/
> org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: https://oss.sonatype.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache.snapshots.https
> (https://repository.apache.org/content/repositories/snapshots
> <https://repository.apache.org/content/repositories/snapshots>): Connect to
> repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache release
> (https://repository.apache.org/content/repositories/releases/
> <https://repository.apache.org/content/repositories/releases/>): Connect to
> repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache snapshot
> (https://repository.apache.org/content/repositories/snapshots/
> <https://repository.apache.org/content/repositories/snapshots/>): Connect
> to repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache.snapshots (http://repository.apache.org/snapshots
> <http://repository.apache.org/snapshots>): Connect to
> repository.apache.org:80 <http://repository.apache.org:80>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> Downloading: https://repository.apache.org/content/repositories/releases/
> org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-
> metadata.xml
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-
> mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://oss.sonatype.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/
> hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> Is there any other configurations I could try to workaround the issue?
>
> Thanks,
> Wangda
>
>
> On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <
> vrushali@twitter.com> wrote:
>
>> Yes, let's continue the discussion on jira https://issues.apache.org/jira
>> /browse/YARN-5976
>>
>> I have captured this thread there as well.
>>
>> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
>> wrote:
>>
>>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>>> really used right now and deal with adding it in later.
>>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>>> import import org.apache.phoenix.util.PropertiesUtil;
>>>
>>> If everybody is cool to remove that for now, then we can deal with
>>> Phoenix as and when we're ready to add the offline aggregation.
>>>
>>> Cheers,
>>>
>>> Joep
>>>
>>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>>> vchannapattan@twitter.com> wrote:
>>>
>>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>>
>>>> Thanks
>>>> Vrushali
>>>>
>>>>
>>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>>
>>>> bq. out of which 1.2.4 is released
>>>>
>>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>>
>>>> FYI
>>>>
>>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>>
>>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out
>>>>> of
>>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade
>>>>> to
>>>>> 1.2.4 or later.
>>>>>
>>>>>
>>>>> Sangjin
>>>>>
>>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>>> vchannapattan@twitter.com> wrote:
>>>>>
>>>>> > Yes, I think bumping up the hbase version to 1.2 should help with
>>>>> this
>>>>> > build time taken issue. I will start looking into this upgrade right
>>>>> > away.
>>>>> >
>>>>> > Thanks
>>>>> > Vrushali
>>>>> >
>>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>>> > >
>>>>> > > I could not reproduce this issue locally but this may be related
>>>>> to some
>>>>> > local maven repos. This may be related to the private repo issues of
>>>>> HBase?
>>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>>> timeline
>>>>> > module might be helpful?
>>>>> > >
>>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump
>>>>> up
>>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>>> Thanks!
>>>>> > >
>>>>> > > Li Lu
>>>>> > >
>>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>
>>>>> wrote:
>>>>> > >>
>>>>> > >> Hi folks,
>>>>> > >>
>>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is
>>>>> updated (per
>>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>>> > >>
>>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>>> SUCCESS [
>>>>> > >> 1.378 s]
>>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>>> SUCCESS [
>>>>> > >> 10.559 s]
>>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>>> SUCCESS [
>>>>> > >> 6.993 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>>> SUCCESS [
>>>>> > >> 0.057 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>>> SUCCESS [
>>>>> > >> 2.266 s]
>>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>>> SUCCESS [
>>>>> > >> 4.075 s]
>>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>>> SUCCESS [
>>>>> > >> 0.924 s]
>>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>>> SUCCESS [
>>>>> > >> 1.549 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................
>>>>> SUCCESS
>>>>> > [05:14
>>>>> > >> min]
>>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>>> SUCCESS [
>>>>> > >> 8.554 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>>> SUCCESS [
>>>>> > >> 1.561 s]
>>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>>> SUCCESS [
>>>>> > >> 1.321 s]
>>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>>> SUCCESS [
>>>>> > >> 0.843 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>>> SUCCESS [
>>>>> > >> 0.949 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>>> SUCCESS [
>>>>> > >> 3.137 s]
>>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>>> SUCCESS [
>>>>> > >> 0.055 s]
>>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>>> SUCCESS [
>>>>> > >> 0.807 s]
>>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>>> SUCCESS [
>>>>> > >> 0.602 s]
>>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>>> SUCCESS [
>>>>> > >> 0.060 s]
>>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>>> SUCCESS [
>>>>> > >> 0.910 s]
>>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>>> SUCCESS [
>>>>> > >> 0.072 s]
>>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>>> SUCCESS [
>>>>> > >> 0.749 s]
>>>>> > >> [INFO]
>>>>> > >> ------------------------------------------------------------
>>>>> > ------------
>>>>> > >> [INFO] BUILD SUCCESS
>>>>> > >> [INFO]
>>>>> > >> ------------------------------------------------------------
>>>>> > ------------
>>>>> > >> [INFO] Total time: 06:02 min
>>>>> > >>
>>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>>> trunk,
>>>>> > but
>>>>> > >> I can often see this happens.
>>>>> > >>
>>>>> > >> Thoughts about how to solve it?
>>>>> > >>
>>>>> > >> Thanks,
>>>>> > >> Wangda
>>>>> > >>
>>>>> > >>
>>>>> > >>
>>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>>> wrote:
>>>>> > >>>
>>>>> > >>> Thanks Wangda.
>>>>> > >>>
>>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>>> anything from
>>>>> > >>> that location (it's a very old content). It just does a wasted
>>>>> effort
>>>>> > by
>>>>> > >>> hitting this repo.
>>>>> > >>>
>>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <
>>>>> wheeleast@gmail.com>
>>>>> > wrote:
>>>>> > >>>>
>>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>>> > >>>>
>>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>>> wheeleast@gmail.com>
>>>>> > wrote:
>>>>> > >>>>>
>>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
>>>>> file a
>>>>> > >>>>> HBase JIRA later.
>>>>> > >>>>>
>>>>> > >>>>> Regards,
>>>>> > >>>>> Wangda
>>>>> > >>>>>
>>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>>> > stevel@hortonworks.com>
>>>>> > >>>>> wrote:
>>>>> > >>>>>
>>>>> > >>>>>> HBase really ought to have a profile for D/Ling from
>>>>> somewhere like
>>>>> > >>>> this,
>>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>>> > >>>>>>
>>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>>> wrote:
>>>>> > >>>>>>>
>>>>> > >>>>>>> Hi YARN-dev,
>>>>> > >>>>>>>
>>>>> > >>>>>>> (cc common-dev),
>>>>> > >>>>>>>
>>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>>> > >>>> maven-metadata.xml
>>>>> > >>>>>> from
>>>>> > >>>>>>> a personal apache site, log looks like:
>>>>> > >>>>>>>
>>>>> > >>>>>>> [INFO] ------------------------------
>>>>> > ------------------------------
>>>>> > >>>>>>> ------------
>>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>>> > >>>>>>> [INFO] ------------------------------
>>>>> > ------------------------------
>>>>> > >>>>>>> ------------
>>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>> ...
>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>> > garyh/mvn/org/apache/hadoop/
>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>> ...
>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>> > garyh/mvn/org/apache/hadoop/
>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>>
>>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it
>>>>> causes by my
>>>>> > >>>>>> local
>>>>> > >>>>>>
>>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>>> and then
>>>>> > >>>>>> going on to try the next repo?
>>>>> > >>>>>>
>>>>> > >>>>>
>>>>> > >>>>>
>>>>> > >>>>
>>>>> > >>>
>>>>> > >>>
>>>>> > >
>>>>> >
>>>>>
>>>>
>>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@apache.org>.
Wait. The errors you're seeing have nothing to do with this or HBASE-16749.
You seem to be hitting an issue with connecting to repository.apache.org.
The original issue was with hitting http://people.apache.org/~garyh/mvn.
This seems to be a different issue. Could you please drill into what's
happening?
On Wed, Dec 14, 2016 at 11:01 AM, Wangda Tan <wh...@gmail.com> wrote:
> Thanks folks for reply, I tried to change some parameters of maven (like
> useCache=true), but it still doesn't work.
>
> The output looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: https://repository.apache.org/content/repositories/releases/
> org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: https://oss.sonatype.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-
> SNAPSHOT/maven-metadata.xml
> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache.snapshots.https
> (https://repository.apache.org/content/repositories/snapshots
> <https://repository.apache.org/content/repositories/snapshots>): Connect to
> repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache release
> (https://repository.apache.org/content/repositories/releases/
> <https://repository.apache.org/content/repositories/releases/>): Connect to
> repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache snapshot
> (https://repository.apache.org/content/repositories/snapshots/
> <https://repository.apache.org/content/repositories/snapshots/>): Connect
> to repository.apache.org:443 <http://repository.apache.org:443>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> *[WARNING] Could not transfer metadata
> org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> from/to apache.snapshots (http://repository.apache.org/snapshots
> <http://repository.apache.org/snapshots>): Connect to
> repository.apache.org:80 <http://repository.apache.org:80>
> [repository.apache.org/207.244.88.143
> <http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
> Downloading: https://repository.apache.org/content/repositories/releases/
> org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-
> metadata.xml
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-
> mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://repository.apache.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: https://oss.sonatype.org/content/repositories/
> snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> Downloading: http://repository.apache.org/snapshots/org/apache/hadoop/
> hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> Is there any other configurations I could try to workaround the issue?
>
> Thanks,
> Wangda
>
>
> On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <
> vrushali@twitter.com> wrote:
>
>> Yes, let's continue the discussion on jira https://issues.apache.org/jira
>> /browse/YARN-5976
>>
>> I have captured this thread there as well.
>>
>> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
>> wrote:
>>
>>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>>> really used right now and deal with adding it in later.
>>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>>> import import org.apache.phoenix.util.PropertiesUtil;
>>>
>>> If everybody is cool to remove that for now, then we can deal with
>>> Phoenix as and when we're ready to add the offline aggregation.
>>>
>>> Cheers,
>>>
>>> Joep
>>>
>>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>>> vchannapattan@twitter.com> wrote:
>>>
>>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>>
>>>> Thanks
>>>> Vrushali
>>>>
>>>>
>>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>>
>>>> bq. out of which 1.2.4 is released
>>>>
>>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>>
>>>> FYI
>>>>
>>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>>
>>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out
>>>>> of
>>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade
>>>>> to
>>>>> 1.2.4 or later.
>>>>>
>>>>>
>>>>> Sangjin
>>>>>
>>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>>> vchannapattan@twitter.com> wrote:
>>>>>
>>>>> > Yes, I think bumping up the hbase version to 1.2 should help with
>>>>> this
>>>>> > build time taken issue. I will start looking into this upgrade right
>>>>> > away.
>>>>> >
>>>>> > Thanks
>>>>> > Vrushali
>>>>> >
>>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>>> > >
>>>>> > > I could not reproduce this issue locally but this may be related
>>>>> to some
>>>>> > local maven repos. This may be related to the private repo issues of
>>>>> HBase?
>>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>>> timeline
>>>>> > module might be helpful?
>>>>> > >
>>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump
>>>>> up
>>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>>> Thanks!
>>>>> > >
>>>>> > > Li Lu
>>>>> > >
>>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com>
>>>>> wrote:
>>>>> > >>
>>>>> > >> Hi folks,
>>>>> > >>
>>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is
>>>>> updated (per
>>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>>> > >>
>>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>>> SUCCESS [
>>>>> > >> 1.378 s]
>>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>>> SUCCESS [
>>>>> > >> 10.559 s]
>>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>>> SUCCESS [
>>>>> > >> 6.993 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>>> SUCCESS [
>>>>> > >> 0.057 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>>> SUCCESS [
>>>>> > >> 2.266 s]
>>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>>> SUCCESS [
>>>>> > >> 4.075 s]
>>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>>> SUCCESS [
>>>>> > >> 0.924 s]
>>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>>> SUCCESS [
>>>>> > >> 1.549 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................
>>>>> SUCCESS
>>>>> > [05:14
>>>>> > >> min]
>>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>>> SUCCESS [
>>>>> > >> 8.554 s]
>>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>>> SUCCESS [
>>>>> > >> 1.561 s]
>>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>>> SUCCESS [
>>>>> > >> 1.321 s]
>>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>>> SUCCESS [
>>>>> > >> 0.843 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>>> SUCCESS [
>>>>> > >> 0.949 s]
>>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>>> SUCCESS [
>>>>> > >> 3.137 s]
>>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>>> SUCCESS [
>>>>> > >> 0.055 s]
>>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>>> SUCCESS [
>>>>> > >> 0.807 s]
>>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>>> SUCCESS [
>>>>> > >> 0.602 s]
>>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>>> SUCCESS [
>>>>> > >> 0.060 s]
>>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>>> SUCCESS [
>>>>> > >> 0.910 s]
>>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>>> SUCCESS [
>>>>> > >> 0.072 s]
>>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>>> SUCCESS [
>>>>> > >> 0.749 s]
>>>>> > >> [INFO]
>>>>> > >> ------------------------------------------------------------
>>>>> > ------------
>>>>> > >> [INFO] BUILD SUCCESS
>>>>> > >> [INFO]
>>>>> > >> ------------------------------------------------------------
>>>>> > ------------
>>>>> > >> [INFO] Total time: 06:02 min
>>>>> > >>
>>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>>> trunk,
>>>>> > but
>>>>> > >> I can often see this happens.
>>>>> > >>
>>>>> > >> Thoughts about how to solve it?
>>>>> > >>
>>>>> > >> Thanks,
>>>>> > >> Wangda
>>>>> > >>
>>>>> > >>
>>>>> > >>
>>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>>> wrote:
>>>>> > >>>
>>>>> > >>> Thanks Wangda.
>>>>> > >>>
>>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>>> anything from
>>>>> > >>> that location (it's a very old content). It just does a wasted
>>>>> effort
>>>>> > by
>>>>> > >>> hitting this repo.
>>>>> > >>>
>>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <
>>>>> wheeleast@gmail.com>
>>>>> > wrote:
>>>>> > >>>>
>>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>>> > >>>>
>>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>>> wheeleast@gmail.com>
>>>>> > wrote:
>>>>> > >>>>>
>>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
>>>>> file a
>>>>> > >>>>> HBase JIRA later.
>>>>> > >>>>>
>>>>> > >>>>> Regards,
>>>>> > >>>>> Wangda
>>>>> > >>>>>
>>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>>> > stevel@hortonworks.com>
>>>>> > >>>>> wrote:
>>>>> > >>>>>
>>>>> > >>>>>> HBase really ought to have a profile for D/Ling from
>>>>> somewhere like
>>>>> > >>>> this,
>>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>>> > >>>>>>
>>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>>> wrote:
>>>>> > >>>>>>>
>>>>> > >>>>>>> Hi YARN-dev,
>>>>> > >>>>>>>
>>>>> > >>>>>>> (cc common-dev),
>>>>> > >>>>>>>
>>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>>> > >>>> maven-metadata.xml
>>>>> > >>>>>> from
>>>>> > >>>>>>> a personal apache site, log looks like:
>>>>> > >>>>>>>
>>>>> > >>>>>>> [INFO] ------------------------------
>>>>> > ------------------------------
>>>>> > >>>>>>> ------------
>>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>>> > >>>>>>> [INFO] ------------------------------
>>>>> > ------------------------------
>>>>> > >>>>>>> ------------
>>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>> ...
>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>> > garyh/mvn/org/apache/hadoop/
>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>> ...
>>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>>> > garyh/mvn/org/apache/hadoop/
>>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>>> > >>>>>>>
>>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it
>>>>> causes by my
>>>>> > >>>>>> local
>>>>> > >>>>>>
>>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>>> and then
>>>>> > >>>>>> going on to try the next repo?
>>>>> > >>>>>>
>>>>> > >>>>>
>>>>> > >>>>>
>>>>> > >>>>
>>>>> > >>>
>>>>> > >>>
>>>>> > >
>>>>> >
>>>>>
>>>>
>>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks folks for reply, I tried to change some parameters of maven (like
useCache=true), but it still doesn't work.
The output looks like:
[INFO]
------------------------------------------------------------------------
[INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
[INFO]
------------------------------------------------------------------------
Downloading:
https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://people.apache.org/~garyh/mvn/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache.snapshots.https
(https://repository.apache.org/content/repositories/snapshots
<https://repository.apache.org/content/repositories/snapshots>): Connect to
repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache release
(https://repository.apache.org/content/repositories/releases/
<https://repository.apache.org/content/repositories/releases/>): Connect to
repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache snapshot
(https://repository.apache.org/content/repositories/snapshots/
<https://repository.apache.org/content/repositories/snapshots/>): Connect
to repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache.snapshots (http://repository.apache.org/snapshots
<http://repository.apache.org/snapshots>): Connect to
repository.apache.org:80 <http://repository.apache.org:80>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
Downloading:
https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://conjars.org/repo/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Is there any other configurations I could try to workaround the issue?
Thanks,
Wangda
On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <vrushali@twitter.com
> wrote:
> Yes, let's continue the discussion on jira https://issues.apache.org/
> jira/browse/YARN-5976
>
> I have captured this thread there as well.
>
> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
> wrote:
>
>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>> really used right now and deal with adding it in later.
>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>> import import org.apache.phoenix.util.PropertiesUtil;
>>
>> If everybody is cool to remove that for now, then we can deal with
>> Phoenix as and when we're ready to add the offline aggregation.
>>
>> Cheers,
>>
>> Joep
>>
>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>> vchannapattan@twitter.com> wrote:
>>
>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>
>>> Thanks
>>> Vrushali
>>>
>>>
>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> bq. out of which 1.2.4 is released
>>>
>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>
>>> FYI
>>>
>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>
>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out
>>>> of
>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
>>>> 1.2.4 or later.
>>>>
>>>>
>>>> Sangjin
>>>>
>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>> vchannapattan@twitter.com> wrote:
>>>>
>>>> > Yes, I think bumping up the hbase version to 1.2 should help with this
>>>> > build time taken issue. I will start looking into this upgrade right
>>>> > away.
>>>> >
>>>> > Thanks
>>>> > Vrushali
>>>> >
>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>> > >
>>>> > > I could not reproduce this issue locally but this may be related to
>>>> some
>>>> > local maven repos. This may be related to the private repo issues of
>>>> HBase?
>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>> timeline
>>>> > module might be helpful?
>>>> > >
>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump
>>>> up
>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>> Thanks!
>>>> > >
>>>> > > Li Lu
>>>> > >
>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
>>>> > >>
>>>> > >> Hi folks,
>>>> > >>
>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is updated
>>>> (per
>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>> > >>
>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>> SUCCESS [
>>>> > >> 1.378 s]
>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>> SUCCESS [
>>>> > >> 10.559 s]
>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>> SUCCESS [
>>>> > >> 6.993 s]
>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>> SUCCESS [
>>>> > >> 0.057 s]
>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>> SUCCESS [
>>>> > >> 2.266 s]
>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>> SUCCESS [
>>>> > >> 4.075 s]
>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>> SUCCESS [
>>>> > >> 0.924 s]
>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>> SUCCESS [
>>>> > >> 1.549 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
>>>> > [05:14
>>>> > >> min]
>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>> SUCCESS [
>>>> > >> 8.554 s]
>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>> SUCCESS [
>>>> > >> 1.561 s]
>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>> SUCCESS [
>>>> > >> 1.321 s]
>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>> SUCCESS [
>>>> > >> 0.843 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>> SUCCESS [
>>>> > >> 0.949 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>> SUCCESS [
>>>> > >> 3.137 s]
>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>> SUCCESS [
>>>> > >> 0.055 s]
>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>> SUCCESS [
>>>> > >> 0.807 s]
>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>> SUCCESS [
>>>> > >> 0.602 s]
>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>> SUCCESS [
>>>> > >> 0.060 s]
>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>> SUCCESS [
>>>> > >> 0.910 s]
>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>> SUCCESS [
>>>> > >> 0.072 s]
>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>> SUCCESS [
>>>> > >> 0.749 s]
>>>> > >> [INFO]
>>>> > >> ------------------------------------------------------------
>>>> > ------------
>>>> > >> [INFO] BUILD SUCCESS
>>>> > >> [INFO]
>>>> > >> ------------------------------------------------------------
>>>> > ------------
>>>> > >> [INFO] Total time: 06:02 min
>>>> > >>
>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>> trunk,
>>>> > but
>>>> > >> I can often see this happens.
>>>> > >>
>>>> > >> Thoughts about how to solve it?
>>>> > >>
>>>> > >> Thanks,
>>>> > >> Wangda
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>> wrote:
>>>> > >>>
>>>> > >>> Thanks Wangda.
>>>> > >>>
>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>> anything from
>>>> > >>> that location (it's a very old content). It just does a wasted
>>>> effort
>>>> > by
>>>> > >>> hitting this repo.
>>>> > >>>
>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wheeleast@gmail.com
>>>> >
>>>> > wrote:
>>>> > >>>>
>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>> > >>>>
>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>> wheeleast@gmail.com>
>>>> > wrote:
>>>> > >>>>>
>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
>>>> file a
>>>> > >>>>> HBase JIRA later.
>>>> > >>>>>
>>>> > >>>>> Regards,
>>>> > >>>>> Wangda
>>>> > >>>>>
>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>> > stevel@hortonworks.com>
>>>> > >>>>> wrote:
>>>> > >>>>>
>>>> > >>>>>> HBase really ought to have a profile for D/Ling from somewhere
>>>> like
>>>> > >>>> this,
>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>> > >>>>>>
>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>> wrote:
>>>> > >>>>>>>
>>>> > >>>>>>> Hi YARN-dev,
>>>> > >>>>>>>
>>>> > >>>>>>> (cc common-dev),
>>>> > >>>>>>>
>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>> > >>>> maven-metadata.xml
>>>> > >>>>>> from
>>>> > >>>>>>> a personal apache site, log looks like:
>>>> > >>>>>>>
>>>> > >>>>>>> [INFO] ------------------------------
>>>> > ------------------------------
>>>> > >>>>>>> ------------
>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>> > >>>>>>> [INFO] ------------------------------
>>>> > ------------------------------
>>>> > >>>>>>> ------------
>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>> ...
>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>> > garyh/mvn/org/apache/hadoop/
>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>> ...
>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>> > garyh/mvn/org/apache/hadoop/
>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>>
>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it causes
>>>> by my
>>>> > >>>>>> local
>>>> > >>>>>>
>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>> and then
>>>> > >>>>>> going on to try the next repo?
>>>> > >>>>>>
>>>> > >>>>>
>>>> > >>>>>
>>>> > >>>>
>>>> > >>>
>>>> > >>>
>>>> > >
>>>> >
>>>>
>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks folks for reply, I tried to change some parameters of maven (like
useCache=true), but it still doesn't work.
The output looks like:
[INFO]
------------------------------------------------------------------------
[INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
[INFO]
------------------------------------------------------------------------
Downloading:
https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://people.apache.org/~garyh/mvn/org/apache/hadoop/hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache.snapshots.https
(https://repository.apache.org/content/repositories/snapshots
<https://repository.apache.org/content/repositories/snapshots>): Connect to
repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache release
(https://repository.apache.org/content/repositories/releases/
<https://repository.apache.org/content/repositories/releases/>): Connect to
repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache snapshot
(https://repository.apache.org/content/repositories/snapshots/
<https://repository.apache.org/content/repositories/snapshots/>): Connect
to repository.apache.org:443 <http://repository.apache.org:443>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
*[WARNING] Could not transfer metadata
org.apache.hadoop:hadoop-client:3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
from/to apache.snapshots (http://repository.apache.org/snapshots
<http://repository.apache.org/snapshots>): Connect to
repository.apache.org:80 <http://repository.apache.org:80>
[repository.apache.org/207.244.88.143
<http://repository.apache.org/207.244.88.143>] failed: Operation timed out*
Downloading:
https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://conjars.org/repo/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-mapreduce-client-app/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
Is there any other configurations I could try to workaround the issue?
Thanks,
Wangda
On Wed, Dec 14, 2016 at 9:22 AM, Vrushali Channapattan <vrushali@twitter.com
> wrote:
> Yes, let's continue the discussion on jira https://issues.apache.org/
> jira/browse/YARN-5976
>
> I have captured this thread there as well.
>
> On Tue, Dec 13, 2016 at 11:27 PM, Joep Rottinghuis <jo...@twitter.com>
> wrote:
>
>> What I'm concerned we can remove the Phoenix dependency, since it isn't
>> really used right now and deal with adding it in later.
>> However, there is PhoenixOfflineAggregationWriterImpl.java which does
>> import import org.apache.phoenix.util.PropertiesUtil;
>>
>> If everybody is cool to remove that for now, then we can deal with
>> Phoenix as and when we're ready to add the offline aggregation.
>>
>> Cheers,
>>
>> Joep
>>
>> On Tue, Dec 13, 2016 at 9:01 PM, Vrushali Channapattan <
>> vchannapattan@twitter.com> wrote:
>>
>>> Hmm, using hbase 1.2.4 may not be possible since Phoenix 4.8.1 needs
>>> 1.2.0. Or we think about adding in the Phoenix dependency later.
>>>
>>> Thanks
>>> Vrushali
>>>
>>>
>>> On Dec 13, 2016, at 8:54 PM, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> bq. out of which 1.2.4 is released
>>>
>>> Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
>>>
>>> FYI
>>>
>>> On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
>>>
>>>> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out
>>>> of
>>>> which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
>>>> 1.2.4 or later.
>>>>
>>>>
>>>> Sangjin
>>>>
>>>> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
>>>> vchannapattan@twitter.com> wrote:
>>>>
>>>> > Yes, I think bumping up the hbase version to 1.2 should help with this
>>>> > build time taken issue. I will start looking into this upgrade right
>>>> > away.
>>>> >
>>>> > Thanks
>>>> > Vrushali
>>>> >
>>>> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
>>>> > >
>>>> > > I could not reproduce this issue locally but this may be related to
>>>> some
>>>> > local maven repos. This may be related to the private repo issues of
>>>> HBase?
>>>> > If this is the case, bumping up hbase dependency version of YARN
>>>> timeline
>>>> > module might be helpful?
>>>> > >
>>>> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump
>>>> up
>>>> > HBase dependency version into 1.2. Shall we prioritize that JIRA?
>>>> Thanks!
>>>> > >
>>>> > > Li Lu
>>>> > >
>>>> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
>>>> > >>
>>>> > >> Hi folks,
>>>> > >>
>>>> > >> It looks like HBASE-16749 is fixed, and Phoenix version is updated
>>>> (per
>>>> > >> Li). But I'm still experiencing slow build of ATSv2 component:
>>>> > >>
>>>> > >> [INFO] Apache Hadoop YARN .................................
>>>> SUCCESS [
>>>> > >> 1.378 s]
>>>> > >> [INFO] Apache Hadoop YARN API .............................
>>>> SUCCESS [
>>>> > >> 10.559 s]
>>>> > >> [INFO] Apache Hadoop YARN Common ..........................
>>>> SUCCESS [
>>>> > >> 6.993 s]
>>>> > >> [INFO] Apache Hadoop YARN Server ..........................
>>>> SUCCESS [
>>>> > >> 0.057 s]
>>>> > >> [INFO] Apache Hadoop YARN Server Common ...................
>>>> SUCCESS [
>>>> > >> 2.266 s]
>>>> > >> [INFO] Apache Hadoop YARN NodeManager .....................
>>>> SUCCESS [
>>>> > >> 4.075 s]
>>>> > >> [INFO] Apache Hadoop YARN Web Proxy .......................
>>>> SUCCESS [
>>>> > >> 0.924 s]
>>>> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService .......
>>>> SUCCESS [
>>>> > >> 1.549 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
>>>> > [05:14
>>>> > >> min]
>>>> > >> [INFO] Apache Hadoop YARN ResourceManager .................
>>>> SUCCESS [
>>>> > >> 8.554 s]
>>>> > >> [INFO] Apache Hadoop YARN Server Tests ....................
>>>> SUCCESS [
>>>> > >> 1.561 s]
>>>> > >> [INFO] Apache Hadoop YARN Client ..........................
>>>> SUCCESS [
>>>> > >> 1.321 s]
>>>> > >> [INFO] Apache Hadoop YARN SharedCacheManager ..............
>>>> SUCCESS [
>>>> > >> 0.843 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage .........
>>>> SUCCESS [
>>>> > >> 0.949 s]
>>>> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests ....
>>>> SUCCESS [
>>>> > >> 3.137 s]
>>>> > >> [INFO] Apache Hadoop YARN Applications ....................
>>>> SUCCESS [
>>>> > >> 0.055 s]
>>>> > >> [INFO] Apache Hadoop YARN DistributedShell ................
>>>> SUCCESS [
>>>> > >> 0.807 s]
>>>> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ...........
>>>> SUCCESS [
>>>> > >> 0.602 s]
>>>> > >> [INFO] Apache Hadoop YARN Site ............................
>>>> SUCCESS [
>>>> > >> 0.060 s]
>>>> > >> [INFO] Apache Hadoop YARN Registry ........................
>>>> SUCCESS [
>>>> > >> 0.910 s]
>>>> > >> [INFO] Apache Hadoop YARN UI ..............................
>>>> SUCCESS [
>>>> > >> 0.072 s]
>>>> > >> [INFO] Apache Hadoop YARN Project .........................
>>>> SUCCESS [
>>>> > >> 0.749 s]
>>>> > >> [INFO]
>>>> > >> ------------------------------------------------------------
>>>> > ------------
>>>> > >> [INFO] BUILD SUCCESS
>>>> > >> [INFO]
>>>> > >> ------------------------------------------------------------
>>>> > ------------
>>>> > >> [INFO] Total time: 06:02 min
>>>> > >>
>>>> > >> This doesn't happen every time when I run build on latest Hadoop
>>>> trunk,
>>>> > but
>>>> > >> I can often see this happens.
>>>> > >>
>>>> > >> Thoughts about how to solve it?
>>>> > >>
>>>> > >> Thanks,
>>>> > >> Wangda
>>>> > >>
>>>> > >>
>>>> > >>
>>>> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
>>>> wrote:
>>>> > >>>
>>>> > >>> Thanks Wangda.
>>>> > >>>
>>>> > >>> To answer Steve's question, I don't think maven downloads
>>>> anything from
>>>> > >>> that location (it's a very old content). It just does a wasted
>>>> effort
>>>> > by
>>>> > >>> hitting this repo.
>>>> > >>>
>>>> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wheeleast@gmail.com
>>>> >
>>>> > wrote:
>>>> > >>>>
>>>> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>>> > >>>>
>>>> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <
>>>> wheeleast@gmail.com>
>>>> > wrote:
>>>> > >>>>>
>>>> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
>>>> file a
>>>> > >>>>> HBase JIRA later.
>>>> > >>>>>
>>>> > >>>>> Regards,
>>>> > >>>>> Wangda
>>>> > >>>>>
>>>> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
>>>> > stevel@hortonworks.com>
>>>> > >>>>> wrote:
>>>> > >>>>>
>>>> > >>>>>> HBase really ought to have a profile for D/Ling from somewhere
>>>> like
>>>> > >>>> this,
>>>> > >>>>>> and, perhaps, list the ASF snapsphot repo first
>>>> > >>>>>>
>>>> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com>
>>>> wrote:
>>>> > >>>>>>>
>>>> > >>>>>>> Hi YARN-dev,
>>>> > >>>>>>>
>>>> > >>>>>>> (cc common-dev),
>>>> > >>>>>>>
>>>> > >>>>>>> YARN timeline service currently sometimes downloads
>>>> > >>>> maven-metadata.xml
>>>> > >>>>>> from
>>>> > >>>>>>> a personal apache site, log looks like:
>>>> > >>>>>>>
>>>> > >>>>>>> [INFO] ------------------------------
>>>> > ------------------------------
>>>> > >>>>>>> ------------
>>>> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
>>>> > >>>>>> 3.0.0-alpha2-SNAPSHOT
>>>> > >>>>>>> [INFO] ------------------------------
>>>> > ------------------------------
>>>> > >>>>>>> ------------
>>>> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
>>>> > >>>> ache/hadoop/hadoop-client/3.
>>>> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>> ...
>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>> > garyh/mvn/org/apache/hadoop/
>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>> ...
>>>> > >>>>>>> Downloading: http://people.apache.org/~
>>>> > garyh/mvn/org/apache/hadoop/
>>>> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>>>> > >>>>>>>
>>>> > >>>>>>> I noticed this happens for a while, I'm not sure if it causes
>>>> by my
>>>> > >>>>>> local
>>>> > >>>>>>
>>>> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them
>>>> and then
>>>> > >>>>>> going on to try the next repo?
>>>> > >>>>>>
>>>> > >>>>>
>>>> > >>>>>
>>>> > >>>>
>>>> > >>>
>>>> > >>>
>>>> > >
>>>> >
>>>>
>>>
>>>
>>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
bq. out of which 1.2.4 is released
Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
FYI
On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
> which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
> 1.2.4 or later.
>
>
> Sangjin
>
> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
> vchannapattan@twitter.com> wrote:
>
> > Yes, I think bumping up the hbase version to 1.2 should help with this
> > build time taken issue. I will start looking into this upgrade right
> > away.
> >
> > Thanks
> > Vrushali
> >
> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
> > >
> > > I could not reproduce this issue locally but this may be related to
> some
> > local maven repos. This may be related to the private repo issues of
> HBase?
> > If this is the case, bumping up hbase dependency version of YARN timeline
> > module might be helpful?
> > >
> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> > HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> > >
> > > Li Lu
> > >
> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
> > >>
> > >> Hi folks,
> > >>
> > >> It looks like HBASE-16749 is fixed, and Phoenix version is updated
> (per
> > >> Li). But I'm still experiencing slow build of ATSv2 component:
> > >>
> > >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> > >> 1.378 s]
> > >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> > >> 10.559 s]
> > >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> > >> 6.993 s]
> > >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> > >> 0.057 s]
> > >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> > >> 2.266 s]
> > >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> > >> 4.075 s]
> > >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> > >> 0.924 s]
> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> > >> 1.549 s]
> > >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> > [05:14
> > >> min]
> > >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> > >> 8.554 s]
> > >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> > >> 1.561 s]
> > >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> > >> 1.321 s]
> > >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> > >> 0.843 s]
> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> > >> 0.949 s]
> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> > >> 3.137 s]
> > >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> > >> 0.055 s]
> > >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> > >> 0.807 s]
> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> > >> 0.602 s]
> > >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> > >> 0.060 s]
> > >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> > >> 0.910 s]
> > >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> > >> 0.072 s]
> > >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> > >> 0.749 s]
> > >> [INFO]
> > >> ------------------------------------------------------------
> > ------------
> > >> [INFO] BUILD SUCCESS
> > >> [INFO]
> > >> ------------------------------------------------------------
> > ------------
> > >> [INFO] Total time: 06:02 min
> > >>
> > >> This doesn't happen every time when I run build on latest Hadoop
> trunk,
> > but
> > >> I can often see this happens.
> > >>
> > >> Thoughts about how to solve it?
> > >>
> > >> Thanks,
> > >> Wangda
> > >>
> > >>
> > >>
> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
> wrote:
> > >>>
> > >>> Thanks Wangda.
> > >>>
> > >>> To answer Steve's question, I don't think maven downloads anything
> from
> > >>> that location (it's a very old content). It just does a wasted effort
> > by
> > >>> hitting this repo.
> > >>>
> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>
> > wrote:
> > >>>>
> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> > >>>>
> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> > wrote:
> > >>>>>
> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
> file a
> > >>>>> HBase JIRA later.
> > >>>>>
> > >>>>> Regards,
> > >>>>> Wangda
> > >>>>>
> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> > stevel@hortonworks.com>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> HBase really ought to have a profile for D/Ling from somewhere
> like
> > >>>> this,
> > >>>>>> and, perhaps, list the ASF snapsphot repo first
> > >>>>>>
> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> > >>>>>>>
> > >>>>>>> Hi YARN-dev,
> > >>>>>>>
> > >>>>>>> (cc common-dev),
> > >>>>>>>
> > >>>>>>> YARN timeline service currently sometimes downloads
> > >>>> maven-metadata.xml
> > >>>>>> from
> > >>>>>>> a personal apache site, log looks like:
> > >>>>>>>
> > >>>>>>> [INFO] ------------------------------
> > ------------------------------
> > >>>>>>> ------------
> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> > >>>>>> 3.0.0-alpha2-SNAPSHOT
> > >>>>>>> [INFO] ------------------------------
> > ------------------------------
> > >>>>>>> ------------
> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
> > >>>> ache/hadoop/hadoop-client/3.
> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>> ...
> > >>>>>>> Downloading: http://people.apache.org/~
> > garyh/mvn/org/apache/hadoop/
> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>> ...
> > >>>>>>> Downloading: http://people.apache.org/~
> > garyh/mvn/org/apache/hadoop/
> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>>
> > >>>>>>> I noticed this happens for a while, I'm not sure if it causes by
> my
> > >>>>>> local
> > >>>>>>
> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them and
> then
> > >>>>>> going on to try the next repo?
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>>
> > >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Ted Yu <yu...@gmail.com>.
bq. out of which 1.2.4 is released
Actually 1.2.4 has already been released. 1.1.8 RC is being voted upon.
FYI
On Tue, Dec 13, 2016 at 5:48 PM, Sangjin Lee <sj...@gmail.com> wrote:
> According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
> which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
> 1.2.4 or later.
>
>
> Sangjin
>
> On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
> vchannapattan@twitter.com> wrote:
>
> > Yes, I think bumping up the hbase version to 1.2 should help with this
> > build time taken issue. I will start looking into this upgrade right
> > away.
> >
> > Thanks
> > Vrushali
> >
> > > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
> > >
> > > I could not reproduce this issue locally but this may be related to
> some
> > local maven repos. This may be related to the private repo issues of
> HBase?
> > If this is the case, bumping up hbase dependency version of YARN timeline
> > module might be helpful?
> > >
> > > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> > HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> > >
> > > Li Lu
> > >
> > >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
> > >>
> > >> Hi folks,
> > >>
> > >> It looks like HBASE-16749 is fixed, and Phoenix version is updated
> (per
> > >> Li). But I'm still experiencing slow build of ATSv2 component:
> > >>
> > >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> > >> 1.378 s]
> > >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> > >> 10.559 s]
> > >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> > >> 6.993 s]
> > >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> > >> 0.057 s]
> > >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> > >> 2.266 s]
> > >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> > >> 4.075 s]
> > >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> > >> 0.924 s]
> > >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> > >> 1.549 s]
> > >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> > [05:14
> > >> min]
> > >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> > >> 8.554 s]
> > >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> > >> 1.561 s]
> > >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> > >> 1.321 s]
> > >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> > >> 0.843 s]
> > >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> > >> 0.949 s]
> > >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> > >> 3.137 s]
> > >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> > >> 0.055 s]
> > >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> > >> 0.807 s]
> > >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> > >> 0.602 s]
> > >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> > >> 0.060 s]
> > >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> > >> 0.910 s]
> > >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> > >> 0.072 s]
> > >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> > >> 0.749 s]
> > >> [INFO]
> > >> ------------------------------------------------------------
> > ------------
> > >> [INFO] BUILD SUCCESS
> > >> [INFO]
> > >> ------------------------------------------------------------
> > ------------
> > >> [INFO] Total time: 06:02 min
> > >>
> > >> This doesn't happen every time when I run build on latest Hadoop
> trunk,
> > but
> > >> I can often see this happens.
> > >>
> > >> Thoughts about how to solve it?
> > >>
> > >> Thanks,
> > >> Wangda
> > >>
> > >>
> > >>
> > >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com>
> wrote:
> > >>>
> > >>> Thanks Wangda.
> > >>>
> > >>> To answer Steve's question, I don't think maven downloads anything
> from
> > >>> that location (it's a very old content). It just does a wasted effort
> > by
> > >>> hitting this repo.
> > >>>
> > >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>
> > wrote:
> > >>>>
> > >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> > >>>>
> > >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> > wrote:
> > >>>>>
> > >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will
> file a
> > >>>>> HBase JIRA later.
> > >>>>>
> > >>>>> Regards,
> > >>>>> Wangda
> > >>>>>
> > >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> > stevel@hortonworks.com>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> HBase really ought to have a profile for D/Ling from somewhere
> like
> > >>>> this,
> > >>>>>> and, perhaps, list the ASF snapsphot repo first
> > >>>>>>
> > >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> > >>>>>>>
> > >>>>>>> Hi YARN-dev,
> > >>>>>>>
> > >>>>>>> (cc common-dev),
> > >>>>>>>
> > >>>>>>> YARN timeline service currently sometimes downloads
> > >>>> maven-metadata.xml
> > >>>>>> from
> > >>>>>>> a personal apache site, log looks like:
> > >>>>>>>
> > >>>>>>> [INFO] ------------------------------
> > ------------------------------
> > >>>>>>> ------------
> > >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> > >>>>>> 3.0.0-alpha2-SNAPSHOT
> > >>>>>>> [INFO] ------------------------------
> > ------------------------------
> > >>>>>>> ------------
> > >>>>>>> Downloading: http://conjars.org/repo/org/ap
> > >>>> ache/hadoop/hadoop-client/3.
> > >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>> ...
> > >>>>>>> Downloading: http://people.apache.org/~
> > garyh/mvn/org/apache/hadoop/
> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>> ...
> > >>>>>>> Downloading: http://people.apache.org/~
> > garyh/mvn/org/apache/hadoop/
> > >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > >>>>>>>
> > >>>>>>> I noticed this happens for a while, I'm not sure if it causes by
> my
> > >>>>>> local
> > >>>>>>
> > >>>>>> is it actually D/Lin'g the files? Or is it looking for them and
> then
> > >>>>>> going on to try the next repo?
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>>
> > >>>
> > >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@gmail.com>.
According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
1.2.4 or later.
Sangjin
On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
vchannapattan@twitter.com> wrote:
> Yes, I think bumping up the hbase version to 1.2 should help with this
> build time taken issue. I will start looking into this upgrade right
> away.
>
> Thanks
> Vrushali
>
> > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
> >
> > I could not reproduce this issue locally but this may be related to some
> local maven repos. This may be related to the private repo issues of HBase?
> If this is the case, bumping up hbase dependency version of YARN timeline
> module might be helpful?
> >
> > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> >
> > Li Lu
> >
> >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
> >>
> >> Hi folks,
> >>
> >> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> >> Li). But I'm still experiencing slow build of ATSv2 component:
> >>
> >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> >> 1.378 s]
> >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> >> 10.559 s]
> >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> >> 6.993 s]
> >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> >> 0.057 s]
> >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> >> 2.266 s]
> >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> >> 4.075 s]
> >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> >> 0.924 s]
> >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> >> 1.549 s]
> >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> [05:14
> >> min]
> >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> >> 8.554 s]
> >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> >> 1.561 s]
> >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> >> 1.321 s]
> >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> >> 0.843 s]
> >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> >> 0.949 s]
> >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> >> 3.137 s]
> >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> >> 0.055 s]
> >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> >> 0.807 s]
> >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> >> 0.602 s]
> >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> >> 0.060 s]
> >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> >> 0.910 s]
> >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> >> 0.072 s]
> >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> >> 0.749 s]
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] Total time: 06:02 min
> >>
> >> This doesn't happen every time when I run build on latest Hadoop trunk,
> but
> >> I can often see this happens.
> >>
> >> Thoughts about how to solve it?
> >>
> >> Thanks,
> >> Wangda
> >>
> >>
> >>
> >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
> >>>
> >>> Thanks Wangda.
> >>>
> >>> To answer Steve's question, I don't think maven downloads anything from
> >>> that location (it's a very old content). It just does a wasted effort
> by
> >>> hitting this repo.
> >>>
> >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>>>
> >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>>>
> >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>>>>
> >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >>>>> HBase JIRA later.
> >>>>>
> >>>>> Regards,
> >>>>> Wangda
> >>>>>
> >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com>
> >>>>> wrote:
> >>>>>
> >>>>>> HBase really ought to have a profile for D/Ling from somewhere like
> >>>> this,
> >>>>>> and, perhaps, list the ASF snapsphot repo first
> >>>>>>
> >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >>>>>>>
> >>>>>>> Hi YARN-dev,
> >>>>>>>
> >>>>>>> (cc common-dev),
> >>>>>>>
> >>>>>>> YARN timeline service currently sometimes downloads
> >>>> maven-metadata.xml
> >>>>>> from
> >>>>>>> a personal apache site, log looks like:
> >>>>>>>
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> >>>>>> 3.0.0-alpha2-SNAPSHOT
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> Downloading: http://conjars.org/repo/org/ap
> >>>> ache/hadoop/hadoop-client/3.
> >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>>
> >>>>>>> I noticed this happens for a while, I'm not sure if it causes by my
> >>>>>> local
> >>>>>>
> >>>>>> is it actually D/Lin'g the files? Or is it looking for them and then
> >>>>>> going on to try the next repo?
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@gmail.com>.
According to HBASE-16749, the fix went into HBase 1.2.4 and 1.1.8 (out of
which 1.2.4 is released). To resolve this issue, we'd need to upgrade to
1.2.4 or later.
Sangjin
On Tue, Dec 13, 2016 at 3:41 PM, Vrushali Channapattan <
vchannapattan@twitter.com> wrote:
> Yes, I think bumping up the hbase version to 1.2 should help with this
> build time taken issue. I will start looking into this upgrade right
> away.
>
> Thanks
> Vrushali
>
> > On Dec 13, 2016, at 3:02 PM, Li Lu <ll...@gmail.com> wrote:
> >
> > I could not reproduce this issue locally but this may be related to some
> local maven repos. This may be related to the private repo issues of HBase?
> If this is the case, bumping up hbase dependency version of YARN timeline
> module might be helpful?
> >
> > +Sangjin, Vrushali, and Joep: In YARN-5976 we’re proposing to bump up
> HBase dependency version into 1.2. Shall we prioritize that JIRA? Thanks!
> >
> > Li Lu
> >
> >> On Dec 13, 2016, at 14:43, Wangda Tan <wh...@gmail.com> wrote:
> >>
> >> Hi folks,
> >>
> >> It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
> >> Li). But I'm still experiencing slow build of ATSv2 component:
> >>
> >> [INFO] Apache Hadoop YARN ................................. SUCCESS [
> >> 1.378 s]
> >> [INFO] Apache Hadoop YARN API ............................. SUCCESS [
> >> 10.559 s]
> >> [INFO] Apache Hadoop YARN Common .......................... SUCCESS [
> >> 6.993 s]
> >> [INFO] Apache Hadoop YARN Server .......................... SUCCESS [
> >> 0.057 s]
> >> [INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
> >> 2.266 s]
> >> [INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
> >> 4.075 s]
> >> [INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
> >> 0.924 s]
> >> [INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
> >> 1.549 s]
> >> [INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS
> [05:14
> >> min]
> >> [INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
> >> 8.554 s]
> >> [INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
> >> 1.561 s]
> >> [INFO] Apache Hadoop YARN Client .......................... SUCCESS [
> >> 1.321 s]
> >> [INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
> >> 0.843 s]
> >> [INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
> >> 0.949 s]
> >> [INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
> >> 3.137 s]
> >> [INFO] Apache Hadoop YARN Applications .................... SUCCESS [
> >> 0.055 s]
> >> [INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
> >> 0.807 s]
> >> [INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
> >> 0.602 s]
> >> [INFO] Apache Hadoop YARN Site ............................ SUCCESS [
> >> 0.060 s]
> >> [INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
> >> 0.910 s]
> >> [INFO] Apache Hadoop YARN UI .............................. SUCCESS [
> >> 0.072 s]
> >> [INFO] Apache Hadoop YARN Project ......................... SUCCESS [
> >> 0.749 s]
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------
> ------------
> >> [INFO] Total time: 06:02 min
> >>
> >> This doesn't happen every time when I run build on latest Hadoop trunk,
> but
> >> I can often see this happens.
> >>
> >> Thoughts about how to solve it?
> >>
> >> Thanks,
> >> Wangda
> >>
> >>
> >>
> >>> On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
> >>>
> >>> Thanks Wangda.
> >>>
> >>> To answer Steve's question, I don't think maven downloads anything from
> >>> that location (it's a very old content). It just does a wasted effort
> by
> >>> hitting this repo.
> >>>
> >>>> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>>>
> >>>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
> >>>>
> >>>>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com>
> wrote:
> >>>>>
> >>>>> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> >>>>> HBase JIRA later.
> >>>>>
> >>>>> Regards,
> >>>>> Wangda
> >>>>>
> >>>>> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <
> stevel@hortonworks.com>
> >>>>> wrote:
> >>>>>
> >>>>>> HBase really ought to have a profile for D/Ling from somewhere like
> >>>> this,
> >>>>>> and, perhaps, list the ASF snapsphot repo first
> >>>>>>
> >>>>>>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >>>>>>>
> >>>>>>> Hi YARN-dev,
> >>>>>>>
> >>>>>>> (cc common-dev),
> >>>>>>>
> >>>>>>> YARN timeline service currently sometimes downloads
> >>>> maven-metadata.xml
> >>>>>> from
> >>>>>>> a personal apache site, log looks like:
> >>>>>>>
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> [INFO] Building Apache Hadoop YARN Timeline Service
> >>>>>> 3.0.0-alpha2-SNAPSHOT
> >>>>>>> [INFO] ------------------------------
> ------------------------------
> >>>>>>> ------------
> >>>>>>> Downloading: http://conjars.org/repo/org/ap
> >>>> ache/hadoop/hadoop-client/3.
> >>>>>>> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>> ...
> >>>>>>> Downloading: http://people.apache.org/~
> garyh/mvn/org/apache/hadoop/
> >>>>>>> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >>>>>>>
> >>>>>>> I noticed this happens for a while, I'm not sure if it causes by my
> >>>>>> local
> >>>>>>
> >>>>>> is it actually D/Lin'g the files? Or is it looking for them and then
> >>>>>> going on to try the next repo?
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Hi folks,
It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
Li). But I'm still experiencing slow build of ATSv2 component:
[INFO] Apache Hadoop YARN ................................. SUCCESS [
1.378 s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [
10.559 s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [
6.993 s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [
0.057 s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
2.266 s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
4.075 s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
0.924 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
1.549 s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [05:14
min]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
8.554 s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
1.561 s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [
1.321 s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
0.843 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
0.949 s]
[INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
3.137 s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [
0.055 s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
0.807 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
0.602 s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [
0.060 s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
0.910 s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [
0.072 s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [
0.749 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 06:02 min
This doesn't happen every time when I run build on latest Hadoop trunk, but
I can often see this happens.
Thoughts about how to solve it?
Thanks,
Wangda
On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
> Thanks Wangda.
>
> To answer Steve's question, I don't think maven downloads anything from
> that location (it's a very old content). It just does a wasted effort by
> hitting this repo.
>
> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>
>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
>>
>> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
>> > HBase JIRA later.
>> >
>> > Regards,
>> > Wangda
>> >
>> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
>> > wrote:
>> >
>> >> HBase really ought to have a profile for D/Ling from somewhere like
>> this,
>> >> and, perhaps, list the ASF snapsphot repo first
>> >>
>> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>> >> >
>> >> > Hi YARN-dev,
>> >> >
>> >> > (cc common-dev),
>> >> >
>> >> > YARN timeline service currently sometimes downloads
>> maven-metadata.xml
>> >> from
>> >> > a personal apache site, log looks like:
>> >> >
>> >> > [INFO] ------------------------------------------------------------
>> >> > ------------
>> >> > [INFO] Building Apache Hadoop YARN Timeline Service
>> >> 3.0.0-alpha2-SNAPSHOT
>> >> > [INFO] ------------------------------------------------------------
>> >> > ------------
>> >> > Downloading: http://conjars.org/repo/org/ap
>> ache/hadoop/hadoop-client/3.
>> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> > ...
>> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> > ...
>> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> >
>> >> > I noticed this happens for a while, I'm not sure if it causes by my
>> >> local
>> >>
>> >> is it actually D/Lin'g the files? Or is it looking for them and then
>> >> going on to try the next repo?
>> >>
>> >
>> >
>>
>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Hi folks,
It looks like HBASE-16749 is fixed, and Phoenix version is updated (per
Li). But I'm still experiencing slow build of ATSv2 component:
[INFO] Apache Hadoop YARN ................................. SUCCESS [
1.378 s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [
10.559 s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [
6.993 s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [
0.057 s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [
2.266 s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [
4.075 s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [
0.924 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [
1.549 s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [05:14
min]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [
8.554 s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [
1.561 s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [
1.321 s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [
0.843 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [
0.949 s]
[INFO] Apache Hadoop YARN Timeline Service HBase tests .... SUCCESS [
3.137 s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [
0.055 s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [
0.807 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [
0.602 s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [
0.060 s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [
0.910 s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [
0.072 s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [
0.749 s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 06:02 min
This doesn't happen every time when I run build on latest Hadoop trunk, but
I can often see this happens.
Thoughts about how to solve it?
Thanks,
Wangda
On Tue, Oct 4, 2016 at 6:50 PM, Sangjin Lee <sj...@gmail.com> wrote:
> Thanks Wangda.
>
> To answer Steve's question, I don't think maven downloads anything from
> that location (it's a very old content). It just does a wasted effort by
> hitting this repo.
>
> On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
>
>> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>>
>> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
>>
>> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
>> > HBase JIRA later.
>> >
>> > Regards,
>> > Wangda
>> >
>> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
>> > wrote:
>> >
>> >> HBase really ought to have a profile for D/Ling from somewhere like
>> this,
>> >> and, perhaps, list the ASF snapsphot repo first
>> >>
>> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>> >> >
>> >> > Hi YARN-dev,
>> >> >
>> >> > (cc common-dev),
>> >> >
>> >> > YARN timeline service currently sometimes downloads
>> maven-metadata.xml
>> >> from
>> >> > a personal apache site, log looks like:
>> >> >
>> >> > [INFO] ------------------------------------------------------------
>> >> > ------------
>> >> > [INFO] Building Apache Hadoop YARN Timeline Service
>> >> 3.0.0-alpha2-SNAPSHOT
>> >> > [INFO] ------------------------------------------------------------
>> >> > ------------
>> >> > Downloading: http://conjars.org/repo/org/ap
>> ache/hadoop/hadoop-client/3.
>> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> > ...
>> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> > ...
>> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >> >
>> >> > I noticed this happens for a while, I'm not sure if it causes by my
>> >> local
>> >>
>> >> is it actually D/Lin'g the files? Or is it looking for them and then
>> >> going on to try the next repo?
>> >>
>> >
>> >
>>
>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@gmail.com>.
Thanks Wangda.
To answer Steve's question, I don't think maven downloads anything from
that location (it's a very old content). It just does a wasted effort by
hitting this repo.
On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>
> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
>
> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> > HBase JIRA later.
> >
> > Regards,
> > Wangda
> >
> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
> > wrote:
> >
> >> HBase really ought to have a profile for D/Ling from somewhere like
> this,
> >> and, perhaps, list the ASF snapsphot repo first
> >>
> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >> >
> >> > Hi YARN-dev,
> >> >
> >> > (cc common-dev),
> >> >
> >> > YARN timeline service currently sometimes downloads maven-metadata.xml
> >> from
> >> > a personal apache site, log looks like:
> >> >
> >> > [INFO] ------------------------------------------------------------
> >> > ------------
> >> > [INFO] Building Apache Hadoop YARN Timeline Service
> >> 3.0.0-alpha2-SNAPSHOT
> >> > [INFO] ------------------------------------------------------------
> >> > ------------
> >> > Downloading: http://conjars.org/repo/org/
> apache/hadoop/hadoop-client/3.
> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> > ...
> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> > ...
> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >
> >> > I noticed this happens for a while, I'm not sure if it causes by my
> >> local
> >>
> >> is it actually D/Lin'g the files? Or is it looking for them and then
> >> going on to try the next repo?
> >>
> >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@gmail.com>.
Thanks Wangda.
To answer Steve's question, I don't think maven downloads anything from
that location (it's a very old content). It just does a wasted effort by
hitting this repo.
On Mon, Oct 3, 2016 at 10:25 AM, Wangda Tan <wh...@gmail.com> wrote:
> Filed: https://issues.apache.org/jira/browse/HBASE-16749
>
> On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
>
> > Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> > HBase JIRA later.
> >
> > Regards,
> > Wangda
> >
> > On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
> > wrote:
> >
> >> HBase really ought to have a profile for D/Ling from somewhere like
> this,
> >> and, perhaps, list the ASF snapsphot repo first
> >>
> >> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >> >
> >> > Hi YARN-dev,
> >> >
> >> > (cc common-dev),
> >> >
> >> > YARN timeline service currently sometimes downloads maven-metadata.xml
> >> from
> >> > a personal apache site, log looks like:
> >> >
> >> > [INFO] ------------------------------------------------------------
> >> > ------------
> >> > [INFO] Building Apache Hadoop YARN Timeline Service
> >> 3.0.0-alpha2-SNAPSHOT
> >> > [INFO] ------------------------------------------------------------
> >> > ------------
> >> > Downloading: http://conjars.org/repo/org/
> apache/hadoop/hadoop-client/3.
> >> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> > ...
> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> > ...
> >> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> >> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >> >
> >> > I noticed this happens for a while, I'm not sure if it causes by my
> >> local
> >>
> >> is it actually D/Lin'g the files? Or is it looking for them and then
> >> going on to try the next repo?
> >>
> >
> >
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Filed: https://issues.apache.org/jira/browse/HBASE-16749
On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> HBase JIRA later.
>
> Regards,
> Wangda
>
> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
> wrote:
>
>> HBase really ought to have a profile for D/Ling from somewhere like this,
>> and, perhaps, list the ASF snapsphot repo first
>>
>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>> >
>> > Hi YARN-dev,
>> >
>> > (cc common-dev),
>> >
>> > YARN timeline service currently sometimes downloads maven-metadata.xml
>> from
>> > a personal apache site, log looks like:
>> >
>> > [INFO] ------------------------------------------------------------
>> > ------------
>> > [INFO] Building Apache Hadoop YARN Timeline Service
>> 3.0.0-alpha2-SNAPSHOT
>> > [INFO] ------------------------------------------------------------
>> > ------------
>> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
>> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> > ...
>> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> > ...
>> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >
>> > I noticed this happens for a while, I'm not sure if it causes by my
>> local
>>
>> is it actually D/Lin'g the files? Or is it looking for them and then
>> going on to try the next repo?
>>
>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Filed: https://issues.apache.org/jira/browse/HBASE-16749
On Mon, Oct 3, 2016 at 10:18 AM, Wangda Tan <wh...@gmail.com> wrote:
> Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a
> HBase JIRA later.
>
> Regards,
> Wangda
>
> On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
> wrote:
>
>> HBase really ought to have a profile for D/Ling from somewhere like this,
>> and, perhaps, list the ASF snapsphot repo first
>>
>> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>> >
>> > Hi YARN-dev,
>> >
>> > (cc common-dev),
>> >
>> > YARN timeline service currently sometimes downloads maven-metadata.xml
>> from
>> > a personal apache site, log looks like:
>> >
>> > [INFO] ------------------------------------------------------------
>> > ------------
>> > [INFO] Building Apache Hadoop YARN Timeline Service
>> 3.0.0-alpha2-SNAPSHOT
>> > [INFO] ------------------------------------------------------------
>> > ------------
>> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
>> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> > ...
>> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> > ...
>> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
>> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>> >
>> > I noticed this happens for a while, I'm not sure if it causes by my
>> local
>>
>> is it actually D/Lin'g the files? Or is it looking for them and then
>> going on to try the next repo?
>>
>
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a HBase
JIRA later.
Regards,
Wangda
On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
wrote:
> HBase really ought to have a profile for D/Ling from somewhere like this,
> and, perhaps, list the ASF snapsphot repo first
>
> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >
> > Hi YARN-dev,
> >
> > (cc common-dev),
> >
> > YARN timeline service currently sometimes downloads maven-metadata.xml
> from
> > a personal apache site, log looks like:
> >
> > [INFO] ------------------------------------------------------------
> > ------------
> > [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> > [INFO] ------------------------------------------------------------
> > ------------
> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >
> > I noticed this happens for a while, I'm not sure if it causes by my local
>
> is it actually D/Lin'g the files? Or is it looking for them and then going
> on to try the next repo?
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Sangjin/Ted/Steve for your comments/suggestions, I will file a HBase
JIRA later.
Regards,
Wangda
On Mon, Oct 3, 2016 at 4:43 AM, Steve Loughran <st...@hortonworks.com>
wrote:
> HBase really ought to have a profile for D/Ling from somewhere like this,
> and, perhaps, list the ASF snapsphot repo first
>
> On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
> >
> > Hi YARN-dev,
> >
> > (cc common-dev),
> >
> > YARN timeline service currently sometimes downloads maven-metadata.xml
> from
> > a personal apache site, log looks like:
> >
> > [INFO] ------------------------------------------------------------
> > ------------
> > [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> > [INFO] ------------------------------------------------------------
> > ------------
> > Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> > 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> > ...
> > Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> > hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> >
> > I noticed this happens for a while, I'm not sure if it causes by my local
>
> is it actually D/Lin'g the files? Or is it looking for them and then going
> on to try the next repo?
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Steve Loughran <st...@hortonworks.com>.
HBase really ought to have a profile for D/Ling from somewhere like this, and, perhaps, list the ASF snapsphot repo first
On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>
> Hi YARN-dev,
>
> (cc common-dev),
>
> YARN timeline service currently sometimes downloads maven-metadata.xml from
> a personal apache site, log looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> I noticed this happens for a while, I'm not sure if it causes by my local
is it actually D/Lin'g the files? Or is it looking for them and then going on to try the next repo?
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Sangjin Lee <sj...@apache.org>.
We should raise a JIRA. I suspect this is more of an hbase issue. I believe
it's coming from the hbase pom that contains a definition of that repo
(named "ghelmling.testing"). This would entail upgrading to a later version
of hbase that removes this repo. I don't think this is a major issue, but
it would be good to keep track of this. Wangda, could you kindly file a
JIRA for this?
I'm also cc'ing Gary to see if he is aware of a release that does not have
the repo definition.
Sangjin
On Sat, Oct 1, 2016 at 9:37 AM, Wangda Tan <wh...@gmail.com> wrote:
> Hi YARN-dev,
>
> (cc common-dev),
>
> YARN timeline service currently sometimes downloads maven-metadata.xml from
> a personal apache site, log looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> I noticed this happens for a while, I'm not sure if it causes by my local
> environment or not.
>
> I don't know if it could be a potential security issue, and this
> significantly slows my build, typically "mvn -DskipTests clean install"
> runs 1-2 mins on my laptop, but when it downloads files from "~garyh" link,
> it takes 8-9 mins.
>
> Please let me know if you also see this happens.
>
> Thanks,
> Wangda
>
Re: Maven build: YARN timeline service downloading maven-metadata
from personal repository?
Posted by Steve Loughran <st...@hortonworks.com>.
HBase really ought to have a profile for D/Ling from somewhere like this, and, perhaps, list the ASF snapsphot repo first
On 1 Oct 2016, at 17:37, Wangda Tan <wh...@gmail.com> wrote:
>
> Hi YARN-dev,
>
> (cc common-dev),
>
> YARN timeline service currently sometimes downloads maven-metadata.xml from
> a personal apache site, log looks like:
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Apache Hadoop YARN Timeline Service 3.0.0-alpha2-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> Downloading: http://conjars.org/repo/org/apache/hadoop/hadoop-client/3.
> 0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
> ...
> Downloading: http://people.apache.org/~garyh/mvn/org/apache/hadoop/
> hadoop-client/3.0.0-alpha2-SNAPSHOT/maven-metadata.xml
>
> I noticed this happens for a while, I'm not sure if it causes by my local
is it actually D/Lin'g the files? Or is it looking for them and then going on to try the next repo?
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org