You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Olaf Flebbe <of...@oflebbe.de> on 2016/02/20 17:13:48 UTC
3rdParty Repositories
Hi Cos,
Regarding BIGTOP-2336:
I made a list of 3rd party repositories from all packages which I would consider to be discussed.
Some of these might be false positives, since I made a simple grep and no parsing of actual pom.xml
Do we agree on which repositories our packages we should use and which to avoid ?
My first blacklist (avoiding) would be:
* All snapshot repositories
* *.com repositories
* *.io, *.cc
The whitelist (o.k. to use) would include jboss.org, apache.org, maven central, glassfish.org, datanucleus.org, jboss.org, eclipse.org
unclear to me:
sonatype.org, java.net
Olaf
----
./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.apache.org/snapshots</url>
./apache-mahout-distribution-0.11.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.mapr.com/maven</url>
./giraph-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
/kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>http://maven.twttr.com</url>
./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>http://maven.twttr.com</url>
./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
./kite-release-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./kite-release-1.1.0/pom.xml- <url>http://maven.twttr.com</url>
./kite-release-1.1.0/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
./zeppelin-0.5.5-incubating/lens/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./zeppelin-0.5.5-incubating/spark/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./zeppelin-0.5.5-incubating/spark-dependencies/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/groups/cdh-releases-rcs</url>
./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/repositories/snapshots</url>
./YCSB-0.1.4/mapkeeper/pom.xml- <url>https://raw.github.com/m1ch1/m1ch1-mvn-repo/master/releases</url>
./YCSB-0.1.4/nosqldb/pom.xml- <url>file:///Users/michi/.m2/repository</url>
./YCSB-0.1.4/voldemort/pom.xml- <url>http://clojars.org/repo</url>
./YCSB-0.1.4/gemfire/pom.xml- <url>http://dist.gemstone.com.s3.amazonaws.com/maven/release/</url>
./hama-0.7.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
tachyon :
<url>https://repository.apache.org/content/repositories/releases</url>
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
<url>http://repository.mapr.com/maven</url>
<url>http://repo.spring.io/libs-release</url>
<url>http://repo.hortonworks.com/content/repositories/releases/</url>
(!)
Re: 3rdParty Repositories
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Any updates on this? No rush -- I'm just curious.
Thanks,
Roman.
On Mon, Feb 22, 2016 at 7:19 AM, Konstantin Boudnik <co...@apache.org> wrote:
> Sounds like a plan. I'd +1 to enforce the list of repos.
>
> On Sat, Feb 20, 2016 at 05:13PM, Olaf Flebbe wrote:
>> Hi Cos,
>>
>> Regarding BIGTOP-2336:
>>
>> I made a list of 3rd party repositories from all packages which I would consider to be discussed.
>>
>> Some of these might be false positives, since I made a simple grep and no parsing of actual pom.xml
>>
>> Do we agree on which repositories our packages we should use and which to avoid ?
>>
>> My first blacklist (avoiding) would be:
>>
>> * All snapshot repositories
>> * *.com repositories
>> * *.io, *.cc
>>
>> The whitelist (o.k. to use) would include jboss.org, apache.org, maven central, glassfish.org, datanucleus.org, jboss.org, eclipse.org
>>
>> unclear to me:
>> sonatype.org, java.net
>>
>> Olaf
>>
>>
>>
>> ----
>>
>>
>> ./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.apache.org/snapshots</url>
>> ./apache-mahout-distribution-0.11.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.mapr.com/maven</url>
>>
>> ./giraph-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>>
>> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
>> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
>>
>>
>> /kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>http://maven.twttr.com</url>
>> ./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
>> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>http://maven.twttr.com</url>
>> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
>> ./kite-release-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./kite-release-1.1.0/pom.xml- <url>http://maven.twttr.com</url>
>> ./kite-release-1.1.0/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
>>
>>
>> ./zeppelin-0.5.5-incubating/lens/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./zeppelin-0.5.5-incubating/spark/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> ./zeppelin-0.5.5-incubating/spark-dependencies/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>>
>>
>>
>> ./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/groups/cdh-releases-rcs</url>
>> ./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/repositories/snapshots</url>
>>
>> ./YCSB-0.1.4/mapkeeper/pom.xml- <url>https://raw.github.com/m1ch1/m1ch1-mvn-repo/master/releases</url>
>> ./YCSB-0.1.4/nosqldb/pom.xml- <url>file:///Users/michi/.m2/repository</url>
>> ./YCSB-0.1.4/voldemort/pom.xml- <url>http://clojars.org/repo</url>
>> ./YCSB-0.1.4/gemfire/pom.xml- <url>http://dist.gemstone.com.s3.amazonaws.com/maven/release/</url>
>>
>> ./hama-0.7.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>>
>>
>> tachyon :
>> <url>https://repository.apache.org/content/repositories/releases</url>
>> <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>> <url>http://repository.mapr.com/maven</url>
>> <url>http://repo.spring.io/libs-release</url>
>> <url>http://repo.hortonworks.com/content/repositories/releases/</url>
>>
>> (!)
>>
>>
>>
>
>
Re: 3rdParty Repositories
Posted by Konstantin Boudnik <co...@apache.org>.
Sounds like a plan. I'd +1 to enforce the list of repos.
On Sat, Feb 20, 2016 at 05:13PM, Olaf Flebbe wrote:
> Hi Cos,
>
> Regarding BIGTOP-2336:
>
> I made a list of 3rd party repositories from all packages which I would consider to be discussed.
>
> Some of these might be false positives, since I made a simple grep and no parsing of actual pom.xml
>
> Do we agree on which repositories our packages we should use and which to avoid ?
>
> My first blacklist (avoiding) would be:
>
> * All snapshot repositories
> * *.com repositories
> * *.io, *.cc
>
> The whitelist (o.k. to use) would include jboss.org, apache.org, maven central, glassfish.org, datanucleus.org, jboss.org, eclipse.org
>
> unclear to me:
> sonatype.org, java.net
>
> Olaf
>
>
>
> ----
>
>
> ./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.apache.org/snapshots</url>
> ./apache-mahout-distribution-0.11.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./apache-mahout-distribution-0.11.0/pom.xml- <url>http://repository.mapr.com/maven</url>
>
> ./giraph-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>
> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-dataset-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
> ./apache-flume-1.6.0-src/flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml- <url>https://repository.cloudera.com/artifactory/libs-snapshot-local</url>
>
>
> /kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>http://maven.twttr.com</url>
> ./kite-release-1.1.0/kite-app-parent/cdh5/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>http://maven.twttr.com</url>
> ./kite-release-1.1.0/kite-app-parent/cdh4/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
> ./kite-release-1.1.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./kite-release-1.1.0/pom.xml- <url>http://maven.twttr.com</url>
> ./kite-release-1.1.0/pom.xml- <url>https://oss.sonatype.org/service/local/staging/deploy/maven2/</url>
>
>
> ./zeppelin-0.5.5-incubating/lens/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./zeppelin-0.5.5-incubating/spark/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> ./zeppelin-0.5.5-incubating/spark-dependencies/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
>
>
>
> ./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/groups/cdh-releases-rcs</url>
> ./hue-release-3.9.0/maven/pom.xml- <url>https://repository.cloudera.com/content/repositories/snapshots</url>
>
> ./YCSB-0.1.4/mapkeeper/pom.xml- <url>https://raw.github.com/m1ch1/m1ch1-mvn-repo/master/releases</url>
> ./YCSB-0.1.4/nosqldb/pom.xml- <url>file:///Users/michi/.m2/repository</url>
> ./YCSB-0.1.4/voldemort/pom.xml- <url>http://clojars.org/repo</url>
> ./YCSB-0.1.4/gemfire/pom.xml- <url>http://dist.gemstone.com.s3.amazonaws.com/maven/release/</url>
>
> ./hama-0.7.0/pom.xml- <url>https://repository.cloudera.com/artifactory/cloudera-repos</url>
>
>
> tachyon :
> <url>https://repository.apache.org/content/repositories/releases</url>
> <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
> <url>http://repository.mapr.com/maven</url>
> <url>http://repo.spring.io/libs-release</url>
> <url>http://repo.hortonworks.com/content/repositories/releases/</url>
>
> (!)
>
>
>