You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Marc Harris <mh...@jumptap.com> on 2008/02/01 16:52:34 UTC
Hadoop and maven
Are the client jars available in a place like ibiblio or repo1.maven.org
so that they can easily be used with maven builds? It's kind of a pain
having to deploy them into my local repository every time a new version
becomes available.
- Marc
Re: Hadoop and maven
Posted by Ted Dunning <td...@veoh.com>.
Certainly if publishing to maven makes it easier for some people to use
hadoop, then it is a good thing.
IT doesn't matter if I never use maven. It doesn't cost me anything.
It does matter that it helps others.
On 2/4/08 11:13 AM, "Fernando Padilla" <fe...@alum.mit.edu> wrote:
> I certainly use maven. And even those who don't like it all agree that
> the dependency management part of maven is totally great and required.
> Some people always propose Ivy as an alternative to maven, but it still
> uses maven repositories; it's an Ant like system, with support for Maven
> dependency repositories.
>
> So yes. please publish to the Maven repositories! :)
>
> These will be used by:
> a) maven users
> b) Ivy users
> c) or just someone (like me) searching for an easy way to find official
> versions by searching through http://mvnrepository.com; instead of
> trying to figure out what webpage where contains the mirror link to
> the ftp server that contains..... :) :)
> d) anyone else?
>
>
>
> Marc Harris wrote:
>> What do the developers think? Is officially publishing artifacts a good
>> idea (and worth the time)? Believe me I am no fan of maven, but when a
>> company decision has been made to switch to maven for builds,
>> incorporating jars that are not available directly through maven seems
>> like a real chore.
>>
>> - Marc
>>
>> On Fri, 2008-02-01 at 16:33 +0000, David Alves wrote:
>>
>>> Hi Marc
>>>
>>> No they aren't. I Have the same problem myself.
>>> As a workaround I have built a maven pom that installs hadoop & hbase as
>>> well as other libs onto my local.
>>> This pom runs in special profile that I only run when I do updates.
>>> This has the advantage of being available to anyone (instead of each
>>> doing the update by hand/batch file).
>>> If you wish to deploy it onto a remote repository just replace/add
>>> install, install-file with deploy deploy-file.
>>>
>>>
>>> Here goes the pom:
>>>
>>> <project xmlns="http://maven.apache.org/POM/4.0.0"
>>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>>> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
>>> http://maven.apache.org/xsd/maven-4.0.0.xsd">
>>> <modelVersion>4.0.0</modelVersion>
>>> <groupId>org.apache.hadoop</groupId>
>>> <artifactId>hadoop</artifactId>
>>> <name>Hadoop/HBase Library (${hadoop.version})</name>
>>> <packaging>jar</packaging>
>>> <version>${hadoop.version}</version>
>>> <build>
>>> <plugins>
>>> <plugin>
>>> <artifactId>maven-install-plugin</artifactId>
>>> <executions>
>>> <execution>
>>> <id>install-hadoop</id>
>>> <phase>install</phase>
>>> <goals>
>>> <goal>install-file</goal>
>>> </goals>
>>> <configuration>
>>> <file>hadoop-${hadoop.version}-core.jar</file>
>>> <groupId>org.apache.hadoop</groupId>
>>> <artifactId>hadoop-core</artifactId>
>>> <packaging>jar</packaging>
>>> <version>${hadoop.version}</version>
>>> <generatePom>true</generatePom>
>>> <createChecksum>true</createChecksum>
>>> </configuration>
>>> </execution>
>>> <execution>
>>> <id>install-hbase</id>
>>> <phase>install</phase>
>>> <goals>
>>> <goal>install-file</goal>
>>> </goals>
>>> <configuration>
>>> <file>hadoop-${hadoop.version}-hbase.jar</file>
>>> <groupId>org.apache.hadoop</groupId>
>>> <artifactId>hadoop-hbase</artifactId>
>>> <packaging>jar</packaging>
>>> <version>${hadoop.version}</version>
>>> <generatePom>true</generatePom>
>>> <createChecksum>true</createChecksum>
>>> </configuration>
>>> </execution>
>>> </executions>
>>> </plugin>
>>> </plugins>
>>> </build>
>>> </project>
>>>
>>> Hope it helps.
>>>
>>> David Alves
>>>
>>>
>>>
>>>
>>>
>>> On Fri, 2008-02-01 at 10:52 -0500, Marc Harris wrote:
>>>> Are the client jars available in a place like ibiblio or repo1.maven.org
>>>> so that they can easily be used with maven builds? It's kind of a pain
>>>> having to deploy them into my local repository every time a new version
>>>> becomes available.
>>>>
>>>> - Marc
>>>>
>>
Re: Hadoop and maven
Posted by Fernando Padilla <fe...@alum.mit.edu>.
I certainly use maven. And even those who don't like it all agree that
the dependency management part of maven is totally great and required.
Some people always propose Ivy as an alternative to maven, but it still
uses maven repositories; it's an Ant like system, with support for Maven
dependency repositories.
So yes. please publish to the Maven repositories! :)
These will be used by:
a) maven users
b) Ivy users
c) or just someone (like me) searching for an easy way to find official
versions by searching through http://mvnrepository.com; instead of
trying to figure out what webpage where contains the mirror link to
the ftp server that contains..... :) :)
d) anyone else?
Marc Harris wrote:
> What do the developers think? Is officially publishing artifacts a good
> idea (and worth the time)? Believe me I am no fan of maven, but when a
> company decision has been made to switch to maven for builds,
> incorporating jars that are not available directly through maven seems
> like a real chore.
>
> - Marc
>
> On Fri, 2008-02-01 at 16:33 +0000, David Alves wrote:
>
>> Hi Marc
>>
>> No they aren't. I Have the same problem myself.
>> As a workaround I have built a maven pom that installs hadoop & hbase as
>> well as other libs onto my local.
>> This pom runs in special profile that I only run when I do updates.
>> This has the advantage of being available to anyone (instead of each
>> doing the update by hand/batch file).
>> If you wish to deploy it onto a remote repository just replace/add
>> install, install-file with deploy deploy-file.
>>
>>
>> Here goes the pom:
>>
>> <project xmlns="http://maven.apache.org/POM/4.0.0"
>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
>> http://maven.apache.org/xsd/maven-4.0.0.xsd">
>> <modelVersion>4.0.0</modelVersion>
>> <groupId>org.apache.hadoop</groupId>
>> <artifactId>hadoop</artifactId>
>> <name>Hadoop/HBase Library (${hadoop.version})</name>
>> <packaging>jar</packaging>
>> <version>${hadoop.version}</version>
>> <build>
>> <plugins>
>> <plugin>
>> <artifactId>maven-install-plugin</artifactId>
>> <executions>
>> <execution>
>> <id>install-hadoop</id>
>> <phase>install</phase>
>> <goals>
>> <goal>install-file</goal>
>> </goals>
>> <configuration>
>> <file>hadoop-${hadoop.version}-core.jar</file>
>> <groupId>org.apache.hadoop</groupId>
>> <artifactId>hadoop-core</artifactId>
>> <packaging>jar</packaging>
>> <version>${hadoop.version}</version>
>> <generatePom>true</generatePom>
>> <createChecksum>true</createChecksum>
>> </configuration>
>> </execution>
>> <execution>
>> <id>install-hbase</id>
>> <phase>install</phase>
>> <goals>
>> <goal>install-file</goal>
>> </goals>
>> <configuration>
>> <file>hadoop-${hadoop.version}-hbase.jar</file>
>> <groupId>org.apache.hadoop</groupId>
>> <artifactId>hadoop-hbase</artifactId>
>> <packaging>jar</packaging>
>> <version>${hadoop.version}</version>
>> <generatePom>true</generatePom>
>> <createChecksum>true</createChecksum>
>> </configuration>
>> </execution>
>> </executions>
>> </plugin>
>> </plugins>
>> </build>
>> </project>
>>
>> Hope it helps.
>>
>> David Alves
>>
>>
>>
>>
>>
>> On Fri, 2008-02-01 at 10:52 -0500, Marc Harris wrote:
>>> Are the client jars available in a place like ibiblio or repo1.maven.org
>>> so that they can easily be used with maven builds? It's kind of a pain
>>> having to deploy them into my local repository every time a new version
>>> becomes available.
>>>
>>> - Marc
>>>
>
Re: Hadoop and maven
Posted by Marc Harris <mh...@jumptap.com>.
What do the developers think? Is officially publishing artifacts a good
idea (and worth the time)? Believe me I am no fan of maven, but when a
company decision has been made to switch to maven for builds,
incorporating jars that are not available directly through maven seems
like a real chore.
- Marc
On Fri, 2008-02-01 at 16:33 +0000, David Alves wrote:
> Hi Marc
>
> No they aren't. I Have the same problem myself.
> As a workaround I have built a maven pom that installs hadoop & hbase as
> well as other libs onto my local.
> This pom runs in special profile that I only run when I do updates.
> This has the advantage of being available to anyone (instead of each
> doing the update by hand/batch file).
> If you wish to deploy it onto a remote repository just replace/add
> install, install-file with deploy deploy-file.
>
>
> Here goes the pom:
>
> <project xmlns="http://maven.apache.org/POM/4.0.0"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
> http://maven.apache.org/xsd/maven-4.0.0.xsd">
> <modelVersion>4.0.0</modelVersion>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>hadoop</artifactId>
> <name>Hadoop/HBase Library (${hadoop.version})</name>
> <packaging>jar</packaging>
> <version>${hadoop.version}</version>
> <build>
> <plugins>
> <plugin>
> <artifactId>maven-install-plugin</artifactId>
> <executions>
> <execution>
> <id>install-hadoop</id>
> <phase>install</phase>
> <goals>
> <goal>install-file</goal>
> </goals>
> <configuration>
> <file>hadoop-${hadoop.version}-core.jar</file>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>hadoop-core</artifactId>
> <packaging>jar</packaging>
> <version>${hadoop.version}</version>
> <generatePom>true</generatePom>
> <createChecksum>true</createChecksum>
> </configuration>
> </execution>
> <execution>
> <id>install-hbase</id>
> <phase>install</phase>
> <goals>
> <goal>install-file</goal>
> </goals>
> <configuration>
> <file>hadoop-${hadoop.version}-hbase.jar</file>
> <groupId>org.apache.hadoop</groupId>
> <artifactId>hadoop-hbase</artifactId>
> <packaging>jar</packaging>
> <version>${hadoop.version}</version>
> <generatePom>true</generatePom>
> <createChecksum>true</createChecksum>
> </configuration>
> </execution>
> </executions>
> </plugin>
> </plugins>
> </build>
> </project>
>
> Hope it helps.
>
> David Alves
>
>
>
>
>
> On Fri, 2008-02-01 at 10:52 -0500, Marc Harris wrote:
> > Are the client jars available in a place like ibiblio or repo1.maven.org
> > so that they can easily be used with maven builds? It's kind of a pain
> > having to deploy them into my local repository every time a new version
> > becomes available.
> >
> > - Marc
> >
>
Re: Hadoop and maven
Posted by David Alves <dr...@criticalsoftware.com>.
Hi Marc
No they aren't. I Have the same problem myself.
As a workaround I have built a maven pom that installs hadoop & hbase as
well as other libs onto my local.
This pom runs in special profile that I only run when I do updates.
This has the advantage of being available to anyone (instead of each
doing the update by hand/batch file).
If you wish to deploy it onto a remote repository just replace/add
install, install-file with deploy deploy-file.
Here goes the pom:
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop</artifactId>
<name>Hadoop/HBase Library (${hadoop.version})</name>
<packaging>jar</packaging>
<version>${hadoop.version}</version>
<build>
<plugins>
<plugin>
<artifactId>maven-install-plugin</artifactId>
<executions>
<execution>
<id>install-hadoop</id>
<phase>install</phase>
<goals>
<goal>install-file</goal>
</goals>
<configuration>
<file>hadoop-${hadoop.version}-core.jar</file>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<packaging>jar</packaging>
<version>${hadoop.version}</version>
<generatePom>true</generatePom>
<createChecksum>true</createChecksum>
</configuration>
</execution>
<execution>
<id>install-hbase</id>
<phase>install</phase>
<goals>
<goal>install-file</goal>
</goals>
<configuration>
<file>hadoop-${hadoop.version}-hbase.jar</file>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-hbase</artifactId>
<packaging>jar</packaging>
<version>${hadoop.version}</version>
<generatePom>true</generatePom>
<createChecksum>true</createChecksum>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
</build>
</project>
Hope it helps.
David Alves
On Fri, 2008-02-01 at 10:52 -0500, Marc Harris wrote:
> Are the client jars available in a place like ibiblio or repo1.maven.org
> so that they can easily be used with maven builds? It's kind of a pain
> having to deploy them into my local repository every time a new version
> becomes available.
>
> - Marc
>