You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by 祝美祺 <me...@gmail.com> on 2011/02/24 14:43:33 UTC
error: UNRESOLVED DEPENDENCIES
when i try to compile mapred of 0.21.0
I got error:
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0
[ivy:resolve] ==== apache-snapshot: tried
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
[ivy:resolve] ==== maven2: tried
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-common-test;0.21.0
[ivy:resolve] ==== apache-snapshot: tried
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
[ivy:resolve] ==== maven2: tried
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
[ivy:resolve] module not found: org.apache.hadoop#hadoop-hdfs;0.21.0
[ivy:resolve] ==== apache-snapshot: tried
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
[ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
[ivy:resolve] ==== maven2: tried
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
[ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.apache.hadoop#hadoop-common;0.21.0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-common-test;0.21.0: not found
[ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
BUILD FAILED
/data0/hadoop-0.21.0/mapred/build.xml:1861: impossible to resolve
dependencies:
resolve failed - see output for details
any ideas?
Re: WholeFileInputFormat
Posted by Harsh J <qw...@gmail.com>.
Hi,
On Fri, Feb 25, 2011 at 4:31 AM, Mohamed Riadh Trad
<Mo...@inria.fr> wrote:
> Dear All,
> Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?
1. Create new class extending FileInputFormat<K, V> (or its other derivatives)
2. Override isSplitable to return false.
3. Provide a record reader according to your needs, if necessary.
3. Done.
Here's a series of gists I could find for reference (authored by Sam
Ritchie, no idea on the license): https://gist.github.com/808035
--
Harsh J
www.harshj.com
WholeFileInputFormat
Posted by Mohamed Riadh Trad <Mo...@inria.fr>.
Dear All,
Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api?
Best Regards,
Trad Mohamed Riadh, M.Sc, Ing.
PhD. student
INRIA-TELECOM PARISTECH
Office: 11-15
Phone: (33)-1 39 63 59 33
Fax: (33)-1 39 63 56 74
Email: riadh.trad@inria.fr
Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/
Re: error: UNRESOLVED DEPENDENCIES
Posted by Johannes Zillmann <jz...@googlemail.com>.
Not sure, but you could try to execute
ant clean clean-cache mvn-install
in the common project before. This would install the common artifacet into the local ivy repo.
Johannes
On Feb 24, 2011, at 3:49 PM, 祝美祺 wrote:
> Thanks,
> i don't think so . i can visit http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/ but there is no file hadoop-common-0.21.0.pom .
>
> so who can tell me how to solve this problem.
>
> 在 2011年2月24日 下午10:41，li ping <li...@gmail.com>写道：
> GFW, you knew that.
>
>
> On Thu, Feb 24, 2011 at 9:43 PM, 祝美祺 <me...@gmail.com> wrote:
> when i try to compile mapred of 0.21.0
> I got error:
>
> [ivy:resolve] :: problems summary ::
> [ivy:resolve] :::: WARNINGS
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
>
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
>
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common-test;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
>
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
>
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-hdfs;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
> [ivy:resolve]
>
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
>
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
>
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
> [ivy:resolve]
>
> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
>
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] :: org.apache.hadoop#hadoop-common;0.21.0: not found
> [ivy:resolve] :: org.apache.hadoop#hadoop-common-test;0.21.0: not found
> [ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve]
> [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
>
> BUILD FAILED
> /data0/hadoop-0.21.0/mapred/build.xml:1861: impossible to resolve
> dependencies:
> resolve failed - see output for details
>
> any ideas?
>
>
>
>
> --
> -----李平
>
Re: error: UNRESOLVED DEPENDENCIES
Posted by 祝美祺 <me...@gmail.com>.
Thanks,
i don't think so . i can visit
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/<http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom>but
there is no file
hadoop-common-0.21.0.pom<https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom>.
so who can tell me how to solve this problem.
在 2011年2月24日 下午10:41，li ping <li...@gmail.com>写道：
> GFW, you knew that.
>
>
> On Thu, Feb 24, 2011 at 9:43 PM, 祝美祺 <me...@gmail.com> wrote:
>
>> when i try to compile mapred of 0.21.0
>>
>> I got error:
>>
>> [ivy:resolve] :: problems summary ::
>> [ivy:resolve] :::: WARNINGS
>> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0
>> [ivy:resolve] ==== apache-snapshot: tried
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
>> [ivy:resolve] ==== maven2: tried
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
>> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common-test;0.21.0
>> [ivy:resolve] ==== apache-snapshot: tried
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
>> [ivy:resolve] ==== maven2: tried
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
>> [ivy:resolve] module not found: org.apache.hadoop#hadoop-hdfs;0.21.0
>> [ivy:resolve] ==== apache-snapshot: tried
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
>> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
>> [ivy:resolve] ==== maven2: tried
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
>> [ivy:resolve] -- artifact
>> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
>> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
>> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
>> [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
>> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
>> [ivy:resolve] :: org.apache.hadoop#hadoop-common;0.21.0: not found
>> [ivy:resolve] :: org.apache.hadoop#hadoop-common-test;0.21.0: not found
>> [ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
>> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
>> [ivy:resolve]
>> [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
>>
>> BUILD FAILED
>> /data0/hadoop-0.21.0/mapred/build.xml:1861: impossible to resolve
>> dependencies:
>> resolve failed - see output for details
>>
>> any ideas?
>>
>>
>
>
> --
> -----李平
>
Re: error: UNRESOLVED DEPENDENCIES
Posted by li ping <li...@gmail.com>.
GFW, you knew that.
On Thu, Feb 24, 2011 at 9:43 PM, 祝美祺 <me...@gmail.com> wrote:
> when i try to compile mapred of 0.21.0
>
> I got error:
>
> [ivy:resolve] :: problems summary ::
> [ivy:resolve] :::: WARNINGS
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common;0.21.0!hadoop-common.jar:
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/hadoop-common-0.21.0.jar
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-common-test;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-common-test;0.21.0!hadoop-common-test.jar:
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common-test/0.21.0/hadoop-common-test-0.21.0.jar
> [ivy:resolve] module not found: org.apache.hadoop#hadoop-hdfs;0.21.0
> [ivy:resolve] ==== apache-snapshot: tried
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
> [ivy:resolve]https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
> [ivy:resolve] ==== maven2: tried
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.pom
> [ivy:resolve] -- artifact
> org.apache.hadoop#hadoop-hdfs;0.21.0!hadoop-hdfs.jar:
> [ivy:resolve]http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.21.0/hadoop-hdfs-0.21.0.jar
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve] :: org.apache.hadoop#hadoop-common;0.21.0: not found
> [ivy:resolve] :: org.apache.hadoop#hadoop-common-test;0.21.0: not found
> [ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.21.0: not found
> [ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
> [ivy:resolve]
> [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
>
> BUILD FAILED
> /data0/hadoop-0.21.0/mapred/build.xml:1861: impossible to resolve
> dependencies:
> resolve failed - see output for details
>
> any ideas?
>
>
--
-----李平