You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2012/10/30 18:00:14 UTC

[jira] [Created] (GIRAPH-392) Can't build hadoop 0.23+ profiles

Roman Shaposhnik created GIRAPH-392:
---------------------------------------

             Summary: Can't build hadoop 0.23+ profiles
                 Key: GIRAPH-392
                 URL: https://issues.apache.org/jira/browse/GIRAPH-392
             Project: Giraph
          Issue Type: Bug
          Components: build
    Affects Versions: 0.2.0
            Reporter: Roman Shaposhnik
            Assignee: Roman Shaposhnik
            Priority: Blocker
             Fix For: 0.2.0


{noformat}
$ mvn -Phadoop_2.0.2 -DskipTests clean install
......
[WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information available
[WARNING] The POM for org.apache.hadoop:hadoop-test:jar:2.0.2-alpha is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Giraph Parent .............................. SUCCESS [0.446s]
[INFO] Apache Giraph ..................................... SUCCESS [1:00.793s]
[INFO] Apache Giraph Formats ............................. FAILURE [0.509s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:01.960s
[INFO] Finished at: Tue Oct 30 09:59:01 PDT 2012
[INFO] Final Memory: 69M/719M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project giraph-formats-contrib: Could not resolve dependencies for project org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-test:jar:2.0.2-alpha in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :giraph-formats-contrib
{noformat}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-392) Can't build hadoop 0.23+ profiles

Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495584#comment-13495584 ] 

Eugene Koontz commented on GIRAPH-392:
--------------------------------------

Hi Roman, thanks for your comment in GIRAPH-418. Pasting it in here too.

bq. Bigtop has integrated running Giraph tests against Hadoop 2.X. You can take a look at how we're doing it wrt. testdata, etc: https://git-wip-us.apache.org/repos/asf?p=bigtop.git;a=blob;f=bigtop-tests/test-artifacts/giraph/src/main/groovy/org/apache/bigtop/itest/giraphsmoke/TestGiraphSmoke.groovy;h=dd82c2f01c9c403847ad15c59975d768f86f23e9;hb=HEAD


                
> Can't build hadoop 0.23+ profiles
> ---------------------------------
>
>                 Key: GIRAPH-392
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-392
>             Project: Giraph
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.2.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: 0.2.0
>
>
> {noformat}
> $ mvn -Phadoop_2.0.2 -DskipTests clean install
> ......
> [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information available
> [WARNING] The POM for org.apache.hadoop:hadoop-test:jar:2.0.2-alpha is missing, no dependency information available
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Giraph Parent .............................. SUCCESS [0.446s]
> [INFO] Apache Giraph ..................................... SUCCESS [1:00.793s]
> [INFO] Apache Giraph Formats ............................. FAILURE [0.509s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:01.960s
> [INFO] Finished at: Tue Oct 30 09:59:01 PDT 2012
> [INFO] Final Memory: 69M/719M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not resolve dependencies for project org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-test:jar:2.0.2-alpha in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :giraph-formats-contrib
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-392) Can't build hadoop 0.23+ profiles

Posted by "Roman Shaposhnik (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487139#comment-13487139 ] 

Roman Shaposhnik commented on GIRAPH-392:
-----------------------------------------

One option is to disable giraph-formats-contrib altogether for new Hadoop profiles (we can't make accumulo work anyway since the upstream accumulo only supports 0.20.205). However, it looks like making hcatalog work shouldn't be that difficult and that leaves us with HBase. On one hand, it shouldn't be that difficult to make it work, but that would require a workaround of an HBase artifacts built against particular Hadoop ones available in local maven cache.

What would be the preferred way of moving forward here?
                
> Can't build hadoop 0.23+ profiles
> ---------------------------------
>
>                 Key: GIRAPH-392
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-392
>             Project: Giraph
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.2.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: 0.2.0
>
>
> {noformat}
> $ mvn -Phadoop_2.0.2 -DskipTests clean install
> ......
> [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information available
> [WARNING] The POM for org.apache.hadoop:hadoop-test:jar:2.0.2-alpha is missing, no dependency information available
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Giraph Parent .............................. SUCCESS [0.446s]
> [INFO] Apache Giraph ..................................... SUCCESS [1:00.793s]
> [INFO] Apache Giraph Formats ............................. FAILURE [0.509s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:01.960s
> [INFO] Finished at: Tue Oct 30 09:59:01 PDT 2012
> [INFO] Final Memory: 69M/719M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not resolve dependencies for project org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-test:jar:2.0.2-alpha in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :giraph-formats-contrib
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-392) Can't build hadoop 0.23+ profiles

Posted by "Nitay Joffe (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/GIRAPH-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492232#comment-13492232 ] 

Nitay Joffe commented on GIRAPH-392:
------------------------------------

Yeah I think we should only put formats in the profiles that can build it / need it for now. I can whip up a quick diff to do this. Then if you guys want to add it for e.g. Hadoop 2.0.1 you can always put it back in.
                
> Can't build hadoop 0.23+ profiles
> ---------------------------------
>
>                 Key: GIRAPH-392
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-392
>             Project: Giraph
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 0.2.0
>            Reporter: Roman Shaposhnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: 0.2.0
>
>
> {noformat}
> $ mvn -Phadoop_2.0.2 -DskipTests clean install
> ......
> [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, no dependency information available
> [WARNING] The POM for org.apache.hadoop:hadoop-test:jar:2.0.2-alpha is missing, no dependency information available
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Giraph Parent .............................. SUCCESS [0.446s]
> [INFO] Apache Giraph ..................................... SUCCESS [1:00.793s]
> [INFO] Apache Giraph Formats ............................. FAILURE [0.509s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:01.960s
> [INFO] Finished at: Tue Oct 30 09:59:01 PDT 2012
> [INFO] Final Memory: 69M/719M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project giraph-formats-contrib: Could not resolve dependencies for project org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-test:jar:2.0.2-alpha in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :giraph-formats-contrib
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira