You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Ryota Egashira (JIRA)" <ji...@apache.org> on 2012/11/28 23:37:58 UTC
[jira] [Created] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Ryota Egashira created OOZIE-1100:
-------------------------------------
Summary: HFTP coordinator input check fails due to missing commons-httpclient.jar
Key: OOZIE-1100
URL: https://issues.apache.org/jira/browse/OOZIE-1100
Project: Oozie
Issue Type: Bug
Affects Versions: 3.2.0, 3.3.0, trunk
Reporter: Ryota Egashira
Assignee: Ryota Egashira
Fix For: 3.3.0, trunk
when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
-----
HadoopAccessorService.createFileSystem(user, path.toUri(),
fsConf).exists(path)
-----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506920#comment-13506920 ]
Alejandro Abdelnur commented on OOZIE-1100:
-------------------------------------------
We should open a bug against Hadoop both hadoop 1 and hadoop 2 so hadoop-client POM includes this dependency in the future
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (OOZIE-1100) HFTP coordinator input check
fails due to missing commons-httpclient.jar
Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507850#comment-13507850 ]
Virag Kothari edited comment on OOZIE-1100 at 12/1/12 3:26 AM:
---------------------------------------------------------------
Please upload the latest patch from RB and change the status to Patch available.. +1 pending jenkins
was (Author: virag):
+1 pending jenkins
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_trunk.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506038#comment-13506038 ]
Rohini Palaniswamy commented on OOZIE-1100:
-------------------------------------------
Pasting the stacktrace Ryota found.
{noformat}
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
at org.apache.hadoop.hdfs.HftpFileSystem$LsParser.fetchList(HftpFileSystem.java:434)
at org.apache.hadoop.hdfs.HftpFileSystem$LsParser.getFileStatus(HftpFileSystem.java:449)
at org.apache.hadoop.hdfs.HftpFileSystem.getFileStatus(HftpFileSystem.java:478)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1271)
at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.pathExists(CoordActionInputCheckXCommand.java:426)
{noformat}
HftpFileSystem in H23 has a call to ServletUtil.encodePath which refers to org/apache/commons/httpclient/URIException
Ryota,
While you are at this, can you also add hftp and webhdfs to the default list of filesystems supported by HadoopAccessorService
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Ryota Egashira (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506978#comment-13506978 ]
Ryota Egashira commented on OOZIE-1100:
---------------------------------------
ok I will do that.
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Ryota Egashira (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryota Egashira updated OOZIE-1100:
----------------------------------
Attachment: OOZIE-1100_trunk-v2.patch
OOZIE-1100_branch-3.3-v2.patch
final ones uploaded. thanks
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_branch-3.3-v2.patch, OOZIE-1100_trunk.patch, OOZIE-1100_trunk-v2.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (OOZIE-1100) HFTP coordinator input check
fails due to missing commons-httpclient.jar
Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507850#comment-13507850 ]
Virag Kothari edited comment on OOZIE-1100 at 12/1/12 3:25 AM:
---------------------------------------------------------------
+1 pending jenkins
was (Author: virag):
+1
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_trunk.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13508926#comment-13508926 ]
Virag Kothari commented on OOZIE-1100:
--------------------------------------
Committed to trunk, branch-3.3, hcat-intre
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_branch-3.3-v2.patch, OOZIE-1100_trunk.patch, OOZIE-1100_trunk-v2.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507893#comment-13507893 ]
Hadoop QA commented on OOZIE-1100:
----------------------------------
Testing JIRA OOZIE-1100
Cleaning local svn workspace
----------------------------
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
. {color:green}+1{color} the patch does not introduce any @author tags
. {color:green}+1{color} the patch does not introduce any tabs
. {color:green}+1{color} the patch does not introduce any trailing spaces
. {color:green}+1{color} the patch does not introduce any line longer than 132
. {color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
. {color:green}+1{color} the patch does not seem to introduce new RAT warnings
{color:green}+1 JAVADOC{color}
. {color:green}+1{color} the patch does not seem to introduce new Javadoc warnings
{color:green}+1 COMPILE{color}
. {color:green}+1{color} HEAD compiles
. {color:green}+1{color} patch compiles
. {color:green}+1{color} the patch does not seem to introduce new javac warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
. {color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
. {color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
. Tests run: 925
. Tests failed: 1
. Tests errors: 0
. The patch failed the following testcases:
. testPauseBundleAndCoordinator(org.apache.oozie.service.TestPauseTransitService)
{color:green}+1 DISTRO{color}
. {color:green}+1{color} distro tarball builds with the patch
----------------------------
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/226/
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_branch-3.3-v2.patch, OOZIE-1100_trunk.patch, OOZIE-1100_trunk-v2.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Virag Kothari (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13507850#comment-13507850 ]
Virag Kothari commented on OOZIE-1100:
--------------------------------------
+1
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_trunk.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Ryota Egashira (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506335#comment-13506335 ]
Ryota Egashira commented on OOZIE-1100:
---------------------------------------
uploaded patch on RB
https://reviews.apache.org/r/8264/
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated OOZIE-1100:
--------------------------------------
Fix Version/s: (was: 3.3.0)
3.3.1
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: trunk, 3.3.1
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_branch-3.3-v2.patch, OOZIE-1100_trunk.patch, OOZIE-1100_trunk-v2.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-1100) HFTP coordinator input check fails
due to missing commons-httpclient.jar
Posted by "Ryota Egashira (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryota Egashira updated OOZIE-1100:
----------------------------------
Attachment: OOZIE-1100_trunk.patch
OOZIE-1100_branch-3.3.patch
> HFTP coordinator input check fails due to missing commons-httpclient.jar
> ------------------------------------------------------------------------
>
> Key: OOZIE-1100
> URL: https://issues.apache.org/jira/browse/OOZIE-1100
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 3.2.0, 3.3.0, trunk
> Reporter: Ryota Egashira
> Assignee: Ryota Egashira
> Fix For: 3.3.0, trunk
>
> Attachments: OOZIE-1100_branch-3.3.patch, OOZIE-1100_trunk.patch
>
>
> when hftp://<path to data> is specified as input dependency, oozie fails to find it even when data exists.
> due to missing commons-httpclient.jar, following part throws Error, then no meaningful error message shows up in oozie.log.
> -----
> HadoopAccessorService.createFileSystem(user, path.toUri(),
> fsConf).exists(path)
> -----
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira