You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Christophe Taton (JIRA)" <ji...@apache.org> on 2008/03/22 11:05:24 UTC
[jira] Created: (HADOOP-3074) URLStreamHandler for the DFS
URLStreamHandler for the DFS
----------------------------
Key: HADOOP-3074
URL: https://issues.apache.org/jira/browse/HADOOP-3074
Project: Hadoop Core
Issue Type: New Feature
Components: util
Reporter: Christophe Taton
Assignee: Christophe Taton
Fix For: 0.17.0
This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080414a.patch
Here you are.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
Fixing all findbugs warnings.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080412a.patch
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581730#action_12581730 ]
Doug Cutting commented on HADOOP-3074:
--------------------------------------
+1 This looks good to me.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks!
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080325a.patch
I dug concerning file:// URLs and the previous patch does not work for these URLs.
This happens because of the late loading of Configuration resource files (which itself relies on URLs).
The new patch forces the load of such resource files before setting the new handler factory, thus allowing it to handle file:// URLs too.
The code has also been cleaned (FSDataInput/OutputStream replaced with Input/OutputStream).
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080322a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588228#action_12588228 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379976/3074-20080412b.patch
against trunk revision 645773.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2218/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2218/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2218/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2218/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080412b.patch
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
Fixing compilation failure due to the constructor {{new IOException(Throwable)}} which does not exist before Java6.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581532#action_12581532 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378477/3074-20080324a.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2035/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2035/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2035/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2035/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080406a.patch
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581510#action_12581510 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378434/3074-20080322a.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit -1. The applied patch generated 197 release audit warnings (more than the trunk's current 195 warnings).
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2034/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2034/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2034/artifact/trunk/build/test/checkstyle-errors.html
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2034/artifact/trunk/current/releaseAuditDiffWarnings.txt
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2034/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080322a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588209#action_12588209 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379973/3074-20080412a.patch
against trunk revision 645773.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs -1. The patch appears to introduce 3 new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2216/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2216/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2216/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2216/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Fix Version/s: (was: 0.17.0)
0.18.0
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12589053#action_12589053 ]
Hudson commented on HADOOP-3074:
--------------------------------
Integrated in Hadoop-trunk #461 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/461/])
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588856#action_12588856 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12380090/3074-20080414a.patch
against trunk revision 645773.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2229/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2229/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2229/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2229/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582087#action_12582087 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378573/3074-20080325a.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs -1. The patch appears to cause Findbugs to fail.
core tests -1. The patch failed core unit tests.
contrib tests -1. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2055/testReport/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2055/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2055/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080322a.patch
Here is a first proposal. The handler has been put in package {{org.apache.hadoop.util.protocols.hdfs}}. Thus you can register it in the JVM as in: {{java -Djava.protocol.handler.pkgs=org.apache.hadoop.util.protocols <MainClass>}}.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080322a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588686#action_12588686 ]
Doug Cutting commented on HADOOP-3074:
--------------------------------------
I would prefer this were in the fs package, not util. In general, we should aim to put things in the most-specific package possible, otherwise, everything winds up in util.
Also, I would prefer the classes were named FsUrlStreamHandler and FsUrlStreamHandlerFactory. Acronyms are easier to read when capitalized, not all-caps, in Java names.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080324a.patch
Fixing missing license headers...
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588153#action_12588153 ]
Hadoop QA commented on HADOOP-3074:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12379511/3074-20080406a.patch
against trunk revision 645773.
@author +1. The patch does not contain any @author tags.
tests included +1. The patch appears to include 3 new or modified tests.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new javac compiler warnings.
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs -1. The patch appears to cause Findbugs to fail.
core tests -1. The patch failed core unit tests.
contrib tests -1. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2213/testReport/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2213/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2213/console
This message is automatically generated.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581743#action_12581743 ]
Raghu Angadi commented on HADOOP-3074:
--------------------------------------
Looks good.
minor:
Do you need to use FSDataInputStream or FSDataOutputStream in the test or in the implementation. Looks like just normal InputStream etc are enough.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Open (was: Patch Available)
New patch to conform to findbugs
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588710#action_12588710 ]
Doug Cutting commented on HADOOP-3074:
--------------------------------------
+1
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch, 3074-20080414a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: (was: 3074-20080322a.patch)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Attachment: 3074-20080324b.patch
The patch 3074-20080324b.patch is not DFS specific anymore, as suggested by Doug.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581598#action_12581598 ]
Doug Cutting commented on HADOOP-3074:
--------------------------------------
This need not be specific to HDFS, but could be generic to any FileSystem implementation, no? The FileSystem API subsumes Java's URL connection API. We could even provide a generic URLStreamHandlerFactory.
http://java.sun.com/javase/6/docs/api/java/net/URL.html#setURLStreamHandlerFactory(java.net.URLStreamHandlerFactory)
Note that we might special-case the "file:" protocol, since the JVM already includes an handler for that.
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.17.0
>
> Attachments: 3074-20080324a.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3074) URLStreamHandler for the DFS
Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christophe Taton updated HADOOP-3074:
-------------------------------------
Status: Patch Available (was: Open)
> URLStreamHandler for the DFS
> ----------------------------
>
> Key: HADOOP-3074
> URL: https://issues.apache.org/jira/browse/HADOOP-3074
> Project: Hadoop Core
> Issue Type: New Feature
> Components: util
> Reporter: Christophe Taton
> Assignee: Christophe Taton
> Fix For: 0.18.0
>
> Attachments: 3074-20080324a.patch, 3074-20080324b.patch, 3074-20080325a.patch, 3074-20080406a.patch, 3074-20080412a.patch, 3074-20080412b.patch
>
>
> This issue aims at providing a handler to resolve DFS URLs ("hdfs://host:port/file/to/path"), so that such URLs can be read using the URL API (mainly {{InputStream url.openStream()}}).
> This allows the use of a {{URLClassLoader}} which would serve classes directly from the DFS.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.