You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Christophe Taton (JIRA)" <ji...@apache.org> on 2007/08/25 00:53:30 UTC

[jira] Created: (HADOOP-1782) DFS File Permissions framework

DFS File Permissions framework
------------------------------

                 Key: HADOOP-1782
                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
             Project: Hadoop
          Issue Type: Improvement
            Reporter: Christophe Taton
            Assignee: Christophe Taton
             Fix For: 0.15.0


In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
In a short-term implementation, we'll focus on providing POSIX style permissions.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Status: Patch Available  (was: Open)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Status: Patch Available  (was: Open)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-24a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1782) DFS File Permissions framework

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12523963 ] 

Hadoop QA commented on HADOOP-1782:
-----------------------------------

+0, new Findbugs warnings

http://issues.apache.org/jira/secure/attachment/12364847/1782_2007-08-30a.patch
applied and successfully tested against trunk revision r571329,
but there appear to be new Findbugs warnings introduced by this patch.

New Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/662/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/662/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/662/console

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Attachment:     (was: 1782_2007-08-24a.patch)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1782) DFS File Permissions framework

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12523975 ] 

Hadoop QA commented on HADOOP-1782:
-----------------------------------

+1

http://issues.apache.org/jira/secure/attachment/12364859/1782_2007-08-30b.patch applied and successfully tested against trunk revision r571333.

Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/664/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/664/console

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Attachment: 1782_2007-08-30b.patch

Again with {{fs.FileStatus}}


> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12525564 ] 

Christophe Taton commented on HADOOP-1782:
------------------------------------------

This issue is a totally independent subset of HADOOP-1298 made to integrate authorization features progressively. It has actually no relationship with HADOOP-1701.
I started splitting HADOOP-1298 into smaller parts as it starts being hard and time-consuming to maintain such a big patch against the current trunk...
The current patch posted in HADOOP-1298 is actually not synchronized with the current trunk. I'll update it in the next hours; it can be applied and should provide running permissions as described in last HADOOP-1298 comments.


> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Attachment: 1782_2007-08-24a.patch

The current patch contains a few {{java.security.Permission}} subclasses that will be eventually used to integrate permissions info into INodes and to achieve permission checking following the standard Java authorization scheme. It also contains POSIX permissions primitives:
- {{fs.permission.WritablePermissionCollection}}: abstract serializable permission collection.
- {{fs.permission.HFilePermission}}: non mutable representation of a permission that some entity may request (to process permission checking).
- {{fs.permission.HFileAction}}: enumeration of the various actions available on a DFS file; for now: create, delete, read, write and setPermissions (assuming that setReplication is mapped to write).
- {{fs.permission.POSIXFileAction}}: enumeration of the regular POSIX actions (read, write and execute); we'll probably not use the execute action and merge it with the read action when considering access to a directory.
- {{fs.permission.POSIXFilePermission}}: non mutable representation of a POSIX action/permission that some entity may request (to process POSIX permission checking). It currently contains a POSIXFileAction and an ID representing the entity requesting the action.
- {{fs.permission.POSIXFilePermissions}}: a mutable per-INode permission collection that holds: an ID representing the owner of the INode and a short bits set that stores the POSIX authorizations for owner, group members and others entities. We currently ignore groups.


> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-24a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Status: Patch Available  (was: Open)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton resolved HADOOP-1782.
--------------------------------------

    Resolution: Duplicate

Should be directly included in HADOOP-1298.

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Doug Cutting updated HADOOP-1782:
---------------------------------

    Status: Open  (was: Patch Available)

This is now being developed in HADOOP-1298.

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Status: Open  (was: Patch Available)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Attachment: 1782_2007-08-30a.patch

Updated {{fs.Path}} to implement {{Serializable}} (should remove the FindBugs warning).
JUnit tests ok.

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1782) DFS File Permissions framework

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12525551 ] 

Raghu Angadi commented on HADOOP-1782:
--------------------------------------

Christophe, could you comment about this issue's relationship with HADOOP-1701.

Do you know of any set of patches that some one could apply and run Hadoop with permissions?

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-30b.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Attachment:     (was: 1782_2007-08-30a.patch)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1782) DFS File Permissions framework

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12523808 ] 

Hadoop QA commented on HADOOP-1782:
-----------------------------------

+0, new Findbugs warnings

http://issues.apache.org/jira/secure/attachment/12364547/1782_2007-08-24a.patch
applied and successfully tested against trunk revision r570983,
but there appear to be new Findbugs warnings introduced by this patch.

New Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/654/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Test results:   http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/654/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/654/console

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-24a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1782) DFS File Permissions framework

Posted by "Christophe Taton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Christophe Taton updated HADOOP-1782:
-------------------------------------

    Status: Open  (was: Patch Available)

> DFS File Permissions framework
> ------------------------------
>
>                 Key: HADOOP-1782
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1782
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Christophe Taton
>            Assignee: Christophe Taton
>             Fix For: 0.15.0
>
>         Attachments: 1782_2007-08-24a.patch
>
>
> In [HADOOP-1298|https://issues.apache.org/jira/browse/HADOOP-1298] we want to provide authorization to the DFS. This issue should provide the bases to add permissions information to INodes.
> In a short-term implementation, we'll focus on providing POSIX style permissions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.