You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Frédéric Bertin (JIRA)" <ji...@apache.org> on 2006/09/08 19:20:22 UTC
[jira] Created: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
-----------------------------------------------------------------
Key: HADOOP-516
URL: http://issues.apache.org/jira/browse/HADOOP-516
Project: Hadoop
Issue Type: New Feature
Environment: Eclipse 3.2
JDK 1.5
Reporter: Frédéric Bertin
to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
* a HDFS explorer adapted from Eclipse filesystem explorer example.
For now, it includes the following features:
o classical tree-based browsing interface, with directory
content being detailed in a 3 columns table (file name, file
size, file type)
o refresh button
o delete file or directory (with confirm dialog): select files
in the tree or table and click the "Delete" button
o rename file or directory: simple click on the file in the
table, type the new name and validate
o open file with system editor: select the file in the table
and click "Open" button (works on Windows, not on Linux)
o internal drag & drop
o external drag & drop from the local filesystem to the HDFS
(the opposite doesn't work)
* a MapReduce *very* simple job launcher:
o select the job XML configuration file
o run the job
o kill the job
o visualize map and reduce progress with progress bars
o open a browser on the Hadoop job tracker web interface
INSTALLATION NOTES:
- Eclipse 3.2
- JDK 1.5
- import the archive in Eclipse
- copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
- right-click on the project and Run As -> Eclipse Application
- enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12530857 ]
Owen O'Malley commented on HADOOP-516:
--------------------------------------
Is this still relevant after HADOOP-1437?
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: https://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Frédéric Bertin (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=comments#action_12449686 ]
Frédéric Bertin commented on HADOOP-516:
----------------------------------------
the file is too big to be attached to the issue (18MB). You can download it from this link: http://ind75.free.fr/HDFSExplorer_win32.zip
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Frédéric Bertin (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=all ]
Frédéric Bertin updated HADOOP-516:
-----------------------------------
Attachment: hdfsExplorer.zip
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Frédéric Bertin (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=comments#action_12434919 ]
Frédéric Bertin commented on HADOOP-516:
----------------------------------------
if you wish, and if you tell me which OS environment you are using, I can generate a standalone application (thanks to Eclipse RCP feature). Then you won't need Eclipse, just a JRE.
Supported OS are:
aix.motif.ppc
hpux.motif.ia64_32
hpux.motif.PA_RISC
linux.gtk.ia64
linux.gtk.ppc
linux.gtk.x86
linux.gtk.x86_64
linux.motif.x86
macosx.carbon.ppc
macosx.carbon.x86
qnx.photon.x86
solaris.gtk.sparc
solaris.motif.sparc
win32.win32.x86
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Thomas Friol (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=comments#action_12433452 ]
Thomas Friol commented on HADOOP-516:
-------------------------------------
I think it is 'hadoop-client.xml' and not 'hadoop-default.xml' that you must put in your scr folder.
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Frédéric Bertin (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=all ]
Frédéric Bertin updated HADOOP-516:
-----------------------------------
Attachment: hdfsExplorer2.zip
refactoring:
- hadoop-client.xml is now configurable with the preferences dialog
added features:
- create a new folder
- upload local files to the HDFS
- download HDFS files to the local filesystem
- F5 and DEL key shortcuts working
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Uros Gruber (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=comments#action_12449367 ]
Uros Gruber commented on HADOOP-516:
------------------------------------
+1
It would be gret for standalone app, because we don't have eclipse on every computer. We use win32.
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-516) Eclipse-based GUI: DFS explorer and
basic Map/Reduce job launcher
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-516?page=comments#action_12434803 ]
Doug Cutting commented on HADOOP-516:
-------------------------------------
I don't use Eclipse, so I cannot evalute this. If others try this and find it useful, please add comments to this bug, vote on it, or both. I can commit it to contrib if a few folks find it useful and none say it is horribly broken.
> Eclipse-based GUI: DFS explorer and basic Map/Reduce job launcher
> -----------------------------------------------------------------
>
> Key: HADOOP-516
> URL: http://issues.apache.org/jira/browse/HADOOP-516
> Project: Hadoop
> Issue Type: New Feature
> Environment: Eclipse 3.2
> JDK 1.5
> Reporter: Frédéric Bertin
> Attachments: hdfsExplorer.zip, hdfsExplorer2.zip
>
>
> to increase productivity in our current project (which makes a heavy use of Hadoop), we wrote a small Eclipse-based GUI application which basically consists in 2 views:
> * a HDFS explorer adapted from Eclipse filesystem explorer example.
> For now, it includes the following features:
> o classical tree-based browsing interface, with directory
> content being detailed in a 3 columns table (file name, file
> size, file type)
> o refresh button
> o delete file or directory (with confirm dialog): select files
> in the tree or table and click the "Delete" button
> o rename file or directory: simple click on the file in the
> table, type the new name and validate
> o open file with system editor: select the file in the table
> and click "Open" button (works on Windows, not on Linux)
> o internal drag & drop
> o external drag & drop from the local filesystem to the HDFS
> (the opposite doesn't work)
> * a MapReduce *very* simple job launcher:
> o select the job XML configuration file
> o run the job
> o kill the job
> o visualize map and reduce progress with progress bars
> o open a browser on the Hadoop job tracker web interface
> INSTALLATION NOTES:
> - Eclipse 3.2
> - JDK 1.5
> - import the archive in Eclipse
> - copy your hadoop conf file (hadoop-default.xml in "src" folder) -> this step should be moved in the GUI later
> - right-click on the project and Run As -> Eclipse Application
> - enjoy...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira