You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Samuel Guo <si...@gmail.com> on 2008/04/16 09:56:59 UTC

any tools to read sequencefile?

Hi all:

    Is there any tool that can be used to read the SequenceFile or other
    InputFormat/OutputFormat?

Best Wishes!

                                                Samuel Guo


Re: any tools to read sequencefile?

Posted by Samuel Guo <gu...@gmail.com>.
Thanks :)

2008/4/16, Adrian Woodhead <ad...@last.fm>:
>
> Samuel, Lukas,
>
> Attached find the source code for our graphical sequence file viewer.
> Like I said it is a quick hack but maybe you find it useful. Basically,
> I took the code from Sun's "DragAndDropDemo" and modified it to call out
> to a util method of ours which converts a sequence file to a string and
> then displays its contents in a GUI pane. To get this to compile and run
> you will need the following jars on your classpath:
>
> commons-io.jar
> commons-lang.jar
> commons-logging.jar
> hadoop-core.jar
> log4j.jar
>
> and of course the classes contained in your sequence file. You should
> then run FileDisplay with no arguments and get a GUI which you can drop
> sequence files onto, or use the file navigator to locate a file. Let me
> know if it works, I had to rip this code out of our source tree so there
> might be issues, but I managed to compile and run it myself with the
> attached source.
>
>
> Adrian
>
>
>
> Lukas Vlcek wrote:
> > Adrian,
> >
> > I would be interested in this tool as well. Do you think you can send me
> > more info?
> >
> > Regards,
> > Lukas
> >
> > On Wed, Apr 16, 2008 at 1:55 PM, Adrian Woodhead <ad...@last.fm> wrote:
> >
> >
> >> We have a very simple GUI that you can drag and drop sequence files
> onto
> >> and it displays them. It was hacked together quite quickly so the code
> >> quality is not amazing but if you want I could send it to you if you
> are
> >> comfortable piecing it together to get it to run on your side.
> >>
> >>
> >> 郭斯杰 wrote:
> >>
> >>
> >>> thanks~
> >>> may be I don't express myself clearly
> >>>
> >>> I mean any tools to show the SequenceFile as plain text or others for
> >>> reading :)
> >>>
> >>>
> >>> 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
> >>>
> >>>
> >>>
> >>>> Hello Samuel
> >>>>
> >>>> There is SequenceFileInputFormat for reading Sequence File.
> >>>>
> >>>>
> >>>>
> >>>>
> http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
> >>>>
> >>>> ---
> >>>>
> >>>> Peeyush
> >>>>
> >>>>
> >>>> On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>> Hi all:
> >>>>>
> >>>>>    Is there any tool that can be used to read the SequenceFile or
> >>>>> other
> >>>>>    InputFormat/OutputFormat?
> >>>>>
> >>>>> Best Wishes!
> >>>>>
> >>>>>                                                Samuel Guo
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>
> >
> >
> >
>
>

Re: any tools to read sequencefile?

Posted by Lukas Vlcek <lu...@gmail.com>.
Thanks :)

2008/4/16 Adrian Woodhead <ad...@last.fm>:

> Samuel, Lukas,
>
> Attached find the source code for our graphical sequence file viewer.
> Like I said it is a quick hack but maybe you find it useful. Basically,
> I took the code from Sun's "DragAndDropDemo" and modified it to call out
> to a util method of ours which converts a sequence file to a string and
> then displays its contents in a GUI pane. To get this to compile and run
> you will need the following jars on your classpath:
>
> commons-io.jar
> commons-lang.jar
> commons-logging.jar
> hadoop-core.jar
> log4j.jar
>
> and of course the classes contained in your sequence file. You should
> then run FileDisplay with no arguments and get a GUI which you can drop
> sequence files onto, or use the file navigator to locate a file. Let me
> know if it works, I had to rip this code out of our source tree so there
> might be issues, but I managed to compile and run it myself with the
> attached source.
>
> Adrian
>
>
> Lukas Vlcek wrote:
> > Adrian,
> >
> > I would be interested in this tool as well. Do you think you can send me
> > more info?
> >
> > Regards,
> > Lukas
> >
> > On Wed, Apr 16, 2008 at 1:55 PM, Adrian Woodhead <ad...@last.fm> wrote:
> >
> >
> >> We have a very simple GUI that you can drag and drop sequence files
> onto
> >> and it displays them. It was hacked together quite quickly so the code
> >> quality is not amazing but if you want I could send it to you if you
> are
> >> comfortable piecing it together to get it to run on your side.
> >>
> >>
> >> 郭斯杰 wrote:
> >>
> >>
> >>> thanks~
> >>> may be I don't express myself clearly
> >>>
> >>> I mean any tools to show the SequenceFile as plain text or others for
> >>> reading :)
> >>>
> >>>
> >>> 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
> >>>
> >>>
> >>>
> >>>> Hello Samuel
> >>>>
> >>>> There is SequenceFileInputFormat for reading Sequence File.
> >>>>
> >>>>
> >>>>
> >>>>
> http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
> >>>>
> >>>> ---
> >>>>
> >>>> Peeyush
> >>>>
> >>>>
> >>>> On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>> Hi all:
> >>>>>
> >>>>>    Is there any tool that can be used to read the SequenceFile or
> >>>>> other
> >>>>>    InputFormat/OutputFormat?
> >>>>>
> >>>>> Best Wishes!
> >>>>>
> >>>>>                                                Samuel Guo
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>
> >
> >
> >
>



-- 
http://blog.lukas-vlcek.com/

Re: any tools to read sequencefile?

Posted by Adrian Woodhead <ad...@last.fm>.
Samuel, Lukas,

Attached find the source code for our graphical sequence file viewer.
Like I said it is a quick hack but maybe you find it useful. Basically,
I took the code from Sun's "DragAndDropDemo" and modified it to call out
to a util method of ours which converts a sequence file to a string and
then displays its contents in a GUI pane. To get this to compile and run
you will need the following jars on your classpath:

commons-io.jar
commons-lang.jar
commons-logging.jar
hadoop-core.jar
log4j.jar

and of course the classes contained in your sequence file. You should
then run FileDisplay with no arguments and get a GUI which you can drop
sequence files onto, or use the file navigator to locate a file. Let me
know if it works, I had to rip this code out of our source tree so there
might be issues, but I managed to compile and run it myself with the
attached source.

Adrian


Lukas Vlcek wrote:
> Adrian,
>
> I would be interested in this tool as well. Do you think you can send me
> more info?
>
> Regards,
> Lukas
>
> On Wed, Apr 16, 2008 at 1:55 PM, Adrian Woodhead <ad...@last.fm> wrote:
>
>   
>> We have a very simple GUI that you can drag and drop sequence files onto
>> and it displays them. It was hacked together quite quickly so the code
>> quality is not amazing but if you want I could send it to you if you are
>> comfortable piecing it together to get it to run on your side.
>>
>>
>> 郭斯杰 wrote:
>>
>>     
>>> thanks~
>>> may be I don't express myself clearly
>>>
>>> I mean any tools to show the SequenceFile as plain text or others for
>>> reading :)
>>>
>>>
>>> 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
>>>
>>>
>>>       
>>>> Hello Samuel
>>>>
>>>> There is SequenceFileInputFormat for reading Sequence File.
>>>>
>>>>
>>>>
>>>> http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
>>>>
>>>> ---
>>>>
>>>> Peeyush
>>>>
>>>>
>>>> On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
>>>>
>>>>
>>>>
>>>>         
>>>>> Hi all:
>>>>>
>>>>>    Is there any tool that can be used to read the SequenceFile or
>>>>> other
>>>>>    InputFormat/OutputFormat?
>>>>>
>>>>> Best Wishes!
>>>>>
>>>>>                                                Samuel Guo
>>>>>
>>>>>
>>>>>
>>>>>           
>>>       
>
>
>   

Re: any tools to read sequencefile?

Posted by Andrzej Bialecki <ab...@getopt.org>.
Lukas Vlcek wrote:
> Adrian,
> 
> I would be interested in this tool as well. Do you think you can send me
> more info?

Please check this: https://issues.apache.org/jira/browse/HADOOP-175


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Re: any tools to read sequencefile?

Posted by Lukas Vlcek <lu...@gmail.com>.
Adrian,

I would be interested in this tool as well. Do you think you can send me
more info?

Regards,
Lukas

On Wed, Apr 16, 2008 at 1:55 PM, Adrian Woodhead <ad...@last.fm> wrote:

> We have a very simple GUI that you can drag and drop sequence files onto
> and it displays them. It was hacked together quite quickly so the code
> quality is not amazing but if you want I could send it to you if you are
> comfortable piecing it together to get it to run on your side.
>
>
> 郭斯杰 wrote:
>
> > thanks~
> > may be I don't express myself clearly
> >
> > I mean any tools to show the SequenceFile as plain text or others for
> > reading :)
> >
> >
> > 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
> >
> >
> > > Hello Samuel
> > >
> > > There is SequenceFileInputFormat for reading Sequence File.
> > >
> > >
> > >
> > > http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
> > >
> > > ---
> > >
> > > Peeyush
> > >
> > >
> > > On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
> > >
> > >
> > >
> > > > Hi all:
> > > >
> > > >    Is there any tool that can be used to read the SequenceFile or
> > > > other
> > > >    InputFormat/OutputFormat?
> > > >
> > > > Best Wishes!
> > > >
> > > >                                                Samuel Guo
> > > >
> > > >
> > > >
> > >
> >
> >
>


-- 
http://blog.lukas-vlcek.com/

Re: any tools to read sequencefile?

Posted by Samuel Guo <gu...@gmail.com>.
Thank you very much!
I think it may be helpful :)

2008/4/16, Adrian Woodhead <ad...@last.fm>:
>
> We have a very simple GUI that you can drag and drop sequence files onto
> and it displays them. It was hacked together quite quickly so the code
> quality is not amazing but if you want I could send it to you if you are
> comfortable piecing it together to get it to run on your side.
>
> 郭斯杰 wrote:
>
> > thanks~
> > may be I don't express myself clearly
> >
> > I mean any tools to show the SequenceFile as plain text or others for
> > reading :)
> >
> >
> > 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
> >
> >
> > > Hello Samuel
> > >
> > > There is SequenceFileInputFormat for reading Sequence File.
> > >
> > >
> > >
> > > http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
> > >
> > > ---
> > >
> > > Peeyush
> > >
> > >
> > > On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
> > >
> > >
> > >
> > > > Hi all:
> > > >
> > > >    Is there any tool that can be used to read the SequenceFile or
> > > > other
> > > >    InputFormat/OutputFormat?
> > > >
> > > > Best Wishes!
> > > >
> > > >                                                Samuel Guo
> > > >
> > > >
> > > >
> > >
> >
> >
>

Re: any tools to read sequencefile?

Posted by Adrian Woodhead <ad...@last.fm>.
We have a very simple GUI that you can drag and drop sequence files onto 
and it displays them. It was hacked together quite quickly so the code 
quality is not amazing but if you want I could send it to you if you are 
comfortable piecing it together to get it to run on your side.

郭斯杰 wrote:
> thanks~
> may be I don't express myself clearly
>
> I mean any tools to show the SequenceFile as plain text or others for
> reading :)
>
>
> 2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
>   
>> Hello Samuel
>>
>> There is SequenceFileInputFormat for reading Sequence File.
>>
>>
>> http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
>>
>> ---
>>
>> Peeyush
>>
>>
>> On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
>>
>>     
>>> Hi all:
>>>
>>>     Is there any tool that can be used to read the SequenceFile or other
>>>     InputFormat/OutputFormat?
>>>
>>> Best Wishes!
>>>
>>>                                                 Samuel Guo
>>>
>>>       
>
>   

Re: any tools to read sequencefile?

Posted by 郭斯杰 <gu...@gmail.com>.
thanks~
may be I don't express myself clearly

I mean any tools to show the SequenceFile as plain text or others for
reading :)


2008/4/16, Peeyush Bishnoi <pe...@yahoo-inc.com>:
>
> Hello Samuel
>
> There is SequenceFileInputFormat for reading Sequence File.
>
>
> http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html
>
> ---
>
> Peeyush
>
>
> On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:
>
> > Hi all:
> >
> >     Is there any tool that can be used to read the SequenceFile or other
> >     InputFormat/OutputFormat?
> >
> > Best Wishes!
> >
> >                                                 Samuel Guo
> >
>

Re: any tools to read sequencefile?

Posted by Peeyush Bishnoi <pe...@yahoo-inc.com>.
Hello Samuel 

There is SequenceFileInputFormat for reading Sequence File. 

http://hadoop.apache.org/core/docs/r0.16.2/api/org/apache/hadoop/mapred/InputFormat.html 

---
Peeyush

On Wed, 2008-04-16 at 15:56 +0800, Samuel Guo wrote:

> Hi all:
> 
>     Is there any tool that can be used to read the SequenceFile or other
>     InputFormat/OutputFormat?
> 
> Best Wishes!
> 
>                                                 Samuel Guo
>