You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Min Zhou <co...@gmail.com> on 2009/09/07 05:46:54 UTC
streaming debug
Hi all,
Currently, debugging a streaming written in other languages like python is
very difficult for us. We ofen come up against such problems, we passed
running python scripts in local mode, but failed when as streaming scripts
in hive. How can I locate bugs we made?
Thanks,
Min
--
My research interests are distributed systems, parallel computing and
bytecode based virtual machine.
My profile:
http://www.linkedin.com/in/coderplay
My blog:
http://coderplay.javaeye.com
Re: streaming debug
Posted by Zheng Shao <zs...@gmail.com>.
When Python script fails, you should be able to see the stderr messages on
the task log page on JobTracker.
http://diveintopython.org/file_handling/index.html will show you how to
print out the stack trace.
Zheng
On Thu, Sep 17, 2009 at 9:00 AM, Min Zhou <co...@gmail.com> wrote:
> Hi Zheng,
>
> Can you give a example, I can't catch your meaning.
>
> Thanks,
> Min
>
>
> On Tue, Sep 8, 2009 at 3:19 AM, Zheng Shao <zs...@gmail.com> wrote:
>
>> We can do a "try except" in the loop that process data line by line, to
>> print out the stack trace in python, as well as the line of data that caused
>> the problem.
>>
>> Zheng
>>
>>
>> On Sun, Sep 6, 2009 at 8:46 PM, Min Zhou <co...@gmail.com> wrote:
>>
>>> Hi all,
>>> Currently, debugging a streaming written in other languages like python
>>> is very difficult for us. We ofen come up against such problems, we
>>> passed running python scripts in local mode, but failed when as streaming
>>> scripts in hive. How can I locate bugs we made?
>>>
>>>
>>> Thanks,
>>> Min
>>> --
>>> My research interests are distributed systems, parallel computing and
>>> bytecode based virtual machine.
>>>
>>> My profile:
>>> http://www.linkedin.com/in/coderplay
>>> My blog:
>>> http://coderplay.javaeye.com
>>>
>>
>>
>>
>> --
>> Yours,
>> Zheng
>>
>
>
>
> --
> My research interests are distributed systems, parallel computing and
> bytecode based virtual machine.
>
> My profile:
> http://www.linkedin.com/in/coderplay
> My blog:
> http://coderplay.javaeye.com
>
--
Yours,
Zheng
Re: streaming debug
Posted by Min Zhou <co...@gmail.com>.
Hi Zheng,
Can you give a example, I can't catch your meaning.
Thanks,
Min
On Tue, Sep 8, 2009 at 3:19 AM, Zheng Shao <zs...@gmail.com> wrote:
> We can do a "try except" in the loop that process data line by line, to
> print out the stack trace in python, as well as the line of data that caused
> the problem.
>
> Zheng
>
>
> On Sun, Sep 6, 2009 at 8:46 PM, Min Zhou <co...@gmail.com> wrote:
>
>> Hi all,
>> Currently, debugging a streaming written in other languages like python is
>> very difficult for us. We ofen come up against such problems, we passed
>> running python scripts in local mode, but failed when as streaming scripts
>> in hive. How can I locate bugs we made?
>>
>>
>> Thanks,
>> Min
>> --
>> My research interests are distributed systems, parallel computing and
>> bytecode based virtual machine.
>>
>> My profile:
>> http://www.linkedin.com/in/coderplay
>> My blog:
>> http://coderplay.javaeye.com
>>
>
>
>
> --
> Yours,
> Zheng
>
--
My research interests are distributed systems, parallel computing and
bytecode based virtual machine.
My profile:
http://www.linkedin.com/in/coderplay
My blog:
http://coderplay.javaeye.com
Re: streaming debug
Posted by Zheng Shao <zs...@gmail.com>.
We can do a "try except" in the loop that process data line by line, to
print out the stack trace in python, as well as the line of data that caused
the problem.
Zheng
On Sun, Sep 6, 2009 at 8:46 PM, Min Zhou <co...@gmail.com> wrote:
> Hi all,
> Currently, debugging a streaming written in other languages like python is
> very difficult for us. We ofen come up against such problems, we passed
> running python scripts in local mode, but failed when as streaming scripts
> in hive. How can I locate bugs we made?
>
>
> Thanks,
> Min
> --
> My research interests are distributed systems, parallel computing and
> bytecode based virtual machine.
>
> My profile:
> http://www.linkedin.com/in/coderplay
> My blog:
> http://coderplay.javaeye.com
>
--
Yours,
Zheng