FW: how to debug Hama Jobs?

["Tu, Min" <mi...@paypal.com>]

From: <Tu>, "Tu, Min" <mi...@paypal.com>>
Date: Wednesday, November 14, 2012 5:12 PM
To: "user-info@hama.apache.org<ma...@hama.apache.org>" <us...@hama.apache.org>>
Cc: "user-faq@hama.apache.org<ma...@hama.apache.org>" <us...@hama.apache.org>>
Subject: how to debug Hama Jobs?

Hi,

This is Min Tu and I am new to Hama. I have developed a Hama graph job and it works fine with simple testing data but failed with real data.

I have looked several places for the reason including

$HAMA_HOME/logs where BSP server is running

$HAMA_HOME/logs where Groom Server is running
$HAMA_HOME/logs/tasklogs/job_ID where Groom server is running

But I can not find the Exception or why the job failed.

Would  you please provide some suggestions? Thank you very much for the help

Min

Re: FW: how to debug Hama Jobs?

[Tommaso Teofili <to...@gmail.com>]

As far as I know RuntimeExceptions are always stack traced if not
explicitly caught.
I think it's a good pattern to just expose those Exceptions that may arise
in the methods signatures and not catching anything else therefore I'm for
keeping things as they are now and avoid try/catching REs in
bsp/setup/cleanup.
If the Graph API needs more fine grained logging I'd be ok with that but
I'd second Edward's proposal to try to run the job with logging level to
debug and see if that information turns to be useful.

Regarding Tu's question I think it'd be better if he can provide some more
information about his setup and maybe paste the job log lines where it says
it failed.

My 2 cents,
Tommaso



2012/11/16 Suraj Menon <me...@gmail.com>

> Hi, it could be a RuntimeException that the application is throwing. I
> would suggest putting a try/catch block in setup, bsp/compute and cleanup
> and log it as error log. You would then find the exception stacktrace in
> the tasklogs/JobID/*.log.  I am looking into scenarios why the exception
> won't be logged.
>
> -Suraj
>
> P.S.: Your mails are getting marked as spam for me. Please subscribe to the
> user mailing list. The instructions are here -
> http://hama.apache.org/mail-lists.html. Please send an email to -
> user-subscribe@hama.apache.org
>
> On Thu, Nov 15, 2012 at 8:44 PM, Edward J. Yoon <edwardyoon@apache.org
> >wrote:
>
> > You can set the log level to debug.
> >
> > On Thu, Nov 15, 2012 at 10:20 AM, Tu, Min <mi...@paypal.com> wrote:
> > >
> > >
> > > From: <Tu>, "Tu, Min" <mi...@paypal.com>>
> > > Date: Wednesday, November 14, 2012 5:12 PM
> > > To: "user-info@hama.apache.org<ma...@hama.apache.org>" <
> > user-info@hama.apache.org<ma...@hama.apache.org>>
> > > Cc: "user-faq@hama.apache.org<ma...@hama.apache.org>" <
> > user-faq@hama.apache.org<ma...@hama.apache.org>>
> > > Subject: how to debug Hama Jobs?
> > >
> > > Hi,
> > >
> > > This is Min Tu and I am new to Hama. I have developed a Hama graph job
> > and it works fine with simple testing data but failed with real data.
> > >
> > > I have looked several places for the reason including
> > >
> > > $HAMA_HOME/logs where BSP server is running
> > >
> > > $HAMA_HOME/logs where Groom Server is running
> > > $HAMA_HOME/logs/tasklogs/job_ID where Groom server is running
> > >
> > > But I can not find the Exception or why the job failed.
> > >
> > > Would  you please provide some suggestions? Thank you very much for the
> > help
> > >
> > > Min
> >
> >
> >
> > --
> > Best Regards, Edward J. Yoon
> > @eddieyoon
> >
>

Re: FW: how to debug Hama Jobs?

[Suraj Menon <me...@gmail.com>]

Hi, it could be a RuntimeException that the application is throwing. I
would suggest putting a try/catch block in setup, bsp/compute and cleanup
and log it as error log. You would then find the exception stacktrace in
the tasklogs/JobID/*.log.  I am looking into scenarios why the exception
won't be logged.

-Suraj

P.S.: Your mails are getting marked as spam for me. Please subscribe to the
user mailing list. The instructions are here -
http://hama.apache.org/mail-lists.html. Please send an email to -
user-subscribe@hama.apache.org

On Thu, Nov 15, 2012 at 8:44 PM, Edward J. Yoon <ed...@apache.org>wrote:

> You can set the log level to debug.
>
> On Thu, Nov 15, 2012 at 10:20 AM, Tu, Min <mi...@paypal.com> wrote:
> >
> >
> > From: <Tu>, "Tu, Min" <mi...@paypal.com>>
> > Date: Wednesday, November 14, 2012 5:12 PM
> > To: "user-info@hama.apache.org<ma...@hama.apache.org>" <
> user-info@hama.apache.org<ma...@hama.apache.org>>
> > Cc: "user-faq@hama.apache.org<ma...@hama.apache.org>" <
> user-faq@hama.apache.org<ma...@hama.apache.org>>
> > Subject: how to debug Hama Jobs?
> >
> > Hi,
> >
> > This is Min Tu and I am new to Hama. I have developed a Hama graph job
> and it works fine with simple testing data but failed with real data.
> >
> > I have looked several places for the reason including
> >
> > $HAMA_HOME/logs where BSP server is running
> >
> > $HAMA_HOME/logs where Groom Server is running
> > $HAMA_HOME/logs/tasklogs/job_ID where Groom server is running
> >
> > But I can not find the Exception or why the job failed.
> >
> > Would  you please provide some suggestions? Thank you very much for the
> help
> >
> > Min
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Re: FW: how to debug Hama Jobs?

["Edward J. Yoon" <ed...@apache.org>]

You can set the log level to debug.

On Thu, Nov 15, 2012 at 10:20 AM, Tu, Min <mi...@paypal.com> wrote:
>
>
> From: <Tu>, "Tu, Min" <mi...@paypal.com>>
> Date: Wednesday, November 14, 2012 5:12 PM
> To: "user-info@hama.apache.org<ma...@hama.apache.org>" <us...@hama.apache.org>>
> Cc: "user-faq@hama.apache.org<ma...@hama.apache.org>" <us...@hama.apache.org>>
> Subject: how to debug Hama Jobs?
>
> Hi,
>
> This is Min Tu and I am new to Hama. I have developed a Hama graph job and it works fine with simple testing data but failed with real data.
>
> I have looked several places for the reason including
>
> $HAMA_HOME/logs where BSP server is running
>
> $HAMA_HOME/logs where Groom Server is running
> $HAMA_HOME/logs/tasklogs/job_ID where Groom server is running
>
> But I can not find the Exception or why the job failed.
>
> Would  you please provide some suggestions? Thank you very much for the help
>
> Min



-- 
Best Regards, Edward J. Yoon
@eddieyoon