You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Sanjay Radia <sr...@yahoo-inc.com> on 2011/06/29 01:43:00 UTC
Re: Developer meetup after the Hadoop Summit - Friday July 1st
I have updated meetup:
http://www.meetup.com/Hadoop-Contributors/events/23890191/
sanjay
On Jun 28, 2011, at 4:27 PM, Sanjay Radia wrote:
>
> On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote:
>
>> We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
>> sunnyvale campus.
>> Will update the meetup page shortly so that folks can register.
>
>
>
> Given that this is the friday before a long weekend, a number of
> folks have asked for an earlier start so that that can leave earlier.
> Hence I am going to change the start time to 9am. A little bit early
> for engineers, but ....
>
> sanjay
>
>
>>
>> sanjay
>>
>>
>>
>> On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
>>
>>> All,
>>> We are planning to have a Hadoop developer meetup in Sunnyvale
>>> during the day on July 1, which is the Friday after the Hadoop
>>> Summit. We are thinking about holding it in the morning, since it is
>>> a Friday before the long weekend. (Thursday is fairly occupied with
>>> other meetings around the Summit.) We will send details out shortly.
>>>
>>> Thanks,
>>> Owen
>>
>
Re:How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
I hate to write these code, although it can work
String javaOpts = conf.get("mapred.child.java.opts", "-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y");
javaOpts = "-Xmx200m -Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y";//javaOpts.replace("@taskid@", taskid.toString());
At 2011-06-29 20:39:35，skaterQiang <xq...@163.com> wrote:
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
Re:How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
I hate to write these code, although it can work
String javaOpts = conf.get("mapred.child.java.opts", "-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y");
javaOpts = "-Xmx200m -Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y";//javaOpts.replace("@taskid@", taskid.toString());
At 2011-06-29 20:39:35，skaterQiang <xq...@163.com> wrote:
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater