You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Owen O'Malley <oo...@yahoo-inc.com> on 2011/06/07 20:21:39 UTC
Developer meetup after the Hadoop Summit
All,
We are planning to have a Hadoop developer meetup in Sunnyvale during the day on July 1, which is the Friday after the Hadoop Summit. We are thinking about holding it in the morning, since it is a Friday before the long weekend. (Thursday is fairly occupied with other meetings around the Summit.) We will send details out shortly.
Thanks,
Owen
Re:How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
I hate to write these code, although it can work
String javaOpts = conf.get("mapred.child.java.opts", "-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y");
javaOpts = "-Xmx200m -Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y";//javaOpts.replace("@taskid@", taskid.toString());
At 2011-06-29 20:39:35，skaterQiang <xq...@163.com> wrote:
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
Re:How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
I hate to write these code, although it can work
String javaOpts = conf.get("mapred.child.java.opts", "-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y");
javaOpts = "-Xmx200m -Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y";//javaOpts.replace("@taskid@", taskid.toString());
At 2011-06-29 20:39:35，skaterQiang <xq...@163.com> wrote:
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
How to debug map reduce in distributed model
Posted by skaterQiang <xq...@163.com>.
Hello guys:
I want to debug the map reduce tasks, especially org.apache.hadoop.mapred.ReduceTask
I want to understand how the data flow work.
So I add the following in the mapred-site.xml
<property>
<name>mapred.child.java.opts</name>
<value>-Xdebug -Xrunjdwp:transport=dt_socket,address=8888,server=y,suspend=y</value>
</property>
mapreduce.tasktracker.map.tasks.maximum 1
mapreduce.tasktracker.reduce.tasks.maximum 1
But by debugging JvmRunner, the -Xdebug is not added into the JVM start up command.
Why? Is there some where guard this?
Or I have to build hadoop with my debug code?
Regards,
Skater
Re: Developer meetup after the Hadoop Summit - Friday July 1st
Posted by Sanjay Radia <sr...@yahoo-inc.com>.
I have updated meetup:
http://www.meetup.com/Hadoop-Contributors/events/23890191/
sanjay
On Jun 28, 2011, at 4:27 PM, Sanjay Radia wrote:
>
> On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote:
>
>> We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
>> sunnyvale campus.
>> Will update the meetup page shortly so that folks can register.
>
>
>
> Given that this is the friday before a long weekend, a number of
> folks have asked for an earlier start so that that can leave earlier.
> Hence I am going to change the start time to 9am. A little bit early
> for engineers, but ....
>
> sanjay
>
>
>>
>> sanjay
>>
>>
>>
>> On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
>>
>>> All,
>>> We are planning to have a Hadoop developer meetup in Sunnyvale
>>> during the day on July 1, which is the Friday after the Hadoop
>>> Summit. We are thinking about holding it in the morning, since it is
>>> a Friday before the long weekend. (Thursday is fairly occupied with
>>> other meetings around the Summit.) We will send details out shortly.
>>>
>>> Thanks,
>>> Owen
>>
>
Re: Developer meetup after the Hadoop Summit - Friday July 1st
Posted by Sanjay Radia <sr...@yahoo-inc.com>.
I have updated meetup:
http://www.meetup.com/Hadoop-Contributors/events/23890191/
sanjay
On Jun 28, 2011, at 4:27 PM, Sanjay Radia wrote:
>
> On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote:
>
>> We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
>> sunnyvale campus.
>> Will update the meetup page shortly so that folks can register.
>
>
>
> Given that this is the friday before a long weekend, a number of
> folks have asked for an earlier start so that that can leave earlier.
> Hence I am going to change the start time to 9am. A little bit early
> for engineers, but ....
>
> sanjay
>
>
>>
>> sanjay
>>
>>
>>
>> On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
>>
>>> All,
>>> We are planning to have a Hadoop developer meetup in Sunnyvale
>>> during the day on July 1, which is the Friday after the Hadoop
>>> Summit. We are thinking about holding it in the morning, since it is
>>> a Friday before the long weekend. (Thursday is fairly occupied with
>>> other meetings around the Summit.) We will send details out shortly.
>>>
>>> Thanks,
>>> Owen
>>
>
Re: Developer meetup after the Hadoop Summit - Friday July 1st
Posted by Sanjay Radia <sr...@yahoo-inc.com>.
I have updated meetup:
http://www.meetup.com/Hadoop-Contributors/events/23890191/
sanjay
On Jun 28, 2011, at 4:27 PM, Sanjay Radia wrote:
>
> On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote:
>
>> We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
>> sunnyvale campus.
>> Will update the meetup page shortly so that folks can register.
>
>
>
> Given that this is the friday before a long weekend, a number of
> folks have asked for an earlier start so that that can leave earlier.
> Hence I am going to change the start time to 9am. A little bit early
> for engineers, but ....
>
> sanjay
>
>
>>
>> sanjay
>>
>>
>>
>> On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
>>
>>> All,
>>> We are planning to have a Hadoop developer meetup in Sunnyvale
>>> during the day on July 1, which is the Friday after the Hadoop
>>> Summit. We are thinking about holding it in the morning, since it is
>>> a Friday before the long weekend. (Thursday is fairly occupied with
>>> other meetings around the Summit.) We will send details out shortly.
>>>
>>> Thanks,
>>> Owen
>>
>
Re: Developer meetup after the Hadoop Summit - Friday July 1st
Posted by Sanjay Radia <sr...@yahoo-inc.com>.
On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote:
> We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
> sunnyvale campus.
> Will update the meetup page shortly so that folks can register.
Given that this is the friday before a long weekend, a number of
folks have asked for an earlier start so that that can leave earlier.
Hence I am going to change the start time to 9am. A little bit early
for engineers, but ....
sanjay
>
> sanjay
>
>
>
> On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
>
>> All,
>> We are planning to have a Hadoop developer meetup in Sunnyvale
>> during the day on July 1, which is the Friday after the Hadoop
>> Summit. We are thinking about holding it in the morning, since it is
>> a Friday before the long weekend. (Thursday is fairly occupied with
>> other meetings around the Summit.) We will send details out shortly.
>>
>> Thanks,
>> Owen
>
Re: Developer meetup after the Hadoop Summit - Friday July 1st
Posted by Sanjay Radia <sr...@yahoo-inc.com>.
We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's
sunnyvale campus.
Will update the meetup page shortly so that folks can register.
sanjay
On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote:
> All,
> We are planning to have a Hadoop developer meetup in Sunnyvale
> during the day on July 1, which is the Friday after the Hadoop
> Summit. We are thinking about holding it in the morning, since it is
> a Friday before the long weekend. (Thursday is fairly occupied with
> other meetings around the Summit.) We will send details out shortly.
>
> Thanks,
> Owen
Re: Developer meetup after the Hadoop Summit
Posted by Alan Gates <ga...@yahoo-inc.com>.
There is also a Pig user meetup the day after: http://www.meetup.com/PigUser/events/21215831/
Alan.
On Jun 7, 2011, at 2:01 PM, Shrinivas Joshi wrote:
> Hi Owen,
>
> If possible, could you please send the list of events surrounding
> Hadoop
> Summit that might be interesting to summit attendees?
>
> The two I know of are BigDataCamp
> http://bigdatacamp-santaclara-2011.eventbrite.com/ happening the day
> before
> and HBase Contributor day at Y! happening the day after
> http://www.meetup.com/hbaseusergroup/events/20572251/
>
> Thanks,
> -Shrinivas
>
> On Tue, Jun 7, 2011 at 1:21 PM, Owen O'Malley <oo...@yahoo-inc.com>
> wrote:
>
>> All,
>> We are planning to have a Hadoop developer meetup in Sunnyvale
>> during the
>> day on July 1, which is the Friday after the Hadoop Summit. We are
>> thinking
>> about holding it in the morning, since it is a Friday before the long
>> weekend. (Thursday is fairly occupied with other meetings around the
>> Summit.) We will send details out shortly.
>>
>> Thanks,
>> Owen
Re: Developer meetup after the Hadoop Summit
Posted by Shrinivas Joshi <js...@gmail.com>.
Hi Owen,
If possible, could you please send the list of events surrounding Hadoop
Summit that might be interesting to summit attendees?
The two I know of are BigDataCamp
http://bigdatacamp-santaclara-2011.eventbrite.com/ happening the day before
and HBase Contributor day at Y! happening the day after
http://www.meetup.com/hbaseusergroup/events/20572251/
Thanks,
-Shrinivas
On Tue, Jun 7, 2011 at 1:21 PM, Owen O'Malley <oo...@yahoo-inc.com> wrote:
> All,
> We are planning to have a Hadoop developer meetup in Sunnyvale during the
> day on July 1, which is the Friday after the Hadoop Summit. We are thinking
> about holding it in the morning, since it is a Friday before the long
> weekend. (Thursday is fairly occupied with other meetings around the
> Summit.) We will send details out shortly.
>
> Thanks,
> Owen