You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by dh...@wipro.com on 2015/09/14 06:39:00 UTC
unsubscribe
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
hadoop output in local not in remote
Posted by mehdi benchoufi <be...@gmail.com>.
Hi
I have some strange issue. I have some `MapR` code running fine on my
local, producing the desired output. With the same `input`, I get no output
when I use this code on some `google-cloud` remote cluster.
Here's the log :
15/09/14 09:23:35 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:35 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:36 INFO Configuration.deprecation: io.bytes.per.checksum
is deprecated. Instead, use dfs.bytes-per-checksum
15/09/14 09:23:36 INFO fs.TrashPolicyDefault: Namenode trash
configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted ../output
mehdibenchoufi@metamap-m:~$ hadoop jar jar/full_metamap.jar avro_input
output
15/09/14 09:23:48 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:49 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:50 INFO client.RMProxy: Connecting to ResourceManager at
metamap-m/10.240.231.143:8032
15/09/14 09:23:51 WARN mapreduce.JobSubmitter: Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/09/14 09:23:55 INFO input.FileInputFormat: Total input paths to
process : 2
15/09/14 09:23:56 INFO mapreduce.JobSubmitter: number of splits:2
15/09/14 09:23:58 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1442217060046_0001
15/09/14 09:23:59 INFO impl.YarnClientImpl: Submitted application
application_1442217060046_0001
15/09/14 09:23:59 INFO mapreduce.Job: The url to track the job:
http://metamap-m:8088/proxy/application_1442217060046_0001/
15/09/14 09:23:59 INFO mapreduce.Job: Running job:
job_1442217060046_0001
15/09/14 09:24:22 INFO mapreduce.Job: Job job_1442217060046_0001
running in uber mode : false
15/09/14 09:24:22 INFO mapreduce.Job: map 0% reduce 0%
15/09/14 09:24:41 INFO mapreduce.Job: map 16% reduce 0%
15/09/14 09:24:44 INFO mapreduce.Job: map 32% reduce 0%
15/09/14 09:24:45 INFO mapreduce.Job: map 51% reduce 0%
15/09/14 09:24:47 INFO mapreduce.Job: map 52% reduce 0%
15/09/14 09:24:53 INFO mapreduce.Job: map 53% reduce 0%
15/09/14 09:24:56 INFO mapreduce.Job: map 68% reduce 0%
15/09/14 09:24:57 INFO mapreduce.Job: map 68% reduce 1%
15/09/14 09:24:58 INFO mapreduce.Job: map 68% reduce 3%
15/09/14 09:24:59 INFO mapreduce.Job: map 100% reduce 3%
15/09/14 09:25:01 INFO mapreduce.Job: map 100% reduce 8%
15/09/14 09:25:03 INFO mapreduce.Job: map 100% reduce 32%
15/09/14 09:25:04 INFO mapreduce.Job: map 100% reduce 35%
15/09/14 09:25:08 INFO mapreduce.Job: map 100% reduce 40%
15/09/14 09:25:11 INFO mapreduce.Job: map 100% reduce 45%
15/09/14 09:25:12 INFO mapreduce.Job: map 100% reduce 55%
15/09/14 09:25:13 INFO mapreduce.Job: map 100% reduce 65%
15/09/14 09:25:14 INFO mapreduce.Job: map 100% reduce 70%
15/09/14 09:25:15 INFO mapreduce.Job: map 100% reduce 80%
15/09/14 09:25:19 INFO mapreduce.Job: map 100% reduce 85%
15/09/14 09:25:20 INFO mapreduce.Job: map 100% reduce 100%
15/09/14 09:26:08 INFO mapreduce.Job: Job job_1442217060046_0001
completed successfully
15/09/14 09:26:08 INFO mapreduce.Job: Counters: 51
File System Counters
FILE: Number of bytes read=128
FILE: Number of bytes written=6484874
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
GS: Number of bytes read=72553378
GS: Number of bytes written=2
GS: Number of read operations=0
GS: Number of large read operations=0
GS: Number of write operations=0
Job Counters
Killed map tasks=1
Killed reduce tasks=1
Launched map tasks=3
Launched reduce tasks=21
Rack-local map tasks=3
Total time spent by all maps in occupied slots (ms)=127110
Total time spent by all reduces in occupied slots (ms)=998415
Total time spent by all map tasks (ms)=63555
Total time spent by all reduce tasks (ms)=199683
Total vcore-seconds taken by all map tasks=63555
Total vcore-seconds taken by all reduce tasks=399366
Total megabyte-seconds taken by all map tasks=130160640
Total megabyte-seconds taken by all reduce tasks=1022376960
Map-Reduce Framework
Map input records=5978
Map output records=5978
Map output bytes=11956
Map output materialized bytes=248
Input split bytes=208
Combine input records=5978
Combine output records=2
Reduce input groups=1
Reduce shuffle bytes=248
Reduce input records=2
Reduce output records=1
Spilled Records=4
Shuffled Maps =40
Failed Shuffles=0
Merged Map outputs=40
GC time elapsed (ms)=916
CPU time spent (ms)=60290
Physical memory (bytes) snapshot=6689841152
Virtual memory (bytes) snapshot=104437014528
Total committed heap usage (bytes)=6258425856
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=72553170
File Output Format Counters
Bytes Written=2
Could someone help ?
Best regards,
Mehdi
RE: unsubscribe
Posted by Brahma Reddy Battula <br...@huawei.com>.
Kindly Drop a mail to user-unsubscribe@hadoop.apache.org
Thanks & Regards
Brahma Reddy Battula
________________________________
From: dhvanika.shah@wipro.com [dhvanika.shah@wipro.com]
Sent: Monday, September 14, 2015 10:09 AM
To: user@hadoop.apache.org
Subject: unsubscribe
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
hadoop output in local not in remote
Posted by mehdi benchoufi <be...@gmail.com>.
Hi
I have some strange issue. I have some `MapR` code running fine on my
local, producing the desired output. With the same `input`, I get no output
when I use this code on some `google-cloud` remote cluster.
Here's the log :
15/09/14 09:23:35 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:35 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:36 INFO Configuration.deprecation: io.bytes.per.checksum
is deprecated. Instead, use dfs.bytes-per-checksum
15/09/14 09:23:36 INFO fs.TrashPolicyDefault: Namenode trash
configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted ../output
mehdibenchoufi@metamap-m:~$ hadoop jar jar/full_metamap.jar avro_input
output
15/09/14 09:23:48 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:49 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:50 INFO client.RMProxy: Connecting to ResourceManager at
metamap-m/10.240.231.143:8032
15/09/14 09:23:51 WARN mapreduce.JobSubmitter: Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/09/14 09:23:55 INFO input.FileInputFormat: Total input paths to
process : 2
15/09/14 09:23:56 INFO mapreduce.JobSubmitter: number of splits:2
15/09/14 09:23:58 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1442217060046_0001
15/09/14 09:23:59 INFO impl.YarnClientImpl: Submitted application
application_1442217060046_0001
15/09/14 09:23:59 INFO mapreduce.Job: The url to track the job:
http://metamap-m:8088/proxy/application_1442217060046_0001/
15/09/14 09:23:59 INFO mapreduce.Job: Running job:
job_1442217060046_0001
15/09/14 09:24:22 INFO mapreduce.Job: Job job_1442217060046_0001
running in uber mode : false
15/09/14 09:24:22 INFO mapreduce.Job: map 0% reduce 0%
15/09/14 09:24:41 INFO mapreduce.Job: map 16% reduce 0%
15/09/14 09:24:44 INFO mapreduce.Job: map 32% reduce 0%
15/09/14 09:24:45 INFO mapreduce.Job: map 51% reduce 0%
15/09/14 09:24:47 INFO mapreduce.Job: map 52% reduce 0%
15/09/14 09:24:53 INFO mapreduce.Job: map 53% reduce 0%
15/09/14 09:24:56 INFO mapreduce.Job: map 68% reduce 0%
15/09/14 09:24:57 INFO mapreduce.Job: map 68% reduce 1%
15/09/14 09:24:58 INFO mapreduce.Job: map 68% reduce 3%
15/09/14 09:24:59 INFO mapreduce.Job: map 100% reduce 3%
15/09/14 09:25:01 INFO mapreduce.Job: map 100% reduce 8%
15/09/14 09:25:03 INFO mapreduce.Job: map 100% reduce 32%
15/09/14 09:25:04 INFO mapreduce.Job: map 100% reduce 35%
15/09/14 09:25:08 INFO mapreduce.Job: map 100% reduce 40%
15/09/14 09:25:11 INFO mapreduce.Job: map 100% reduce 45%
15/09/14 09:25:12 INFO mapreduce.Job: map 100% reduce 55%
15/09/14 09:25:13 INFO mapreduce.Job: map 100% reduce 65%
15/09/14 09:25:14 INFO mapreduce.Job: map 100% reduce 70%
15/09/14 09:25:15 INFO mapreduce.Job: map 100% reduce 80%
15/09/14 09:25:19 INFO mapreduce.Job: map 100% reduce 85%
15/09/14 09:25:20 INFO mapreduce.Job: map 100% reduce 100%
15/09/14 09:26:08 INFO mapreduce.Job: Job job_1442217060046_0001
completed successfully
15/09/14 09:26:08 INFO mapreduce.Job: Counters: 51
File System Counters
FILE: Number of bytes read=128
FILE: Number of bytes written=6484874
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
GS: Number of bytes read=72553378
GS: Number of bytes written=2
GS: Number of read operations=0
GS: Number of large read operations=0
GS: Number of write operations=0
Job Counters
Killed map tasks=1
Killed reduce tasks=1
Launched map tasks=3
Launched reduce tasks=21
Rack-local map tasks=3
Total time spent by all maps in occupied slots (ms)=127110
Total time spent by all reduces in occupied slots (ms)=998415
Total time spent by all map tasks (ms)=63555
Total time spent by all reduce tasks (ms)=199683
Total vcore-seconds taken by all map tasks=63555
Total vcore-seconds taken by all reduce tasks=399366
Total megabyte-seconds taken by all map tasks=130160640
Total megabyte-seconds taken by all reduce tasks=1022376960
Map-Reduce Framework
Map input records=5978
Map output records=5978
Map output bytes=11956
Map output materialized bytes=248
Input split bytes=208
Combine input records=5978
Combine output records=2
Reduce input groups=1
Reduce shuffle bytes=248
Reduce input records=2
Reduce output records=1
Spilled Records=4
Shuffled Maps =40
Failed Shuffles=0
Merged Map outputs=40
GC time elapsed (ms)=916
CPU time spent (ms)=60290
Physical memory (bytes) snapshot=6689841152
Virtual memory (bytes) snapshot=104437014528
Total committed heap usage (bytes)=6258425856
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=72553170
File Output Format Counters
Bytes Written=2
Could someone help ?
Best regards,
Mehdi
RE: unsubscribe
Posted by Brahma Reddy Battula <br...@huawei.com>.
Kindly Drop a mail to user-unsubscribe@hadoop.apache.org
Thanks & Regards
Brahma Reddy Battula
________________________________
From: dhvanika.shah@wipro.com [dhvanika.shah@wipro.com]
Sent: Monday, September 14, 2015 10:09 AM
To: user@hadoop.apache.org
Subject: unsubscribe
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
RE: unsubscribe
Posted by Brahma Reddy Battula <br...@huawei.com>.
Kindly Drop a mail to user-unsubscribe@hadoop.apache.org
Thanks & Regards
Brahma Reddy Battula
________________________________
From: dhvanika.shah@wipro.com [dhvanika.shah@wipro.com]
Sent: Monday, September 14, 2015 10:09 AM
To: user@hadoop.apache.org
Subject: unsubscribe
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
hadoop output in local not in remote
Posted by mehdi benchoufi <be...@gmail.com>.
Hi
I have some strange issue. I have some `MapR` code running fine on my
local, producing the desired output. With the same `input`, I get no output
when I use this code on some `google-cloud` remote cluster.
Here's the log :
15/09/14 09:23:35 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:35 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:36 INFO Configuration.deprecation: io.bytes.per.checksum
is deprecated. Instead, use dfs.bytes-per-checksum
15/09/14 09:23:36 INFO fs.TrashPolicyDefault: Namenode trash
configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted ../output
mehdibenchoufi@metamap-m:~$ hadoop jar jar/full_metamap.jar avro_input
output
15/09/14 09:23:48 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:49 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:50 INFO client.RMProxy: Connecting to ResourceManager at
metamap-m/10.240.231.143:8032
15/09/14 09:23:51 WARN mapreduce.JobSubmitter: Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/09/14 09:23:55 INFO input.FileInputFormat: Total input paths to
process : 2
15/09/14 09:23:56 INFO mapreduce.JobSubmitter: number of splits:2
15/09/14 09:23:58 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1442217060046_0001
15/09/14 09:23:59 INFO impl.YarnClientImpl: Submitted application
application_1442217060046_0001
15/09/14 09:23:59 INFO mapreduce.Job: The url to track the job:
http://metamap-m:8088/proxy/application_1442217060046_0001/
15/09/14 09:23:59 INFO mapreduce.Job: Running job:
job_1442217060046_0001
15/09/14 09:24:22 INFO mapreduce.Job: Job job_1442217060046_0001
running in uber mode : false
15/09/14 09:24:22 INFO mapreduce.Job: map 0% reduce 0%
15/09/14 09:24:41 INFO mapreduce.Job: map 16% reduce 0%
15/09/14 09:24:44 INFO mapreduce.Job: map 32% reduce 0%
15/09/14 09:24:45 INFO mapreduce.Job: map 51% reduce 0%
15/09/14 09:24:47 INFO mapreduce.Job: map 52% reduce 0%
15/09/14 09:24:53 INFO mapreduce.Job: map 53% reduce 0%
15/09/14 09:24:56 INFO mapreduce.Job: map 68% reduce 0%
15/09/14 09:24:57 INFO mapreduce.Job: map 68% reduce 1%
15/09/14 09:24:58 INFO mapreduce.Job: map 68% reduce 3%
15/09/14 09:24:59 INFO mapreduce.Job: map 100% reduce 3%
15/09/14 09:25:01 INFO mapreduce.Job: map 100% reduce 8%
15/09/14 09:25:03 INFO mapreduce.Job: map 100% reduce 32%
15/09/14 09:25:04 INFO mapreduce.Job: map 100% reduce 35%
15/09/14 09:25:08 INFO mapreduce.Job: map 100% reduce 40%
15/09/14 09:25:11 INFO mapreduce.Job: map 100% reduce 45%
15/09/14 09:25:12 INFO mapreduce.Job: map 100% reduce 55%
15/09/14 09:25:13 INFO mapreduce.Job: map 100% reduce 65%
15/09/14 09:25:14 INFO mapreduce.Job: map 100% reduce 70%
15/09/14 09:25:15 INFO mapreduce.Job: map 100% reduce 80%
15/09/14 09:25:19 INFO mapreduce.Job: map 100% reduce 85%
15/09/14 09:25:20 INFO mapreduce.Job: map 100% reduce 100%
15/09/14 09:26:08 INFO mapreduce.Job: Job job_1442217060046_0001
completed successfully
15/09/14 09:26:08 INFO mapreduce.Job: Counters: 51
File System Counters
FILE: Number of bytes read=128
FILE: Number of bytes written=6484874
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
GS: Number of bytes read=72553378
GS: Number of bytes written=2
GS: Number of read operations=0
GS: Number of large read operations=0
GS: Number of write operations=0
Job Counters
Killed map tasks=1
Killed reduce tasks=1
Launched map tasks=3
Launched reduce tasks=21
Rack-local map tasks=3
Total time spent by all maps in occupied slots (ms)=127110
Total time spent by all reduces in occupied slots (ms)=998415
Total time spent by all map tasks (ms)=63555
Total time spent by all reduce tasks (ms)=199683
Total vcore-seconds taken by all map tasks=63555
Total vcore-seconds taken by all reduce tasks=399366
Total megabyte-seconds taken by all map tasks=130160640
Total megabyte-seconds taken by all reduce tasks=1022376960
Map-Reduce Framework
Map input records=5978
Map output records=5978
Map output bytes=11956
Map output materialized bytes=248
Input split bytes=208
Combine input records=5978
Combine output records=2
Reduce input groups=1
Reduce shuffle bytes=248
Reduce input records=2
Reduce output records=1
Spilled Records=4
Shuffled Maps =40
Failed Shuffles=0
Merged Map outputs=40
GC time elapsed (ms)=916
CPU time spent (ms)=60290
Physical memory (bytes) snapshot=6689841152
Virtual memory (bytes) snapshot=104437014528
Total committed heap usage (bytes)=6258425856
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=72553170
File Output Format Counters
Bytes Written=2
Could someone help ?
Best regards,
Mehdi
RE: unsubscribe
Posted by Brahma Reddy Battula <br...@huawei.com>.
Kindly Drop a mail to user-unsubscribe@hadoop.apache.org
Thanks & Regards
Brahma Reddy Battula
________________________________
From: dhvanika.shah@wipro.com [dhvanika.shah@wipro.com]
Sent: Monday, September 14, 2015 10:09 AM
To: user@hadoop.apache.org
Subject: unsubscribe
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
hadoop output in local not in remote
Posted by mehdi benchoufi <be...@gmail.com>.
Hi
I have some strange issue. I have some `MapR` code running fine on my
local, producing the desired output. With the same `input`, I get no output
when I use this code on some `google-cloud` remote cluster.
Here's the log :
15/09/14 09:23:35 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:35 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:36 INFO Configuration.deprecation: io.bytes.per.checksum
is deprecated. Instead, use dfs.bytes-per-checksum
15/09/14 09:23:36 INFO fs.TrashPolicyDefault: Namenode trash
configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
Deleted ../output
mehdibenchoufi@metamap-m:~$ hadoop jar jar/full_metamap.jar avro_input
output
15/09/14 09:23:48 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
15/09/14 09:23:49 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
15/09/14 09:23:50 INFO client.RMProxy: Connecting to ResourceManager at
metamap-m/10.240.231.143:8032
15/09/14 09:23:51 WARN mapreduce.JobSubmitter: Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/09/14 09:23:55 INFO input.FileInputFormat: Total input paths to
process : 2
15/09/14 09:23:56 INFO mapreduce.JobSubmitter: number of splits:2
15/09/14 09:23:58 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1442217060046_0001
15/09/14 09:23:59 INFO impl.YarnClientImpl: Submitted application
application_1442217060046_0001
15/09/14 09:23:59 INFO mapreduce.Job: The url to track the job:
http://metamap-m:8088/proxy/application_1442217060046_0001/
15/09/14 09:23:59 INFO mapreduce.Job: Running job:
job_1442217060046_0001
15/09/14 09:24:22 INFO mapreduce.Job: Job job_1442217060046_0001
running in uber mode : false
15/09/14 09:24:22 INFO mapreduce.Job: map 0% reduce 0%
15/09/14 09:24:41 INFO mapreduce.Job: map 16% reduce 0%
15/09/14 09:24:44 INFO mapreduce.Job: map 32% reduce 0%
15/09/14 09:24:45 INFO mapreduce.Job: map 51% reduce 0%
15/09/14 09:24:47 INFO mapreduce.Job: map 52% reduce 0%
15/09/14 09:24:53 INFO mapreduce.Job: map 53% reduce 0%
15/09/14 09:24:56 INFO mapreduce.Job: map 68% reduce 0%
15/09/14 09:24:57 INFO mapreduce.Job: map 68% reduce 1%
15/09/14 09:24:58 INFO mapreduce.Job: map 68% reduce 3%
15/09/14 09:24:59 INFO mapreduce.Job: map 100% reduce 3%
15/09/14 09:25:01 INFO mapreduce.Job: map 100% reduce 8%
15/09/14 09:25:03 INFO mapreduce.Job: map 100% reduce 32%
15/09/14 09:25:04 INFO mapreduce.Job: map 100% reduce 35%
15/09/14 09:25:08 INFO mapreduce.Job: map 100% reduce 40%
15/09/14 09:25:11 INFO mapreduce.Job: map 100% reduce 45%
15/09/14 09:25:12 INFO mapreduce.Job: map 100% reduce 55%
15/09/14 09:25:13 INFO mapreduce.Job: map 100% reduce 65%
15/09/14 09:25:14 INFO mapreduce.Job: map 100% reduce 70%
15/09/14 09:25:15 INFO mapreduce.Job: map 100% reduce 80%
15/09/14 09:25:19 INFO mapreduce.Job: map 100% reduce 85%
15/09/14 09:25:20 INFO mapreduce.Job: map 100% reduce 100%
15/09/14 09:26:08 INFO mapreduce.Job: Job job_1442217060046_0001
completed successfully
15/09/14 09:26:08 INFO mapreduce.Job: Counters: 51
File System Counters
FILE: Number of bytes read=128
FILE: Number of bytes written=6484874
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
GS: Number of bytes read=72553378
GS: Number of bytes written=2
GS: Number of read operations=0
GS: Number of large read operations=0
GS: Number of write operations=0
Job Counters
Killed map tasks=1
Killed reduce tasks=1
Launched map tasks=3
Launched reduce tasks=21
Rack-local map tasks=3
Total time spent by all maps in occupied slots (ms)=127110
Total time spent by all reduces in occupied slots (ms)=998415
Total time spent by all map tasks (ms)=63555
Total time spent by all reduce tasks (ms)=199683
Total vcore-seconds taken by all map tasks=63555
Total vcore-seconds taken by all reduce tasks=399366
Total megabyte-seconds taken by all map tasks=130160640
Total megabyte-seconds taken by all reduce tasks=1022376960
Map-Reduce Framework
Map input records=5978
Map output records=5978
Map output bytes=11956
Map output materialized bytes=248
Input split bytes=208
Combine input records=5978
Combine output records=2
Reduce input groups=1
Reduce shuffle bytes=248
Reduce input records=2
Reduce output records=1
Spilled Records=4
Shuffled Maps =40
Failed Shuffles=0
Merged Map outputs=40
GC time elapsed (ms)=916
CPU time spent (ms)=60290
Physical memory (bytes) snapshot=6689841152
Virtual memory (bytes) snapshot=104437014528
Total committed heap usage (bytes)=6258425856
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=72553170
File Output Format Counters
Bytes Written=2
Could someone help ?
Best regards,
Mehdi