hadoop output in local not in remote

[mehdi benchoufi <be...@gmail.com>]

Hi

I have some strange issue. I have some `MapR` code running fine on my
local, producing the desired output. With the same `input`, I get no output
when I use this code on some `google-cloud` remote cluster.

Here's the log :

    15/09/14 09:23:35 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
    15/09/14 09:23:35 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
    15/09/14 09:23:36 INFO Configuration.deprecation: io.bytes.per.checksum
is deprecated. Instead, use dfs.bytes-per-checksum
    15/09/14 09:23:36 INFO fs.TrashPolicyDefault: Namenode trash
configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes.
    Deleted ../output
    mehdibenchoufi@metamap-m:~$ hadoop jar jar/full_metamap.jar avro_input
output
    15/09/14 09:23:48 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
    15/09/14 09:23:49 INFO gcs.GoogleHadoopFileSystemBase: GHFS version:
1.4.0-hadoop2
    15/09/14 09:23:50 INFO client.RMProxy: Connecting to ResourceManager at
metamap-m/10.240.231.143:8032
    15/09/14 09:23:51 WARN mapreduce.JobSubmitter: Hadoop command-line
option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
    15/09/14 09:23:55 INFO input.FileInputFormat: Total input paths to
process : 2
    15/09/14 09:23:56 INFO mapreduce.JobSubmitter: number of splits:2
    15/09/14 09:23:58 INFO mapreduce.JobSubmitter: Submitting tokens for
job: job_1442217060046_0001
    15/09/14 09:23:59 INFO impl.YarnClientImpl: Submitted application
application_1442217060046_0001
    15/09/14 09:23:59 INFO mapreduce.Job: The url to track the job:
http://metamap-m:8088/proxy/application_1442217060046_0001/
    15/09/14 09:23:59 INFO mapreduce.Job: Running job:
job_1442217060046_0001
    15/09/14 09:24:22 INFO mapreduce.Job: Job job_1442217060046_0001
running in uber mode : false
    15/09/14 09:24:22 INFO mapreduce.Job:  map 0% reduce 0%
    15/09/14 09:24:41 INFO mapreduce.Job:  map 16% reduce 0%
    15/09/14 09:24:44 INFO mapreduce.Job:  map 32% reduce 0%
    15/09/14 09:24:45 INFO mapreduce.Job:  map 51% reduce 0%
    15/09/14 09:24:47 INFO mapreduce.Job:  map 52% reduce 0%
    15/09/14 09:24:53 INFO mapreduce.Job:  map 53% reduce 0%
    15/09/14 09:24:56 INFO mapreduce.Job:  map 68% reduce 0%
    15/09/14 09:24:57 INFO mapreduce.Job:  map 68% reduce 1%
    15/09/14 09:24:58 INFO mapreduce.Job:  map 68% reduce 3%
    15/09/14 09:24:59 INFO mapreduce.Job:  map 100% reduce 3%
    15/09/14 09:25:01 INFO mapreduce.Job:  map 100% reduce 8%
    15/09/14 09:25:03 INFO mapreduce.Job:  map 100% reduce 32%
    15/09/14 09:25:04 INFO mapreduce.Job:  map 100% reduce 35%
    15/09/14 09:25:08 INFO mapreduce.Job:  map 100% reduce 40%
    15/09/14 09:25:11 INFO mapreduce.Job:  map 100% reduce 45%
    15/09/14 09:25:12 INFO mapreduce.Job:  map 100% reduce 55%
    15/09/14 09:25:13 INFO mapreduce.Job:  map 100% reduce 65%
    15/09/14 09:25:14 INFO mapreduce.Job:  map 100% reduce 70%
    15/09/14 09:25:15 INFO mapreduce.Job:  map 100% reduce 80%
    15/09/14 09:25:19 INFO mapreduce.Job:  map 100% reduce 85%
    15/09/14 09:25:20 INFO mapreduce.Job:  map 100% reduce 100%
    15/09/14 09:26:08 INFO mapreduce.Job: Job job_1442217060046_0001
completed successfully
    15/09/14 09:26:08 INFO mapreduce.Job: Counters: 51
    File System Counters
    FILE: Number of bytes read=128
    FILE: Number of bytes written=6484874
    FILE: Number of read operations=0
    FILE: Number of large read operations=0
    FILE: Number of write operations=0
    GS: Number of bytes read=72553378
    GS: Number of bytes written=2
    GS: Number of read operations=0
    GS: Number of large read operations=0
    GS: Number of write operations=0
    Job Counters
    Killed map tasks=1
    Killed reduce tasks=1
    Launched map tasks=3
    Launched reduce tasks=21
    Rack-local map tasks=3
    Total time spent by all maps in occupied slots (ms)=127110
    Total time spent by all reduces in occupied slots (ms)=998415
    Total time spent by all map tasks (ms)=63555
    Total time spent by all reduce tasks (ms)=199683
    Total vcore-seconds taken by all map tasks=63555
    Total vcore-seconds taken by all reduce tasks=399366
    Total megabyte-seconds taken by all map tasks=130160640
    Total megabyte-seconds taken by all reduce tasks=1022376960
    Map-Reduce Framework
    Map input records=5978
    Map output records=5978
    Map output bytes=11956
    Map output materialized bytes=248
    Input split bytes=208
    Combine input records=5978
    Combine output records=2
    Reduce input groups=1
    Reduce shuffle bytes=248
    Reduce input records=2
    Reduce output records=1
    Spilled Records=4
    Shuffled Maps =40
    Failed Shuffles=0
    Merged Map outputs=40
    GC time elapsed (ms)=916
    CPU time spent (ms)=60290
    Physical memory (bytes) snapshot=6689841152
    Virtual memory (bytes) snapshot=104437014528
    Total committed heap usage (bytes)=6258425856
    Shuffle Errors
    BAD_ID=0
    CONNECTION=0
    IO_ERROR=0
    WRONG_LENGTH=0
    WRONG_MAP=0
    WRONG_REDUCE=0
    File Input Format Counters
    Bytes Read=72553170
    File Output Format Counters
    Bytes Written=2

Could someone help ?

Best regards,
Mehdi