You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Binglin Chang (JIRA)" <ji...@apache.org> on 2014/04/28 10:47:16 UTC

[jira] [Commented] (MAPREDUCE-5864) The part-r-00000 did not generate when I run a sample, wordcount with non-ascii path.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982841#comment-13982841 ] 

Binglin Chang commented on MAPREDUCE-5864:
------------------------------------------

More details:

{code}
2014-04-28 08:40:29,574 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 50 bytes
2014-04-28 08:40:29,705 INFO org.apache.hadoop.mapred.Task: Task:attempt_201404220359_0033_r_000000_0 is done. And is in the process of commiting
2014-04-28 08:40:30,774 INFO org.apache.hadoop.mapred.Task: Task attempt_201404220359_0033_r_000000_0 is allowed to commit now
2014-04-28 08:40:30,785 INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_201404220359_0033_r_000000_0' to /dex/en??/output
2014-04-28 08:40:30,790 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201404220359_0033_r_000000_0' done.

[serengeti@wdc-vhadp-pub2-dhcp-72-245 ~]$ hadoop fs -ls /dex/en??/output
-rw-r--r--   3 serengeti hadoop          0 2014-04-28 08:40 /dex/en??/output/_SUCCESS
-rw-r--r--   3 serengeti hadoop         36 2014-04-28 08:40 /dex/en??/output/part-r-00000
drwxrwxr-x   - serengeti hadoop          0 2014-04-28 08:40 /dex/en中文/output/_logs
{code}

Looks like the some of the Chinese character is replaced to "??",  _SUCCESS and part files are affected, but _SUCCESS file are just fine.



> The part-r-00000 did not generate when I run a sample, wordcount with non-ascii path.
> -------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5864
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5864
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: applicationmaster
>    Affects Versions: 1.2.1
>         Environment: CentOS 
>            Reporter: Lizhao.Du
>            Assignee: Binglin Chang
>             Fix For: 1.2.1
>
>         Attachments: HadoopMapReduce_nonASCII_PATH.png
>
>
> When I run a command, hadoop jar /opt/serengeti/hadoop-examples-1.2.1.jar wordcount /user/Administrator/测试/input  /user/Administrator/测试/output, the output seem that it succeeded. But, only _logs can be generated under the /user/Administrator/测试/output.  The file _SUCCESS and part-r-00000 have not generated.



--
This message was sent by Atlassian JIRA
(v6.2#6252)