You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rekha Joshi (JIRA)" <ji...@apache.org> on 2014/05/25 02:25:01 UTC

[jira] [Resolved] (TEZ-822) map progress report NaN when it is running randomwriter

     [ https://issues.apache.org/jira/browse/TEZ-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rekha Joshi resolved TEZ-822.
-----------------------------

          Resolution: Implemented
       Fix Version/s: 0.5.0
    Target Version/s: 0.5.0

Hi Chen,

I tried it several times on my tez environment (0.5.0) and cannot reproduce it.Below logs -

hadoop jar <my-tez-path>/tez-mapreduce-examples-0.5.0-incubating-SNAPSHOT.jar randomwriter out3
2014-05-24 17:10:49.067 java[9827:1003] Unable to load realm mapping info from SCDynamicStore
14/05/24 17:10:49 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/05/24 17:10:49 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/05/24 17:10:49 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
Running 10 maps.
Job started: Sat May 24 17:10:50 PDT 2014
14/05/24 17:10:50 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/05/24 17:10:50 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/05/24 17:10:51 INFO mapreduce.JobSubmitter: number of splits:10
14/05/24 17:10:51 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1400975042027_0006
14/05/24 17:10:51 INFO client.YARNRunner: Number of stages: 1
14/05/24 17:10:51 INFO Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
14/05/24 17:10:52 INFO client.TezClient: Submitting DAG to YARN, applicationId=application_1400975042027_0006, dagName=random-writer
14/05/24 17:10:52 INFO impl.YarnClientImpl: Submitted application application_1400975042027_0006
14/05/24 17:10:52 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/05/24 17:10:52 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
14/05/24 17:10:52 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1400975042027_0006/
14/05/24 17:10:52 INFO mapreduce.Job: Running job: job_1400975042027_0006
14/05/24 17:10:58 INFO mapreduce.Job: Job job_1400975042027_0006 running in uber mode : false
14/05/24 17:10:58 INFO mapreduce.Job:  map 0% reduce 0%
14/05/24 17:12:24 INFO mapreduce.Job:  map 10% reduce 0%
14/05/24 17:12:28 INFO mapreduce.Job:  map 20% reduce 0%
14/05/24 17:12:33 INFO mapreduce.Job:  map 30% reduce 0%
14/05/24 17:12:34 INFO mapreduce.Job:  map 40% reduce 0%
14/05/24 17:12:36 INFO mapreduce.Job:  map 60% reduce 0%
14/05/24 17:13:09 INFO mapreduce.Job:  map 70% reduce 0%
14/05/24 17:13:13 INFO mapreduce.Job:  map 80% reduce 0%
14/05/24 17:13:14 INFO mapreduce.Job:  map 90% reduce 0%
14/05/24 17:13:15 INFO mapreduce.Job:  map 100% reduce 0%
14/05/24 17:13:15 INFO mapreduce.Job: Job job_1400975042027_0006 completed successfully
14/05/24 17:13:15 INFO mapreduce.Job: Counters: 0
Job ended: Sat May 24 17:13:15 PDT 2014
The job took 144 seconds.

Hence marking this as already implemented.If I notice this anytime on latest, will confirm and reopen then.HTW.Thanks.

> map progress report NaN when it is running randomwriter
> -------------------------------------------------------
>
>                 Key: TEZ-822
>                 URL: https://issues.apache.org/jira/browse/TEZ-822
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: Chen He
>            Assignee: Rekha Joshi
>            Priority: Minor
>             Fix For: 0.5.0
>
>
> hadoop jar tez/lib/tez-mapreduce-examples-0.3.0-SNAPSHOT.jar randomwriter /user/chenhe/outputwriter
> 14/02/10 10:50:39 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> 14/02/10 10:50:39 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> Running 10 maps.
> Job started: Mon Feb 10 10:50:40 CST 2014
> 14/02/10 10:50:40 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
> 14/02/10 10:50:41 INFO mapreduce.JobSubmitter: number of splits:10
> 14/02/10 10:50:41 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1392049937987_0002
> 14/02/10 10:50:42 INFO impl.YarnClientImpl: Submitted application application_1392049937987_0002
> 14/02/10 10:50:42 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1392049937987_0002/
> 14/02/10 10:50:42 INFO mapreduce.Job: Running job: job_1392049937987_0002
> 14/02/10 10:50:50 INFO mapreduce.Job: Job job_1392049937987_0002 running in uber mode : false
> 14/02/10 10:50:50 INFO mapreduce.Job:  map 0% reduce 0%
> 14/02/10 10:51:11 INFO mapreduce.Job:  map NaN% reduce 0%



--
This message was sent by Atlassian JIRA
(v6.2#6252)