You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Dhruv Mahajan <dh...@gmail.com> on 2016/01/23 03:11:00 UTC

issues with latest reef bits

I got the latest reef bits and tried using it to run some application. I
got the following errors and job did not even launch. Any idea?



Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
: 2016-01-22T17:52:20.4140996-08:00 0001

INFO: Done preparing Driver filesystem layout in
C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789

Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
2016-01-22T17:52:20.4453525-08:00 0001

INFO: Launch Java with command: C:\java\bin\java.exe -cp
c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com

mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo

p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar

e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-

client-0.14.0-SNAPSHOT-shaded.jar
org.apache.reef.bridge.client.YarnJobSubmissionClient
C:\Users\dhrumaha\AppData\Local\Temp\2\ree

f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
Expected string. Got VALUE_NULL

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at org.apache.avro.io.JsonDecoder.readString(JsonDecoder.java:227)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at org.apache.avro.io.JsonDecoder.readString(JsonDecoder.java:214)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at
org.apache.avro.io.ValidatingDecoder.readString(ValidatingDecoder.java:107)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:20.9922474-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub

missionFromCS.java:206)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j

ava:196)

Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
2016-01-22T17:52:21.0078735-08:00 0003

ERROR:  at
org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)

Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
2016-01-22T17:52:21.0234992-08:00 0001

INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP

1/22/2016 5:52:21 PM     Time elapsed(s): 2.461



***** Unexpected failure. Please contact 'tlcsupp' with details *****

===== Begin detailed dump =====

(1) Unexpected exception: File
C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t

xt deosn't exist while trying to get tracking Uri,
'System.ApplicationException'

   at
Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
filepath) in c:\Users\dhrumaha\Desktop\projec

ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
42

   at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
reefClient, String filePath) in c:\Users\dhrumaha\Deskto

p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
60

   at
Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
jobSubmission) in c:\Users\dhrumaha\Desktop\

projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line 100

   at
Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org.Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](

IMRUJobDefinition jobDefinition) in
c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli

ent.cs:line 151

   at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95

   at DTLC.RunTLCPlusPlus.MainCore(String args) in
c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62

====== End detailed dump =====

Re: issues with latest reef bits

Posted by Andrew Chung <af...@gmail.com>.
Merged, thanks!

On Mon, Jan 25, 2016 at 6:39 PM, Dhruv Mahajan <dh...@gmail.com>
wrote:

> I am not aware of this part of code so cannot merge...Andrew/markus can you
> review and merge.
>
> On Mon, Jan 25, 2016 at 4:24 PM, Anupam <an...@gmail.com> wrote:
>
> > Issue: https://issues.apache.org/jira/browse/REEF-1156
> > PR: https://github.com/apache/reef/pull/796
> >
> > Thanks,
> >
> > On 25 January 2016 at 16:07, Markus Weimer <ma...@weimo.de> wrote:
> > > On 2016-01-25 13:41, Anupam wrote:
> > >> Just to confirm, I am looking into this will get back with a reply by
> > >> EOD 2015-01-25 (PST).
> > >
> > > Thanks! Can you please track this as a JIRA such that we have a point
> of
> > > reference for the future?
> > >
> > > Markus
> >
> >
> >
> > --
> > Anupam
> > Bellevue, WA
> > Ph: +1 (425)-777-5570
> >
>

Re: issues with latest reef bits

Posted by Dhruv Mahajan <dh...@gmail.com>.
I am not aware of this part of code so cannot merge...Andrew/markus can you
review and merge.

On Mon, Jan 25, 2016 at 4:24 PM, Anupam <an...@gmail.com> wrote:

> Issue: https://issues.apache.org/jira/browse/REEF-1156
> PR: https://github.com/apache/reef/pull/796
>
> Thanks,
>
> On 25 January 2016 at 16:07, Markus Weimer <ma...@weimo.de> wrote:
> > On 2016-01-25 13:41, Anupam wrote:
> >> Just to confirm, I am looking into this will get back with a reply by
> >> EOD 2015-01-25 (PST).
> >
> > Thanks! Can you please track this as a JIRA such that we have a point of
> > reference for the future?
> >
> > Markus
>
>
>
> --
> Anupam
> Bellevue, WA
> Ph: +1 (425)-777-5570
>

Re: issues with latest reef bits

Posted by Anupam <an...@gmail.com>.
Issue: https://issues.apache.org/jira/browse/REEF-1156
PR: https://github.com/apache/reef/pull/796

Thanks,

On 25 January 2016 at 16:07, Markus Weimer <ma...@weimo.de> wrote:
> On 2016-01-25 13:41, Anupam wrote:
>> Just to confirm, I am looking into this will get back with a reply by
>> EOD 2015-01-25 (PST).
>
> Thanks! Can you please track this as a JIRA such that we have a point of
> reference for the future?
>
> Markus



-- 
Anupam
Bellevue, WA
Ph: +1 (425)-777-5570

Re: issues with latest reef bits

Posted by Markus Weimer <ma...@weimo.de>.
On 2016-01-25 13:41, Anupam wrote:
> Just to confirm, I am looking into this will get back with a reply by
> EOD 2015-01-25 (PST).

Thanks! Can you please track this as a JIRA such that we have a point of
reference for the future?

Markus

Re: issues with latest reef bits

Posted by Anupam <an...@gmail.com>.
Just to confirm, I am looking into this will get back with a reply by
EOD 2015-01-25 (PST).

On 24 January 2016 at 01:34, Anupam <an...@gmail.com> wrote:
> Thanks Andrew. I will take a look.
>
> On 23 January 2016 at 10:27, Andrew Chung <af...@gmail.com> wrote:
>> Anupam, this seems like the change in avro schema for
>> AvroYarnJobSubmissionParameters for only allowing literal "NULL" strings.
>> Seems like we forgot to change the default value for dfsJobSubmissionFolder
>> in AvroYarnJobSubmissionParameters.cs to "NULL".
>>
>> Thanks,
>> Andrew
>>
>> On Fri, Jan 22, 2016 at 11:00 PM, Markus Weimer <ma...@weimo.de> wrote:
>>
>>> Hi,
>>>
>>> this could be related to the new client bits that got merged today. Anupam
>>> and Andrew can comment on that.
>>>
>>> Markus
>>>
>>>
>>>
>>> On 2016-01-22 18:11, Dhruv Mahajan wrote:
>>>
>>>> I got the latest reef bits and tried using it to run some application. I
>>>> got the following errors and job did not even launch. Any idea?
>>>>
>>>>
>>>>
>>>> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
>>>> : 2016-01-22T17:52:20.4140996-08:00 0001
>>>>
>>>> INFO: Done preparing Driver filesystem layout in
>>>>
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
>>>> 2016-01-22T17:52:20.4453525-08:00 0001
>>>>
>>>> INFO: Launch Java with command: C:\java\bin\java.exe -cp
>>>> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>>>>
>>>>
>>>> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>>>>
>>>>
>>>> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>>>>
>>>>
>>>> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>>>>
>>>> client-0.14.0-SNAPSHOT-shaded.jar
>>>> org.apache.reef.bridge.client.YarnJobSubmissionClient
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>>>>
>>>> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
>>>> Expected string. Got VALUE_NULL
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io
>>>> .JsonDecoder.readString(JsonDecoder.java:227)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at org.apache.avro.io
>>>> .JsonDecoder.readString(JsonDecoder.java:214)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>> org.apache.avro.io
>>>> .ValidatingDecoder.readString(ValidatingDecoder.java:107)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>>>>
>>>> missionFromCS.java:206)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>>>>
>>>> ava:196)
>>>>
>>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>>
>>>> ERROR:  at
>>>>
>>>> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>>>>
>>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
>>>> 2016-01-22T17:52:21.0234992-08:00 0001
>>>>
>>>> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>>>>
>>>> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>>>>
>>>>
>>>>
>>>> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>>>>
>>>> ===== Begin detailed dump =====
>>>>
>>>> (1) Unexpected exception: File
>>>>
>>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>>>>
>>>> xt deosn't exist while trying to get tracking Uri,
>>>> 'System.ApplicationException'
>>>>
>>>>     at
>>>>
>>>> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
>>>> filepath) in c:\Users\dhrumaha\Desktop\projec
>>>>
>>>>
>>>> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
>>>> 42
>>>>
>>>>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
>>>> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>>>>
>>>>
>>>> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
>>>> 60
>>>>
>>>>     at
>>>>
>>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
>>>> jobSubmission) in c:\Users\dhrumaha\Desktop\
>>>>
>>>> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line
>>>> 100
>>>>
>>>>     at
>>>> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org
>>>> .Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>>>>
>>>> IMRUJobDefinition jobDefinition) in
>>>>
>>>> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>>>>
>>>> ent.cs:line 151
>>>>
>>>>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
>>>> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>>>>
>>>>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
>>>> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>>>>
>>>> ====== End detailed dump =====
>>>>
>>>>
>
>
>
> --
> Anupam
> Bellevue, WA
> Ph: +1 (425)-777-5570



-- 
Anupam
Bellevue, WA
Ph: +1 (425)-777-5570

Re: issues with latest reef bits

Posted by Anupam <an...@gmail.com>.
Thanks Andrew. I will take a look.

On 23 January 2016 at 10:27, Andrew Chung <af...@gmail.com> wrote:
> Anupam, this seems like the change in avro schema for
> AvroYarnJobSubmissionParameters for only allowing literal "NULL" strings.
> Seems like we forgot to change the default value for dfsJobSubmissionFolder
> in AvroYarnJobSubmissionParameters.cs to "NULL".
>
> Thanks,
> Andrew
>
> On Fri, Jan 22, 2016 at 11:00 PM, Markus Weimer <ma...@weimo.de> wrote:
>
>> Hi,
>>
>> this could be related to the new client bits that got merged today. Anupam
>> and Andrew can comment on that.
>>
>> Markus
>>
>>
>>
>> On 2016-01-22 18:11, Dhruv Mahajan wrote:
>>
>>> I got the latest reef bits and tried using it to run some application. I
>>> got the following errors and job did not even launch. Any idea?
>>>
>>>
>>>
>>> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
>>> : 2016-01-22T17:52:20.4140996-08:00 0001
>>>
>>> INFO: Done preparing Driver filesystem layout in
>>>
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
>>> 2016-01-22T17:52:20.4453525-08:00 0001
>>>
>>> INFO: Launch Java with command: C:\java\bin\java.exe -cp
>>> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>>>
>>>
>>> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>>>
>>>
>>> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>>>
>>>
>>> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>>>
>>> client-0.14.0-SNAPSHOT-shaded.jar
>>> org.apache.reef.bridge.client.YarnJobSubmissionClient
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>>>
>>> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
>>> Expected string. Got VALUE_NULL
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io
>>> .JsonDecoder.readString(JsonDecoder.java:227)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at org.apache.avro.io
>>> .JsonDecoder.readString(JsonDecoder.java:214)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>> org.apache.avro.io
>>> .ValidatingDecoder.readString(ValidatingDecoder.java:107)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:20.9922474-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>>>
>>> missionFromCS.java:206)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>>>
>>> ava:196)
>>>
>>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>>> 2016-01-22T17:52:21.0078735-08:00 0003
>>>
>>> ERROR:  at
>>>
>>> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>>>
>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
>>> 2016-01-22T17:52:21.0234992-08:00 0001
>>>
>>> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>>>
>>> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>>>
>>>
>>>
>>> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>>>
>>> ===== Begin detailed dump =====
>>>
>>> (1) Unexpected exception: File
>>>
>>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>>>
>>> xt deosn't exist while trying to get tracking Uri,
>>> 'System.ApplicationException'
>>>
>>>     at
>>>
>>> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
>>> filepath) in c:\Users\dhrumaha\Desktop\projec
>>>
>>>
>>> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
>>> 42
>>>
>>>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
>>> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>>>
>>>
>>> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
>>> 60
>>>
>>>     at
>>>
>>> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
>>> jobSubmission) in c:\Users\dhrumaha\Desktop\
>>>
>>> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line
>>> 100
>>>
>>>     at
>>> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org
>>> .Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>>>
>>> IMRUJobDefinition jobDefinition) in
>>>
>>> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>>>
>>> ent.cs:line 151
>>>
>>>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
>>> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>>>
>>>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
>>> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>>>
>>> ====== End detailed dump =====
>>>
>>>



-- 
Anupam
Bellevue, WA
Ph: +1 (425)-777-5570

Re: issues with latest reef bits

Posted by Andrew Chung <af...@gmail.com>.
Anupam, this seems like the change in avro schema for
AvroYarnJobSubmissionParameters for only allowing literal "NULL" strings.
Seems like we forgot to change the default value for dfsJobSubmissionFolder
in AvroYarnJobSubmissionParameters.cs to "NULL".

Thanks,
Andrew

On Fri, Jan 22, 2016 at 11:00 PM, Markus Weimer <ma...@weimo.de> wrote:

> Hi,
>
> this could be related to the new client bits that got merged today. Anupam
> and Andrew can comment on that.
>
> Markus
>
>
>
> On 2016-01-22 18:11, Dhruv Mahajan wrote:
>
>> I got the latest reef bits and tried using it to run some application. I
>> got the following errors and job did not even launch. Any idea?
>>
>>
>>
>> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
>> : 2016-01-22T17:52:20.4140996-08:00 0001
>>
>> INFO: Done preparing Driver filesystem layout in
>>
>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
>> 2016-01-22T17:52:20.4453525-08:00 0001
>>
>> INFO: Launch Java with command: C:\java\bin\java.exe -cp
>> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>>
>>
>> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>>
>>
>> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>>
>>
>> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>>
>> client-0.14.0-SNAPSHOT-shaded.jar
>> org.apache.reef.bridge.client.YarnJobSubmissionClient
>> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>>
>> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
>> Expected string. Got VALUE_NULL
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at org.apache.avro.io
>> .JsonDecoder.readString(JsonDecoder.java:227)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at org.apache.avro.io
>> .JsonDecoder.readString(JsonDecoder.java:214)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at
>> org.apache.avro.io
>> .ValidatingDecoder.readString(ValidatingDecoder.java:107)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:20.9922474-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>>
>> missionFromCS.java:206)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>>
>> ava:196)
>>
>> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
>> 2016-01-22T17:52:21.0078735-08:00 0003
>>
>> ERROR:  at
>>
>> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>>
>> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
>> 2016-01-22T17:52:21.0234992-08:00 0001
>>
>> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>>
>> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>>
>>
>>
>> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>>
>> ===== Begin detailed dump =====
>>
>> (1) Unexpected exception: File
>>
>> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>>
>> xt deosn't exist while trying to get tracking Uri,
>> 'System.ApplicationException'
>>
>>     at
>>
>> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
>> filepath) in c:\Users\dhrumaha\Desktop\projec
>>
>>
>> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
>> 42
>>
>>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
>> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>>
>>
>> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
>> 60
>>
>>     at
>>
>> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
>> jobSubmission) in c:\Users\dhrumaha\Desktop\
>>
>> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line
>> 100
>>
>>     at
>> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org
>> .Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>>
>> IMRUJobDefinition jobDefinition) in
>>
>> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>>
>> ent.cs:line 151
>>
>>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
>> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>>
>>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
>> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>>
>> ====== End detailed dump =====
>>
>>

Re: issues with latest reef bits

Posted by Markus Weimer <ma...@weimo.de>.
Hi,

this could be related to the new client bits that got merged today. 
Anupam and Andrew can comment on that.

Markus


On 2016-01-22 18:11, Dhruv Mahajan wrote:
> I got the latest reef bits and tried using it to run some application. I
> got the following errors and job did not even launch. Any idea?
>
>
>
> Org.Apache.REEF.Client.Common.DriverFolderPreparationHelper Information: 0
> : 2016-01-22T17:52:20.4140996-08:00 0001
>
> INFO: Done preparing Driver filesystem layout in
> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Information: 0 :
> 2016-01-22T17:52:20.4453525-08:00 0001
>
> INFO: Launch Java with command: C:\java\bin\java.exe -cp
> c:\hadoop\hadoop-2.7.1\etc\hadoop;c:\hadoop\hadoop-2.7.1\share\hadoop\com
>
> mon\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\common\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs;c:\hadoop\hadoop-2.7.1\share\hadoo
>
> p\hdfs\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\hdfs\*;c:\hadoop\hadoop-2.7.1\share\hadoop\yarn\lib\*;c:\hadoop\hadoop-2.7.1\shar
>
> e\hadoop\yarn\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\lib\*;c:\hadoop\hadoop-2.7.1\share\hadoop\mapreduce\*;./reef-bridge-
>
> client-0.14.0-SNAPSHOT-shaded.jar
> org.apache.reef.bridge.client.YarnJobSubmissionClient
> C:\Users\dhrumaha\AppData\Local\Temp\2\ree
>
> f-IMRU-LBFGS-TLCPP-20160122175219789\job-submission-params.json
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR: Exception in thread "main" org.apache.avro.AvroTypeException:
> Expected string. Got VALUE_NULL
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at org.apache.avro.io.JsonDecoder.error(JsonDecoder.java:697)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at org.apache.avro.io.JsonDecoder.readString(JsonDecoder.java:227)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at org.apache.avro.io.JsonDecoder.readString(JsonDecoder.java:214)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at
> org.apache.avro.io.ValidatingDecoder.readString(ValidatingDecoder.java:107)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:348)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:341)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:154)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:20.9922474-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:177)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:148)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:139)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.readYarnClusterSubmissionFromCSFromInputStream(YarnClusterSub
>
> missionFromCS.java:206)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.reef.bridge.client.YarnClusterSubmissionFromCS.fromJobSubmissionParametersFile(YarnClusterSubmissionFromCS.j
>
> ava:196)
>
> Org.Apache.REEF.Client.Common.JavaClientLauncher Error: 0 :
> 2016-01-22T17:52:21.0078735-08:00 0003
>
> ERROR:  at
> org.apache.reef.bridge.client.YarnJobSubmissionClient.main(YarnJobSubmissionClient.java:233)
>
> Org.Apache.REEF.Client.Yarn.YarnREEFClient Information: 0 :
> 2016-01-22T17:52:21.0234992-08:00 0001
>
> INFO: Submitted the Driver for execution.IMRU-LBFGS-TLCPP
>
> 1/22/2016 5:52:21 PM     Time elapsed(s): 2.461
>
>
>
> ***** Unexpected failure. Please contact 'tlcsupp' with details *****
>
> ===== Begin detailed dump =====
>
> (1) Unexpected exception: File
> C:\Users\dhrumaha\AppData\Local\Temp\2\reef-IMRU-LBFGS-TLCPP-20160122175219789\DriverHttpEndpoint.t
>
> xt deosn't exist while trying to get tracking Uri,
> 'System.ApplicationException'
>
>     at
> Org.Apache.REEF.Client.YARN.YarnJobSubmissionResult.GetTrackingUrlAppId(String
> filepath) in c:\Users\dhrumaha\Desktop\projec
>
> ts\reef\lang\cs\Org.Apache.REEF.Client\YARN\YarnJobSubmissionResult.cs:line
> 42
>
>     at Org.Apache.REEF.Client.Common.JobSubmissionResult..ctor(IREEFClient
> reefClient, String filePath) in c:\Users\dhrumaha\Deskto
>
> p\projects\reef\lang\cs\Org.Apache.REEF.Client\Common\JobSubmissionResult.cs:line
> 60
>
>     at
> Org.Apache.REEF.Client.Yarn.YarnREEFClient.SubmitAndGetJobStatus(IJobSubmission
> jobSubmission) in c:\Users\dhrumaha\Desktop\
>
> projects\reef\lang\cs\Org.Apache.REEF.Client\YARN\YARNREEFClient.cs:line 100
>
>     at
> Org.Apache.REEF.IMRU.OnREEF.Client.REEFIMRUClient.Org.Apache.REEF.IMRU.API.IIMRUClient.Submit[TMapInput,TMapOutput,TResult](
>
> IMRUJobDefinition jobDefinition) in
> c:\Users\dhrumaha\Desktop\projects\reef\lang\cs\Org.Apache.REEF.IMRU\OnREEF\Client\REEFIMRUCli
>
> ent.cs:line 151
>
>     at DTLC.Execution.DistributedTrainCommand.Impl.Run() in
> c:\TLCPlusPlus\Main\DTLC\Execution\DistributedTrainCommand.cs:line 95
>
>     at DTLC.RunTLCPlusPlus.MainCore(String args) in
> c:\TLCPlusPlus\Main\DTLC\Program.cs:line 62
>
> ====== End detailed dump =====
>