You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by "Krautwurm, Florian" <fl...@siemens.com> on 2015/07/10 11:32:14 UTC
timelineclient in 2.4.0.2.1.11.0-891
Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
I also know, that there was a patch in YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian
AW: timelineclient in 2.4.0.2.1.11.0-891
Posted by "Kleegrewe, Christian" <ch...@siemens.com>.
Please use bugzilla
Von: Krautwurm, Florian [mailto:florian.krautwurm@siemens.com]
Gesendet: Freitag, 10. Juli 2015 11:32
An: user@hadoop.apache.org
Betreff: timelineclient in 2.4.0.2.1.11.0-891
Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
I also know, that there was a patch in YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian
AW: timelineclient in 2.4.0.2.1.11.0-891
Posted by "Kleegrewe, Christian" <ch...@siemens.com>.
Please use bugzilla
Von: Krautwurm, Florian [mailto:florian.krautwurm@siemens.com]
Gesendet: Freitag, 10. Juli 2015 11:32
An: user@hadoop.apache.org
Betreff: timelineclient in 2.4.0.2.1.11.0-891
Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
I also know, that there was a patch in YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian
Re: timelineclient in 2.4.0.2.1.11.0-891
Posted by Hitesh Shah <hi...@apache.org>.
The error seems to clearly indicate that you are submitting to an invalid queue:
"java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default”
You may want to address the queue name issue first before looking into enabling/disabling Timeline.
Furthermore, Apache releases are not versioned using 6 digits (https://hadoop.apache.org/releases.html). For your deployment and the changes across the 2 versions, you may wish to contact the Hadoop distro vendor that has been used for your cluster.
thanks
— Hitesh
On Jul 10, 2015, at 2:32 AM, Krautwurm, Florian <fl...@siemens.com> wrote:
> Hi,
>
> for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
>
> …
> 2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
> java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
> at java.lang.Thread.run(Thread.java:745)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
> …
>
>
> I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
>
>
> Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
>
> The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
>
> I also know, that there was a patch in YARN-1962, which disables the timelineserver by default.
> Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
>
> To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
>
> Where can I get such information?
>
> Thanks an best regards,
> Florian
Re: timelineclient in 2.4.0.2.1.11.0-891
Posted by Hitesh Shah <hi...@apache.org>.
The error seems to clearly indicate that you are submitting to an invalid queue:
"java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default”
You may want to address the queue name issue first before looking into enabling/disabling Timeline.
Furthermore, Apache releases are not versioned using 6 digits (https://hadoop.apache.org/releases.html). For your deployment and the changes across the 2 versions, you may wish to contact the Hadoop distro vendor that has been used for your cluster.
thanks
— Hitesh
On Jul 10, 2015, at 2:32 AM, Krautwurm, Florian <fl...@siemens.com> wrote:
> Hi,
>
> for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
>
> …
> 2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
> java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
> at java.lang.Thread.run(Thread.java:745)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
> …
>
>
> I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
>
>
> Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
>
> The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
>
> I also know, that there was a patch in YARN-1962, which disables the timelineserver by default.
> Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
>
> To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
>
> Where can I get such information?
>
> Thanks an best regards,
> Florian
Re: timelineclient in 2.4.0.2.1.11.0-891
Posted by Hitesh Shah <hi...@apache.org>.
The error seems to clearly indicate that you are submitting to an invalid queue:
"java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default”
You may want to address the queue name issue first before looking into enabling/disabling Timeline.
Furthermore, Apache releases are not versioned using 6 digits (https://hadoop.apache.org/releases.html). For your deployment and the changes across the 2 versions, you may wish to contact the Hadoop distro vendor that has been used for your cluster.
thanks
— Hitesh
On Jul 10, 2015, at 2:32 AM, Krautwurm, Florian <fl...@siemens.com> wrote:
> Hi,
>
> for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
>
> …
> 2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
> java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
> at java.lang.Thread.run(Thread.java:745)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
> …
>
>
> I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
>
>
> Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
>
> The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
>
> I also know, that there was a patch in YARN-1962, which disables the timelineserver by default.
> Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
>
> To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
>
> Where can I get such information?
>
> Thanks an best regards,
> Florian
AW: timelineclient in 2.4.0.2.1.11.0-891
Posted by "Kleegrewe, Christian" <ch...@siemens.com>.
Please use bugzilla
Von: Krautwurm, Florian [mailto:florian.krautwurm@siemens.com]
Gesendet: Freitag, 10. Juli 2015 11:32
An: user@hadoop.apache.org
Betreff: timelineclient in 2.4.0.2.1.11.0-891
Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
I also know, that there was a patch in YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian
Re: timelineclient in 2.4.0.2.1.11.0-891
Posted by Hitesh Shah <hi...@apache.org>.
The error seems to clearly indicate that you are submitting to an invalid queue:
"java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default”
You may want to address the queue name issue first before looking into enabling/disabling Timeline.
Furthermore, Apache releases are not versioned using 6 digits (https://hadoop.apache.org/releases.html). For your deployment and the changes across the 2 versions, you may wish to contact the Hadoop distro vendor that has been used for your cluster.
thanks
— Hitesh
On Jul 10, 2015, at 2:32 AM, Krautwurm, Florian <fl...@siemens.com> wrote:
> Hi,
>
> for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
>
> …
> 2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
> java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
> at java.lang.Thread.run(Thread.java:745)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
> …
>
>
> I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
>
>
> Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
>
> The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
>
> I also know, that there was a patch in YARN-1962, which disables the timelineserver by default.
> Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
>
> To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
>
> Where can I get such information?
>
> Thanks an best regards,
> Florian
AW: timelineclient in 2.4.0.2.1.11.0-891
Posted by "Kleegrewe, Christian" <ch...@siemens.com>.
Please use bugzilla
Von: Krautwurm, Florian [mailto:florian.krautwurm@siemens.com]
Gesendet: Freitag, 10. Juli 2015 11:32
An: user@hadoop.apache.org
Betreff: timelineclient in 2.4.0.2.1.11.0-891
Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion 0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I also found several issues (but not mine) with it online.
I also know, that there was a patch in YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 but not disabled by default (as it seems to be not included in 2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian