You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by Gaurav Gupta <ga...@gmail.com> on 2016/01/20 01:08:38 UTC

Re: container error for bad configuration

Hi Evan,

The error message clear suggests that resource file is bad. It is missing
</description> tag. Can you check other resource files too?

Thanks
Gaurav

On Tue, Jan 19, 2016 at 5:36 AM, yaoxiaohua <ya...@outlook.com> wrote:

> Hi guys,
>
>                 When I run applications on yarn, there is always some
> containers failed for the following reason:
>
>
>
> Tue, 19 Jan 2016 07:29:22 GMT   Tue, 19 Jan 2016 07:29:30 GMT   7sec
>
> Error: java.lang.RuntimeException: org.xml.sax.SAXParseException:
>
>  “description”must use“</description>”end。
>
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
>
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
>
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
>
>  at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) at
>
> org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:870) at
>
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1889)
>
> at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2379)
>
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
>
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
>
>  at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
>
>  at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
>
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
>
> at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:339)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:270)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:432)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:164)
>
>
>  at
> org.apache.hadoop.mapred.YarnChild.configureLocalDirs(YarnChild.java:232)
>
>  at org.apache.hadoop.mapred.YarnChild.configureTask(YarnChild.java:290)
>
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
>
>  Caused by: org.xml.sax.SAXParseException: elementtype“description” must
> used“</description>” end。
>
>  at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at
> org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>
> at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
>
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
>
>  at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
>
>  at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
>
> ... 18 more Container killed by the ApplicationMaster. Container killed on
> request.
>
> Exit code is 143 Container exited with a non-zero exit code 143
>
>
>
> It seems that the xml file are bad, I check marped-site.xml and
> yarn-site.xml, it is fine.
>
> Could you give me any tips
>
>
>
> Best Regards,
>
> Evan
>

Re: container error for bad configuration

Posted by Gaurav Gupta <ga...@gmail.com>.

Container will take the hdfs-site.xml from the classpath. Can you check if
your classpath is correct?

On Tue, Jan 19, 2016 at 5:28 PM, yaoxiaohua <ya...@outlook.com> wrote:

> Hi Gupta,
>
>                 Thanks for your reply,
>
>                 I observe the app running ,and find some containers
> failed, then
>
>                 I enter the container directory and find the syserr file.
>
>                 Cat and find that it report hdfs-site.xml is bad with
> </description> sign.
>
>
>
>                 Then I check all the data node hdfs-sitel.xml file with
> xmllint , it looks fine all.
>
>                 My confuse is that why yarn container running with
> hdfs-site.xml ?
>
>                 And I know that it doesn’t point the file
> $HADOOP_HOME/etc/hadoop/hdfs-site.xml
>
>                 It points to the local hdfs-site.xml, I don’t know why
> generate a local hdfs-site.xml
>
>                 In yarn stage folder. And I check all datanodes in yarn
> log stage directory,
>
>                 Find some hdfs-site.xml, and check it is ok.
>
>
>
>
>
>
>
> *From:* Gaurav Gupta [mailto:gaurav.gopi123@gmail.com]
> *Sent:* 2016年1月20日 8:09
> *To:* yaoxiaohua
> *Cc:* user@hadoop.apache.org
> *Subject:* Re: container error for bad configuration
>
>
>
> Hi Evan,
>
>
>
> The error message clear suggests that resource file is bad. It is missing
> </description> tag. Can you check other resource files too?
>
>
>
> Thanks
>
> Gaurav
>
>
>
> On Tue, Jan 19, 2016 at 5:36 AM, yaoxiaohua <ya...@outlook.com>
> wrote:
>
> Hi guys,
>
>                 When I run applications on yarn, there is always some
> containers failed for the following reason:
>
>
>
> Tue, 19 Jan 2016 07:29:22 GMT   Tue, 19 Jan 2016 07:29:30 GMT   7sec
>
> Error: java.lang.RuntimeException: org.xml.sax.SAXParseException:
>
>  “description”must use“</description>”end。
>
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
>
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
>
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
>
>  at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) at
>
> org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:870) at
>
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1889)
>
> at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2379)
>
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
>
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
>
>  at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
>
>  at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
>
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
>
> at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:339)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:270)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:432)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:164)
>
>
>  at
> org.apache.hadoop.mapred.YarnChild.configureLocalDirs(YarnChild.java:232)
>
>  at org.apache.hadoop.mapred.YarnChild.configureTask(YarnChild.java:290)
>
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
>
>  Caused by: org.xml.sax.SAXParseException: elementtype“description” must
> used“</description>” end。
>
>  at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at
> org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>
> at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
>
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
>
>  at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
>
>  at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
>
> ... 18 more Container killed by the ApplicationMaster. Container killed on
> request.
>
> Exit code is 143 Container exited with a non-zero exit code 143
>
>
>
> It seems that the xml file are bad, I check marped-site.xml and
> yarn-site.xml, it is fine.
>
> Could you give me any tips
>
>
>
> Best Regards,
>
> Evan
>
>
>

Re: container error for bad configuration

Posted by Gaurav Gupta <ga...@gmail.com>.

Container will take the hdfs-site.xml from the classpath. Can you check if
your classpath is correct?

On Tue, Jan 19, 2016 at 5:28 PM, yaoxiaohua <ya...@outlook.com> wrote:

> Hi Gupta,
>
>                 Thanks for your reply,
>
>                 I observe the app running ,and find some containers
> failed, then
>
>                 I enter the container directory and find the syserr file.
>
>                 Cat and find that it report hdfs-site.xml is bad with
> </description> sign.
>
>
>
>                 Then I check all the data node hdfs-sitel.xml file with
> xmllint , it looks fine all.
>
>                 My confuse is that why yarn container running with
> hdfs-site.xml ?
>
>                 And I know that it doesn’t point the file
> $HADOOP_HOME/etc/hadoop/hdfs-site.xml
>
>                 It points to the local hdfs-site.xml, I don’t know why
> generate a local hdfs-site.xml
>
>                 In yarn stage folder. And I check all datanodes in yarn
> log stage directory,
>
>                 Find some hdfs-site.xml, and check it is ok.
>
>
>
>
>
>
>
> *From:* Gaurav Gupta [mailto:gaurav.gopi123@gmail.com]
> *Sent:* 2016年1月20日 8:09
> *To:* yaoxiaohua
> *Cc:* user@hadoop.apache.org
> *Subject:* Re: container error for bad configuration
>
>
>
> Hi Evan,
>
>
>
> The error message clear suggests that resource file is bad. It is missing
> </description> tag. Can you check other resource files too?
>
>
>
> Thanks
>
> Gaurav
>
>
>
> On Tue, Jan 19, 2016 at 5:36 AM, yaoxiaohua <ya...@outlook.com>
> wrote:
>
> Hi guys,
>
>                 When I run applications on yarn, there is always some
> containers failed for the following reason:
>
>
>
> Tue, 19 Jan 2016 07:29:22 GMT   Tue, 19 Jan 2016 07:29:30 GMT   7sec
>
> Error: java.lang.RuntimeException: org.xml.sax.SAXParseException:
>
>  “description”must use“</description>”end。
>
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
>
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
>
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
>
>  at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) at
>
> org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:870) at
>
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1889)
>
> at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2379)
>
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
>
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
>
>  at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
>
>  at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
>
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
>
> at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:339)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:270)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:432)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:164)
>
>
>  at
> org.apache.hadoop.mapred.YarnChild.configureLocalDirs(YarnChild.java:232)
>
>  at org.apache.hadoop.mapred.YarnChild.configureTask(YarnChild.java:290)
>
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
>
>  Caused by: org.xml.sax.SAXParseException: elementtype“description” must
> used“</description>” end。
>
>  at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at
> org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>
> at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
>
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
>
>  at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
>
>  at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
>
> ... 18 more Container killed by the ApplicationMaster. Container killed on
> request.
>
> Exit code is 143 Container exited with a non-zero exit code 143
>
>
>
> It seems that the xml file are bad, I check marped-site.xml and
> yarn-site.xml, it is fine.
>
> Could you give me any tips
>
>
>
> Best Regards,
>
> Evan
>
>
>

Re: container error for bad configuration

Posted by Gaurav Gupta <ga...@gmail.com>.

Container will take the hdfs-site.xml from the classpath. Can you check if
your classpath is correct?

On Tue, Jan 19, 2016 at 5:28 PM, yaoxiaohua <ya...@outlook.com> wrote:

> Hi Gupta,
>
>                 Thanks for your reply,
>
>                 I observe the app running ,and find some containers
> failed, then
>
>                 I enter the container directory and find the syserr file.
>
>                 Cat and find that it report hdfs-site.xml is bad with
> </description> sign.
>
>
>
>                 Then I check all the data node hdfs-sitel.xml file with
> xmllint , it looks fine all.
>
>                 My confuse is that why yarn container running with
> hdfs-site.xml ?
>
>                 And I know that it doesn’t point the file
> $HADOOP_HOME/etc/hadoop/hdfs-site.xml
>
>                 It points to the local hdfs-site.xml, I don’t know why
> generate a local hdfs-site.xml
>
>                 In yarn stage folder. And I check all datanodes in yarn
> log stage directory,
>
>                 Find some hdfs-site.xml, and check it is ok.
>
>
>
>
>
>
>
> *From:* Gaurav Gupta [mailto:gaurav.gopi123@gmail.com]
> *Sent:* 2016年1月20日 8:09
> *To:* yaoxiaohua
> *Cc:* user@hadoop.apache.org
> *Subject:* Re: container error for bad configuration
>
>
>
> Hi Evan,
>
>
>
> The error message clear suggests that resource file is bad. It is missing
> </description> tag. Can you check other resource files too?
>
>
>
> Thanks
>
> Gaurav
>
>
>
> On Tue, Jan 19, 2016 at 5:36 AM, yaoxiaohua <ya...@outlook.com>
> wrote:
>
> Hi guys,
>
>                 When I run applications on yarn, there is always some
> containers failed for the following reason:
>
>
>
> Tue, 19 Jan 2016 07:29:22 GMT   Tue, 19 Jan 2016 07:29:30 GMT   7sec
>
> Error: java.lang.RuntimeException: org.xml.sax.SAXParseException:
>
>  “description”must use“</description>”end。
>
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2338)
>
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
>
> at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
>
>  at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) at
>
> org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:870) at
>
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1889)
>
> at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2379)
>
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
>
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
>
>  at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
>
>  at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
>
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
>
> at org.apache.hadoop.fs.FileSystem.getLocal(FileSystem.java:339)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:270)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:432)
>
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:164)
>
>
>  at
> org.apache.hadoop.mapred.YarnChild.configureLocalDirs(YarnChild.java:232)
>
>  at org.apache.hadoop.mapred.YarnChild.configureTask(YarnChild.java:290)
>
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
>
>  Caused by: org.xml.sax.SAXParseException: elementtype“description” must
> used“</description>” end。
>
>  at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at
> org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>
> at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
>
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2173)
>
>  at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2161)
>
>  at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2232)
>
> ... 18 more Container killed by the ApplicationMaster. Container killed on
> request.
>
> Exit code is 143 Container exited with a non-zero exit code 143
>
>
>
> It seems that the xml file are bad, I check marped-site.xml and
> yarn-site.xml, it is fine.
>
> Could you give me any tips
>
>
>
> Best Regards,
>
> Evan
>
>
>