You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "YingmingWang (Jira)" <ji...@apache.org> on 2020/02/21 02:04:00 UTC
[jira] [Comment Edited] (YARN-10153) Problems of offline analysis
with showSimulationTrace.html
[ https://issues.apache.org/jira/browse/YARN-10153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041443#comment-17041443 ]
YingmingWang edited comment on YARN-10153 at 2/21/20 2:03 AM:
--------------------------------------------------------------
OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ?
If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data.
I place more files as rar in attachment.
Thank for your help!
was (Author: lmy777):
OK, I describe my question again. I know your meaning that I can see the many charts and the data changing when my SLS is running. If I just see the real time websitte, http:host:port/simulate, it is ok. After the running of SLS example, it generate realtimetrack.json and jobruntime.csv to record the information of this simulation.Then, I choose the realtimetrack.json in showSimulationTrace.html but it cannot generate offinle analysis outcome. It has no response and change. The problem is that why I just see the real time website but I cannot see offline analysis. I am afraid that my SLS configuration has problem, it leads to problems in offline analysis and even simulation results. Another question is whether my INFO is ok even if it has ' resource-types.xml not found' ?
If I directy open the realtimetrack.json by website, it displays: SyntaxERROR: JSON.parse: end of data when ',' or ']' was expected at line 134 column 1 of the JSON data.
I place more files as zip in attachment.
Thank for your help.
> Problems of offline analysis with showSimulationTrace.html
> ----------------------------------------------------------
>
> Key: YARN-10153
> URL: https://issues.apache.org/jira/browse/YARN-10153
> Project: Hadoop YARN
> Issue Type: Bug
> Components: scheduler-load-simulator
> Affects Versions: 3.2.1
> Environment: Ubuntu18.04
> JAVA 1.8.0_241
> Hadoop-3.2.1
> Reporter: YingmingWang
> Priority: Major
> Fix For: 3.2.1
>
> Attachments: INFO.txt, sls_file.rar
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> I am new to learn YARN SLS. After the configuration of HADOOP and YARN SLS, I run the example in sample-data. It doesn't have WARNING or ERROR. I can see the chart and data changing in real time by host:port/simulate but I can not analyse the realtimetrack.json file by showSimulationTrace.html after the run. I modified my file with the improvement of YARN-9836 but it still can't analyze trace. The whole INFO file is placed in .txt.
> {code:java}
> // code placeholder
> # Begining
> INFO conf.Configuration: resource-types.xml not found
> INFO resource.ResourceUtils:Unable to find 'resource-types.xml'.
> # Finally
> 2020-02-20 14:59:40,838 INFO sls.SLSRunner: SLSRunner tears down.
> 2020-02-20 14:59:40,839 INFO resourcemanager.RMAppManager$ApplicationSummary: appId=application_1582181515746_0002,name=N/A,user=jenkins,queue=sls_queue_1,state=FINISHED,trackingUrl=http://host2-virtual-machine:18088/proxy/application_1582181515746_0002/,appMasterHost=localhost,submitTime=1582181622389,startTime=1582181622389,launchTime=-1,finishTime=1582181980390,finalStatus=SUCCEEDED,memorySeconds=2433739,vcoreSeconds=2313,preemptedMemorySeconds=0,preemptedVcoreSeconds=0,preemptedAMContainers=0,preemptedNonAMContainers=0,preemptedResources=<memory:0\, vCores:0>,applicationType=YARN,resourceSeconds=2433739 MB-seconds\, 2313 vcore-seconds,preemptedResourceSeconds=0 MB-seconds\, 0 vcore-seconds,applicationTags=
> {code}
> I want to know how to solve it or a more correct configuration process. Thank you very much.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org