You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tao Wang (JIRA)" <ji...@apache.org> on 2016/11/07 07:37:58 UTC

[jira] [Created] (SPARK-18298) HistoryServer use GMT time all time

Tao Wang created SPARK-18298:
--------------------------------

             Summary: HistoryServer use GMT time all time
                 Key: SPARK-18298
                 URL: https://issues.apache.org/jira/browse/SPARK-18298
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 2.0.1, 2.0.0
         Environment: suse 11.3 with CST time
            Reporter: Tao Wang


When I started HistoryServer for reading event logs, the timestamp readed will be parsed using local timezone like "CST"(confirmed via debug).

But the time related columns like "Started"/"Completed"/"Last Updated" in History Server UI using "GMT" time, which is 8 hours earlier than "CST".

{code}
App ID	App Name	Started	Completed	Duration	Spark User	Last Updated	Event Log
local-1478225166651	Spark shell	2016-11-04 02:06:06	2016-11-07 01:33:30	71.5 h	root	2016-11-07 01:33:30
{/code}

I've checked the REST api and found the result like:
{code}
[ {
  "id" : "local-1478225166651",
  "name" : "Spark shell",
  "attempts" : [ {
    "startTime" : "2016-11-04T02:06:06.020GMT",
    "endTime" : "2016-11-07T01:33:30.265GMT",
    "lastUpdated" : "2016-11-07T01:33:30.000GMT",
    "duration" : 257244245,
    "sparkUser" : "root",
    "completed" : true,
    "lastUpdatedEpoch" : 1478482410000,
    "endTimeEpoch" : 1478482410265,
    "startTimeEpoch" : 1478225166020
  } ]
}, {
  "id" : "local-1478224925869",
  "name" : "Spark Pi",
  "attempts" : [ {
    "startTime" : "2016-11-04T02:02:02.133GMT",
    "endTime" : "2016-11-04T02:02:07.468GMT",
    "lastUpdated" : "2016-11-04T02:02:07.000GMT",
    "duration" : 5335,
    "sparkUser" : "root",
...
{/code}

So maybe the change happened in transferring between server and browser? I have no idea where to go from this point.

Hope guys can offer some help, or just fix it if it's easy? :)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org