You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shivu Sondur (JIRA)" <ji...@apache.org> on 2018/10/18 07:15:00 UTC

[jira] [Updated] (SPARK-25683) Updated the log for the firstTime event Drop occurs.

     [ https://issues.apache.org/jira/browse/SPARK-25683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shivu Sondur updated SPARK-25683:
---------------------------------
    Description: 
{code:xml}
18/10/08 17:51:40 ERROR AsyncEventQueue: Dropping event from queue eventLog. This likely means one of the listeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler.
18/10/08 17:51:40 WARN AsyncEventQueue: Dropped 1 events from eventLog since Wed Dec 31 16:00:00 PST 1969.
18/10/08 17:52:40 WARN AsyncEventQueue: Dropped 144853 events from eventLog since Mon Oct 08 17:51:40 PDT 2018.
{code}

Here it shows the time as Wed Dec 31 16:00:00 PST 1969 for the first log, 
log should updated as  "... since start of the application" if 'lastReportTimestamp' == 0.
when the  first dropEvent occurs.

  was:
{code:xml}
18/10/08 17:51:40 ERROR AsyncEventQueue: Dropping event from queue eventLog. This likely means one of the listeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler.
18/10/08 17:51:40 WARN AsyncEventQueue: Dropped 1 events from eventLog since Wed Dec 31 16:00:00 PST 1969.
18/10/08 17:52:40 WARN AsyncEventQueue: Dropped 144853 events from eventLog since Mon Oct 08 17:51:40 PDT 2018.
{code}

Here it shows the time as Wed Dec 31 16:00:00 PST 1969 for the first log, I think it would be better if we show the initialized time as the time here.

        Summary: Updated the log for the firstTime event Drop occurs.  (was: Make AsyncEventQueue.lastReportTimestamp inital value as the currentTime instead of 0)

> Updated the log for the firstTime event Drop occurs.
> ----------------------------------------------------
>
>                 Key: SPARK-25683
>                 URL: https://issues.apache.org/jira/browse/SPARK-25683
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.3.2
>            Reporter: Devaraj K
>            Priority: Trivial
>
> {code:xml}
> 18/10/08 17:51:40 ERROR AsyncEventQueue: Dropping event from queue eventLog. This likely means one of the listeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler.
> 18/10/08 17:51:40 WARN AsyncEventQueue: Dropped 1 events from eventLog since Wed Dec 31 16:00:00 PST 1969.
> 18/10/08 17:52:40 WARN AsyncEventQueue: Dropped 144853 events from eventLog since Mon Oct 08 17:51:40 PDT 2018.
> {code}
> Here it shows the time as Wed Dec 31 16:00:00 PST 1969 for the first log, 
> log should updated as  "... since start of the application" if 'lastReportTimestamp' == 0.
> when the  first dropEvent occurs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org