You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2016/01/24 00:36:39 UTC
[jira] [Commented] (SPARK-3075) Expose a way for users to parse
event logs
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114030#comment-15114030 ]
Josh Rosen commented on SPARK-3075:
-----------------------------------
This seems out-of-scope / won't fix to me. I don't think we want to open up those internal APIs; our JSON protocol is stable anyways and there are lots of nice tools for working with this type of JSON data (including Spark SQL itself), so I'm going to resolve this as "Won't Fix" for now.
> Expose a way for users to parse event logs
> ------------------------------------------
>
> Key: SPARK-3075
> URL: https://issues.apache.org/jira/browse/SPARK-3075
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.0.2
> Reporter: Andrew Or
>
> Both ReplayListenerBus and util.JsonProtocol are private[spark], so the user wants to parse the event logs themselves for analytics they will have to write their own JSON deserializers (or do some crazy reflection to access these methods). We should expose an easy way for them to do this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org