You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ilya Ganelin <il...@gmail.com> on 2016/07/22 03:26:22 UTC
NoClassDefFoundError with ZonedDateTime
Hello - I'm trying to deploy the Spark TimeSeries library in a new
environment. I'm running Spark 1.6.1 submitted through YARN in a cluster
with Java 8 installed on all nodes but I'm getting the NoClassDef at
runtime when trying to create a new TimeSeriesRDD. Since ZonedDateTime is
part of Java 8 I feel like I shouldn't need to do anything else. The weird
thing is I get it on the data nodes, not the driver. Any thoughts on what's
causing this or how to track it down? Would appreciate the help.
Thanks!
Re: NoClassDefFoundError with ZonedDateTime
Posted by Timur Shenkao <ts...@timshenkao.su>.
Which version of Java 8 do you use? AFAIK, it's recommended to exploit Java
1.8_0.66 +
On Fri, Jul 22, 2016 at 8:49 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> On Fri, Jul 22, 2016 at 6:43 AM, Ted Yu <yu...@gmail.com> wrote:
> > You can use this command (assuming log aggregation is turned on):
> >
> > yarn logs --applicationId XX
>
> I don't think it's gonna work for already-running application (and I
> wish I were mistaken since I needed it just yesterday) and you have to
> revert to stderr of ApplicationMaster in container 1.
>
> Jacek
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
Re: NoClassDefFoundError with ZonedDateTime
Posted by Jacek Laskowski <ja...@japila.pl>.
On Fri, Jul 22, 2016 at 6:43 AM, Ted Yu <yu...@gmail.com> wrote:
> You can use this command (assuming log aggregation is turned on):
>
> yarn logs --applicationId XX
I don't think it's gonna work for already-running application (and I
wish I were mistaken since I needed it just yesterday) and you have to
revert to stderr of ApplicationMaster in container 1.
Jacek
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: NoClassDefFoundError with ZonedDateTime
Posted by Ted Yu <yu...@gmail.com>.
You can use this command (assuming log aggregation is turned on):
yarn logs --applicationId XX
In the log, you should see snippet such as the following:
java.class.path=...
FYI
On Thu, Jul 21, 2016 at 9:38 PM, Ilya Ganelin <il...@gmail.com> wrote:
> what's the easiest way to get the Classpath for the spark application
> itself?
>
> On Thu, Jul 21, 2016 at 9:37 PM Ted Yu <yu...@gmail.com> wrote:
>
>> Might be classpath issue.
>>
>> Mind pastebin'ning the effective class path ?
>>
>> Stack trace of NoClassDefFoundError may also help provide some clue.
>>
>> On Thu, Jul 21, 2016 at 8:26 PM, Ilya Ganelin <il...@gmail.com> wrote:
>>
>>> Hello - I'm trying to deploy the Spark TimeSeries library in a new
>>> environment. I'm running Spark 1.6.1 submitted through YARN in a cluster
>>> with Java 8 installed on all nodes but I'm getting the NoClassDef at
>>> runtime when trying to create a new TimeSeriesRDD. Since ZonedDateTime is
>>> part of Java 8 I feel like I shouldn't need to do anything else. The weird
>>> thing is I get it on the data nodes, not the driver. Any thoughts on what's
>>> causing this or how to track it down? Would appreciate the help.
>>>
>>> Thanks!
>>>
>>
>>
Re: NoClassDefFoundError with ZonedDateTime
Posted by Ilya Ganelin <il...@gmail.com>.
what's the easiest way to get the Classpath for the spark application
itself?
On Thu, Jul 21, 2016 at 9:37 PM Ted Yu <yu...@gmail.com> wrote:
> Might be classpath issue.
>
> Mind pastebin'ning the effective class path ?
>
> Stack trace of NoClassDefFoundError may also help provide some clue.
>
> On Thu, Jul 21, 2016 at 8:26 PM, Ilya Ganelin <il...@gmail.com> wrote:
>
>> Hello - I'm trying to deploy the Spark TimeSeries library in a new
>> environment. I'm running Spark 1.6.1 submitted through YARN in a cluster
>> with Java 8 installed on all nodes but I'm getting the NoClassDef at
>> runtime when trying to create a new TimeSeriesRDD. Since ZonedDateTime is
>> part of Java 8 I feel like I shouldn't need to do anything else. The weird
>> thing is I get it on the data nodes, not the driver. Any thoughts on what's
>> causing this or how to track it down? Would appreciate the help.
>>
>> Thanks!
>>
>
>
Re: NoClassDefFoundError with ZonedDateTime
Posted by Ted Yu <yu...@gmail.com>.
Might be classpath issue.
Mind pastebin'ning the effective class path ?
Stack trace of NoClassDefFoundError may also help provide some clue.
On Thu, Jul 21, 2016 at 8:26 PM, Ilya Ganelin <il...@gmail.com> wrote:
> Hello - I'm trying to deploy the Spark TimeSeries library in a new
> environment. I'm running Spark 1.6.1 submitted through YARN in a cluster
> with Java 8 installed on all nodes but I'm getting the NoClassDef at
> runtime when trying to create a new TimeSeriesRDD. Since ZonedDateTime is
> part of Java 8 I feel like I shouldn't need to do anything else. The weird
> thing is I get it on the data nodes, not the driver. Any thoughts on what's
> causing this or how to track it down? Would appreciate the help.
>
> Thanks!
>