You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Brian Konzman (JIRA)" <ji...@apache.org> on 2018/07/30 18:52:00 UTC
[jira] [Updated] (LIVY-464) Cannot connect to Datastax standalone
cluster DSE 5.1.5
[ https://issues.apache.org/jira/browse/LIVY-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Konzman updated LIVY-464:
-------------------------------
Description:
Using
livy.spark.master = dse://<server>:9042
The new way to define a datastax cluster as the spark master in livy.conf returns
{{Error: Master must either be yarn or start with spark, mesos, local}}
livy.spark.master = spark://<server>:9042
{{18/04/30 17:21:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:9042...}}
{{18/04/30 17:21:51 INFO TransportClientFactory: Successfully created connection to <server>:9042 after 19 ms (0 ms spent in bootstraps)}}
{{18/04/30 17:21:51 WARN TransportChannelHandler: Exception in connection from <server>:9042 java.lang.IllegalArgumentException: Frame length should be positive: -8858580467037765640}}
livy.spark.master = spark://<server>:7077
{{18/04/30 17:23:31 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
{{18/04/30 17:23:31 INFO TransportClientFactory: Successfully created connection to <server>:7077 after 15 ms (0 ms spent in bootstraps) }}{{18/04/30 17:23:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
{{18/04/30 17:24:11 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
{{18/04/30 17:24:31 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.}}
was:
Using
livy.spark.master = dse://<server>:9042
The new way to define a datastax cluster as the spark master in livy.conf returns
{{Error: Master must either be yarn or start with spark, mesos, local}}
livy.spark.master = spark://<server>:9042
{{18/04/30 17:21:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:9042...}}
{{18/04/30 17:21:51 INFO TransportClientFactory: Successfully created connection to <server>:9042 after 19 ms (0 ms spent in bootstraps)}}
{{18/04/30 17:21:51 WARN TransportChannelHandler: Exception in connection from <server>:9042 java.lang.IllegalArgumentException: Frame length should be positive: -8858580467037765640}}
livy.spark.master = spark://<server>:7077
{{18/04/30 17:23:31 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
{{18/04/30 17:23:31 INFO TransportClientFactory: Successfully created connection to <server>:7077 after 15 ms (0 ms spent in bootstraps) }}{{18/04/30 17:23:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://ccwa-csssp-dev1-02:7077... }}
{{18/04/30 17:24:11 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
{{18/04/30 17:24:31 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.}}
> Cannot connect to Datastax standalone cluster DSE 5.1.5
> -------------------------------------------------------
>
> Key: LIVY-464
> URL: https://issues.apache.org/jira/browse/LIVY-464
> Project: Livy
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.5.0, 0.6.0
> Environment: OSX and Ubuntu 16.04 in docker
> Reporter: Brian Konzman
> Priority: Major
>
> Using
> livy.spark.master = dse://<server>:9042
> The new way to define a datastax cluster as the spark master in livy.conf returns
> {{Error: Master must either be yarn or start with spark, mesos, local}}
> livy.spark.master = spark://<server>:9042
>
> {{18/04/30 17:21:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:9042...}}
> {{18/04/30 17:21:51 INFO TransportClientFactory: Successfully created connection to <server>:9042 after 19 ms (0 ms spent in bootstraps)}}
> {{18/04/30 17:21:51 WARN TransportChannelHandler: Exception in connection from <server>:9042 java.lang.IllegalArgumentException: Frame length should be positive: -8858580467037765640}}
>
> livy.spark.master = spark://<server>:7077
>
> {{18/04/30 17:23:31 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
> {{18/04/30 17:23:31 INFO TransportClientFactory: Successfully created connection to <server>:7077 after 15 ms (0 ms spent in bootstraps) }}{{18/04/30 17:23:51 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
> {{18/04/30 17:24:11 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://<server>:7077... }}
> {{18/04/30 17:24:31 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)