You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by shyla deshpande <de...@gmail.com> on 2018/12/21 22:24:12 UTC
How to add Cassandra Interpreter to Zeppelin on EMR?
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I
should add?
Appreciate your help
Thanks
-shyla
Re: How to add Cassandra Interpreter to Zeppelin on EMR?
Posted by Xun Liu <ne...@163.com>.
I don't have Cassandra in my zeppelin, so I can only help you guess where the problem is from the log.
From your log, These two questions should all be caused by the lack of dependent JAR packages that Cassandra runs. You may not be setting up the runtime environment for Cassandra（or scala） correctly.
You can look at the missing class according to the log, then download the JAR package from the class name to the `zeppelin/interpreter/Cassandra/…` directory and try to solve the problem.
> 在 2018年12月23日，上午12:03，shyla deshpande <de...@gmail.com> 写道：
>
> I wanted to add that I am using
> emr-5.20.0
> Applications:Spark 2.4.0, Zeppelin 0.8.0,
> Thanks
>
> On Sat, Dec 22, 2018 at 7:56 AM shyla deshpande <deshpandeshyla@gmail.com <ma...@gmail.com>> wrote:
> Hi Xun,
>
> Thank you for your response. You set me in the right direction and I made some progress.
> I still have 2 issues.
> 1. I was able to add the cassandra interpreter. But now I am getting the following error.
> <Screen Shot 2018-12-22 at 7.51.35 AM.png>
> 2. I am unable to add spark-cassandra-connector
> <Screen Shot 2018-12-22 at 7.44.50 AM.png>
>
> I appreciate your help.
> Thanks
> -Shyla
>
> On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <neliuxun@163.com <ma...@163.com>> wrote:
> hi, shyla deshpande
>
> You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
> You may need to restart zeppelin and you can easily see the interpreter registration information.
>
> INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573 <http://10.120.196.234:48573/>
> INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
> INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
> INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
> INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
> INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
> INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
> WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
> INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
> INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
> INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
> INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
> INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
> INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
> INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
> INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
> INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
> INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
> INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
> INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
> INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
> INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
> INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
> INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
> INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
> INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
> INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
> INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
> INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
> INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
> INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json <>
> INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
> INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
> INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
> INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
> INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
> INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
> INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
> INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
> INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
> INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
> INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
> INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
> INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
> INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
> INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
> INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
> INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json
>
>
>> 在 2018年12月22日，上午6:39，shyla deshpande <deshpandeshyla@gmail.com <ma...@gmail.com>> 写道：
>>
>> I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo?
>> <Screen Shot 2018-12-21 at 2.36.51 PM.png>
>>
>> On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <deshpandeshyla@gmail.com <ma...@gmail.com>> wrote:
>> Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
>>
>> But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
>> What are the properties name and value I should specify. Any dependencies I should add?
>>
>> Appreciate your help
>> Thanks
>> -shyla
>
Re: How to add Cassandra Interpreter to Zeppelin on EMR?
Posted by shyla deshpande <de...@gmail.com>.
I wanted to add that I am using
*emr*-5.20.0
Applications:Spark 2.4.0, Zeppelin 0.8.0,
Thanks
On Sat, Dec 22, 2018 at 7:56 AM shyla deshpande <de...@gmail.com>
wrote:
> Hi Xun,
>
> Thank you for your response. You set me in the right direction and I made
> some progress.
> I still have 2 issues.
> 1. I was able to add the cassandra interpreter. But now I am getting the
> following error.
> [image: Screen Shot 2018-12-22 at 7.51.35 AM.png]
> 2. I am unable to add spark-cassandra-connector
> [image: Screen Shot 2018-12-22 at 7.44.50 AM.png]
>
> I appreciate your help.
> Thanks
> -Shyla
>
> On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <ne...@163.com> wrote:
>
>> hi, shyla deshpande
>>
>> You can check if the cassandra interpreter is registered in zeppelin's
>> startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
>> You may need to restart zeppelin and you can easily see the interpreter
>> registration information.
>>
>> INFO [2018-12-21 21:36:18,967] ({Thread-13}
>> RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is
>> starting at 10.120.196.234:48573
>> INFO [2018-12-21 21:36:19,455] ({main}
>> RemoteInterpreterEventServer.java[start]:127) -
>> RemoteInterpreterEventServer is started
>> INFO [2018-12-21 21:36:19,492] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: hazelcastjet
>> INFO [2018-12-21 21:36:19,497] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: flink
>> INFO [2018-12-21 21:36:19,501] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: ignite
>> INFO [2018-12-21 21:36:19,509] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: kylin
>> INFO [2018-12-21 21:36:19,512] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: angular
>> WARN [2018-12-21 21:36:19,546] ({main}
>> InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) -
>> No interpreter-setting.json found in
>> /home/hadoop/zeppelin-current/interpreter/scio
>> INFO [2018-12-21 21:36:19,550] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: cassandra
>> INFO [2018-12-21 21:36:19,553] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: scalding
>> INFO [2018-12-21 21:36:19,555] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: lens
>> INFO [2018-12-21 21:36:19,559] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: livy
>> INFO [2018-12-21 21:36:19,562] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: java
>> INFO [2018-12-21 21:36:19,565] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: sh
>> INFO [2018-12-21 21:36:19,567] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: alluxio
>> INFO [2018-12-21 21:36:19,570] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: beam
>> INFO [2018-12-21 21:36:19,572] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: elasticsearch
>> INFO [2018-12-21 21:36:19,575] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: md
>> INFO [2018-12-21 21:36:19,578] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: spark
>> INFO [2018-12-21 21:36:19,580] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: file
>> INFO [2018-12-21 21:36:19,584] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: submarine
>> INFO [2018-12-21 21:36:19,586] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: geode
>> INFO [2018-12-21 21:36:19,588] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: bigquery
>> INFO [2018-12-21 21:36:19,590] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: pig
>> INFO [2018-12-21 21:36:19,593] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: neo4j
>> INFO [2018-12-21 21:36:19,595] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: hbase
>> INFO [2018-12-21 21:36:19,597] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: groovy
>> INFO [2018-12-21 21:36:19,599] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: sap
>> INFO [2018-12-21 21:36:19,602] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: python
>> INFO [2018-12-21 21:36:19,604] ({main}
>> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
>> InterpreterSettingTemplate: jdbc
>> INFO [2018-12-21 21:36:19,610] ({main}
>> FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load
>> Interpreter Setting from file:
>> hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
>> INFO [2018-12-21 21:36:19,835] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting ignite from interpreter.json
>> INFO [2018-12-21 21:36:19,836] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting beam from interpreter.json
>> INFO [2018-12-21 21:36:19,836] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting geode from interpreter.json
>> INFO [2018-12-21 21:36:19,837] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting jdbc from interpreter.json
>> INFO [2018-12-21 21:36:19,838] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting lens from interpreter.json
>> INFO [2018-12-21 21:36:19,838] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting pig from interpreter.json
>> INFO [2018-12-21 21:36:19,839] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting file from interpreter.json
>> INFO [2018-12-21 21:36:19,839] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting java from interpreter.json
>> INFO [2018-12-21 21:36:19,840] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting elasticsearch from interpreter.json
>> INFO [2018-12-21 21:36:19,841] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting submarine from interpreter.json
>> INFO [2018-12-21 21:36:19,841] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting sh from interpreter.json
>> INFO [2018-12-21 21:36:19,842] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting spark from interpreter.json
>> INFO [2018-12-21 21:36:19,843] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting md from interpreter.json
>> INFO [2018-12-21 21:36:19,843] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting hazelcastjet from interpreter.json
>> INFO [2018-12-21 21:36:19,843] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting alluxio from interpreter.json
>> INFO [2018-12-21 21:36:19,844] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting bigquery from interpreter.json
>> INFO [2018-12-21 21:36:19,844] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting hbase from interpreter.json
>> INFO [2018-12-21 21:36:19,844] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting python from interpreter.json
>> INFO [2018-12-21 21:36:19,845] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting sap from interpreter.json
>> INFO [2018-12-21 21:36:19,845] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting scalding from interpreter.json
>> INFO [2018-12-21 21:36:19,845] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting flink from interpreter.json
>> INFO [2018-12-21 21:36:19,846] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting angular from interpreter.json
>> INFO [2018-12-21 21:36:19,846] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting livy from interpreter.json
>> INFO [2018-12-21 21:36:19,847] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting neo4j from interpreter.json
>> INFO [2018-12-21 21:36:19,847] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting groovy from interpreter.json
>> INFO [2018-12-21 21:36:19,848] ({main}
>> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
>> Setting cassandra from interpreter.json
>>
>>
>> 在 2018年12月22日，上午6:39，shyla deshpande <de...@gmail.com> 写道：
>>
>> I think the problem is, I don't see cassandra Interpreter group. How do I
>> add cassandra Intepreter grouo?
>> <Screen Shot 2018-12-21 at 2.36.51 PM.png>
>>
>> On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <de...@gmail.com>
>> wrote:
>>
>>> Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
>>>
>>> But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
>>> What are the properties name and value I should specify. Any
>>> dependencies I should add?
>>>
>>> Appreciate your help
>>> Thanks
>>> -shyla
>>>
>>
>>
Re: How to add Cassandra Interpreter to Zeppelin on EMR?
Posted by shyla deshpande <de...@gmail.com>.
Hi Xun,
Thank you for your response. You set me in the right direction and I made
some progress.
I still have 2 issues.
1. I was able to add the cassandra interpreter. But now I am getting the
following error.
[image: Screen Shot 2018-12-22 at 7.51.35 AM.png]
2. I am unable to add spark-cassandra-connector
[image: Screen Shot 2018-12-22 at 7.44.50 AM.png]
I appreciate your help.
Thanks
-Shyla
On Fri, Dec 21, 2018 at 7:21 PM Xun Liu <ne...@163.com> wrote:
> hi, shyla deshpande
>
> You can check if the cassandra interpreter is registered in zeppelin's
> startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
> You may need to restart zeppelin and you can easily see the interpreter
> registration information.
>
> INFO [2018-12-21 21:36:18,967] ({Thread-13}
> RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is
> starting at 10.120.196.234:48573
> INFO [2018-12-21 21:36:19,455] ({main}
> RemoteInterpreterEventServer.java[start]:127) -
> RemoteInterpreterEventServer is started
> INFO [2018-12-21 21:36:19,492] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: hazelcastjet
> INFO [2018-12-21 21:36:19,497] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: flink
> INFO [2018-12-21 21:36:19,501] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: ignite
> INFO [2018-12-21 21:36:19,509] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: kylin
> INFO [2018-12-21 21:36:19,512] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: angular
> WARN [2018-12-21 21:36:19,546] ({main}
> InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) -
> No interpreter-setting.json found in
> /home/hadoop/zeppelin-current/interpreter/scio
> INFO [2018-12-21 21:36:19,550] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: cassandra
> INFO [2018-12-21 21:36:19,553] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: scalding
> INFO [2018-12-21 21:36:19,555] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: lens
> INFO [2018-12-21 21:36:19,559] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: livy
> INFO [2018-12-21 21:36:19,562] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: java
> INFO [2018-12-21 21:36:19,565] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: sh
> INFO [2018-12-21 21:36:19,567] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: alluxio
> INFO [2018-12-21 21:36:19,570] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: beam
> INFO [2018-12-21 21:36:19,572] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: elasticsearch
> INFO [2018-12-21 21:36:19,575] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: md
> INFO [2018-12-21 21:36:19,578] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: spark
> INFO [2018-12-21 21:36:19,580] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: file
> INFO [2018-12-21 21:36:19,584] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: submarine
> INFO [2018-12-21 21:36:19,586] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: geode
> INFO [2018-12-21 21:36:19,588] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: bigquery
> INFO [2018-12-21 21:36:19,590] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: pig
> INFO [2018-12-21 21:36:19,593] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: neo4j
> INFO [2018-12-21 21:36:19,595] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: hbase
> INFO [2018-12-21 21:36:19,597] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: groovy
> INFO [2018-12-21 21:36:19,599] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: sap
> INFO [2018-12-21 21:36:19,602] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: python
> INFO [2018-12-21 21:36:19,604] ({main}
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register
> InterpreterSettingTemplate: jdbc
> INFO [2018-12-21 21:36:19,610] ({main}
> FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load
> Interpreter Setting from file:
> hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
> INFO [2018-12-21 21:36:19,835] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting ignite from interpreter.json
> INFO [2018-12-21 21:36:19,836] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting beam from interpreter.json
> INFO [2018-12-21 21:36:19,836] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting geode from interpreter.json
> INFO [2018-12-21 21:36:19,837] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting jdbc from interpreter.json
> INFO [2018-12-21 21:36:19,838] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting lens from interpreter.json
> INFO [2018-12-21 21:36:19,838] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting pig from interpreter.json
> INFO [2018-12-21 21:36:19,839] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting file from interpreter.json
> INFO [2018-12-21 21:36:19,839] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting java from interpreter.json
> INFO [2018-12-21 21:36:19,840] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting elasticsearch from interpreter.json
> INFO [2018-12-21 21:36:19,841] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting submarine from interpreter.json
> INFO [2018-12-21 21:36:19,841] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting sh from interpreter.json
> INFO [2018-12-21 21:36:19,842] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting spark from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting md from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting hazelcastjet from interpreter.json
> INFO [2018-12-21 21:36:19,843] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting alluxio from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting bigquery from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting hbase from interpreter.json
> INFO [2018-12-21 21:36:19,844] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting python from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting sap from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting scalding from interpreter.json
> INFO [2018-12-21 21:36:19,845] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting flink from interpreter.json
> INFO [2018-12-21 21:36:19,846] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting angular from interpreter.json
> INFO [2018-12-21 21:36:19,846] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting livy from interpreter.json
> INFO [2018-12-21 21:36:19,847] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting neo4j from interpreter.json
> INFO [2018-12-21 21:36:19,847] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting groovy from interpreter.json
> INFO [2018-12-21 21:36:19,848] ({main}
> InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter
> Setting cassandra from interpreter.json
>
>
> 在 2018年12月22日，上午6:39，shyla deshpande <de...@gmail.com> 写道：
>
> I think the problem is, I don't see cassandra Interpreter group. How do I
> add cassandra Intepreter grouo?
> <Screen Shot 2018-12-21 at 2.36.51 PM.png>
>
> On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <de...@gmail.com>
> wrote:
>
>> Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
>>
>> But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
>> What are the properties name and value I should specify. Any dependencies
>> I should add?
>>
>> Appreciate your help
>> Thanks
>> -shyla
>>
>
>
Re: How to add Cassandra Interpreter to Zeppelin on EMR?
Posted by Xun Liu <ne...@163.com>.
hi, shyla deshpande
You can check if the cassandra interpreter is registered in zeppelin's startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter registration information.
INFO [2018-12-21 21:36:18,967] ({Thread-13} RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is starting at 10.120.196.234:48573
INFO [2018-12-21 21:36:19,455] ({main} RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is started
INFO [2018-12-21 21:36:19,492] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hazelcastjet
INFO [2018-12-21 21:36:19,497] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: flink
INFO [2018-12-21 21:36:19,501] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: ignite
INFO [2018-12-21 21:36:19,509] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: kylin
INFO [2018-12-21 21:36:19,512] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: angular
WARN [2018-12-21 21:36:19,546] ({main} InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
INFO [2018-12-21 21:36:19,550] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: cassandra
INFO [2018-12-21 21:36:19,553] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: scalding
INFO [2018-12-21 21:36:19,555] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: lens
INFO [2018-12-21 21:36:19,559] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: livy
INFO [2018-12-21 21:36:19,562] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: java
INFO [2018-12-21 21:36:19,565] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sh
INFO [2018-12-21 21:36:19,567] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: alluxio
INFO [2018-12-21 21:36:19,570] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: beam
INFO [2018-12-21 21:36:19,572] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: elasticsearch
INFO [2018-12-21 21:36:19,575] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: md
INFO [2018-12-21 21:36:19,578] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: spark
INFO [2018-12-21 21:36:19,580] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: file
INFO [2018-12-21 21:36:19,584] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: submarine
INFO [2018-12-21 21:36:19,586] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: geode
INFO [2018-12-21 21:36:19,588] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: bigquery
INFO [2018-12-21 21:36:19,590] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: pig
INFO [2018-12-21 21:36:19,593] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: neo4j
INFO [2018-12-21 21:36:19,595] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: hbase
INFO [2018-12-21 21:36:19,597] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: groovy
INFO [2018-12-21 21:36:19,599] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: sap
INFO [2018-12-21 21:36:19,602] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: python
INFO [2018-12-21 21:36:19,604] ({main} InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register InterpreterSettingTemplate: jdbc
INFO [2018-12-21 21:36:19,610] ({main} FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter Setting from file: hdfs://mldev/user/hadoop/zeppelin/conf/interpreter.json
INFO [2018-12-21 21:36:19,835] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting ignite from interpreter.json
INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting beam from interpreter.json
INFO [2018-12-21 21:36:19,836] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting geode from interpreter.json
INFO [2018-12-21 21:36:19,837] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting jdbc from interpreter.json
INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting lens from interpreter.json
INFO [2018-12-21 21:36:19,838] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting pig from interpreter.json
INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting file from interpreter.json
INFO [2018-12-21 21:36:19,839] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting java from interpreter.json
INFO [2018-12-21 21:36:19,840] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting elasticsearch from interpreter.json
INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting submarine from interpreter.json
INFO [2018-12-21 21:36:19,841] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sh from interpreter.json
INFO [2018-12-21 21:36:19,842] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting spark from interpreter.json
INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting md from interpreter.json
INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hazelcastjet from interpreter.json
INFO [2018-12-21 21:36:19,843] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting alluxio from interpreter.json
INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting bigquery from interpreter.json
INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting hbase from interpreter.json
INFO [2018-12-21 21:36:19,844] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting python from interpreter.json
INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting sap from interpreter.json
INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting scalding from interpreter.json
INFO [2018-12-21 21:36:19,845] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting flink from interpreter.json
INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting angular from interpreter.json
INFO [2018-12-21 21:36:19,846] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting livy from interpreter.json
INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting neo4j from interpreter.json
INFO [2018-12-21 21:36:19,847] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting groovy from interpreter.json
INFO [2018-12-21 21:36:19,848] ({main} InterpreterSettingManager.java[loadFromFile]:277) - Create Interpreter Setting cassandra from interpreter.json
> 在 2018年12月22日，上午6:39，shyla deshpande <de...@gmail.com> 写道：
>
> I think the problem is, I don't see cassandra Interpreter group. How do I add cassandra Intepreter grouo?
> <Screen Shot 2018-12-21 at 2.36.51 PM.png>
>
> On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <deshpandeshyla@gmail.com <ma...@gmail.com>> wrote:
> Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
>
> But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
> What are the properties name and value I should specify. Any dependencies I should add?
>
> Appreciate your help
> Thanks
> -shyla
Re: How to add Cassandra Interpreter to Zeppelin on EMR?
Posted by shyla deshpande <de...@gmail.com>.
I think the problem is, I don't see cassandra Interpreter group. How do I
add cassandra Intepreter grouo?
[image: Screen Shot 2018-12-21 at 2.36.51 PM.png]
On Fri, Dec 21, 2018 at 2:24 PM shyla deshpande <de...@gmail.com>
wrote:
> Directory /usr/lib/zeppelin/interpreter/cassandra already exists.
>
> But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
> What are the properties name and value I should specify. Any dependencies
> I should add?
>
> Appreciate your help
> Thanks
> -shyla
>