You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "dylan (JIRA)" <ji...@apache.org> on 2017/09/18 10:09:00 UTC
[jira] [Created] (CARBONDATA-1484) carbonthriftserver cache is not
refreshed
dylan created CARBONDATA-1484:
---------------------------------
Summary: carbonthriftserver cache is not refreshed
Key: CARBONDATA-1484
URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
Project: CarbonData
Issue Type: Bug
Components: core
Affects Versions: 1.1.0
Environment: spark:1.6.0,mysql hive metastore
Reporter: dylan
Fix For: NONE
i am use carbondata version is 1.1.0 and spark version is 1.6.0.
and I reproduce in accordance with the official quick-start-guide case
again,
1.Creating a Table
cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")
2.load data into table
cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")
3.start carbonthriftserver
/home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit --master local[*]
--driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"
--executor-memory 4G --driver-memory 2g --conf
spark.serializer=org.apache.spark.serializer.KryoSerializer --conf
"spark.sql.shuffle.partitions=3" --conf spark.speculation=true --class
org.apache.carbondata.spark.thriftserver.CarbonThriftServer
/home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar
hdfs://nameservice1/user/zz/rp_carbon_store
4.Connecting to CarbonData Thrift Server Using Beeline.
<http://chuantu.biz/t6/47/1505284993x2890202558.jpg>
5.drop table
cc.sql("drop table carbondb.test_table")
6.recreate table and load data
cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")
cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")
7.select data use beeline
<http://chuantu.biz/t6/47/1505284937x1034817476.jpg>
Like the above error, the cache is not updated
in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is
one session on beeline,
and i test this case on the current carbondata master branch(1.2.0),
when i use beeline there is no Btree load failed info,but in my table there
is no data,All the data is null,but in spark-shell is ok.
spark-shell:
+---+-----+--------+---+
| id| name| city|age|
+---+-----+--------+---+
| 1|david|shenzhen| 31|
| 2|eason|shenzhen| 27|
| 3|jarry| wuhan| 35|
+---+-----+--------+---+
beeline:
0: jdbc:hive2://localhost:10000> select * from carbondb.test_table;
+-------+-------+-------+-------+--+
| id | name | city | age |
+-------+-------+-------+-------+--+
| NULL | NULL | NULL | NULL |
| NULL | NULL | NULL | NULL |
| NULL | NULL | NULL | NULL |
+-------+-------+-------+-------+--+
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)