You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "dylan (JIRA)" <ji...@apache.org> on 2017/09/18 10:09:00 UTC

[jira] [Created] (CARBONDATA-1484) carbonthriftserver cache is not refreshed

dylan created CARBONDATA-1484:
---------------------------------

             Summary: carbonthriftserver cache is not refreshed
                 Key: CARBONDATA-1484
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
             Project: CarbonData
          Issue Type: Bug
          Components: core
    Affects Versions: 1.1.0
         Environment: spark:1.6.0,mysql hive metastore
            Reporter: dylan
             Fix For: NONE


  i am use carbondata version is 1.1.0 and spark version is 1.6.0. 
    and I reproduce in accordance with the official quick-start-guide case 
again, 
    1.Creating a Table 
cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name 
String,city String,age int) stored by 'carbondata' ") 

    2.load data into table 
  cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into 
table carbondb.test_table") 

    3.start carbonthriftserver 
   /home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit  --master local[*] 
--driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties" 
--executor-memory 4G  --driver-memory 2g  --conf 
spark.serializer=org.apache.spark.serializer.KryoSerializer   --conf 
"spark.sql.shuffle.partitions=3" --conf spark.speculation=true   --class 
org.apache.carbondata.spark.thriftserver.CarbonThriftServer 
/home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar 
hdfs://nameservice1/user/zz/rp_carbon_store 

   4.Connecting to CarbonData Thrift Server Using Beeline. 

         <http://chuantu.biz/t6/47/1505284993x2890202558.jpg> 

   5.drop table 
   cc.sql("drop table carbondb.test_table") 

   6.recreate table and load data 
    cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name 
String,city String,age int) stored by 'carbondata' ") 
    cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into 
table carbondb.test_table") 

   7.select data use beeline 
    <http://chuantu.biz/t6/47/1505284937x1034817476.jpg> 
   Like the above error, the cache is not updated 

 in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is 
one session on beeline, 

and i test this case on the current carbondata master branch(1.2.0), 

 when i use beeline there is no Btree load failed info,but in my table there 
is no data,All the data is null,but in spark-shell is ok. 
spark-shell: 
+---+-----+--------+---+ 
| id| name|    city|age| 
+---+-----+--------+---+ 
|  1|david|shenzhen| 31| 
|  2|eason|shenzhen| 27| 
|  3|jarry|   wuhan| 35| 
+---+-----+--------+---+ 

beeline: 
0: jdbc:hive2://localhost:10000> select * from  carbondb.test_table; 
+-------+-------+-------+-------+--+ 
|  id   | name  | city  |  age  | 
+-------+-------+-------+-------+--+ 
| NULL  | NULL  | NULL  | NULL  | 
| NULL  | NULL  | NULL  | NULL  | 
| NULL  | NULL  | NULL  | NULL  | 
+-------+-------+-------+-------+--+ 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)