You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "dylan (JIRA)" <ji...@apache.org> on 2017/09/18 10:11:00 UTC
[jira] [Updated] (CARBONDATA-1484) carbonthriftserver cache is not
refreshed
[ https://issues.apache.org/jira/browse/CARBONDATA-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dylan updated CARBONDATA-1484:
------------------------------
External issue URL: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Fw-carbonthriftserver-can-not-be-load-many-times-td21823.html
> carbonthriftserver cache is not refreshed
> -----------------------------------------
>
> Key: CARBONDATA-1484
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
> Project: CarbonData
> Issue Type: Bug
> Components: core
> Affects Versions: 1.1.0
> Environment: spark:1.6.0,mysql hive metastore
> Reporter: dylan
> Fix For: NONE
>
>
> i am use carbondata version is 1.1.0 and spark version is 1.6.0.
> and I reproduce in accordance with the official quick-start-guide case
> again,
> 1.Creating a Table
> cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
> String,city String,age int) stored by 'carbondata' ")
> 2.load data into table
> cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
> table carbondb.test_table")
> 3.start carbonthriftserver
> /home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit --master local[*]
> --driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"
> --executor-memory 4G --driver-memory 2g --conf
> spark.serializer=org.apache.spark.serializer.KryoSerializer --conf
> "spark.sql.shuffle.partitions=3" --conf spark.speculation=true --class
> org.apache.carbondata.spark.thriftserver.CarbonThriftServer
> /home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar
> hdfs://nameservice1/user/zz/rp_carbon_store
> 4.Connecting to CarbonData Thrift Server Using Beeline.
> <http://chuantu.biz/t6/47/1505284993x2890202558.jpg>
> 5.drop table
> cc.sql("drop table carbondb.test_table")
> 6.recreate table and load data
> cc.sql("create table IF NOT EXISTS carbondb.test_table(id string,name
> String,city String,age int) stored by 'carbondata' ")
> cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
> table carbondb.test_table")
> 7.select data use beeline
> <http://chuantu.biz/t6/47/1505284937x1034817476.jpg>
> Like the above error, the cache is not updated
> in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is
> one session on beeline,
> and i test this case on the current carbondata master branch(1.2.0),
> when i use beeline there is no Btree load failed info,but in my table there
> is no data,All the data is null,but in spark-shell is ok.
> spark-shell:
> +---+-----+--------+---+
> | id| name| city|age|
> +---+-----+--------+---+
> | 1|david|shenzhen| 31|
> | 2|eason|shenzhen| 27|
> | 3|jarry| wuhan| 35|
> +---+-----+--------+---+
> beeline:
> 0: jdbc:hive2://localhost:10000> select * from carbondb.test_table;
> +-------+-------+-------+-------+--+
> | id | name | city | age |
> +-------+-------+-------+-------+--+
> | NULL | NULL | NULL | NULL |
> | NULL | NULL | NULL | NULL |
> | NULL | NULL | NULL | NULL |
> +-------+-------+-------+-------+--+
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)