You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Deepti Bhardwaj (JIRA)" <ji...@apache.org> on 2017/01/16 12:00:32 UTC
[jira] [Updated] (CARBONDATA-644) Select query fails randomly on
spark shell
[ https://issues.apache.org/jira/browse/CARBONDATA-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Deepti Bhardwaj updated CARBONDATA-644:
---------------------------------------
Attachment: connectdemo1.csv
eror-log-while-select
Description:
I created a carbon table and loaded it with data(csv attached) via spark shell by running the below command from $SPARK_HOME/bin :
./spark-shell
and then to get the carbon context :
import org.apache.spark.sql.CarbonContext;
val cc = new CarbonContext(sc);
CREATE AND LOAD COMMANDS:
scala>cc.sql("CREATE TABLE connectdemo1 (name String, gender String, province String , singler String, age Int) STORED BY 'org.apache.carbondata.format'");
scala>cc.sql("LOAD DATA inpath 'hdfs://localhost:54310/BabuStore/Data/uniqdata/connectdemo1.csv' INTO table connectdemo1 options('DELIMITER'=',','FILEHEADER'='name, gender, province, singler, age')");
The above two operations were successful but when I tried to run the select query, it failed giving me the java.io.FileNotFoundException(see the log attached)
scala> cc.sql("select * from connectdemo1").show();
> Select query fails randomly on spark shell
> ------------------------------------------
>
> Key: CARBONDATA-644
> URL: https://issues.apache.org/jira/browse/CARBONDATA-644
> Project: CarbonData
> Issue Type: Bug
> Components: data-query
> Affects Versions: 1.0.0-incubating
> Environment: spark 1.6.2
> Reporter: Deepti Bhardwaj
> Assignee: Ravindra Pesala
> Priority: Minor
> Attachments: connectdemo1.csv, eror-log-while-select
>
>
> I created a carbon table and loaded it with data(csv attached) via spark shell by running the below command from $SPARK_HOME/bin :
> ./spark-shell
> and then to get the carbon context :
> import org.apache.spark.sql.CarbonContext;
> val cc = new CarbonContext(sc);
> CREATE AND LOAD COMMANDS:
> scala>cc.sql("CREATE TABLE connectdemo1 (name String, gender String, province String , singler String, age Int) STORED BY 'org.apache.carbondata.format'");
> scala>cc.sql("LOAD DATA inpath 'hdfs://localhost:54310/BabuStore/Data/uniqdata/connectdemo1.csv' INTO table connectdemo1 options('DELIMITER'=',','FILEHEADER'='name, gender, province, singler, age')");
> The above two operations were successful but when I tried to run the select query, it failed giving me the java.io.FileNotFoundException(see the log attached)
> scala> cc.sql("select * from connectdemo1").show();
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)