[jira] [Commented] (CARBONDATA-88) Use ./bin/carbon-spark-shell to run, generated two issues

["Shoujie Zhuo (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CARBONDATA-88?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387116#comment-15387116 ] 

Shoujie Zhuo commented on CARBONDATA-88:
----------------------------------------

did you set conf like：
val storePath = "hdfs://hacluster/Opt/CarbonStore"
val cc = new CarbonContext(sc, storePath)
cc.setConf("carbon.kettle.home","./carbondata/carbonplugins")
val metadata = new File("").getCanonicalPath + "/carbondata/metadata"
cc.setConf("hive.metastore.warehouse.dir", metadata)
cc.setConf(HiveConf.ConfVars.HIVECHECKFILEFORMAT.varname, "false")

> Use ./bin/carbon-spark-shell to run, generated two issues
> ---------------------------------------------------------
>
>                 Key: CARBONDATA-88
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-88
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: Apache CarbonData 0.1.0-incubating
>         Environment: Apache Spark1.6.1
> The latest master code of Apache CarbonData
>            Reporter: ChenLiang
>            Assignee: Ravindra Pesala
>            Priority: Minor
>
> Use ./bin/carbon-spark-shell to run, generated two issues:
> 1. The carbonshellstore be created under root directory, propose to move carbonshellstore to ./bin directory
> 2.Data load failure:
> scala> cc.sql("LOAD DATA LOCAL INPATH '/Users/apple/Downloads/spark-1.6.1-bin-hadoop2.6/carbondata/hzmeetup.csv' INTO TABLE meetupTable")
> java.lang.Exception: Dataload failure
> 	at org.carbondata.spark.rdd.CarbonDataRDDFactory$.loadCarbonData(CarbonDataRDDFactory.scala:791)
> 	at org.apache.spark.sql.execution.command.LoadTable.run(carbonTableSchema.scala:1167)
> 	at org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:58)
> 	at org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:56)
> 	at org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:70)
> 	at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:132)
> 	at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:130)
> 	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
> 	at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:130)
> 	at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:55)
> 	at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:55)
> 	at org.apache.spark.sql.DataFrame.<init>(DataFrame.scala:145)
> 	at org.apache.spark.sql.DataFrame.<init>(DataFrame.scala:130)
> 	at org.carbondata.spark.rdd.CarbonDataFrameRDD.<init>(CarbonDataFrameRDD.scala:23)
> 	at org.apache.spark.sql.CarbonContext.sql(CarbonContext.scala:131)
> 	at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)