[jira] [Commented] (CARBONDATA-896) throws nullpointerException while insert data

["Rahul Kumar (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CARBONDATA-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964137#comment-15964137 ] 

Rahul Kumar commented on CARBONDATA-896:
----------------------------------------

hi [~Sehriff] ,
i have tried following query with spark-1.6 :
    cc.sql("""
           CREATE TABLE IF NOT EXISTS t3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary   
      Int,floatField float)
           STORED BY 'carbondata'
           """)
    cc.sql("""
           CREATE TABLE IF NOT EXISTS h3
           (ID Int, date Date, country String,
           name String, phonetype String, serialname String, salary Int,floatField float)row format delimited fields terminated by ','""")

    cc.sql(s""" LOAD DATA LOCAL INPATH '$testData' into table h3""")
    cc.sql(""" SELECT * FROM h3""").show()
    cc.sql("insert into default.t3 select * from h3").show
    cc.sql("""SELECT * FROM h3""").show()
    cc.sql("""SELECT * FROM t3""").show()

and its working fine for me .

Can you please add some more information( spark version, csv, executed steps)

> throws nullpointerException while insert data
> ---------------------------------------------
>
>                 Key: CARBONDATA-896
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-896
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.0.0-incubating
>            Reporter: sehriff
>
> insert data into carbon table from hive using sql like:
> cc.sql("insert into carbon.table_carbon select * from hivetable").show
> and got the following error:
> Job aborted due to stage failure: Task 0 in stage 26.3 failed 4 times, most recent failure: Lost task 0.3 in stage 26.3 (TID 5628, HDD013): java.lang.NullPointerException
> 	at org.apache.carbondata.core.datastore.filesystem.AbstractDFSCarbonFile.getLastModifiedTime(AbstractDFSCarbonFile.java:135)
> 	at org.apache.carbondata.core.datastore.filesystem.AbstractDFSCarbonFile.isFileModified(AbstractDFSCarbonFile.java:210)
> 	at org.apache.carbondata.core.cache.dictionary.AbstractDictionaryCache.isDictionaryMetaFileModified(AbstractDictionaryCache.java:119)
> 	at org.apache.carbondata.core.cache.dictionary.AbstractDictionaryCache.checkAndLoadDictionaryData(AbstractDictionaryCache.java:158)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.getDictionary(ReverseDictionaryCache.java:174)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.get(ReverseDictionaryCache.java:67)
> 	at org.apache.carbondata.core.cache.dictionary.ReverseDictionaryCache.get(ReverseDictionaryCache.java:38)
> 	at org.apache.carbondata.spark.load.CarbonLoaderUtil.getDictionary(CarbonLoaderUtil.java:463)
> 	at org.apache.carbondata.spark.load.CarbonLoaderUtil.getDictionary(CarbonLoaderUtil.java:469)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:413)
> 	at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:342)
> 	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> 	at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> 	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:89)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)