You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ravindra Pesala (JIRA)" <ji...@apache.org> on 2017/03/03 07:23:45 UTC
[jira] [Resolved] (CARBONDATA-738) Able to load dataframe with
boolean type in a carbon table but with null values
[ https://issues.apache.org/jira/browse/CARBONDATA-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravindra Pesala resolved CARBONDATA-738.
----------------------------------------
Resolution: Fixed
Fix Version/s: 1.0.1-incubating
> Able to load dataframe with boolean type in a carbon table but with null values
> -------------------------------------------------------------------------------
>
> Key: CARBONDATA-738
> URL: https://issues.apache.org/jira/browse/CARBONDATA-738
> Project: CarbonData
> Issue Type: Bug
> Components: spark-integration
> Affects Versions: 1.0.0-incubating
> Environment: spark 1.6,spark 2.1
> Reporter: anubhav tarar
> Assignee: anubhav tarar
> Priority: Trivial
> Fix For: 1.0.1-incubating
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> i created a dataframe with boolean type as follows
> case class People(name: String, occupation: String, consultant: Boolean)
> val people = List(People("sangeeta", "engineer", true), People("pallavi", "consultant", true))
> val peopleRDD: RDD[People] = cc.sc.parallelize(people)
> val peopleDF: DataFrame = peopleRDD.toDF("name", "occupation", "id")
> peopleDF.write
> .format("carbondata")
> .option("tableName", "carbon2")
> .option("compress", "true")
> .mode(SaveMode.Overwrite)
> .save()
> cc.sql("SELECT * FROM carbon2").show()
> currently boolean type is not supported in carbon data but table gets created
> but it shows me null values
> +--------+----------+----+
> | name|occupation| id|
> +--------+----------+----+
> | pallavi|consultant|null|
> |sangeeta| engineer|null|
> +--------+----------+----+
> for boolean type it should throw unsupported type exception
> there is problem with carbondataframe writer
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)