You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Mohammad Shahid Khan (JIRA)" <ji...@apache.org> on 2017/12/22 06:08:00 UTC
[jira] [Updated] (CARBONDATA-1929) carbon property configuration
validation
[ https://issues.apache.org/jira/browse/CARBONDATA-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mohammad Shahid Khan updated CARBONDATA-1929:
---------------------------------------------
Description:
Issue 1 :
In carbon.properties carbon.timestamp.format=testserwerwerwer12312312312312 is configured and spark submit server is started using the command -
bin/spark-submit --master yarn-client --executor-memory 10G --executor-cores 5 --driver-memory 5G --num-executors 3 --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer --jars /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-core-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-format-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-hadoop-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-processing-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-streaming-1.3.0.0100.jar /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark2-1.3.0.0100.jar "hdfs://hacluster/carbonstore"
From Beeline User tries to create a table
Issue 2 :
In carbon.properties the below properties is configured and spark submit server is started using the command
carbon.sort.file.write.buffer.size=test
carbon.sort.intermediate.files.limit=test
From Beeline User creates a table
User tries to load data.
Issue 3:
In carbon.properties the below properties is configured and spark submit server is started using the command
carbon.block.meta.size.reserved.percentage=test
From beeline user creates table and tries to load data.
was:
Issue 1 :
In carbon.properties carbon.timestamp.format=testserwerwerwer12312312312312 is configured and spark submit server is started using the command -
bin/spark-submit --master yarn-client --executor-memory 10G --executor-cores 5 --driver-memory 5G --num-executors 3 --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer --jars /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-core-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-format-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-hadoop-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-processing-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-streaming-1.3.0.0100.jar /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark2-1.3.0.0100.jar "hdfs://hacluster/carbonstore"
From Beeline User tries to create a table
Create table parsing fails as shown below in snap.
http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71DkJFN3iXJAG7vplZsvI%2bl7M%3d
Issue 2 :
In carbon.properties the below properties is configured and spark submit server is started using the command
carbon.sort.file.write.buffer.size=test
carbon.sort.intermediate.files.limit=test
From Beeline User creates a table
User tries to load data.
Issue :Data loading fails as shown in snap.
http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71DjeZqxHmMLFdeVr460BZPL4%3d
Issue 3:
In carbon.properties the below properties is configured and spark submit server is started using the command
carbon.block.meta.size.reserved.percentage=test
From beeline user creates table and tries to load data.
Issue :Data loading fails as shown in snap.
http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71Ds5xK0%2fNEhBDzhdFVtoc3sg%3d
> carbon property configuration validation
> ----------------------------------------
>
> Key: CARBONDATA-1929
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1929
> Project: CarbonData
> Issue Type: Bug
> Reporter: Mohammad Shahid Khan
>
> Issue 1 :
> In carbon.properties carbon.timestamp.format=testserwerwerwer12312312312312 is configured and spark submit server is started using the command -
> bin/spark-submit --master yarn-client --executor-memory 10G --executor-cores 5 --driver-memory 5G --num-executors 3 --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer --jars /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-core-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-format-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-hadoop-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-processing-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-streaming-1.3.0.0100.jar /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark2-1.3.0.0100.jar "hdfs://hacluster/carbonstore"
> From Beeline User tries to create a table
> Issue 2 :
> In carbon.properties the below properties is configured and spark submit server is started using the command
> carbon.sort.file.write.buffer.size=test
> carbon.sort.intermediate.files.limit=test
> From Beeline User creates a table
> User tries to load data.
> Issue 3:
> In carbon.properties the below properties is configured and spark submit server is started using the command
> carbon.block.meta.size.reserved.percentage=test
> From beeline user creates table and tries to load data.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)