You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ajeet Rai (JIRA)" <ji...@apache.org> on 2017/11/17 09:00:03 UTC
[jira] [Updated] (CARBONDATA-1754) Carbon1.3.0 Concurrent
Load-Compaction: Compaction job fails at run time if insert overwrite job
is running concurrently
[ https://issues.apache.org/jira/browse/CARBONDATA-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ajeet Rai updated CARBONDATA-1754:
----------------------------------
Description:
Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite job is running concurrently.
Steps:
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction concurrently from two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails with below exception:
| ERROR | [pool-23-thread-49] | Error running hive query: | org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction failed to update metadata for table ajeet.flow_carbon_new999
7: Ideally compaction job should give error in start with message that insert overwrite in progress.
was:
Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite job is running concurrently.
Steps:
1: Create a table
2: Start three load one by one
3: After load is completed, start insert overwrite and minor compaction concurrently from two different session
4: observe that both jobs are are running
5: Observe that Insert overwrite job is success but after that compaction fails with below exception:
| ERROR | [pool-23-thread-49] | Error running hive query: | org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction failed to update metadata for table ajeet.flow_carbon_new999
7: Ideally compaction job should give error with message that insert overwrite in progress.
> Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite job is running concurrently
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-1754
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1754
> Project: CarbonData
> Issue Type: Bug
> Components: data-load
> Affects Versions: 1.3.0
> Environment: 3 Node ant cluster
> Reporter: Ajeet Rai
> Labels: dfx
>
> Carbon1.3.0 Concurrent Load-Compaction: Compaction job fails at run time if insert overwrite job is running concurrently.
> Steps:
> 1: Create a table
> 2: Start three load one by one
> 3: After load is completed, start insert overwrite and minor compaction concurrently from two different session
> 4: observe that both jobs are are running
> 5: Observe that Insert overwrite job is success but after that compaction fails with below exception:
> | ERROR | [pool-23-thread-49] | Error running hive query: | org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1$$anon$2.run(SparkExecuteStatementOperation.scala:167)
> org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception: Compaction failed to update metadata for table ajeet.flow_carbon_new999
> 7: Ideally compaction job should give error in start with message that insert overwrite in progress.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)