[jira] [Created] (KYLIN-1881) Fail the build job when Hive statements are not allowed

["Yiming Liu (JIRA)" <ji...@apache.org>]

Yiming Liu created KYLIN-1881:
---------------------------------

             Summary: Fail the build job when Hive statements are not allowed
                 Key: KYLIN-1881
                 URL: https://issues.apache.org/jira/browse/KYLIN-1881
             Project: Kylin
          Issue Type: Bug
          Components: Job Engine
    Affects Versions: v1.5.2
            Reporter: Yiming Liu
            Assignee: Dong Li


I was using Hive 1.1.0 with Beeline as the default Hive CLI. 

The sample cube built failed with exception: *java.lang.IllegalArgumentException: Map input splits are 0 bytes, something is wrong*. After checking the Hadoop MapReduce log, I found the following error *Error while processing statement: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=42000,code=1)\*, but the job said *SUCCEED*. I think Kylin should catch this error and set the build step to FAILED, and show the error in the GUI.

{quote}
{
  "uuid" : "9836965c-f943-499b-b630-57d0ff86ea02-00",
  "version" : "1.5.2",
  "content" : "scan complete in 2ms\nConnecting to jdbc:hive2://XX.XX.XX.XX:24002,XX.XX.XX.XX:24002,XX.XX.XX.XX24002/;serviceDiscoveryMode=zooKeeper;sasl.qop=auth-conf;auth=KERBEROS;principal=hive/hadoop.hadoop.com@HADOOP.COM\nDebug is  true storeKey false useTicketCache true useKeyTab false doNotPrompt false ticketCache is null isInitiator true KeyTab is null refreshKrb5Config is false principal is null tryFirstPass is false useFirstPass is false storePass is false clearPass is false\nAcquire TGT from Cache\nPrincipal is insured@HADOOP.COM\nCommit Succeeded \n\nConnected to: Apache Hive (version 1.1.0)\nDriver: Hive JDBC (version 1.1.0)\nTransaction isolation: TRANSACTION_REPEATABLE_READ\n0: jdbc:hive2://XX.XX.XX.XX:21066/> USE default;\nNo rows affected (0.08 seconds)\n0: jdbc:hive2://XX.XX.XX.XX:21066/> DROP TABLE IF EXISTS kylin_intermediate_ky \nlin_sales_cube_desc_20120101000000_20160801000000;\nNo rows affected (0.123 seconds)\n0: jdbc:hive2://XX.XX.XX.XX:21066/> \n0: jdbc:hive2://XX.XX.XX.XX:21066/> CREATE EXTERNAL TABLE IF NOT EXISTS kylin_ \nintermediate_kylin_sales_cube_desc_20120101000000_20160801000000\n. . . . . . . . . . . . . . . . . . > (\n. . . . . . . . . . . . . . . . . . > DEFAULT_KYLIN_SALES_PART_DT date\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_SALES_LEAF_CATEG_ID bigint\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_SALES_LSTG_SITE_ID int\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_META_CAT \nEG_NAME string\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LV \nL2_NAME string\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LV \nL3_NAME string\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_SALES_LSTG_FORMAT_NAME stri \nng\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_SALES_PRICE decimal(19,4)\n. . . . . . . . . . . . . . . . . . > ,DEFAULT_KYLIN_SALES_SELLER_ID bigint\n. . . . . . . . . . . . . . . . . . > )\n. . . . . . . . . . . . . . . . . . > ROW FORMAT DELIMITED FIELDS TERMINATED BY  \n'\\177'\n. . . . . . . . . . . . . . . . . . > STORED AS SEQUENCEFILE\n. . . . . . . . . . . . . . . . . . > LOCATION '/kylin/kylin_metadata/kylin-9836 \n965c-f943-499b-b630-57d0ff86ea02/kylin_intermediate_kylin_sales_cube_desc_201201 \n01000000_20160801000000';\nNo rows affected (0.336 seconds)\n0: jdbc:hive2://XX.XX.XX.XX:21066/> \n0: jdbc:hive2://XX.XX.XX.XX:21066/> SET dfs.replication=2;\n{color:red}Error: Error while processing statement: Cannot modify dfs.replication at runtime. It is not in list of params that are allowed to be modified at runtime (state=42000,code=1)\n\n{color}Closing: 0: jdbc:hive2://XX.XX.XX.XX:24002,XX.XX.XX.XX:24002,XX.XX.XX.XX:24002/;serviceDiscoveryMode=zooKeeper;sasl.qop=auth-conf;auth=KERBEROS;principal=hive/hadoop.hadoop.com@HADOOP.COM\n",
  "status" : "SUCCEED",
  "info" : {
    "startTime" : "1467943018140",
    "endTime" : "1467943021680"
  },
  "last_modified" : 1467943021682
}
{quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)