[jira] [Created] (HIVE-22226) Getting Arrayoutofbound exception when using left join

["Ramesh Pemmasani Srinivasalu (Jira)" <ji...@apache.org>]

Ramesh Pemmasani Srinivasalu created HIVE-22226:
---------------------------------------------------

             Summary: Getting Arrayoutofbound exception when using left join
                 Key: HIVE-22226
                 URL: https://issues.apache.org/jira/browse/HIVE-22226
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
    Affects Versions: 2.3.1
         Environment: production
            Reporter: Ramesh Pemmasani Srinivasalu


19/09/13 07:12:04 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:37645 with 4.1 GB RAM, BlockManagerId(8, servername.corp.com, 37645)
19/09/13 07:12:04 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:52820) with ID 9
19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8
19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:33041 with 4.1 GB RAM, BlockManagerId(9, servername.corp.com, 33041)
19/09/13 07:12:05 INFO hive.HiveContext: Initializing execution hive, version 1.1.0
19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:48136) with ID 11
19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:39145 with 4.1 GB RAM, BlockManagerId(11, servername.corp.com, 39145)
19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username
19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/d16faa91-82cb-424a-907d-70d48c03b9ea_resources
19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea
19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/username/d16faa91-82cb-424a-907d-70d48c03b9ea
19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea/_tmp_space.db
19/09/13 07:12:05 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
19/09/13 07:12:05 INFO hive.HiveContext: default warehouse location is /user/hive/warehouse
19/09/13 07:12:05 INFO hive.HiveContext: Initializing metastore client version 1.1.0 using Spark classes.
19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1dvpap.corp.com:50616) with ID 7
19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1dvpap.corp.com:44921 with 4.1 GB RAM, BlockManagerId(7, lsdna1dvpap.corp.com, 44921)
19/09/13 07:12:06 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1sjpappr.corp.com:57542) with ID 6
19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/ca568677-0f11-4ef4-baef-cfea87c32f40_resources
19/09/13 07:12:06 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1sjpappr.corp.com:37121 with 4.1 GB RAM, BlockManagerId(6, lsdna1sjpappr.corp.com, 37121)
19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40
19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/user/ca568677-0f11-4ef4-baef-cfea87c32f40
19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40/_tmp_space.db
19/09/13 07:12:06 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
19/09/13 07:12:07 INFO hive.metastore: Trying to connect to metastore with URI thrift://servername.corp.com:9083
19/09/13 07:12:07 INFO hive.metastore: Opened a connection to metastore, current connections: 1
19/09/13 07:12:07 INFO hive.metastore: Connected to metastore.
19/09/13 07:12:07 INFO metadata.Hive: Registering function hash256 com.bac.peaks.pksHash
19/09/13 07:12:07 INFO metadata.Hive: Registering function tempfunction com.bac.qrt.udf.ConvertExponential
19/09/13 07:12:07 INFO metadata.Hive: Registering function annual_value com.boa.rrsa.riskcalc.udf.CalculateAnnualValueUDF
19/09/13 07:12:07 WARN controller.SparkFlowController: Metadata is not being logged. Please make sure this is intended!
19/09/13 07:12:07 INFO controller.SparkFlowController: Instanciating Flow Class:com.bac.rctt.apps.flowbot.flows.OrderedStepFlow
19/09/13 07:12:07 INFO controller.SparkFlowController: Running Flow:sp_cmrcl_tre_by_facility_02
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Starting OrderedStepFlow
19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Validating steps...
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Verifying config
19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-020
19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-020
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-010
19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-010
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-030
19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-030
19/09/13 07:12:07 INFO flows.OrderedStepFlow: Finished validating steps
19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: New Instance of DataFrameEnvelope
19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: Running mergeAttributes
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setDataFrame
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setExistingDataFrame
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Converting column names to lower case
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Collects stats attribute has value not found: flow.metadata.dataframe.collectStats
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: No collectStats columns were provided, so skipping calculation
19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Registering new temp table: flow_metadata
19/09/13 07:12:08 INFO flows.OrderedStepFlow: Processing step: flow.steps.step-010
19/09/13 07:12:08 INFO processors.ExecuteCMD: ******Item to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql exehqldf1
19/09/13 07:12:08 INFO processors.ExecuteCMD: New Step Name:flow.steps.step-010-1
19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd name:exehqldf1
19/09/13 07:12:08 INFO envelope.FlowEnvelope: Running clone attributes
19/09/13 07:12:08 INFO processors.ExecuteCMD: found filesystem step! Going to pass 'flow.steps.step-010-1' to executeCommand
19/09/13 07:12:08 INFO processors.ExecuteCMD: Executing command: sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
Error: Error while compiling statement: FAILED: ArrayIndexOutOfBoundsException null (state=42000,code=40000)
19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes
19/09/13 07:18:51 INFO util.FeedSLA$: SLA check not enabled for step flow.steps.step-010
19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes



--
This message was sent by Atlassian Jira
(v8.3.4#803005)