You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/05/27 03:45:52 UTC
[GitHub] [incubator-dolphinscheduler] primoshen opened a new issue #2817: [QUESTION] The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
primoshen opened a new issue #2817:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2817
*For better global communication, please give priority to using English description, thx! *
**Describe the question**
A clear and concise description of what the question is.
The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
# Name Process Instance Node Type State Submit Time Start Time End Time host Duration(s) Retry Count Operation
1
ods层 会员卡充消明细
crm 会员卡充消明细-0-1590454926421
SHELL 2020-05-26 09:02:06 2020-05-26 09:02:07 2020-05-26 09:03:36 192.168.0.99 89 0
log:
[INFO] 2020-05-26 09:02:09.725 - [taskAppId=TASK-5-42-110]:[106] - -> SLF4J: Class path contains multiple SLF4J bindings.
[INFO] 2020-05-26 09:02:10.791 - [taskAppId=TASK-5-42-110]:[106] - -> SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/log4j-slf4j-impl-2.8.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
20/05/26 09:02:09 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7-cdh6.1.0
20/05/26 09:02:09 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
20/05/26 09:02:09 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
20/05/26 09:02:09 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
20/05/26 09:02:09 WARN tool.BaseSqoopTool: It seems that you're doing hive import directly into default
20/05/26 09:02:09 WARN tool.BaseSqoopTool: hive warehouse directory which is not supported. Sqoop is
20/05/26 09:02:09 WARN tool.BaseSqoopTool: firstly importing data into separate directory and then
20/05/26 09:02:09 WARN tool.BaseSqoopTool: inserting data into hive. Please consider removing
20/05/26 09:02:09 WARN tool.BaseSqoopTool: --target-dir or --warehouse-dir into /user/hive/warehouse in
20/05/26 09:02:09 WARN tool.BaseSqoopTool: case that you will detect any issues.
20/05/26 09:02:09 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
20/05/26 09:02:09 INFO tool.CodeGenTool: Beginning code generation
20/05/26 09:02:10 INFO manager.SqlManager: Executing SQL statement: select ta.id as src_cd ,ta.order_code as src_sys_so_cd ,ta.order_id as ro_cd ,ta.user_id as vip_cd ,ta.shop_id as str_cd ,tc.shop_name as str_nm ,coalesce((case when ta.type!=2 then ta.amount end),0) as rchg_amt ,coalesce((case when ta.type=2 then ta.amount end),0) as pay_amt ,ta.donation_amount as dnt_amt ,ta.last_balance as b4_rchg_amt ,ta.type as typ ,tb.status as chg_stat ,tb.pay_type as chg_pay_typ ,tb.pay_id as chg_pay_cd ,tb.order_type as chg_typ ,tb.recharge_type as rchg_typ ,ta.is_lock as lock_stat ,FROM_UNIXTIME(ta.c_t, '%Y%m%d %H:%i:%s') as create_time ,from_unixtime(unix_timestamp(),'%Y%m%d %H:%i:%s') as etl_time from qm_member.t_user_wallet_recharge ta left join qm_member.t_order_recharge tb on ta.order_id=tb.id and ta.order_code=tb.order_code and ta.user_id=tb.user_id and ta.shop_id=tb.shop_id and FROM_UNIXTIME(ta.c_t, '%Y%m%d')=FROM_UNIXTIME(tb.c_t/1000, '%Y%m%d') left join fresh_mall.t_shop tc on ta.shop_id=tc.id where FROM_UNIXTIME(ta.c_t, '%Y%m%d')='20200525' and (1 = 0)
20/05/26 09:02:10 INFO manager.SqlManager: Executing SQL statement: select ta.id as src_cd ,ta.order_code as src_sys_so_cd ,ta.order_id as ro_cd ,ta.user_id as vip_cd ,ta.shop_id as str_cd ,tc.shop_name as str_nm ,coalesce((case when ta.type!=2 then ta.amount end),0) as rchg_amt ,coalesce((case when ta.type=2 then ta.amount end),0) as pay_amt ,ta.donation_amount as dnt_amt ,ta.last_balance as b4_rchg_amt ,ta.type as typ ,tb.status as chg_stat ,tb.pay_type as chg_pay_typ ,tb.pay_id as chg_pay_cd ,tb.order_type as chg_typ ,tb.recharge_type as rchg_typ ,ta.is_lock as lock_stat ,FROM_UNIXTIME(ta.c_t, '%Y%m%d %H:%i:%s') as create_time ,from_unixtime(unix_timestamp(),'%Y%m%d %H:%i:%s') as etl_time from qm_member.t_user_wallet_recharge ta left join qm_member.t_order_recharge tb on ta.order_id=tb.id and ta.order_code=tb.order_code and ta.user_id=tb.user_id and ta.shop_id=tb.shop_id and FROM_UNIXTIME(ta.c_t, '%Y%m%d')=FROM_UNIXTIME(tb.c_t/1000, '%Y%m%d') left join fresh_mall.t_shop tc on ta.shop_id=tc.id where FROM_UNIXTIME(ta.c_t, '%Y%m%d')='20200525' and (1 = 0)
20/05/26 09:02:10 INFO manager.SqlManager: Executing SQL statement: select ta.id as src_cd ,ta.order_code as src_sys_so_cd ,ta.order_id as ro_cd ,ta.user_id as vip_cd ,ta.shop_id as str_cd ,tc.shop_name as str_nm ,coalesce((case when ta.type!=2 then ta.amount end),0) as rchg_amt ,coalesce((case when ta.type=2 then ta.amount end),0) as pay_amt ,ta.donation_amount as dnt_amt ,ta.last_balance as b4_rchg_amt ,ta.type as typ ,tb.status as chg_stat ,tb.pay_type as chg_pay_typ ,tb.pay_id as chg_pay_cd ,tb.order_type as chg_typ ,tb.recharge_type as rchg_typ ,ta.is_lock as lock_stat ,FROM_UNIXTIME(ta.c_t, '%Y%m%d %H:%i:%s') as create_time ,from_unixtime(unix_timestamp(),'%Y%m%d %H:%i:%s') as etl_time from qm_member.t_user_wallet_recharge ta left join qm_member.t_order_recharge tb on ta.order_id=tb.id and ta.order_code=tb.order_code and ta.user_id=tb.user_id and ta.shop_id=tb.shop_id and FROM_UNIXTIME(ta.c_t, '%Y%m%d')=FROM_UNIXTIME(tb.c_t/1000, '%Y%m%d') left join fresh_mall.t_shop tc on ta.shop_id=tc.id where FROM_UNIXTIME(ta.c_t, '%Y%m%d')='20200525' and (1 = 0)
20/05/26 09:02:10 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
[INFO] 2020-05-26 09:02:12.371 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:12 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-primo/compile/0a02e116dfcdf96238b879000bd2d6d2/QueryResult.jar
[INFO] 2020-05-26 09:02:13.596 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:13 INFO tool.ImportTool: Destination directory /user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d_bak/statis_date=20200525 is not present, hence not deleting.
20/05/26 09:02:13 INFO mapreduce.ImportJobBase: Beginning query import.
20/05/26 09:02:13 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
20/05/26 09:02:13 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
20/05/26 09:02:13 INFO client.RMProxy: Connecting to ResourceManager at ai.test.host01/192.168.0.99:8032
20/05/26 09:02:13 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /user/hdfs/.staging/job_1590395672740_0054
[INFO] 2020-05-26 09:02:14.956 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:14 INFO db.DBInputFormat: Using read commited transaction isolation
[INFO] 2020-05-26 09:02:21.568 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:15 INFO mapreduce.JobSubmitter: number of splits:1
20/05/26 09:02:15 INFO Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
20/05/26 09:02:15 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1590395672740_0054
20/05/26 09:02:15 INFO mapreduce.JobSubmitter: Executing with tokens: []
20/05/26 09:02:15 INFO conf.Configuration: resource-types.xml not found
20/05/26 09:02:15 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
20/05/26 09:02:15 INFO impl.YarnClientImpl: Submitted application application_1590395672740_0054
20/05/26 09:02:15 INFO mapreduce.Job: The url to track the job: http://ai.test.host01:8088/proxy/application_1590395672740_0054/
20/05/26 09:02:15 INFO mapreduce.Job: Running job: job_1590395672740_0054
20/05/26 09:02:21 INFO mapreduce.Job: Job job_1590395672740_0054 running in uber mode : false
[INFO] 2020-05-26 09:02:27.620 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:21 INFO mapreduce.Job: map 0% reduce 0%
20/05/26 09:02:27 INFO mapreduce.Job: map 100% reduce 0%
[INFO] 2020-05-26 09:02:29.551 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:27 INFO mapreduce.Job: Job job_1590395672740_0054 completed successfully
20/05/26 09:02:27 INFO mapreduce.Job: Counters: 33
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=243182
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=85
HDFS: Number of bytes written=326957
HDFS: Number of read operations=6
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
HDFS: Number of bytes read erasure-coded=0
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=11202
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=3734
Total vcore-milliseconds taken by all map tasks=3734
Total megabyte-milliseconds taken by all map tasks=38236160
Map-Reduce Framework
Map input records=6573
Map output records=6573
Input split bytes=85
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=50
CPU time spent (ms)=3030
Physical memory (bytes) snapshot=455688192
Virtual memory (bytes) snapshot=10758451200
Total committed heap usage (bytes)=1519386624
Peak Map Physical memory (bytes)=455688192
Peak Map Virtual memory (bytes)=10758451200
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=326957
20/05/26 09:02:27 INFO mapreduce.ImportJobBase: Transferred 319.2939 KB in 14.5548 seconds (21.9374 KB/sec)
20/05/26 09:02:27 INFO mapreduce.ImportJobBase: Retrieved 6573 records.
20/05/26 09:02:27 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table null
20/05/26 09:02:27 INFO manager.SqlManager: Executing SQL statement: select ta.id as src_cd ,ta.order_code as src_sys_so_cd ,ta.order_id as ro_cd ,ta.user_id as vip_cd ,ta.shop_id as str_cd ,tc.shop_name as str_nm ,coalesce((case when ta.type!=2 then ta.amount end),0) as rchg_amt ,coalesce((case when ta.type=2 then ta.amount end),0) as pay_amt ,ta.donation_amount as dnt_amt ,ta.last_balance as b4_rchg_amt ,ta.type as typ ,tb.status as chg_stat ,tb.pay_type as chg_pay_typ ,tb.pay_id as chg_pay_cd ,tb.order_type as chg_typ ,tb.recharge_type as rchg_typ ,ta.is_lock as lock_stat ,FROM_UNIXTIME(ta.c_t, '%Y%m%d %H:%i:%s') as create_time ,from_unixtime(unix_timestamp(),'%Y%m%d %H:%i:%s') as etl_time from qm_member.t_user_wallet_recharge ta left join qm_member.t_order_recharge tb on ta.order_id=tb.id and ta.order_code=tb.order_code and ta.user_id=tb.user_id and ta.shop_id=tb.shop_id and FROM_UNIXTIME(ta.c_t, '%Y%m%d')=FROM_UNIXTIME(tb.c_t/1000, '%Y%m%d') left join fresh_mall.t_shop tc on ta.shop_id=tc.id where FROM_UNIXTIME(ta.c_t, '%Y%m%d')='20200525' and (1 = 0)
20/05/26 09:02:27 INFO manager.SqlManager: Executing SQL statement: select ta.id as src_cd ,ta.order_code as src_sys_so_cd ,ta.order_id as ro_cd ,ta.user_id as vip_cd ,ta.shop_id as str_cd ,tc.shop_name as str_nm ,coalesce((case when ta.type!=2 then ta.amount end),0) as rchg_amt ,coalesce((case when ta.type=2 then ta.amount end),0) as pay_amt ,ta.donation_amount as dnt_amt ,ta.last_balance as b4_rchg_amt ,ta.type as typ ,tb.status as chg_stat ,tb.pay_type as chg_pay_typ ,tb.pay_id as chg_pay_cd ,tb.order_type as chg_typ ,tb.recharge_type as rchg_typ ,ta.is_lock as lock_stat ,FROM_UNIXTIME(ta.c_t, '%Y%m%d %H:%i:%s') as create_time ,from_unixtime(unix_timestamp(),'%Y%m%d %H:%i:%s') as etl_time from qm_member.t_user_wallet_recharge ta left join qm_member.t_order_recharge tb on ta.order_id=tb.id and ta.order_code=tb.order_code and ta.user_id=tb.user_id and ta.shop_id=tb.shop_id and FROM_UNIXTIME(ta.c_t, '%Y%m%d')=FROM_UNIXTIME(tb.c_t/1000, '%Y%m%d') left join fresh_mall.t_shop tc on ta.shop_id=tc.id where FROM_UNIXTIME(ta.c_t, '%Y%m%d')='20200525' and (1 = 0)
20/05/26 09:02:28 WARN hive.TableDefWriter: Column rchg_amt had to be cast to a less precise type in Hive
20/05/26 09:02:28 WARN hive.TableDefWriter: Column pay_amt had to be cast to a less precise type in Hive
20/05/26 09:02:28 WARN hive.TableDefWriter: Column dnt_amt had to be cast to a less precise type in Hive
20/05/26 09:02:28 WARN hive.TableDefWriter: Column b4_rchg_amt had to be cast to a less precise type in Hive
20/05/26 09:02:28 INFO hive.HiveImport: Loading uploaded data into Hive
20/05/26 09:02:28 INFO conf.HiveConf: Found configuration file file:/etc/hive/conf.cloudera.hive/hive-site.xml
[INFO] 2020-05-26 09:02:31.454 - [taskAppId=TASK-5-42-110]:[106] - -> Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/hive-common-2.1.1-cdh6.1.0.jar!/hive-log4j2.properties Async: false
20/05/26 09:02:29 INFO SessionState:
Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/jars/hive-common-2.1.1-cdh6.1.0.jar!/hive-log4j2.properties Async: false
20/05/26 09:02:29 INFO session.SessionState: Created HDFS directory: /tmp/hive/hdfs/835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:29 INFO session.SessionState: Created local directory: /tmp/primo/835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:29 INFO session.SessionState: Created HDFS directory: /tmp/hive/hdfs/835b05f3-6342-492e-ab55-ada8ba574257/_tmp_space.db
20/05/26 09:02:29 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:29 INFO session.SessionState: Updating thread name to 835b05f3-6342-492e-ab55-ada8ba574257 main
20/05/26 09:02:29 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:29 INFO ql.Driver: Compiling command(queryId=primo_20200526090229_13d0564e-3d27-4c47-88f6-d85724f61062): CREATE TABLE IF NOT EXISTS `dc_ods`.`tdc_ods_crm_mem_card_rchg_pay_detail_d` ( `src_cd` BIGINT, `src_sys_so_cd` STRING, `ro_cd` INT, `vip_cd` INT, `str_cd` INT, `str_nm` STRING, `rchg_amt` DOUBLE, `pay_amt` DOUBLE, `dnt_amt` DOUBLE, `b4_rchg_amt` DOUBLE, `typ` TINYINT, `chg_stat` INT, `chg_pay_typ` INT, `chg_pay_cd` STRING, `chg_typ` TINYINT, `rchg_typ` TINYINT, `lock_stat` TINYINT, `create_time` STRING, `etl_time` STRING) COMMENT 'Imported by sqoop on 2020/05/26 09:02:28' PARTITIONED BY (statis_date STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE
20/05/26 09:02:31 INFO hive.metastore: Trying to connect to metastore with URI thrift://ai.test.host01:9083
[INFO] 2020-05-26 09:02:31.968 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:31 INFO hive.metastore: Opened a connection to metastore, current connections: 1
20/05/26 09:02:31 INFO hive.metastore: Connected to metastore.
20/05/26 09:02:31 INFO parse.CalcitePlanner: Starting Semantic Analysis
20/05/26 09:02:31 INFO parse.CalcitePlanner: Creating table dc_ods.tdc_ods_crm_mem_card_rchg_pay_detail_d position=27
20/05/26 09:02:31 INFO ql.Driver: Semantic Analysis Completed
20/05/26 09:02:31 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
20/05/26 09:02:31 INFO ql.Driver: Completed compiling command(queryId=primo_20200526090229_13d0564e-3d27-4c47-88f6-d85724f61062); Time taken: 2.047 seconds
20/05/26 09:02:31 INFO lockmgr.DummyTxnManager: Creating lock manager of type org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager
20/05/26 09:02:31 INFO imps.CuratorFrameworkImpl: Starting
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh6.1.0--1, built on 12/07/2018 00:32 GMT
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:host.name=ai.test.host01
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.version=1.8.0_141
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/java/jdk1.8.0_141-cloudera/jre
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/etc/hadoop/conf.cloudera.yarn:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-jaxrs-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-framework-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerby-util-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-client-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jul-to-slf4j-1.7.25.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/curator-recipes-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/azure-data-lake-store-sdk-2.2.9.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jcip-annotations-1.0-1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/paranamer-2.8.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/logredactor-2.0.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-annotations-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-webapp-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-identity-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-api-1.7.25.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-xml-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerby-xdr-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-server-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-servlet-1.19.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-crypto-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/metrics-core-3.0.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-server-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-util-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-client-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-core-1.19.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-util-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/stax2-api-3.1.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerby-asn1-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsch-0.1.54.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/snappy-java-1.1.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerby-pkix-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/asm-5.0.4.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/aws-java-sdk-bundle-1.11.271.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-servlet-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-server-1.19.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-http-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-io-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-api-2.2.11.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-core-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-json-1.19.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/zookeeper.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/wildfly-openssl-1.0.4.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/re2j-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/json-smart-2.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-xc-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/log4j-core-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-codec-1.11.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-common-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-admin-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-io-2.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/woodstox-core-5.0.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-databind-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/log4j-api-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/xz-1.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-core-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerb-simplekdc-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-configuration2-2.1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/httpcore-4.4.6.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jetty-security-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/kerby-config-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-common.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-azure.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-common-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-azure-datalake.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-kms.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-aws.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-annotations.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-nfs.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-auth.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-format-sources.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-cascading.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-encoding.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-pig-bundle.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-azure-datalake-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-annotations-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-cascading3.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-common-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-column.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-scala_2.10.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-format.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-nfs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-common.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-hadoop.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-pig.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-auth-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-aws-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-kms-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-generator.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-thrift.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-azure-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//hadoop-common-3.0.0-cdh6.1.0-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-jackson.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-protobuf.jar:/opt/cloudera/parcels/CDH/lib/hadoop/.//parquet-avro.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/./:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/avro-1.8.2-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/curator-framework-2.12.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerby-util-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/curator-client-2.12.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/okhttp-2.7.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-annotations-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-webapp-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/paranamer-2.8.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-identity-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/json-smart-2.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-xml-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-server-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-servlet-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerby-xdr-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/json-simple-1.1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-servlet-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-util-ajax-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsch-0.1.54.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-crypto-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-server-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-http-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-client-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/snappy-java-1.1.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-util-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-common-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-core-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-util-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/asm-5.0.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerby-asn1-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerby-config-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/stax2-api-3.1.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-json-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jersey-server-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerby-pkix-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-core-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-security-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/re2j-1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jetty-io-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/httpcore-4.4.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/zookeeper-3.4.5-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-codec-1.11.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-simplekdc-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/xz-1.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/okio-1.6.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-core-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/kerb-admin-1.0.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/commons-io-2.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/lib/jackson-databind-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-client.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0-cdh6.1.0-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-client-3.0.0-cdh6.1.0-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-client-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-hdfs/.//hadoop-hdfs-3.0.0-cdh6.1.0-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0-cdh6.1.0-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-rumen.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-gridmix.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-openstack-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-aliyun-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//kafka-clients-2.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-sls.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-rumen-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archive-logs.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-streaming.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//ojalgo-43.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-sls-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-datajoin-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-extras.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-kafka-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-kafka.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//lz4-java-1.4.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-datajoin.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-gridmix-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-distcp-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-distcp.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-openstack.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//jdom-1.1.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archives.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-aliyun.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/spark-2.4.0-cdh6.1.0-yarn-shuffle.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/json-io-2.5.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-client-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-jaxrs-json-provider-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/objenesis-1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-module-jaxb-annotations-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/ehcache-3.3.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/java-util-1.9.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/guice-4.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/guice-servlet-4.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/metrics-core-3.0.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/jackson-jaxrs-base-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/jersey-guice-1.19.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/lib/fst-2.50.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-api.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-client.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-common.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-registry.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-router.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-api-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-registry-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-common-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-client-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-common-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-router-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hadoop/libexec/../../hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/conf:/etc/zookeeper:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/ant-contrib-1.0b3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/avro-ipc.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/avro.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/avro-mapred.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-codec-1.9.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-compress-1.11.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-jexl-2.1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-lang3-3.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-logging-1.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/commons-pool-1.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/datanucleus-api-jdo-4.2.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/datanucleus-core-4.1.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/datanucleus-rdbms-4.1.7.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/derby-10.14.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/fastutil-7.2.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/hsqldb-1.8.0.10.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jackson-annotations-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jackson-core-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jackson-databind-2.9.5.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/javax.jdo-3.2.0-m3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-http-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-io-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-security-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-server-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-servlet-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jetty-util-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/jsr305-2.0.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/kite-data-core.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/kite-data-hive.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/kite-data-mapreduce.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/kite-hadoop-compatibility.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/mysql-connector-java.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/opencsv-2.3.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/paranamer-2.8.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-avro.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-column.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-common.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-encoding.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-format.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-hadoop.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/parquet-jackson.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/re2j-1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/slf4j-api-1.7.25.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/snappy-java-1.1.4.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/transaction-api-1.1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/lib/xz-1.6.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/shaded-clients/hbase-shaded-mapreduce-2.1.0-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/findbugs-annotations-1.3.9-1.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hbase/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.25.jar:/usr/share/java/mysql-connector-java.jar:/usr/share/java/postgresql-jdbc2ee.jar:/usr/share/java/postgresql-jdbc2.jar:/usr/share/java/postgresql-jdbc3.jar:/usr/share/java/postgresql-jdbc.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/accumulo-core-1.8.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/accumulo-fate-1.8.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/accumulo-start-1.8.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/accumulo-trace-1.8.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/aggdesigner-algorithm-6.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ant-1.6.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ant-1.9.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ant-launcher-1.9.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/antlr4-runtime-4.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/antlr-runtime-3.5.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/aopalliance-repackaged-2.5.0-b32.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/apache-jsp-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/apache-jstl-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/asm-5.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/asm-commons-5.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/asm-tree-5.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/avatica-1.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/avro.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/calcite-core-1.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/calcite-druid-1.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/calcite-linq4j-1.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-cli-1.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-codec-1.9.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-compress-1.9.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-crypto-1.0.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-dbcp-1.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-lang3-3.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-logging-1.0.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-math3-3.6.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-pool-1.5.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/commons-vfs2-2.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/curator-client-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/curator-framework-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/curator-recipes-2.12.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/datanucleus-api-jdo-4.2.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/datanucleus-core-4.1.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/datanucleus-rdbms-4.1.7.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/derby-10.14.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/disruptor-3.3.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ecj-4.4.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/fastutil-6.5.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/findbugs-annotations-1.3.9-1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/groovy-all-2.4.11.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/guava-14.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/guice-assistedinject-3.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-client.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-common.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-hadoop2-compat.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-hadoop-compat.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-http.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-mapreduce.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-metrics-api.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-metrics.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-procedure.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-protocol.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-replication.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-server.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-shaded-miscellaneous.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-shaded-netty.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-shaded-protobuf.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hbase-zookeeper.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/HikariCP-2.6.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-accumulo-handler-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-accumulo-handler.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-ant-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-ant.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-beeline-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-beeline.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-classification-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-classification.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-cli-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-cli.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-common-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-common.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-exec-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-exec.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-hbase-handler-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-hbase-handler.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-hplsql-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-hplsql.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-kryo-registrator-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-kryo-registrator.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-client-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-client.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-common-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-common.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-ext-client-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-ext-client.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-server-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-server.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-tez-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-llap-tez.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-metastore-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-metastore.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-orc-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-orc.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-serde-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-serde.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-service.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-rpc-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-rpc.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-0.23-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-0.23.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-scheduler-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-shims-scheduler.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-storage-api-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-storage-api.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-testutils-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hive-testutils.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hk2-api-2.5.0-b32.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hk2-locator-2.5.0-b32.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/hk2-utils-2.5.0-b32.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/htrace-core.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/httpcore-4.4.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ivy-2.4.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-annotations-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-core-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-databind-2.9.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-jaxrs-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-mapper-asl-1.9.13-cloudera.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jackson-xc-1.9.13.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jamon-runtime-2.3.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/janino-2.7.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javassist-3.20.0-GA.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.annotation-api-1.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.el-3.0.1-b10.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.inject-2.5.0-b32.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.jdo-3.2.0-m3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.servlet.jsp-2.3.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.servlet.jsp-api-2.3.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javax.ws.rs-api-2.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/javolution-5.5.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jcodings-1.0.18.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jcommander-1.48.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jdo-api-3.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-client-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-common-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-container-servlet-core-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-guava-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-media-jaxb-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jersey-server-2.25.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-annotations-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-client-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-http-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-io-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-jaas-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-jndi-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-plus-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-rewrite-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-runner-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-schemas-3.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-security-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-server-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-servlet-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-util-6.1.26.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-webapp-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jetty-xml-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jline-2.12.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/joda-time-2.9.9.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/joni-2.1.11.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jpam-1.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/json-20090211.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jsp-api-2.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/jta-1.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/junit-4.11.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/libfb303-0.9.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/libthrift-0.9.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/log4j-1.2-api-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/log4j-api-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/log4j-core-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/log4j-slf4j-impl-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/log4j-web-2.8.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/logredactor-2.0.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/metrics-core-3.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/metrics-json-3.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/metrics-jvm-3.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/opencsv-2.3.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/org.abego.treelayout.core-1.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/osgi-resource-locator-1.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/paranamer-2.8.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/re2j-1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/servlet-api-2.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/slider-core-0.90.2-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/snappy-0.2.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/snappy-java-1.1.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/ST4-4.0.4.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/stax-api-1.0.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/super-csv-2.2.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/taglibs-standard-impl-1.2.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/taglibs-standard-spec-1.2.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/tempus-fugit-1.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/tephra-api-0.6.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/tephra-core-0.6.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/tephra-hbase-compat-1.0-0.6.0.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/transaction-api-1.1.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-api-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-common-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-core-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-discovery-api-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-discovery-core-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/twill-zookeeper-0.6.0-incubating.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/validation-api-1.1.0.Final.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/velocity-1.5.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/websocket-api-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/websocket-client-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/websocket-common-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/websocket-server-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/websocket-servlet-9.3.20.v20170531.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/xz-1.6.jar:/opt/cloudera/parcels/CDH/lib/hive/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/lib/hive-hcatalog/libexec/../share/hcatalog/hive-hcatalog-core-2.1.1-cdh6.1.0.jar:/opt/cloudera/parcels/CDH/lib/hive/conf:/etc/hbase/conf:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/sqoop-1.4.7-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/sqoop.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/sqoop-test-1.4.7-cdh6.1.0.jar:/opt/cloudera/parcels/CDH-6.1.0-1.cdh6.1.0.p0.770702/bin/../lib/sqoop/sqoop-test.jar
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-1127.8.2.el7.x86_64
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:user.name=primo
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/primo
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Client environment:user.dir=/tmp/dolphinscheduler/exec/process/6/5/42/110
20/05/26 09:02:31 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=ai.test.host01:2181 sessionTimeout=1200000 watcher=org.apache.curator.ConnectionState@1eab0700
20/05/26 09:02:31 INFO zookeeper.ClientCnxn: Opening socket connection to server ai.test.host01/192.168.0.99:2181. Will not attempt to authenticate using SASL (unknown error)
20/05/26 09:02:31 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.0.99:37426, server: ai.test.host01/192.168.0.99:2181
20/05/26 09:02:31 INFO zookeeper.ClientCnxn: Session establishment complete on server ai.test.host01/192.168.0.99:2181, sessionid = 0x1724af80ae607b9, negotiated timeout = 40000
20/05/26 09:02:31 INFO state.ConnectionStateManager: State change: CONNECTED
20/05/26 09:02:31 INFO ql.Driver: Executing command(queryId=primo_20200526090229_13d0564e-3d27-4c47-88f6-d85724f61062): CREATE TABLE IF NOT EXISTS `dc_ods`.`tdc_ods_crm_mem_card_rchg_pay_detail_d` ( `src_cd` BIGINT, `src_sys_so_cd` STRING, `ro_cd` INT, `vip_cd` INT, `str_cd` INT, `str_nm` STRING, `rchg_amt` DOUBLE, `pay_amt` DOUBLE, `dnt_amt` DOUBLE, `b4_rchg_amt` DOUBLE, `typ` TINYINT, `chg_stat` INT, `chg_pay_typ` INT, `chg_pay_cd` STRING, `chg_typ` TINYINT, `rchg_typ` TINYINT, `lock_stat` TINYINT, `create_time` STRING, `etl_time` STRING) COMMENT 'Imported by sqoop on 2020/05/26 09:02:28' PARTITIONED BY (statis_date STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE
20/05/26 09:02:31 INFO ql.Driver: Completed executing command(queryId=primo_20200526090229_13d0564e-3d27-4c47-88f6-d85724f61062); Time taken: 0.005 seconds
OK
20/05/26 09:02:31 INFO ql.Driver: OK
Time taken: 2.18 seconds
20/05/26 09:02:31 INFO CliDriver: Time taken: 2.18 seconds
20/05/26 09:02:31 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:31 INFO session.SessionState: Resetting thread name to main
20/05/26 09:02:31 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:31 INFO session.SessionState: Updating thread name to 835b05f3-6342-492e-ab55-ada8ba574257 main
20/05/26 09:02:31 INFO ql.Driver: Compiling command(queryId=primo_20200526090231_06adceaa-ef47-4234-8a81-77b6a84afe77):
LOAD DATA INPATH 'hdfs://ai.test.host01:8020/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d_bak/statis_date=20200525' OVERWRITE INTO TABLE `dc_ods`.`tdc_ods_crm_mem_card_rchg_pay_detail_d` PARTITION (statis_date='20200525')
20/05/26 09:02:31 INFO sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=835b05f3-6342-492e-ab55-ada8ba574257, clientType=HIVECLI]
20/05/26 09:02:31 INFO hive.metastore: Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
20/05/26 09:02:31 INFO hive.metastore: Closed a connection to metastore, current connections: 0
20/05/26 09:02:31 INFO hive.metastore: Trying to connect to metastore with URI thrift://ai.test.host01:9083
20/05/26 09:02:31 INFO hive.metastore: Opened a connection to metastore, current connections: 1
20/05/26 09:02:31 INFO hive.metastore: Connected to metastore.
20/05/26 09:02:31 WARN metastore.RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting to reconnect.
org.apache.thrift.transport.TTransportException: Cannot write to null outputStream
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:142)
at org.apache.thrift.protocol.TBinaryProtocol.writeI32(TBinaryProtocol.java:178)
at org.apache.thrift.protocol.TBinaryProtocol.writeMessageBegin(TBinaryProtocol.java:106)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:70)
at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_get_partition_with_auth(ThriftHiveMetastore.java:2217)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_partition_with_auth(ThriftHiveMetastore.java:2205)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getPartitionWithAuthInfo(HiveMetaStoreClient.java:1513)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:154)
at com.sun.proxy.$Proxy40.getPartitionWithAuthInfo(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[INFO] 2020-05-26 09:02:32.968 - [taskAppId=TASK-5-42-110]:[106] - -> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2477)
at com.sun.proxy.$Proxy40.getPartitionWithAuthInfo(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:2158)
at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:2099)
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer$TableSpec.<init>(BaseSemanticAnalyzer.java:1094)
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer$TableSpec.<init>(BaseSemanticAnalyzer.java:976)
at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:210)
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:600)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1414)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1543)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1332)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1321)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:187)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:409)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:342)
at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:489)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:505)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:808)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:774)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:701)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.sqoop.hive.HiveImport.executeScript(HiveImport.java:280)
at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:216)
at org.apache.sqoop.hive.HiveImport.importTable(HiveImport.java:374)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:549)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:633)
at org.apache.sqoop.Sqoop.run(Sqoop.java:146)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:182)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:233)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:242)
at org.apache.sqoop.Sqoop.main(Sqoop.java:251)
20/05/26 09:02:32 INFO hive.metastore: Trying to connect to metastore with URI thrift://ai.test.host01:9083
[INFO] 2020-05-26 09:02:34.030 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:32 INFO hive.metastore: Opened a connection to metastore, current connections: 2
20/05/26 09:02:32 INFO hive.metastore: Connected to metastore.
20/05/26 09:02:33 INFO ql.Driver: Semantic Analysis Completed
20/05/26 09:02:33 INFO ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
20/05/26 09:02:33 INFO ql.Driver: Completed compiling command(queryId=primo_20200526090231_06adceaa-ef47-4234-8a81-77b6a84afe77); Time taken: 1.514 seconds
20/05/26 09:02:33 INFO ql.Driver: Executing command(queryId=primo_20200526090231_06adceaa-ef47-4234-8a81-77b6a84afe77):
LOAD DATA INPATH 'hdfs://ai.test.host01:8020/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d_bak/statis_date=20200525' OVERWRITE INTO TABLE `dc_ods`.`tdc_ods_crm_mem_card_rchg_pay_detail_d` PARTITION (statis_date='20200525')
20/05/26 09:02:33 INFO ql.Driver: Starting task [Stage-0:MOVE] in serial mode
20/05/26 09:02:33 INFO hive.metastore: Closed a connection to metastore, current connections: 1
Loading data to table dc_ods.tdc_ods_crm_mem_card_rchg_pay_detail_d partition (statis_date=20200525)
20/05/26 09:02:33 INFO exec.Task: Loading data to table dc_ods.tdc_ods_crm_mem_card_rchg_pay_detail_d partition (statis_date=20200525) from hdfs://ai.test.host01:8020/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d_bak/statis_date=20200525
20/05/26 09:02:33 INFO hive.metastore: Trying to connect to metastore with URI thrift://ai.test.host01:9083
20/05/26 09:02:33 INFO hive.metastore: Opened a connection to metastore, current connections: 2
20/05/26 09:02:33 INFO hive.metastore: Connected to metastore.
20/05/26 09:02:33 INFO exec.MoveTask: Partition is: {statis_date=20200525}
20/05/26 09:02:33 INFO fs.TrashPolicyDefault: Moved: 'hdfs://ai.test.host01:8020/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d/statis_date=20200525/part-m-00000.snappy' to trash at: hdfs://ai.test.host01:8020/user/hdfs/.Trash/Current/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d/statis_date=20200525/part-m-00000.snappy1590454953593
20/05/26 09:02:33 INFO common.FileUtils: Creating directory if it doesn't exist: hdfs://ai.test.host01:8020/user/hive/warehouse/dc_ods.db/tdc_ods_crm_mem_card_rchg_pay_detail_d/statis_date=20200525
20/05/26 09:02:34 INFO ql.Driver: Starting task [Stage-1:STATS] in serial mode
[INFO] 2020-05-26 09:02:34.608 - [taskAppId=TASK-5-42-110]:[106] - -> 20/05/26 09:02:34 INFO exec.StatsTask: Executing stats task
20/05/26 09:02:34 INFO hive.metastore: Closed a connection to metastore, current connections: 1
20/05/26 09:02:34 INFO hive.metastore: Trying to connect to metastore with URI thrift://ai.test.host01:9083
20/05/26 09:02:34 INFO hive.metastore: Opened a connection to metastore, current connections: 2
20/05/26 09:02:34 INFO hive.metastore: Connected to metastore.
20/05/26 09:02:34 INFO exec.StatsTask: Partition dc_ods.tdc_ods_crm_mem_card_rchg_pay_detail_d{statis_date=20200525} stats: [numFiles=1, numRows=0, totalSize=326957, rawDataSize=0, numFilesErasureCoded=0]
20/05/26 09:02:34 INFO ql.Driver: Completed executing command(queryId=primo_20200526090231_06adceaa-ef47-4234-8a81-77b6a84afe77); Time taken: 0.779 seconds
OK
20/05/26 09:02:34 INFO ql.Driver: OK
Time taken: 2.322 seconds
20/05/26 09:02:34 INFO CliDriver: Time taken: 2.322 seconds
20/05/26 09:02:34 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:34 INFO session.SessionState: Resetting thread name to main
20/05/26 09:02:34 INFO conf.HiveConf: Using the default value passed in for log id: 835b05f3-6342-492e-ab55-ada8ba574257
20/05/26 09:02:34 INFO session.SessionState: Deleted directory: /tmp/hive/hdfs/835b05f3-6342-492e-ab55-ada8ba574257 on fs with scheme hdfs
20/05/26 09:02:34 INFO session.SessionState: Deleted directory: /tmp/primo/835b05f3-6342-492e-ab55-ada8ba574257 on fs with scheme file
20/05/26 09:02:34 INFO hive.metastore: Closed a connection to metastore, current connections: 1
20/05/26 09:02:34 INFO hive.HiveImport: Hive import complete.
20/05/26 09:02:34 INFO imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting
20/05/26 09:02:34 INFO zookeeper.ZooKeeper: Session: 0x1724af80ae607b9 closed
20/05/26 09:02:34 INFO zookeeper.ClientCnxn: EventThread shut down
20/05/26 09:02:34 INFO CuratorFrameworkSingleton: Closing ZooKeeper client.
**Which version of DolphinScheduler:**
-[1.2.0]
**Additional context**
Add any other context about the problem here.
**Requirement or improvement
- Please describe about your requirements or improvement suggestions.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Eights-Li commented on issue #2817: [QUESTION] The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
Posted by GitBox <gi...@apache.org>.
Eights-Li commented on issue #2817:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2817#issuecomment-640016283
yes, worker log can find the reason.
you should check the yarn config, if yarn not ha, set you yarn ip in yarnips(for ha) and yarn ip(for standalone)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Eights-Li closed issue #2817: [QUESTION] The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
Posted by GitBox <gi...@apache.org>.
Eights-Li closed issue #2817:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2817
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] primoshen commented on issue #2817: [QUESTION] The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
Posted by GitBox <gi...@apache.org>.
primoshen commented on issue #2817:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2817#issuecomment-646506455
> yes, worker log can find the reason.
> you should check the yarn config, if yarn not ha, set you yarn ip in yarnips(for ha) and yarn ip(for standalone)
I con't find any error from yarn application.
In my cluster only one machine, so not ha, when Setting up the environment, i have set singleYarnIp ip. in my system, dolphinscheduler only shell failure!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] itbasketplayer commented on issue #2817: [QUESTION] The shell task executes the spoop script, and the data is written to hive, but the status of the task is failure!
Posted by GitBox <gi...@apache.org>.
itbasketplayer commented on issue #2817:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2817#issuecomment-636614675
you should check the worker's ERROR logs, maybe the field app_link of table t_ds_task_instance is too short. and may be the yarn application status is FAILURE
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org