Hive imports

["Clum, Joshua [USA]" <Cl...@bah.com>]

Hi,

I'm trying to run a hive import from sqoop using:
http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html

It seems to run and complete the job but I get some weird messages and no tables show up in hive. Any ideas?

I'm using this query:

sqoop-create-hive-table  --connect jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066 --username user -P --verbose --hive-overwrite --hive-table hello --table BIODATA.CMPD_PHASE_VIEW

and here is the output I get:

13/08/01 17:38:53 DEBUG tool.BaseSqoopTool: Enabled debug logging.
13/08/01 17:38:53 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/08/01 17:38:53 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
13/08/01 17:38:53 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
13/08/01 17:38:53 WARN tool.BaseSqoopTool: It seems that you've specified at least one of following:
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-home
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-overwrite
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --create-hive-table
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-table
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-partition-key
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-partition-value
13/08/01 17:38:53 WARN tool.BaseSqoopTool: --map-column-hive
13/08/01 17:38:53 WARN tool.BaseSqoopTool: Without specifying parameter --hive-import. Please note that
13/08/01 17:38:53 WARN tool.BaseSqoopTool: those arguments will not be used in this session. Either
13/08/01 17:38:53 WARN tool.BaseSqoopTool: specify --hive-import to apply them correctly or remove them
13/08/01 17:38:53 WARN tool.BaseSqoopTool: from command line to remove this warning.
13/08/01 17:38:53 INFO tool.BaseSqoopTool: Please note that --hive-home, --hive-partition-key,
13/08/01 17:38:53 INFO tool.BaseSqoopTool: hive-partition-value and --map-column-hive options are
13/08/01 17:38:53 INFO tool.BaseSqoopTool: are also valid for HCatalog imports and exports
13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.cloudera.sqoop.manager.DefaultManagerFactory
13/08/01 17:38:53 DEBUG manager.DefaultManagerFactory: Trying with scheme: jdbc:oracle:thin:@brsusdv.merck.com:25553
13/08/01 17:38:53 DEBUG manager.OracleManager$ConnCache: Instantiated new connection cache.
13/08/01 17:38:53 INFO manager.SqlManager: Using default fetchSize of 1000
13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.OracleManager@35285701
13/08/01 17:38:53 DEBUG hive.HiveImport: Hive.inputTable: BIODATA.CMPD_PHASE_VIEW
13/08/01 17:38:53 DEBUG hive.HiveImport: Hive.outputTable: hello
13/08/01 17:38:53 DEBUG manager.OracleManager: Using column names query: SELECT t.* FROM BIODATA.CMPD_PHASE_VIEW t WHERE 1=0
13/08/01 17:38:53 DEBUG manager.OracleManager: Creating a new connection for jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066, using username: huron
13/08/01 17:38:53 DEBUG manager.OracleManager: No connection paramenters specified. Using regular API for making connection.
13/08/01 17:38:54 INFO manager.OracleManager: Time zone has been set to GMT
13/08/01 17:38:54 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
13/08/01 17:38:54 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM BIODATA.CMPD_PHASE_VIEW t WHERE 1=0
13/08/01 17:38:54 DEBUG manager.OracleManager$ConnCache: Caching released connection for jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066/huron
13/08/01 17:38:54 WARN hive.TableDefWriter: Column PROTOCOL_VERSION had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column NOTEBOOK_NUMBER had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column EVENT_DATE had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column QA_REFERENCE_GROUP had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column RESULT_ID had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column GROUP_ID had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column TESTED_CONCENTRATION had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column MODIFIED_DATE had to be cast to a less precise type in Hive
13/08/01 17:38:54 WARN hive.TableDefWriter: Column CMPD_PHASE had to be cast to a less precise type in Hive
13/08/01 17:38:54 DEBUG hive.TableDefWriter: Create statement: CREATE TABLE IF NOT EXISTS `hello` ( `SAMPLE_ID` STRING, `COMPOUND_ID` STRING, `PARENT_ID` STRING, `LOAD_JOB_NUMBER` STRING, `PROTOCOL_VERSION` DOUBLE, `NOTEBOOK_NUMBER` DOUBLE, `NOTEBOOK_PAGE_REFERENCE` STRING, `EVENT_DATE` STRING, `QA_REFERENCE_RESULT` STRING, `QA_REFERENCE_GROUP` DOUBLE, `EXPERIMENT_DESCRIPTION` STRING, `RESULT_ID` DOUBLE, `GROUP_ID` DOUBLE, `MASKED_RESULT` STRING, `TESTED_CONCENTRATION` DOUBLE, `TESTED_CONCENTRATION_UNITS` STRING, `INVESTIGATOR` STRING, `PRODUCED_BY` STRING, `MODIFIED_DATE` STRING, `ANNOTATION` STRING, `COMPOUND_STATE` STRING, `CMPD_PHASE_QUAL` STRING, `CMPD_PHASE` DOUBLE, `VALUE_UNIT` STRING) COMMENT 'Imported by sqoop on 2013/08/01 17:38:54' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
13/08/01 17:38:55 DEBUG hive.TableDefWriter: Load statement: LOAD DATA INPATH 'hdfs://ip-54-40-237-75:17020/user/mapred/BIODATA.CMPD_PHASE_VIEW' OVERWRITE INTO TABLE `hello`
13/08/01 17:38:55 INFO hive.HiveImport: Loading uploaded data into Hive
13/08/01 17:38:55 DEBUG hive.HiveImport: Using in-process Hive instance.
13/08/01 17:38:55 DEBUG util.SubprocessSecurityManager: Installing subprocess security manager
13/08/01 17:38:56 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
13/08/01 17:38:56 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
13/08/01 17:38:56 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: yarn.nodemanager.local-dirs;  Ignoring.
13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.

Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.4.0-38.jar!/hive-log4j.properties