You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by hpd84_0321 <hp...@163.com> on 2015/01/08 10:07:17 UTC
Re: [jira] [Commented] (SQOOP-1393) Import data from database to Hive as Parquet files
hello,i have found this problem too .
sqoop import --direct --connect jdbc:oracle:thin:@172.16.19.62:1521:orcl --username kdh --password kdh#123 --target-dir /usr/hive/warehouse/pm_mft_parquet --table PM_MFT --num-mappers 1 --hive-import --hive-table pm_mft_parquet --create-hive-table --as-parquetfile
============================================================
From: Richard (JIRA)
Date: 2014-09-14 11:19
To: dev
Subject: [jira] [Commented] (SQOOP-1393) Import data from database to Hive as Parquet files
[ https://issues.apache.org/jira/browse/SQOOP-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133063#comment-14133063 ]
Richard commented on SQOOP-1393:
--------------------------------
{code}
14/09/12 21:24:46 WARN spi.Registration: Not loading URI patterns in org.kitesdk.data.hcatalog.impl.Loader
14/09/12 21:24:46 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI: hive?dataset=null
org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI: hive?dataset=null
{code}
This error probably because hive/hcat is not installed or HIVE_HOME/HCAT_HOME is not set. Sqoop will use HIVE_HOME/HCAT_HOME to find hive libs, which are needed in hive import as Parquet file.
> Import data from database to Hive as Parquet files
> --------------------------------------------------
>
> Key: SQOOP-1393
> URL: https://issues.apache.org/jira/browse/SQOOP-1393
> Project: Sqoop
> Issue Type: Sub-task
> Components: tools
> Reporter: Qian Xu
> Assignee: Richard
> Fix For: 1.4.6
>
> Attachments: patch.diff, patch_v2.diff, patch_v3.diff
>
>
> Import data to Hive as Parquet file can be separated into two steps:
> 1. Import an individual table from an RDBMS to HDFS as a set of Parquet files.
> 2. Import the data into Hive by generating and executing a CREATE TABLE statement to define the data's layout in Hive with Parquet format table
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)