You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Ram (Jira)" <ji...@apache.org> on 2020/08/28 13:56:00 UTC
[jira] [Commented] (SQOOP-3313) Remove Kite dependency
[ https://issues.apache.org/jira/browse/SQOOP-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186553#comment-17186553 ]
Ram commented on SQOOP-3313:
----------------------------
[~dvoros] [~vasas]
We are using *sqoop 1.4.7* to upload parquet data that is stored in HDFS - *Plain parquet files and NOT a Hive table*
**We're still facing the same issue -
{code:java}
20/08/28 13:37:02 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetIOException: Cannot access descriptor location: hdfs:///<location>/part-00000-f9f92493-36a1-4714-bcc6-291c118cf599-c000/snappy/parquet/.metadata
org.kitesdk.data.DatasetIOException: Cannot access descriptor location: hdfs:///<location>/part-00000-f9f92493-36a1-4714-bcc6-291c118cf599-c000/snappy/parquet/.metadata{code}
The command we're running -
{code:java}
/sqoop-1.4.7.bin__hadoop-2.6.0/bin/sqoop export --connect jdbc:postgresql://<postgres_db_details> --username <username> --password <password> --table <table_name> --export-dir hdfs:///<location>/part-00000-f9f92493-36a1-4714-bcc6-291c118cf599-c000.parquet
{code}
Postgres JAR - postgresql-42.2.11.jar
Please do suggest a solution ASAP.
> Remove Kite dependency
> ----------------------
>
> Key: SQOOP-3313
> URL: https://issues.apache.org/jira/browse/SQOOP-3313
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Daniel Voros
> Assignee: Daniel Voros
> Priority: Major
> Fix For: 3.0.0
>
>
> Having Kite as a dependency makes it hard to release a version of Sqoop compatible with Hadoop 3.
> For details see discussion on dev list in [this thread|http://example.com] and also SQOOP-3305.
> Let's use this ticket to gather features that need to be changed/reimplemented.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)