[jira] [Resolved] (NIFI-4071) ConvertJSONToSQL does not support Hive

["Matt Burgess (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Burgess resolved NIFI-4071.
--------------------------------
    Resolution: Implemented

> ConvertJSONToSQL does not support Hive
> --------------------------------------
>
>                 Key: NIFI-4071
>                 URL: https://issues.apache.org/jira/browse/NIFI-4071
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Matt Burgess
>            Priority: Minor
>
> Currently, the ConvertJSONToSQL processor does not support Hive as the target database, either using a HiveConnectionPool or a DBCPConnectionPool configured with a Hive driver. At the very least:
> 1) A SQLException occurs when determining the auto-increment value. This is due to a Hive bug (HIVE-13528 [https://issues.apache.org/jira/browse/HIVE-13528]) where the column is not named according to the spec ([http://docs.oracle.com/javase/8/docs/api/java/sql/DatabaseMetaData.html#getColumns-java.lang.String-java.lang.String-java.lang.String-java.lang.String-]).
> 2) Column names are returned with the table name prepended (using a dot separator)
> 3) There may be other JDBC API calls that are not supported by the Hive JDBC driver.
> #1 could be solved by checking for "IS_AUTOINCREMENT" then failing over to "IS_AUTO_INCREMENT".  #2 could be solved with a lastIndexOf("."), as is done in _org.apache.nifi.util.hive.HiveJdbcCommon#createSchema(java.sql.ResultSet, java.lang.String)_. #3 would take some investigation into the other JDBC API calls being made.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)