getColumns Syntax with double quotes wont work for me

[Tony Pearson <to...@unlv.edu>]

I have tried both the PutDatabaseRecord and ConvertJsonToSQL
components. I am converting my flow file to Avro in both cases.and gets me
further than using Avro by itself

When the components fetch column names to validate against the schema of
the flowfile it produces the following quert:

show /* JDBC:DatabaseMetaData.getColumns() */ columns in table
"ADVENTUREWORKS"."STAGING"."Store"

So having the double quotes on the DBName and SchemaName are not an issue
for me, but the double quotes on the table name is not working for me.

I could customize the component, but if there is a workaround I would
appreciate it.

Also I would like to investigate becoming a contributor. I have worked with
Talend for over 10 years, but NiFi has me converted

tony pearson

Re: getColumns Syntax with double quotes wont work for me

[Matt Burgess <ma...@apache.org>]

Tony,

I think you're running into NIFI-7313 [1] when you put the
fully-qualified table name into the Table Name property of
PutDatabaseRecord. As a workaround you could add the database name and
possibly the catalog/schema name to the JDBC URL you are connecting
to. If you can't add the catalog/schema name to the JDBC URL there are
properties on PutDatabaseRecord for them. However I don't know if they
get quoted if Quote Table Identifiers is set, if not we should write
up an improvement/bug for that.

NIFI-7313 will be available in the upcoming 1.12.0 release of NiFi.

Regards,
Matt

[1] https://issues.apache.org/jira/browse/NIFI-7313


On Mon, Aug 10, 2020 at 9:30 AM Bryan Bende <bb...@gmail.com> wrote:
>
> Hi Tony,
>
> I'm not that familiar with these processors, but PutDatabaseRecord has a
> property for "Quote Table Identifiers" which may control that, although it
> defaults to false so it seems like it shouldn't be quoting it by default.
>
> Have you tried changing that property at all?
>
> As far as contributing, it should be fairly easy to get involved. You can
> create a jira for something you'd like to contribute [1] (or find an
> existing one), and the submit a pull request for that jira [2]. The
> contributor guide should have a lot more details [3].
>
> Thanks,
>
> Bryan
>
> [1] https://issues.apache.org/jira/browse/NIFI
> [2] https://github.com/apache/nifi/pulls
> [3] https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide
>
>
> On Thu, Aug 6, 2020 at 7:16 PM Tony Pearson <to...@unlv.edu> wrote:
>
> > I have tried both the PutDatabaseRecord and ConvertJsonToSQL
> > components. I am converting my flow file to Avro in both cases.and gets me
> > further than using Avro by itself
> >
> > When the components fetch column names to validate against the schema of
> > the flowfile it produces the following quert:
> >
> > show /* JDBC:DatabaseMetaData.getColumns() */ columns in table
> > "ADVENTUREWORKS"."STAGING"."Store"
> >
> > So having the double quotes on the DBName and SchemaName are not an issue
> > for me, but the double quotes on the table name is not working for me.
> >
> > I could customize the component, but if there is a workaround I would
> > appreciate it.
> >
> > Also I would like to investigate becoming a contributor. I have worked with
> > Talend for over 10 years, but NiFi has me converted
> >
> > tony pearson
> >

Re: getColumns Syntax with double quotes wont work for me

[Bryan Bende <bb...@gmail.com>]

Hi Tony,

I'm not that familiar with these processors, but PutDatabaseRecord has a
property for "Quote Table Identifiers" which may control that, although it
defaults to false so it seems like it shouldn't be quoting it by default.

Have you tried changing that property at all?

As far as contributing, it should be fairly easy to get involved. You can
create a jira for something you'd like to contribute [1] (or find an
existing one), and the submit a pull request for that jira [2]. The
contributor guide should have a lot more details [3].

Thanks,

Bryan

[1] https://issues.apache.org/jira/browse/NIFI
[2] https://github.com/apache/nifi/pulls
[3] https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide


On Thu, Aug 6, 2020 at 7:16 PM Tony Pearson <to...@unlv.edu> wrote:

> I have tried both the PutDatabaseRecord and ConvertJsonToSQL
> components. I am converting my flow file to Avro in both cases.and gets me
> further than using Avro by itself
>
> When the components fetch column names to validate against the schema of
> the flowfile it produces the following quert:
>
> show /* JDBC:DatabaseMetaData.getColumns() */ columns in table
> "ADVENTUREWORKS"."STAGING"."Store"
>
> So having the double quotes on the DBName and SchemaName are not an issue
> for me, but the double quotes on the table name is not working for me.
>
> I could customize the component, but if there is a workaround I would
> appreciate it.
>
> Also I would like to investigate becoming a contributor. I have worked with
> Talend for over 10 years, but NiFi has me converted
>
> tony pearson
>