You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "mayki (Jira)" <ji...@apache.org> on 2023/11/08 11:51:00 UTC

[jira] [Commented] (NIFI-11439) Add Storage API URL to GCS Processors

    [ https://issues.apache.org/jira/browse/NIFI-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784000#comment-17784000 ] 

mayki commented on NIFI-11439:
------------------------------

Hello,

For the parameter Storage-api-url, it seems neither 
"https://{*}storage{*}-xxx.p.googleapis.com/{*}storage{*}/v1/"  nor "https://{*}storage{*}-xxx.p.googleapis.com" working.
{code:java}
PutGCSObject[id=aea7e07c-018b-1000-ffff] Failure completing upload flowfile=test/minh.txt bucket=xxx key=test/minh.txt reason=404 Not Found
POST https://storage-xxx.p.googleapis.com/upload/storage/v1/storage/v1/b/xxx/o?name=test/minh.txt&uploadType=resumable
Not Found: com.google.cloud.storage.StorageException: 404 Not Found

PutGCSObject[id=aea7e07c-018b-1000-ffff] Failure completing upload flowfile=test/minh.txt bucket=xxx key=test/minh.txt reason=www.googleapis.com: com.google.cloud.storage.StorageException: www.googleapis.com
- Caused by: java.net.UnknownHostException: www.googleapis.com {code}
Need we add something more in the processor ?

Thanks

> Add Storage API URL to GCS Processors
> -------------------------------------
>
>                 Key: NIFI-11439
>                 URL: https://issues.apache.org/jira/browse/NIFI-11439
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Paul Grey
>            Assignee: Paul Grey
>            Priority: Minor
>             Fix For: 2.0.0, 1.22.0
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> AWS processors allow the override of the base endpoint for API calls to AWS services [1].  GCS libraries provide analogous capabilities, as documented here [2].  Expose a GCS processor property to enable GCS endpoint override behavior.
> [1] https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-aws-bundle/nifi-aws-abstract-processors/src/main/java/org/apache/nifi/processors/aws/AbstractAWSProcessor.java#L146-L154
> [2] https://cloud.google.com/storage/docs/request-endpoints#storage-set-client-endpoint-java



--
This message was sent by Atlassian Jira
(v8.20.10#820010)