You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "TechnophobicLampshade (via GitHub)" <gi...@apache.org> on 2024/02/27 13:05:35 UTC
[I] Avoid double initialisation / double finalize of Aws SDK [arrow]
TechnophobicLampshade opened a new issue, #40262:
URL: https://github.com/apache/arrow/issues/40262
### Describe the usage question you have. Please include as many useful details as possible.
I have pre-existing code that uses the C++ AWS SDK and calls `Aws::InitAPI` and `Aws::ShutdownAPI`. Now I am using arrow with s3, and it seems to need me to call _arrow_'s `arrow::fs::InitializeS3()` before it will allow me to use the `S3FileSystem`. I would prefer to handle SDK initialisation myself, but I don't see a way to tell arrow that "I've already initialised the SDK, don't do it yourself". I would prefer not to add Arrow awareness to all of my existing code.
Is there a known workaround for this please?
### Component(s)
C++
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-1966592235
> Is there a known workaround for this please?
Currently, no, but that's a reasonable feature request. Perhaps by adding APIs such as:
```c++
void MarkS3Initialized();
void MarkS3Finalized();
```
What do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-1967185783
> Perhaps this avoids the need for this altogether.
Can you take a look and see whether it's good enough for you?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "johnkerl (via GitHub)" <gi...@apache.org>.
johnkerl commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-2229060140
We have tested wheels with the referenced AWS SDK patch, in 16.0 and 17.0-rc wheels (see #42154), and we believe this issue still exists.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-3547496002
This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this usage question has evolved into a feature request or docs update, please remove the 'Type: usage' label and add the 'Type: enhancement' label instead.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "TechnophobicLampshade (via GitHub)" <gi...@apache.org>.
TechnophobicLampshade commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-1966982642
It seems that in more recent versions of the aws sdk than I was using, there is code that ignores duplicate Init/Shutdown calls:
https://github.com/aws/aws-sdk-cpp/blob/5929e202e9b1cd84d6234aa01b64f56fd2208350/src/aws-cpp-sdk-core/source/Aws.cpp#L188
Perhaps this avoids the need for this altogether.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] Avoid double initialisation / double finalize of Aws SDK [arrow]
Posted by "TechnophobicLampshade (via GitHub)" <gi...@apache.org>.
TechnophobicLampshade commented on issue #40262:
URL: https://github.com/apache/arrow/issues/40262#issuecomment-1966769995
Thanks @pitrou. That API makes sense to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org