You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@libcloud.apache.org by to...@apache.org on 2022/01/28 22:00:17 UTC
[libcloud] branch trunk updated (d918c5a -> a385009)
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git.
from d918c5a Add test which verifies the code doesn't throw if creationDate attribute is not present.
add 6ae0ec8 Add ScalewayStorageDriver, ScalewayConnectionAWS4 and correspoding regions
add ef7206c Add missing types
add 00c45c6 Add simple test for scalewa storage driver
add a961757 Add documentation and example based on the Minio docs
add 84af616 Add corrections. Use region concept from S3 driver.
add 380de27 SCW storage driver: Update tests to be more S3 compliant
add 11277c7 Fix typo
add 7899015 Use NotImplementedError instead
add a158138 Improve test case
add 85fcc84 Fix SignedHeaders
add 9756deb Merge pull request #1 from murlock/scw_object_storage_driver
add 03bec65 In order to download (private) objects we need to be able to generate a valid CDN URL, hence shamefully just use the working code from the S3StorageDriver. Also update tests.
new 74eacc9 Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
new 5e774d5 Add corrections
new f80f94b Linting and black
new adf8a13 Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
new e292395 Add changelog entry.
new 843713d Re-generate supported providers tables.
new a385009 Merge branch 'reixd-scw_object_storage_driver' into trunk
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.rst | 4 +
docs/_static/images/provider_logos/scaleway.svg | 21 +++++
.../upload_example.py} | 12 ++-
docs/storage/_supported_methods_cdn.rst | 2 +
docs/storage/_supported_methods_main.rst | 2 +
docs/storage/_supported_providers.rst | 2 +
docs/storage/drivers/scaleway.rst | 27 +++++++
libcloud/common/aws.py | 4 +-
libcloud/storage/drivers/scaleway.py | 91 ++++++++++++++++++++++
libcloud/storage/providers.py | 1 +
libcloud/storage/types.py | 1 +
.../storage/{test_minio.py => test_scaleway.py} | 46 ++++-------
12 files changed, 177 insertions(+), 36 deletions(-)
create mode 100644 docs/_static/images/provider_logos/scaleway.svg
copy docs/examples/storage/{upload_with_metadata.py => scaleway/upload_example.py} (54%)
create mode 100644 docs/storage/drivers/scaleway.rst
create mode 100644 libcloud/storage/drivers/scaleway.py
copy libcloud/test/storage/{test_minio.py => test_scaleway.py} (52%)
[libcloud] 02/07: Add corrections
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit 5e774d5143d2f9b82b9cd1bd9f88184b1fd15712
Author: Rainer 'rei' Schuth <re...@reixd.net>
AuthorDate: Thu Dec 16 12:45:22 2021 +0100
Add corrections
---
libcloud/storage/drivers/scaleway.py | 2 +-
libcloud/storage/types.py | 3 ---
2 files changed, 1 insertion(+), 4 deletions(-)
diff --git a/libcloud/storage/drivers/scaleway.py b/libcloud/storage/drivers/scaleway.py
index 7d153a3..8a5798c 100644
--- a/libcloud/storage/drivers/scaleway.py
+++ b/libcloud/storage/drivers/scaleway.py
@@ -45,7 +45,7 @@ class ScalewayStorageDriver(BaseS3StorageDriver):
secure=True,
host=None,
port=None,
- region=None,
+ region="fr-par",
url=None,
**kwargs,
):
diff --git a/libcloud/storage/types.py b/libcloud/storage/types.py
index bce8ffa..5d10d27 100644
--- a/libcloud/storage/types.py
+++ b/libcloud/storage/types.py
@@ -107,9 +107,6 @@ class Provider(object):
S3_RGW_OUTSCALE = "s3_rgw_outscale"
MINIO = "minio"
SCALEWAY = "scaleway"
- SCALEWAY_FR_PAR = "scaleway_fr_par"
- SCALEWAY_NL_AMS = "scaleway_nl_ams"
- SCALEWAY_PL_WAW = "scaleway_pl_waw"
# Deperecated
CLOUDFILES_US = "cloudfiles_us"
[libcloud] 03/07: Linting and black
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit f80f94b6e4ff789ab8f90891ede2eef6cc462018
Author: Rainer 'rei' Schuth <re...@reixd.net>
AuthorDate: Thu Dec 16 15:00:02 2021 +0100
Linting and black
---
docs/examples/storage/scaleway/upload_example.py | 2 +-
libcloud/common/aws.py | 3 +--
libcloud/storage/drivers/scaleway.py | 6 +++++-
3 files changed, 7 insertions(+), 4 deletions(-)
diff --git a/docs/examples/storage/scaleway/upload_example.py b/docs/examples/storage/scaleway/upload_example.py
index 6374a37..41b4a91 100644
--- a/docs/examples/storage/scaleway/upload_example.py
+++ b/docs/examples/storage/scaleway/upload_example.py
@@ -11,7 +11,7 @@ container = driver.get_container(container_name="<your-bucket-name>")
extra = {
"meta_data": {"owner": "myuser", "created": "2001-05-25"},
- "acl": "public-read"
+ "acl": "public-read",
}
with open(FILE_PATH, "rb") as iterator:
diff --git a/libcloud/common/aws.py b/libcloud/common/aws.py
index 515e994..f6498f8 100644
--- a/libcloud/common/aws.py
+++ b/libcloud/common/aws.py
@@ -347,8 +347,7 @@ class AWSRequestSignerAlgorithmV4(AWSRequestSigner):
)
def _get_signed_headers(self, headers):
- return ";".join([k.lower()
- for k in sorted(headers.keys(), key=str.lower)])
+ return ";".join([k.lower() for k in sorted(headers.keys(), key=str.lower)])
def _get_canonical_headers(self, headers):
return (
diff --git a/libcloud/storage/drivers/scaleway.py b/libcloud/storage/drivers/scaleway.py
index 8a5798c..7edfb03 100644
--- a/libcloud/storage/drivers/scaleway.py
+++ b/libcloud/storage/drivers/scaleway.py
@@ -13,7 +13,11 @@
# See the License for the specific language governing permissions and
# limitations under the License.
-from libcloud.storage.drivers.s3 import S3SignatureV4Connection, S3StorageDriver, S3_CDN_URL_EXPIRY_HOURS
+from libcloud.storage.drivers.s3 import (
+ S3SignatureV4Connection,
+ S3StorageDriver,
+ S3_CDN_URL_EXPIRY_HOURS,
+)
from libcloud.storage.drivers.s3 import BaseS3StorageDriver
__all__ = ["ScalewayStorageDriver"]
[libcloud] 07/07: Merge branch 'reixd-scw_object_storage_driver' into trunk
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit a38500988b67c43a4bf1b05a46c1f19f5b0e9ed9
Merge: d918c5a 843713d
Author: Tomaz Muraus <to...@tomaz.me>
AuthorDate: Fri Jan 28 23:00:10 2022 +0100
Merge branch 'reixd-scw_object_storage_driver' into trunk
CHANGES.rst | 4 ++
docs/_static/images/provider_logos/scaleway.svg | 21 ++++++
docs/examples/storage/scaleway/upload_example.py | 20 ++++++
docs/storage/_supported_methods_cdn.rst | 2 +
docs/storage/_supported_methods_main.rst | 2 +
docs/storage/_supported_providers.rst | 2 +
docs/storage/drivers/scaleway.rst | 27 +++++++
libcloud/common/aws.py | 4 +-
libcloud/storage/drivers/scaleway.py | 91 ++++++++++++++++++++++++
libcloud/storage/providers.py | 1 +
libcloud/storage/types.py | 1 +
libcloud/test/storage/test_scaleway.py | 57 +++++++++++++++
12 files changed, 230 insertions(+), 2 deletions(-)
[libcloud] 05/07: Add changelog entry.
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit e2923959d7ae2a6fed6bc051e83a31adcd6cbf52
Author: Tomaz Muraus <to...@tomaz.me>
AuthorDate: Fri Jan 28 22:57:54 2022 +0100
Add changelog entry.
---
CHANGES.rst | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/CHANGES.rst b/CHANGES.rst
index 02e85db..179e7bc 100644
--- a/CHANGES.rst
+++ b/CHANGES.rst
@@ -52,6 +52,10 @@ Storage
(GITHUB-1631)
[Tomaz Muraus - @Kami]
+- [Scaleway] Add new driver for the Scaleway Object Storage.
+ (GITHUB-1633)
+ [@reixd]
+
Common
~~~~~~
[libcloud] 06/07: Re-generate supported providers tables.
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit 843713dc9c554a031c6768063422ad96dfd52bce
Author: Tomaz Muraus <to...@tomaz.me>
AuthorDate: Fri Jan 28 22:59:00 2022 +0100
Re-generate supported providers tables.
---
docs/storage/_supported_methods_cdn.rst | 2 ++
docs/storage/_supported_methods_main.rst | 2 ++
docs/storage/_supported_providers.rst | 2 ++
3 files changed, 6 insertions(+)
diff --git a/docs/storage/_supported_methods_cdn.rst b/docs/storage/_supported_methods_cdn.rst
index c449836..5e500b6 100644
--- a/docs/storage/_supported_methods_cdn.rst
+++ b/docs/storage/_supported_methods_cdn.rst
@@ -37,6 +37,7 @@ Provider enable container cdn enable object cdn get contain
`Amazon S3 (us-gov-west-1)`_ no no no yes
`Amazon S3 (us-west-1)`_ no no no yes
`Amazon S3 (us-west-2)`_ no no no yes
+`Scaleway Storage Driver`_ no no no yes
============================= ==================== ================= ===================== ==================
.. _`Aliyun OSS`: http://www.aliyun.com/product/oss
@@ -73,3 +74,4 @@ Provider enable container cdn enable object cdn get contain
.. _`Amazon S3 (us-gov-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-2)`: http://aws.amazon.com/s3/
+.. _`Scaleway Storage Driver`: https://www.scaleway.com/en/object-storage/
diff --git a/docs/storage/_supported_methods_main.rst b/docs/storage/_supported_methods_main.rst
index aa91878..8f24dfa 100644
--- a/docs/storage/_supported_methods_main.rst
+++ b/docs/storage/_supported_methods_main.rst
@@ -37,6 +37,7 @@ Provider list containers list objects create container dele
`Amazon S3 (us-gov-west-1)`_ yes yes yes yes yes yes yes yes yes yes yes
`Amazon S3 (us-west-1)`_ yes yes yes yes yes yes yes yes yes yes yes
`Amazon S3 (us-west-2)`_ yes yes yes yes yes yes yes yes yes yes yes
+`Scaleway Storage Driver`_ yes yes yes yes yes yes yes yes yes yes yes
============================= =============== ============ ================ ================ ============= ======================= =============== ========================== ========================= ================================= =============
.. _`Aliyun OSS`: http://www.aliyun.com/product/oss
@@ -73,3 +74,4 @@ Provider list containers list objects create container dele
.. _`Amazon S3 (us-gov-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-2)`: http://aws.amazon.com/s3/
+.. _`Scaleway Storage Driver`: https://www.scaleway.com/en/object-storage/
diff --git a/docs/storage/_supported_providers.rst b/docs/storage/_supported_providers.rst
index 36bf608..f75ee4f 100644
--- a/docs/storage/_supported_providers.rst
+++ b/docs/storage/_supported_providers.rst
@@ -19,6 +19,7 @@ Provider Documentation P
`Amazon S3`_ :doc:`Click </storage/drivers/s3>` S3 ap-northeast-1, ap-northeast-2, ap-northeast-3, ap-south-1, ap-southeast-1, ap-southeast-2, ca-central-1, cn-north-1, cn-northwest-1, eu-central-1, eu-north-1, eu-west-1, eu-west-2, eu-west-3, me-south-1, sa-east-1, sa-east-2, us-east-1, us-east-2, us-gov-east-1, us-gov-west-1, us-west-1, us-west-2 :mod:`libcloud.storage.drivers.s3` :class:`S3StorageDriver`
`Ceph RGW`_ S3_RGW single region driver :mod:`libcloud.storage.drivers.rgw` :class:`S3RGWStorageDriver`
`RGW Outscale`_ S3_RGW_OUTSCALE single region driver :mod:`libcloud.storage.drivers.rgw` :class:`S3RGWOutscaleStorageDriver`
+`Scaleway Storage Driver`_ :doc:`Click </storage/drivers/scaleway>` SCALEWAY fr-par, nl-ams, pl-waw :mod:`libcloud.storage.drivers.scaleway` :class:`ScalewayStorageDriver`
========================== =================================================== =================== =========================================================================================================================================================================================================================================================================================================== =================================================== ========================================
.. _`Aliyun OSS`: http://www.aliyun.com/product/oss
@@ -55,3 +56,4 @@ Provider Documentation P
.. _`Amazon S3 (us-gov-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-1)`: http://aws.amazon.com/s3/
.. _`Amazon S3 (us-west-2)`: http://aws.amazon.com/s3/
+.. _`Scaleway Storage Driver`: https://www.scaleway.com/en/object-storage/
[libcloud] 01/07: Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit 74eacc9a3ee334a619fcfbca7cbffdf48eda6455
Merge: 90971e1 03bec65
Author: Tomaz Muraus <to...@tomaz.me>
AuthorDate: Thu Dec 16 00:27:34 2021 +0100
Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
docs/_static/images/provider_logos/scaleway.svg | 21 ++++++
docs/examples/storage/scaleway/upload_example.py | 20 ++++++
docs/storage/drivers/scaleway.rst | 27 ++++++++
libcloud/common/aws.py | 5 +-
libcloud/storage/drivers/scaleway.py | 87 ++++++++++++++++++++++++
libcloud/storage/providers.py | 1 +
libcloud/storage/types.py | 4 ++
libcloud/test/storage/test_scaleway.py | 57 ++++++++++++++++
8 files changed, 220 insertions(+), 2 deletions(-)
[libcloud] 04/07: Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
Posted by to...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
tomaz pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/libcloud.git
commit adf8a13e312283b9cf7e659ae2ab867520db5179
Merge: 74eacc9 f80f94b
Author: Tomaz Muraus <to...@tomaz.me>
AuthorDate: Fri Jan 28 22:56:46 2022 +0100
Merge branch 'scw_object_storage_driver' of https://github.com/reixd/libcloud into reixd-scw_object_storage_driver
docs/examples/storage/scaleway/upload_example.py | 2 +-
libcloud/common/aws.py | 3 +--
libcloud/storage/drivers/scaleway.py | 8 ++++++--
libcloud/storage/types.py | 3 ---
4 files changed, 8 insertions(+), 8 deletions(-)