You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by gx...@apache.org on 2023/11/07 14:31:03 UTC
(incubator-opendal) branch persy_test_planner updated (ca6d88436 -> 964253e1c)
This is an automated email from the ASF dual-hosted git repository.
gxd pushed a change to branch persy_test_planner
in repository https://gitbox.apache.org/repos/asf/incubator-opendal.git
omit ca6d88436 refactor(services/persy): update persy datafile path
omit 5513654cf refactor(services/persy): migrate tot test planner
add 303f6e5b3 refactor(services/libsql): Migrate libsql task to new behavior test planner (#3363)
add 26539633e fix(services/s3): Accept List responses without ETag (#3478)
add fd6cb675a feat(bindings/python)!: Implement File and AsyncFile to replace Reader (#3474)
add d27dc3e67 fix(bindings/python): fix type annotations and improve docs (#3483)
add d1304255b docs(readme): Fix capitalization about the ABFS service in README.md (#3485)
add 2ef54656e feat(services): Implement ConfigDeserializer and add S3Config as example (#3490)
add 6909f3a3d feat(core): add OpenStack Swift e2e test (#3493)
add 1ac054d0b feat(doc): add OpenStack Swift document for the website (#3494)
add bdd4228d3 refactor(service/postgresql): Add PostgresqlConfig to implement ConfigDeserializer (#3495)
add 199a0a53a feat(services): add SqliteConfig (#3497)
add 42a0e994d feat(bindings/C): implement capability (#3479)
add 87a7ac153 refactor(binding/python): Add multiple custom exception for each of error code in Rust Core (#3492)
add 3e2114dcb refactor(service/libsql): Add LibsqlConfig to implement ConfigDeserializer (#3501)
add c96a170f1 feat: add mongodb gridfs service support (#3491)
add c8d382339 refactor(service/mysql): Add MysqlConfig to implement ConfigDeserializer (#3499)
add 91661d4aa feat(services): add RedisConfig (#3498)
add abca9b8fd ci: Use cargo test instead of carge nextest (#3505)
add 7c29c3b34 chore(services/libsql): Fix typos in backend (#3506)
add 58f120248 chore: Bump to v0.42.0 to start release process (#3509)
add b92fea802 chore(service/vercel_artifacts): add doc in backend (#3508)
new ebb6f3039 refactor(services/persy): migrate tot test planner
new 964253e1c refactor(services/persy): update persy datafile path
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ca6d88436)
\
N -- N -- N refs/heads/persy_test_planner (964253e1c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.env.example | 11 +
.github/actions/behavior_test_core/action.yaml | 2 +-
.github/scripts/behavior_test/plan.py | 1 -
.github/services/libsql/libsql-auth/action.yml | 57 ++++
.github/services/libsql/libsql/action.yml | 55 +++
.../swift}/action.yml | 35 +-
.github/workflows/behavior_test_core.yml | 1 -
.github/workflows/ci.yml | 1 +
.github/workflows/service_test_libsql.yml | 132 -------
CHANGELOG.md | 169 +++++++++
Cargo.lock | 24 +-
Cargo.toml | 4 +-
README.md | 2 +-
bindings/c/Makefile | 4 +-
bindings/c/include/opendal.h | 257 +++++++++++++-
bindings/c/src/lib.rs | 2 +
bindings/c/src/metadata.rs | 2 +-
bindings/c/src/operator_info.rs | 279 +++++++++++++++
bindings/c/tests/opinfo.cpp | 111 ++++++
bindings/cpp/CMakeLists.txt | 2 +-
bindings/haskell/opendal.cabal | 2 +-
bindings/java/Cargo.toml | 5 +
bindings/java/pom.xml | 2 +-
bindings/nodejs/Cargo.toml | 4 +
bindings/nodejs/npm/darwin-arm64/package.json | 2 +-
bindings/nodejs/npm/darwin-x64/package.json | 2 +-
bindings/nodejs/npm/linux-x64-gnu/package.json | 2 +-
bindings/nodejs/npm/win32-x64-msvc/package.json | 2 +-
bindings/nodejs/package.json | 2 +-
bindings/python/Cargo.toml | 4 +
bindings/python/python/opendal/__init__.pyi | 38 ++-
bindings/python/python/opendal/exceptions.pyi | 86 +++++
bindings/python/python/opendal/layers.pyi | 15 +-
bindings/python/src/capability.rs | 60 ++++
bindings/python/src/errors.rs | 61 ++++
bindings/python/src/{reader.rs => file.rs} | 291 ++++++++++------
bindings/python/src/lib.rs | 32 +-
bindings/python/src/operator.rs | 77 +++--
bindings/python/src/utils.rs | 51 ++-
bindings/python/tests/test_async_copy.py | 10 +-
bindings/python/tests/test_async_delete.py | 6 +-
bindings/python/tests/test_async_rename.py | 18 +-
bindings/python/tests/test_capability.py | 2 +-
.../tests/test_exceptions.py} | 14 +-
bindings/python/tests/test_read.py | 53 ++-
bindings/python/tests/test_sync_copy.py | 10 +-
bindings/python/tests/test_sync_delete.py | 4 +-
bindings/python/tests/test_sync_rename.py | 18 +-
bindings/python/tests/test_write.py | 5 +-
bindings/python/upgrade.md | 39 ++-
core/Cargo.toml | 1 +
core/src/docs/upgrade.md | 2 +-
core/src/raw/serde_util.rs | 379 +++++++++++++++++++++
core/src/services/{mongodb => gridfs}/backend.rs | 196 ++++++-----
core/src/services/{mongodb => gridfs}/docs.md | 17 +-
core/src/services/{memory => gridfs}/mod.rs | 2 +-
core/src/services/libsql/backend.rs | 73 ++--
core/src/services/libsql/mod.rs | 1 +
core/src/services/mod.rs | 21 +-
core/src/services/mysql/backend.rs | 72 ++--
core/src/services/mysql/mod.rs | 1 +
core/src/services/postgresql/backend.rs | 85 +++--
core/src/services/postgresql/mod.rs | 1 +
core/src/services/redis/backend.rs | 100 +++---
core/src/services/redis/mod.rs | 1 +
core/src/services/s3/backend.rs | 335 +++++++++++-------
core/src/services/s3/mod.rs | 1 +
core/src/services/s3/pager.rs | 25 +-
core/src/services/sqlite/backend.rs | 96 ++++--
core/src/services/sqlite/mod.rs | 1 +
core/src/services/swift/backend.rs | 1 -
core/src/services/vercel_artifacts/backend.rs | 1 +
core/src/types/operator/builder.rs | 2 +
core/src/types/scheme.rs | 4 +
.../docker-compose-swift.yml} | 13 +-
website/community/committers/release.md | 4 +-
website/docs/services/gridfs.mdx | 68 ++++
website/docs/services/swift.mdx | 70 ++++
78 files changed, 2825 insertions(+), 816 deletions(-)
create mode 100644 .github/services/libsql/libsql-auth/action.yml
create mode 100644 .github/services/libsql/libsql/action.yml
copy .github/services/{s3/minio_s3_with_anonymous => swift/swift}/action.yml (53%)
delete mode 100644 .github/workflows/service_test_libsql.yml
create mode 100644 bindings/c/src/operator_info.rs
create mode 100644 bindings/c/tests/opinfo.cpp
create mode 100644 bindings/python/python/opendal/exceptions.pyi
create mode 100644 bindings/python/src/errors.rs
rename bindings/python/src/{reader.rs => file.rs} (50%)
copy bindings/{php/.cargo/config.toml => python/tests/test_exceptions.py} (77%)
copy core/src/services/{mongodb => gridfs}/backend.rs (55%)
copy core/src/services/{mongodb => gridfs}/docs.md (59%)
copy core/src/services/{memory => gridfs}/mod.rs (95%)
copy fixtures/{http/docker-compose-nginx.yml => swift/docker-compose-swift.yml} (77%)
create mode 100644 website/docs/services/gridfs.mdx
create mode 100644 website/docs/services/swift.mdx
(incubator-opendal) 01/02: refactor(services/persy): migrate tot test planner
Posted by gx...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
gxd pushed a commit to branch persy_test_planner
in repository https://gitbox.apache.org/repos/asf/incubator-opendal.git
commit ebb6f303989a2b14152d83232ea5951b1b8f51fb
Author: G-XD <GX...@gmail.com>
AuthorDate: Fri Nov 3 21:21:21 2023 +0800
refactor(services/persy): migrate tot test planner
---
.github/services/persy/persy/action.yml | 33 +++++++++++++++++++
.github/workflows/service_test_persy.yml | 56 --------------------------------
2 files changed, 33 insertions(+), 56 deletions(-)
diff --git a/.github/services/persy/persy/action.yml b/.github/services/persy/persy/action.yml
new file mode 100644
index 000000000..10cc8e291
--- /dev/null
+++ b/.github/services/persy/persy/action.yml
@@ -0,0 +1,33 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+name: persy
+description: 'Behavior test for Persy'
+
+runs:
+ using: "composite"
+ steps:
+ - name: Setup
+ shell: bash
+ run: |
+ cat << EOF >> $GITHUB_ENV
+ RUST_BACKTRACE=full
+ RUST_LOG=debug
+ OPENDAL_PERSY_DATAFILE=${{ runner.temp }}/test.persy
+ OPENDAL_PERSY_SEGMENT=data
+ OPENDAL_PERSY_INDEX=index
+ EOF
diff --git a/.github/workflows/service_test_persy.yml b/.github/workflows/service_test_persy.yml
deleted file mode 100644
index 36b5e0ccf..000000000
--- a/.github/workflows/service_test_persy.yml
+++ /dev/null
@@ -1,56 +0,0 @@
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements. See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership. The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License. You may obtain a copy of the License at
-#
-# http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing,
-# software distributed under the License is distributed on an
-# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-# KIND, either express or implied. See the License for the
-# specific language governing permissions and limitations
-# under the License.
-
-name: Service Test Persy
-
-on:
- push:
- branches:
- - main
- pull_request:
- branches:
- - main
- paths:
- - "core/src/**"
- - "core/tests/**"
- - "!core/src/docs/**"
- - "!core/src/services/**"
- - "core/src/services/persy/**"
- - ".github/workflows/service_test_persy.yml"
-
-concurrency:
- group: ${{ github.workflow }}-${{ github.ref }}-${{ github.event_name }}
- cancel-in-progress: true
-
-jobs:
- persy:
- runs-on: ubuntu-latest
- steps:
- - uses: actions/checkout@v4
- - name: Setup Rust toolchain
- uses: ./.github/actions/setup
- - name: Test persy
- shell: bash
- working-directory: core
- run: cargo test behavior --features tests,services-persy
- env:
- RUST_BACKTRACE: full
- RUST_LOG: debug
- OPENDAL_TEST: persy
- OPENDAL_PERSY_DATAFILE: ./test.persy
- OPENDAL_PERSY_SEGMENT: data
- OPENDAL_PERSY_INDEX: index
(incubator-opendal) 02/02: refactor(services/persy): update persy datafile path
Posted by gx...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
gxd pushed a commit to branch persy_test_planner
in repository https://gitbox.apache.org/repos/asf/incubator-opendal.git
commit 964253e1c0a24d642849dd38a90668c1203ab964
Author: G-XD <GX...@gmail.com>
AuthorDate: Mon Nov 6 23:21:51 2023 +0800
refactor(services/persy): update persy datafile path
---
.github/services/persy/persy/action.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/services/persy/persy/action.yml b/.github/services/persy/persy/action.yml
index 10cc8e291..c28a5db90 100644
--- a/.github/services/persy/persy/action.yml
+++ b/.github/services/persy/persy/action.yml
@@ -27,7 +27,7 @@ runs:
cat << EOF >> $GITHUB_ENV
RUST_BACKTRACE=full
RUST_LOG=debug
- OPENDAL_PERSY_DATAFILE=${{ runner.temp }}/test.persy
+ OPENDAL_PERSY_DATAFILE=./test.persy
OPENDAL_PERSY_SEGMENT=data
OPENDAL_PERSY_INDEX=index
EOF