You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by gi...@apache.org on 2022/10/22 16:26:44 UTC
[arrow-ballista] branch dependabot/cargo/master/arrow-25.0.0 updated (ecb725f5 -> 50d205d2)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/master/arrow-25.0.0
in repository https://gitbox.apache.org/repos/asf/arrow-ballista.git
discard ecb725f5 Update arrow requirement from 24.0.0 to 25.0.0
add 8d83fa24 Unified the log level configuration behavior (#386)
add 610db7a5 Add DistinctCount support (#384)
add 231d1e3c Update flatbuffers requirement from 2.1.2 to 22.9.29 (#390)
add 51210532 Remove active execution graph when the related job is successful or failed (#392)
add f8885061 Cache encoded stage plan (#393)
add 8c49b929 Remove duplicate remove_active_execution_graph when merge PR 393
add de5f9ef8 Fix q20 sql typo in benchmarks (#409)
add dea62491 Switch to mimalloc and enable by default in executor (#370)
add f58d7191 Pull-based execution loop improvements (#380)
add 3b51de51 Add notes on Apache Reporter (#401)
add 7a3d6de1 delete unmaintained arm docker build (#413)
add 794dd95e Use local shuffle reader in containerized environments and some improvements. (#399)
add 93df7446 Improve launch task efficiency by calling LaunchMultiTask (#394)
add 0050ecef Add round robin executor slots reservation policy for the scheduler to evenly assign tasks to executors (#395)
add a1473d0c Add RoundRobinLocal slots policy for caching executor data to avoid seld persistency (#396)
add 5c2420c9 Make the scheduler event loop buffer size configurable (#398)
add f899f101 MINOR: Fix yarn warnings (#415)
add 8e0e3495 Update etcd-client requirement from 0.9 to 0.10 (#111)
add 0e2542fe Fix #127 Automatic version updates for github actions with dependabot (#128)
add 486764ff Bump actions/setup-node from 2 to 3 (#424)
add 2c9b8a36 Bump actions/setup-python from 2 to 4 (#423)
add baea0b39 Bump actions/download-artifact from 2 to 3 (#421)
add 33be45db Bump actions/upload-artifact from 2 to 3 (#420)
add b4e2d818 Bump actions/checkout from 2 to 3 (#422)
add 988d3235 Return multiple tasks in poll_work based on free slots (#429)
add 5593c3bd Run integration tests as part of release verification (#426)
add 5d4bc84a Move scheduler UI files into scheduler module (#431)
add 6e281c4b 0.9.0 Release (#432)
add bdb35434 User Guide updates (#430)
add 50d205d2 Update arrow requirement from 24.0.0 to 25.0.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ecb725f5)
\
N -- N -- N refs/heads/dependabot/cargo/master/arrow-25.0.0 (50d205d2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/dependabot.yml | 22 +-
.github/workflows/comment_bot.yml | 6 +-
.github/workflows/dev.yml | 12 +-
.github/workflows/dev_pr.yml | 2 +-
.github/workflows/python_build.yml | 20 +-
.github/workflows/python_test.yaml | 4 +-
.github/workflows/rust.yml | 18 +-
.github/workflows/typescript.yml | 6 +-
ballista-cli/Cargo.toml | 4 +-
ballista/CHANGELOG.md | 167 +++++++++++
ballista/client/Cargo.toml | 8 +-
ballista/core/Cargo.toml | 2 +-
ballista/core/proto/ballista.proto | 5 +-
.../core/src/execution_plans/shuffle_reader.rs | 111 ++++---
ballista/core/src/serde/physical_plan/mod.rs | 29 +-
ballista/core/src/serde/physical_plan/to_proto.rs | 8 +-
ballista/executor/Cargo.toml | 9 +-
ballista/executor/src/execution_loop.rs | 63 ++--
ballista/executor/src/main.rs | 15 +-
ballista/scheduler/Cargo.toml | 10 +-
ballista/scheduler/scheduler_config_spec.toml | 12 +
.../scheduler/src/config.rs | 39 ++-
ballista/scheduler/src/lib.rs | 1 +
ballista/scheduler/src/main.rs | 38 ++-
ballista/scheduler/src/scheduler_server/grpc.rs | 57 ++--
ballista/scheduler/src/scheduler_server/mod.rs | 40 ++-
.../src/scheduler_server/query_stage_scheduler.rs | 6 +-
ballista/scheduler/src/standalone.rs | 1 +
ballista/scheduler/src/state/executor_manager.rs | 333 +++++++++++++++++++--
ballista/scheduler/src/state/mod.rs | 62 +++-
ballista/scheduler/src/state/task_manager.rs | 240 ++++++++++++---
.../{ui/scheduler => scheduler/ui}/.dockerignore | 0
ballista/{ui/scheduler => scheduler/ui}/.gitignore | 0
ballista/{ui/scheduler => scheduler/ui}/README.md | 2 +-
ballista/{ui/scheduler => scheduler/ui}/index.d.ts | 0
.../{ui/scheduler => scheduler/ui}/package.json | 0
.../scheduler => scheduler/ui}/public/favicon.ico | Bin
.../scheduler => scheduler/ui}/public/index.html | 0
.../scheduler => scheduler/ui}/public/logo192.png | Bin
.../scheduler => scheduler/ui}/public/logo512.png | Bin
.../ui}/public/manifest.json | 0
.../scheduler => scheduler/ui}/public/robots.txt | 0
.../ui}/react-table-config.d.ts | 0
.../{ui/scheduler => scheduler/ui}/src/App.css | 0
.../scheduler => scheduler/ui}/src/App.test.tsx | 0
.../{ui/scheduler => scheduler/ui}/src/App.tsx | 0
.../ui}/src/components/DataTable.tsx | 0
.../ui}/src/components/Empty.tsx | 0
.../ui}/src/components/ExecutorsList.tsx | 0
.../ui}/src/components/Footer.tsx | 0
.../ui}/src/components/Header.tsx | 2 +-
.../ui}/src/components/JobStagesMetrics.tsx | 0
.../ui}/src/components/QueriesList.tsx | 4 +-
.../ui}/src/components/Summary.tsx | 0
.../ui}/src/components/logo.svg | 0
.../{ui/scheduler => scheduler/ui}/src/index.css | 0
.../{ui/scheduler => scheduler/ui}/src/index.tsx | 0
.../ui}/src/react-app-env.d.ts | 0
.../ui}/src/reportWebVitals.ts | 0
.../scheduler => scheduler/ui}/src/setupTests.ts | 0
.../{ui/scheduler => scheduler/ui}/tsconfig.json | 0
ballista/{ui/scheduler => scheduler/ui}/yarn.lock | 0
benchmarks/Cargo.toml | 7 +-
benchmarks/queries/q20.sql | 4 +-
dev/build-ballista-docker-arm64.sh | 34 ---
dev/build-ui.sh | 2 +-
dev/docker/ballista-scheduler.Dockerfile | 2 +-
dev/docker/builder-entrypoint.sh | 2 +-
dev/release/README.md | 32 +-
dev/release/verify-release-candidate.sh | 2 +
dev/update_ballista_versions.py | 3 +-
docs/source/user-guide/cli.md | 18 +-
docs/source/user-guide/deployment/cargo-install.md | 7 +-
.../source/user-guide/deployment/docker-compose.md | 60 +---
docs/source/user-guide/deployment/docker.md | 32 +-
docs/source/user-guide/deployment/index.rst | 2 +-
docs/source/user-guide/deployment/kubernetes.md | 43 ++-
docs/source/user-guide/images/ballista-web-ui.png | Bin 234939 -> 142890 bytes
docs/source/user-guide/python.md | 5 +
examples/Cargo.toml | 4 +-
python/Cargo.toml | 4 +-
81 files changed, 1188 insertions(+), 433 deletions(-)
copy dev/release/crate-deps.dot => ballista/scheduler/src/config.rs (50%)
rename ballista/{ui/scheduler => scheduler/ui}/.dockerignore (100%)
rename ballista/{ui/scheduler => scheduler/ui}/.gitignore (100%)
rename ballista/{ui/scheduler => scheduler/ui}/README.md (98%)
rename ballista/{ui/scheduler => scheduler/ui}/index.d.ts (100%)
rename ballista/{ui/scheduler => scheduler/ui}/package.json (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/favicon.ico (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/index.html (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/logo192.png (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/logo512.png (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/manifest.json (100%)
rename ballista/{ui/scheduler => scheduler/ui}/public/robots.txt (100%)
rename ballista/{ui/scheduler => scheduler/ui}/react-table-config.d.ts (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/App.css (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/App.test.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/App.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/DataTable.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/Empty.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/ExecutorsList.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/Footer.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/Header.tsx (97%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/JobStagesMetrics.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/QueriesList.tsx (98%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/Summary.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/components/logo.svg (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/index.css (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/index.tsx (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/react-app-env.d.ts (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/reportWebVitals.ts (100%)
rename ballista/{ui/scheduler => scheduler/ui}/src/setupTests.ts (100%)
rename ballista/{ui/scheduler => scheduler/ui}/tsconfig.json (100%)
rename ballista/{ui/scheduler => scheduler/ui}/yarn.lock (100%)
delete mode 100755 dev/build-ballista-docker-arm64.sh