You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2023/06/11 05:08:15 UTC
[GitHub] [iceberg] dependabot[bot] opened a new pull request, #7814: Build: Bump ray from 2.4.0 to 2.5.0 in /python
dependabot[bot] opened a new pull request, #7814:
URL: https://github.com/apache/iceberg/pull/7814
Bumps [ray](https://github.com/ray-project/ray) from 2.4.0 to 2.5.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/ray-project/ray/releases">ray's releases</a>.</em></p>
<blockquote>
<h2>Ray-2.5.0</h2>
<p>The Ray 2.5 release features focus on a number of enhancements and improvements across the Ray ecosystem, including:</p>
<ul>
<li>Training LLMs with Ray Train: New support for checkpointing distributed models, and Pytorch Lightning FSDP to enable training large models on Ray Train’s LightningTrainer</li>
<li>LLM applications with Ray Serve & Core: New support for streaming responses and model multiplexing</li>
<li>Improvements to Ray Data: In 2.5, <a href="https://docs.ray.io/en/master/data/faq.html#migrating-to-strict-mode">strict mode </a>is enabled by default. This means that schemas are required for all Datasets, and standalone Python objects are no longer supported. Also, the default batch format is fixed to NumPy, giving better performance for <a href="https://docs.ray.io/en/master/data/batch_inference.html">batch inference</a>.</li>
<li>RLlib enhancements: New support for multi-gpu training, along with <a href="https://github.com/ray-project/rllib-contrib">ray-project/rllib-contrib</a> to contain the community contributed algorithms</li>
<li>Core enhancements: Enable new feature of lightweight resource broadcasting to improve reliability and scalability. Add many enhancements for Core reliability, logging, scheduler, and worker process.</li>
</ul>
<h1>Ray Libraries</h1>
<h2>Ray AIR</h2>
<p>đź’«Enhancements:</p>
<ul>
<li>Experiment restore stress tests (<a href="https://redirect.github.com/ray-project/ray/issues/33706">#33706</a>)</li>
<li>Context-aware output engine
<ul>
<li>Add parameter columns to status table (<a href="https://redirect.github.com/ray-project/ray/issues/35388">#35388</a>)</li>
<li>Context-aware output engine: Add docs, experimental feature docs, prepare default on (<a href="https://redirect.github.com/ray-project/ray/issues/35129">#35129</a>)</li>
<li>Fix trial status at end (more info + cut off) (<a href="https://redirect.github.com/ray-project/ray/issues/35128">#35128</a>)</li>
<li>Improve leaked mentions of Tune concepts (<a href="https://redirect.github.com/ray-project/ray/issues/35003">#35003</a>)</li>
<li>Improve passed time display (<a href="https://redirect.github.com/ray-project/ray/issues/34951">#34951</a>)</li>
<li>Use flat metrics in results report, use Trainable._progress_metrics (<a href="https://redirect.github.com/ray-project/ray/issues/35035">#35035</a>)</li>
<li>Print experiment information at experiment start (<a href="https://redirect.github.com/ray-project/ray/issues/34952">#34952</a>)</li>
<li>Print single trial config + results as table (<a href="https://redirect.github.com/ray-project/ray/issues/34788">#34788</a>)</li>
<li>Print out worker ip for distributed train workers. (<a href="https://redirect.github.com/ray-project/ray/issues/33807">#33807</a>)</li>
<li>Minor fix to print configuration on start. (<a href="https://redirect.github.com/ray-project/ray/issues/34575">#34575</a>)</li>
<li>Check <code>air_verbosity</code> against None. (<a href="https://redirect.github.com/ray-project/ray/issues/33871">#33871</a>)</li>
<li>Better wording for empty config. (<a href="https://redirect.github.com/ray-project/ray/issues/33811">#33811</a>)</li>
</ul>
</li>
<li>Flatten config and metrics before passing to mlflow (<a href="https://redirect.github.com/ray-project/ray/issues/35074">#35074</a>)</li>
<li>Remote_storage: Prefer fsspec filesystems over native pyarrow (<a href="https://redirect.github.com/ray-project/ray/issues/34663">#34663</a>)</li>
<li>Use filesystem wrapper to exclude files from upload (<a href="https://redirect.github.com/ray-project/ray/issues/34102">#34102</a>)</li>
<li>GCE test variants for air_benchmark and air_examples (<a href="https://redirect.github.com/ray-project/ray/issues/34466">#34466</a>)</li>
<li>New storage path configuration
<ul>
<li>Add <code>RunConfig.storage_path</code> to replace <code>SyncConfig.upload_dir</code> and <code>RunConfig.local_dir</code>. (<a href="https://redirect.github.com/ray-project/ray/issues/33463">#33463</a>)</li>
<li>Use Ray storage URI as default storage path, if configured [no_early_kickoff] (<a href="https://redirect.github.com/ray-project/ray/issues/34470">#34470</a>)</li>
<li>Move to new storage_path API in tests and examples (<a href="https://redirect.github.com/ray-project/ray/issues/34263">#34263</a>)</li>
</ul>
</li>
</ul>
<p>🔨 Fixes:</p>
<ul>
<li>Store unflattened metrics in _TrackedCheckpoint (<a href="https://redirect.github.com/ray-project/ray/issues/35658">#35658</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/35706">#35706</a>)</li>
<li>Fix <code>test_tune_torch_get_device_gpu</code> race condition (<a href="https://redirect.github.com/ray-project/ray/issues/35004">#35004</a>)</li>
<li>Deflake test_e2e_train_flow.py (<a href="https://redirect.github.com/ray-project/ray/issues/34308">#34308</a>)</li>
<li>Pin deepspeed version for now to unblock ci. (<a href="https://redirect.github.com/ray-project/ray/issues/34406">#34406</a>)</li>
<li>Fix AIR benchmark configuration link failure. (<a href="https://redirect.github.com/ray-project/ray/issues/34597">#34597</a>)</li>
<li>Fix unused config building function in lightning MNIST example.</li>
</ul>
<p>đź“–Documentation:</p>
<ul>
<li>Change doc occurrences of ray.data.Dataset to ray.data.Datastream (<a href="https://redirect.github.com/ray-project/ray/issues/34520">#34520</a>)</li>
<li>DreamBooth example: Fix code for batch size > 1 (<a href="https://redirect.github.com/ray-project/ray/issues/34398">#34398</a>)</li>
<li>Synced tabs in AIR getting started (<a href="https://redirect.github.com/ray-project/ray/issues/35170">#35170</a>)</li>
<li>New Ray AIR link for try it out (<a href="https://redirect.github.com/ray-project/ray/issues/34924">#34924</a>)</li>
<li>Correctly Render the Enumerate Numbers in <code>convert_torch_code_to_ray_air</code> (<a href="https://redirect.github.com/ray-project/ray/issues/35224">#35224</a>)</li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/ray-project/ray/commit/586c376e0769082cb5cfa1333e8264a5fa6b73ec"><code>586c376</code></a> [RLlib][Docs] Fix failing catalog docs include (<a href="https://redirect.github.com/ray-project/ray/issues/36083">#36083</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36103">#36103</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/9a9d853e74a38f85df7c5af463614cdfa15a41aa"><code>9a9d853</code></a> Remove rc0 from version numbers (<a href="https://redirect.github.com/ray-project/ray/issues/36096">#36096</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/657e2f4bc2dd79bb7cd6c72b79f673d663baf415"><code>657e2f4</code></a> [Serve] Improve the replica recover scenario (<a href="https://redirect.github.com/ray-project/ray/issues/35946">#35946</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36086">#36086</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/df3ef84366f22fd32619074022484b1e69f1dd53"><code>df3ef84</code></a> [docs] Fixing inconsistent height of cards on landing page (<a href="https://redirect.github.com/ray-project/ray/issues/35995">#35995</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36031">#36031</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/9e28c2f586187c449aa4c68b42f6ae564a3863df"><code>9e28c2f</code></a> [doc][core][dashboard][state] Promote state api and dashboard usage in core u...</li>
<li><a href="https://github.com/ray-project/ray/commit/8793d80b36c7013f7a806c70e6825121a12423b7"><code>8793d80</code></a> [Serve][Doc] Multiplexing doc (<a href="https://redirect.github.com/ray-project/ray/issues/35701">#35701</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/35885">#35885</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/34b562054fc0b93255a8b7e3308d0a021126318c"><code>34b5620</code></a> [docs] kapa hotfix (<a href="https://redirect.github.com/ray-project/ray/issues/36036">#36036</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36048">#36048</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/c9ce481faa3ef6b45865ceb67cb9286f362c6324"><code>c9ce481</code></a> Cherry pick docs PRs for contributor page, landing page, o11y (<a href="https://redirect.github.com/ray-project/ray/issues/35969">#35969</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/5bb3d900af44b44ab195e5e7f030ac29b989b615"><code>5bb3d90</code></a> [Java] Upgrade TestNG to patch CVEs (<a href="https://redirect.github.com/ray-project/ray/issues/36027">#36027</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36055">#36055</a>)</li>
<li><a href="https://github.com/ray-project/ray/commit/a391deac03986799357147595552a11a47ff64b2"><code>a391dea</code></a> Deflake test_worker_kv_calls (<a href="https://redirect.github.com/ray-project/ray/issues/35744">#35744</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/36010">#36010</a>)</li>
<li>Additional commits viewable in <a href="https://github.com/ray-project/ray/compare/ray-2.4.0...ray-2.5.0">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko merged pull request #7814: Build: Bump ray from 2.4.0 to 2.5.0 in /python
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko merged PR #7814:
URL: https://github.com/apache/iceberg/pull/7814
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org