You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-1489] Update Flink support with authentication support [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2024/07/02 18:22:52 UTC, 10 replies.
- [PR] Cip 9 openapi [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/02 21:46:24 UTC, 0 replies.
- Re: [PR] [CELEBORN-1458][FOLLOWUP] Fix REST API endpoint of decommissioning in decommissioning.md [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/07/02 22:03:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-1491] introduce flusher working queue size metric [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/07/02 22:50:34 UTC, 2 replies.
- Re: [PR] [CELEBORN-1483] Add storage policy [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/07/02 23:27:41 UTC, 3 replies.
- Re: [PR] [CELEBORN-1439] Fix revive logic bug which will casue data correctness issue and job failiure [celeborn] - posted by "wangshengjie123 (via GitHub)" <gi...@apache.org> on 2024/07/03 07:37:23 UTC, 17 replies.
- [PR] [CELEBORN-1378] Call PartitionDataWriter#flush() before submitting to commitThreadPool [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/03 12:53:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-1477][CIP-9] Refine the celeborn RESTful APIs [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2024/07/03 16:12:13 UTC, 19 replies.
- Re: [PR] [CELEBORN-1477] Refine the master/worker RESTful APIs [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/03 18:52:06 UTC, 0 replies.
- [PR] Fix errorprone classified warnings in flink module [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2024/07/03 21:25:43 UTC, 3 replies.
- [PR] check admin [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/04 01:30:51 UTC, 1 replies.
- [PR] [CELEBORN-1493] Check admin privileges for http admin requests [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/04 01:38:44 UTC, 2 replies.
- [PR] [CELEBORN-914][FOLLOWUP] Add aggressive mode to evict memory shuffle file [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/04 03:19:20 UTC, 5 replies.
- [PR] [CELEBORN-1489] Update Flink support with authentication support - backport to 0.5 [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/04 06:35:02 UTC, 3 replies.
- Re: [PR] [CELEBORN-1190][FOLLOWUP] Fix WARNING of error prone [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/04 08:32:18 UTC, 64 replies.
- Re: [PR] [CELEBORN-1479] Report register shuffle failed reason in exception [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/07/04 15:33:53 UTC, 3 replies.
- [PR] [CELEBORN-1318][FOLLOWUP] Transfer properties for token authentication [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/05 00:25:18 UTC, 5 replies.
- [PR] [CELEBORN-1491][FOLLOWUP] Add flusher working queue size metric into grafana dashboard [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/05 06:15:37 UTC, 1 replies.
- Re: [PR] [CELEBORN-1446] Enable chunk prefetch when initialize CelebornInputStream [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/05 08:31:48 UTC, 12 replies.
- Re: [PR] [CELEBORN-1318][FOLLOWUP] Transfer extraInfo for token authentication [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/07/05 16:02:37 UTC, 3 replies.
- Re: [PR] [CELEBORN-1318][FOLLOWUP] Transfer extraInfo for http authentication providers [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/07/05 17:42:58 UTC, 8 replies.
- Re: [PR] [CELEBORN-1469] Support writing shuffle data to OSS(S3 only) [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/08 05:46:02 UTC, 20 replies.
- [PR] [CELEBORN-1494] Support IPv6 addresses in PbSerDeUtils.fromPackedPartitionLocations [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/09 08:12:36 UTC, 4 replies.
- [PR] [CELEBORN-1495] CelebornColumnDictionary supports dictionary of float and double column type [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/09 09:53:29 UTC, 2 replies.
- [PR] [CELEBORN-1487] CongestionController support control traffic by user/worker traffic speed [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/07/09 11:28:54 UTC, 6 replies.
- [PR] [CELEBORN-1496] Differentiate map results with only different stageAttemptId [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/07/09 12:38:42 UTC, 72 replies.
- Re: [I] [Umbrella] Celeborn Support Apache Flink [celeborn] - posted by "zhisheng17 (via GitHub)" <gi...@apache.org> on 2024/07/09 12:53:40 UTC, 1 replies.
- [PR] [CELEBORN-1499] Bump Ratis version from 3.0.1 to 3.1.0 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/10 08:47:20 UTC, 6 replies.
- [PR] [CELEBORN-1498] Decide whether to reuse the shuffle id based on the appShuffle's numAvailableOutputs [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/07/10 13:37:43 UTC, 3 replies.
- [PR] [Revereted test] test with fine grained pr reverted [celeborn] - posted by "YutingWang98 (via GitHub)" <gi...@apache.org> on 2024/07/10 17:24:57 UTC, 0 replies.
- [PR] [CELEBORN-1497] Optimize read buffer dispatcher to retain buffers until worker has memory pressure [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/11 02:24:58 UTC, 1 replies.
- [PR] [Celeborn=1500] Filter out empty InputStreams [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/11 02:37:17 UTC, 0 replies.
- Re: [PR] [Celeborn-1500] Filter out empty InputStreams [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/11 02:51:33 UTC, 0 replies.
- [PR] shade [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 03:13:05 UTC, 0 replies.
- Re: [PR] [CELEBORN-1440] Support baseline implementation of Celeborn Dashboard Server [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 03:17:57 UTC, 1 replies.
- Re: [PR] [CELEBORN-1493] Check admin privileges for http mutative requests [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 04:17:57 UTC, 5 replies.
- [PR] fix form mediaType [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 04:40:43 UTC, 0 replies.
- Re: [PR] [CELEBORN-1317][FOLLOWUP] Fix media type for form urlencoded APIs [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 04:48:00 UTC, 5 replies.
- [PR] [CELEBORN-1477][FOLLOWUP] Upload the celeborn-openapi-client to to nexus staging [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 05:04:02 UTC, 12 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] Shade the dependencies for openapi-client [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 06:50:20 UTC, 21 replies.
- Re: [PR] [CELEBORN-1317][FOLLOWUP] Fix media type annotations for form urlencoded APIs [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 08:00:14 UTC, 10 replies.
- Re: [PR] [CELEBORN-1500] Filter out empty InputStreams [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/11 09:40:34 UTC, 1 replies.
- [PR] [CELEBORN-1317][FOLLOWUP] Provide migration guide for /api/v1 [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 18:37:07 UTC, 0 replies.
- Re: [PR] [CELEBORN-1317][FOLLOWUP] User guide for `/api/v1` migration [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/11 18:51:38 UTC, 0 replies.
- [PR] Initial commit of Apache Flink 1.16 support [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/11 22:43:23 UTC, 0 replies.
- Re: [PR] [CELEBORN-1504] Support for Apache Flink 1.16 [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/12 02:22:17 UTC, 14 replies.
- [PR] Align jackson [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/12 06:37:10 UTC, 0 replies.
- Re: [PR] [CELEBORN-1505] Algin the celeborn server jackson dependency versions [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/12 06:42:43 UTC, 4 replies.
- Re: [PR] [CELEBORN-1473] TransportClientFactory should register netty memory metric with source for shared pooled ByteBuf allocator [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/12 08:32:28 UTC, 4 replies.
- Re: [PR] [Test] test with fine grained pr reverted [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/07/12 09:58:08 UTC, 4 replies.
- Re: [PR] [CELEBORN-1317][CIP-9][FOLLOWUP] User guide for `/api/v1` migration [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/07/12 10:40:57 UTC, 3 replies.
- [PR] Revert "[CELEBORN-1036][FOLLOWUP] totalInflightReqs should decrement when batchIdSet contains the batchId to avoid duplicate caller of removeBatch" [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/12 12:51:25 UTC, 1 replies.
- Re: [PR] [BUG] Revert "[CELEBORN-1036][FOLLOWUP] totalInflightReqs should decrement when batchIdSet contains the batchId to avoid duplicate caller of removeBatch" [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/07/13 03:55:24 UTC, 1 replies.
- Re: [PR] [CELEBORN-1506][BUG] Revert "[CELEBORN-1036][FOLLOWUP] totalInflightReqs should decrement when batchIdSet contains the batchId to avoid duplicate caller of removeBatch" [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/13 05:10:03 UTC, 3 replies.
- [PR] [CELEBORN-1437][DOC] Merge METRICS.md into monitoring.md [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/13 05:23:28 UTC, 17 replies.
- [PR] [CELEBORN-1436][DOC] Move Rest API out from monitoring.md to webapi.md [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/13 06:18:17 UTC, 5 replies.
- Re: [PR] [WIP][CELEBORN-1319] Optimize skew partition logic for Reduce Mode to avoid sorting shuffle files [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/14 08:32:33 UTC, 0 replies.
- [PR] [CELEBORN-1507] Prevent invalid Filegroups from being used [celeborn] - posted by "zhaostu4 (via GitHub)" <gi...@apache.org> on 2024/07/15 02:01:52 UTC, 17 replies.
- [PR] [CELEBORN-1508] switch the location at a high level [celeborn] - posted by "zhaostu4 (via GitHub)" <gi...@apache.org> on 2024/07/15 03:12:14 UTC, 0 replies.
- [PR] [CELEBORN-1509] prevent holding the lock for I/O [celeborn] - posted by "zhaostu4 (via GitHub)" <gi...@apache.org> on 2024/07/15 03:40:22 UTC, 0 replies.
- Re: [PR] [CELEBORN-1509] Reply response without holding a lock [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/07/15 07:01:09 UTC, 0 replies.
- [PR] [CELEBORN-1436][FOLLOWUP] Fix REST API endpoint of decommissioning in decommissioning.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/15 10:25:10 UTC, 5 replies.
- Re: [PR] [CELEBORN-1477][CIP-9][FOLLOWUP] User guide for `/api/v1` migration [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/15 10:34:08 UTC, 17 replies.
- [PR] [CELEBORN-1507] [WIP] Add support for custom master endpoint resolver [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/07/15 12:19:18 UTC, 1 replies.
- Re: [PR] [CELEBORN-1511] Add support for custom master endpoint resolver [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/07/16 09:00:12 UTC, 30 replies.
- [PR] [CELEBORN-1292][FOLLOWUP] Introduce application dimension resource consumption metrics of worker [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/16 12:19:54 UTC, 1 replies.
- [PR] [CELEBORN-1512] Bump Flink from 1.19.0 to 1.19.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/16 12:41:39 UTC, 2 replies.
- [PR] [CELEBORN-1318][FOLLOWUP] Upload the celeborn-common to nexus staging for http authentication extensions [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/16 16:06:02 UTC, 6 replies.
- Re: [PR] [CELEBORN-1292][FOLLOWUP] Introduce application dimension resource consumption metrics of Worker [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/07/17 01:54:36 UTC, 11 replies.
- [PR] [CELEBORN-1513] Support wildcard bind in dual stack environments [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/07/17 06:39:00 UTC, 22 replies.
- [PR] [CELEBORN-1515] SparkShuffleManager should set lifecycleManager to null after stopping lifecycleManager in Spark 2 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/18 06:48:57 UTC, 3 replies.
- [PR] DynamicConfigServiceFactory should support singleton. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/07/18 10:49:02 UTC, 2 replies.
- [PR] [CELEBORN-1481] CongestionController should also control memory file [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/07/18 11:01:31 UTC, 1 replies.
- [PR] [CELEBORN-1477][FOLLOWUP] Fix NPE and [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/18 21:46:30 UTC, 0 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] Fix api v1 response [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/18 21:54:51 UTC, 0 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] Fix api v1 response issue [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/18 23:15:53 UTC, 4 replies.
- [PR] [CELEBORN-1233] Add unit test to verify data correctness [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/07/19 05:18:38 UTC, 2 replies.
- Re: [PR] [CELEBORN-1516] DynamicConfigServiceFactory should support singleton. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/07/19 07:21:01 UTC, 2 replies.
- [PR] [CELEBORN-1518] Add support for Apache Spark barrier stages [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/22 08:39:28 UTC, 22 replies.
- [PR] jackson core [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/23 18:46:20 UTC, 0 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] Fix shaded celeborn-openapi-client dependency lack issue [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 06:46:34 UTC, 3 replies.
- [PR] Appache httpclient [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 10:10:50 UTC, 0 replies.
- [PR] [CELEBORN-1519] Do not update estimated partition size if it is unchanged [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/07/24 12:39:17 UTC, 5 replies.
- [PR] Minor logging for AppDiskUsage and Fixed UTs [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/07/24 16:47:37 UTC, 1 replies.
- Re: [PR] [CELEBORN-1477] Using openapi `apache-httpclient` library instead of `jersey2` [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 17:39:50 UTC, 1 replies.
- [PR] Celeborn spi [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 18:08:46 UTC, 0 replies.
- Re: [PR] [CELEBORN-1521] Introduce celeborn-spi module for authentication extensions [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 19:59:37 UTC, 9 replies.
- [PR] Fix applicationId extraction from shuffle key [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/24 22:47:14 UTC, 0 replies.
- Re: [PR] [CELEBORN-1522] Fix applicationId extraction from shuffle key [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/25 04:50:15 UTC, 1 replies.
- Re: [PR] [CELEBORN-1520] Minor logging fix for AppDiskUsageMetric and Fixed UTs [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/07/25 05:47:19 UTC, 2 replies.
- Re: [PR] [CELEBORN-1477] Using openapi-generator `apache-httpclient` library instead of `jersey2` [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/07/25 06:03:38 UTC, 22 replies.
- [PR] [CELEBORN-1524] Support IPv6 hostnames for Apache Ratis [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/07/25 19:52:45 UTC, 7 replies.
- Re: [PR] [CELEBORN-1501] Introduce application dimension resource consumption metrics of Worker [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/29 03:07:33 UTC, 1 replies.
- [PR] [CELEBORN-1526] Fix MR plugin can not run on Hadoop 3.1.0 [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/07/29 03:30:44 UTC, 4 replies.
- [PR] [CELEBORN-1527] Error prone plugin should exclude target/generated-sources/java of module [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/29 07:11:17 UTC, 5 replies.
- [PR] [CELEBORN-1190][FOLLOWUP] Update WARNING checks of error prone to ERROR for CI [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/07/29 09:04:50 UTC, 1 replies.
- [PR] Use volumeClaimTemplates to support various storage backend [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/07/30 08:53:47 UTC, 0 replies.
- Re: [PR] [CELEBORN-1528][HELM] Use volumeClaimTemplates to support various storage backend [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/07/30 12:00:39 UTC, 1 replies.
- [PR] Read shuffle data from S3 [celeborn] - posted by "zhaohehuhu (via GitHub)" <gi...@apache.org> on 2024/07/31 02:43:05 UTC, 1 replies.
- Re: [PR] [CELEBORN-1470] CelebornInputStream should retry to get next chunk starting from returned chunk for no replication [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/07/31 09:13:07 UTC, 0 replies.
- [PR] add scheduleCheckTask method for scheduled task [celeborn] - posted by "zhaohehuhu (via GitHub)" <gi...@apache.org> on 2024/07/31 09:25:47 UTC, 0 replies.
- Re: [PR] add a scheduleCheckTask method for scheduled task [celeborn] - posted by "zhaohehuhu (via GitHub)" <gi...@apache.org> on 2024/07/31 09:27:49 UTC, 0 replies.
- [PR] [CELEBORN-1532][HELM] Make helm charts more customizable [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/07/31 11:36:50 UTC, 0 replies.
- [PR] [CELEBORN-1533] Log location when CelebornInputStream#fillBuffer fails [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/07/31 14:48:24 UTC, 1 replies.
- [PR] Sort the api v1 response sequence [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/07/31 18:34:57 UTC, 0 replies.