You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [GOBBLIN-1944] Add gobblin-temporal load generator for a single subsuming super-workflow with a configurable number of activities nested beneath [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/01 00:06:52 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1944) Create Gobblin-Temporal load-generator to de-risk Temporal's scaling - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/01 00:07:00 UTC, 2 replies.
- [PR] Implement Distributed Data Movement (DDM) Gobblin-on-Temporal `WorkUnit` evaluation [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/01 00:36:07 UTC, 6 replies.
- [jira] [Resolved] (GOBBLIN-1944) Create Gobblin-Temporal load-generator to de-risk Temporal's scaling - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:08:00 UTC, 0 replies.
- [jira] [Closed] (GOBBLIN-1906) protect against nulls when converting `State` to a `hadoop.conf.Configuration` - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:09:00 UTC, 0 replies.
- [jira] [Closed] (GOBBLIN-1941) Create abstractions for developing on Temporal - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:09:00 UTC, 0 replies.
- [jira] [Resolved] (GOBBLIN-1906) protect against nulls when converting `State` to a `hadoop.conf.Configuration` - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:09:00 UTC, 0 replies.
- [jira] [Resolved] (GOBBLIN-1941) Create abstractions for developing on Temporal - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:09:00 UTC, 0 replies.
- [jira] [Closed] (GOBBLIN-1944) Create Gobblin-Temporal load-generator to de-risk Temporal's scaling - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:09:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1945) Implement Gobblin-on-Temporal WorkUnit Evaluation - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:10:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1945) Implement Gobblin-on-Temporal WorkUnit Evaluation - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/01 05:12:00 UTC, 0 replies.
- Re: [PR] [GOBBLIN-1945] Implement Distributed Data Movement (DDM) Gobblin-on-Temporal `WorkUnit` evaluation [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/01 06:41:47 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1945) Implement Gobblin-on-Temporal WorkUnit Evaluation - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/01 06:42:00 UTC, 0 replies.
- Re: [PR] [GOBBLIN-1942] Create MySQL util class for re-usable methods and setup MysqlDagActio… [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/01 17:36:41 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1942) Create MySQL util class for re-usable methods & enable MysqlDagActionStore retention - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/01 17:37:00 UTC, 2 replies.
- [jira] [Created] (GOBBLIN-1946) Unit tests for DagActionStoreChangeMonitor Process Message - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/01 21:31:00 UTC, 0 replies.
- [PR] Add framework and unit tests for DagActionStoreChangeMonitor [gobblin] - posted by "umustafi (via GitHub)" <gi...@apache.org> on 2023/11/01 21:40:56 UTC, 18 replies.
- [jira] [Closed] (GOBBLIN-1740) Split Workunit for Kafka Streaming jobs - posted by "Hanghang Liu (Jira)" <ji...@apache.org> on 2023/11/02 04:27:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1947) Send WorkUnitChangeEvent when helix task consistently fail - posted by "Hanghang Liu (Jira)" <ji...@apache.org> on 2023/11/02 04:31:00 UTC, 0 replies.
- [PR] [Hotfix] add option to detect malformed orc during commit [gobblin] - posted by "hanghangliu (via GitHub)" <gi...@apache.org> on 2023/11/02 07:17:43 UTC, 25 replies.
- [jira] [Created] (GOBBLIN-1948) Use Consist flowExecutionId Across Participants - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/02 18:54:00 UTC, 0 replies.
- [PR] [GOBBLIN-1948] Use same flowExecutionId across participants [gobblin] - posted by "umustafi (via GitHub)" <gi...@apache.org> on 2023/11/02 18:55:10 UTC, 13 replies.
- [jira] [Work logged] (GOBBLIN-1948) Use Consist flowExecutionId Across Participants - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/02 18:56:00 UTC, 13 replies.
- [jira] [Created] (GOBBLIN-1949) Add option to detect malformed orc during commit - posted by "Hanghang Liu (Jira)" <ji...@apache.org> on 2023/11/02 21:26:00 UTC, 0 replies.
- Re: [PR] [Hotfix][GOBBLIN-1949] add option to detect malformed orc during commit [gobblin] - posted by "hanghangliu (via GitHub)" <gi...@apache.org> on 2023/11/02 21:44:54 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1949) Add option to detect malformed orc during commit - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/02 21:45:00 UTC, 2 replies.
- Re: [PR] [GOBBLIN-1910]Refactor dag manager to reduce bulkiness for adhoc REST calls for launch, resume and kill [gobblin] - posted by "arjun4084346 (via GitHub)" <gi...@apache.org> on 2023/11/03 00:46:09 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1910) Refactor code to move current in-memory references to new design for REST calls: Launch, Resume and Kill - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/03 00:47:00 UTC, 0 replies.
- Re: [PR] [GOBBLIN-1929]implement get dataset path for IcebergDataset and RecursiveCopyableDataset [gobblin] - posted by "arjun4084346 (via GitHub)" <gi...@apache.org> on 2023/11/04 03:51:07 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1929) Implement Dataset Path for IcebergDataset and RecursiveCopyableDataset - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/04 03:52:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1950) Allow extension of GobblinMCEPublisher and customization of fileList for computeFileMetrics - posted by "Andy Jiang (Jira)" <ji...@apache.org> on 2023/11/06 19:07:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1950) Allow extension of GobblinMCEPublisher and customization of list to compute file metrics - posted by "Andy Jiang (Jira)" <ji...@apache.org> on 2023/11/06 19:08:00 UTC, 0 replies.
- [PR] [GOBBLIN-1950] Allow extension of functions in GobblinMCEPublisher and customization of fileList file metrics are calculated for [gobblin] - posted by "AndyJiang99 (via GitHub)" <gi...@apache.org> on 2023/11/06 19:12:38 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1950) Allow extension of GobblinMCEPublisher and customization of list to compute file metrics - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/06 19:13:00 UTC, 2 replies.
- Re: [PR] [GOBBLIN-1932] Custom partitioner partitioning based on the record timestamp [gobblin] - posted by "AndyJiang99 (via GitHub)" <gi...@apache.org> on 2023/11/06 19:16:09 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1932) Custom partitioner that determines the partitioned path based on the timestamp of the record itself - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/06 19:17:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1951) GTE emission when deleting a corrupted ORC file written by the OrcWriter - posted by "Matthew Ho (Jira)" <ji...@apache.org> on 2023/11/06 21:16:00 UTC, 0 replies.
- [PR] [GOBBLIN-1951] Emit GTE when deleting corrupted ORC files [gobblin] - posted by "homatthew (via GitHub)" <gi...@apache.org> on 2023/11/06 21:20:38 UTC, 5 replies.
- [jira] [Work logged] (GOBBLIN-1951) GTE emission when deleting a corrupted ORC file written by the OrcWriter - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/06 21:21:00 UTC, 5 replies.
- [jira] [Created] (GOBBLIN-1952) GaaS JobNames with long lengths cause issues with HDFS folders - posted by "William Lo (Jira)" <ji...@apache.org> on 2023/11/07 00:07:00 UTC, 0 replies.
- [PR] [GOBBLIN-1952] Make jobname shortening in GaaS more aggressive [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/07 02:45:04 UTC, 9 replies.
- [jira] [Work logged] (GOBBLIN-1952) GaaS JobNames with long lengths cause issues with HDFS folders - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/07 02:46:00 UTC, 9 replies.
- [jira] [Closed] (GOBBLIN-1949) Add option to detect malformed orc during commit - posted by "Hanghang Liu (Jira)" <ji...@apache.org> on 2023/11/07 17:53:00 UTC, 0 replies.
- [jira] [Resolved] (GOBBLIN-1949) Add option to detect malformed orc during commit - posted by "Hanghang Liu (Jira)" <ji...@apache.org> on 2023/11/07 17:53:00 UTC, 0 replies.
- Re: [PR] Make KafkaTopicGroupingWorkUnitPacker pack with desired num of container [gobblin] - posted by "codecov-commenter (via GitHub)" <gi...@apache.org> on 2023/11/08 01:37:13 UTC, 1 replies.
- [jira] [Created] (GOBBLIN-1953) Fix container taskoutput directory isolation issue during container transition - posted by "Matthew Ho (Jira)" <ji...@apache.org> on 2023/11/08 22:39:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1954) Update FlowSpec Safely to Avoid Deserialization and Compilation Failure - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/09 01:25:00 UTC, 1 replies.
- [jira] [Created] (GOBBLIN-1954) Update FlowSpec Safely to Avoid Compilation Failure - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/09 01:25:00 UTC, 0 replies.
- [PR] Fix FlowSpec Updating Function [gobblin] - posted by "umustafi (via GitHub)" <gi...@apache.org> on 2023/11/09 01:28:50 UTC, 24 replies.
- [jira] [Created] (GOBBLIN-1955) Emit metric to tune LeaseArbiter Linger metric - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/09 23:42:00 UTC, 0 replies.
- [PR] Emit metric to tune LeaseArbiter Linger metric [gobblin] - posted by "umustafi (via GitHub)" <gi...@apache.org> on 2023/11/09 23:42:35 UTC, 5 replies.
- [PR] [draft] Dag refactor [gobblin] - posted by "arjun4084346 (via GitHub)" <gi...@apache.org> on 2023/11/12 04:47:34 UTC, 2 replies.
- [PR] [GOBBLIN-1953] Add an exception message to orc writer validation GTE [gobblin] - posted by "homatthew (via GitHub)" <gi...@apache.org> on 2023/11/14 00:11:54 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1953) Fix container taskoutput directory isolation issue during container transition - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/14 00:12:00 UTC, 2 replies.
- [jira] [Created] (GOBBLIN-1956) Make Kafka streaming pipeline be able to config the max poll records during runtime - posted by "Zihan Li (Jira)" <ji...@apache.org> on 2023/11/15 00:38:00 UTC, 0 replies.
- [PR] [GOBBLIN-1956]Make Kafka streaming pipeline be able to config the max poll records during runtime [gobblin] - posted by "ZihanLi58 (via GitHub)" <gi...@apache.org> on 2023/11/15 00:51:15 UTC, 6 replies.
- [jira] [Work logged] (GOBBLIN-1956) Make Kafka streaming pipeline be able to config the max poll records during runtime - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/15 00:52:00 UTC, 6 replies.
- [jira] [Created] (GOBBLIN-1957) Add feature to improve ORCWriter buffer sizes with large record sizes - posted by "William Lo (Jira)" <ji...@apache.org> on 2023/11/15 21:01:00 UTC, 0 replies.
- [PR] [GOBBLIN-1957] GobblinOrcwriter improvements for large records [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/15 21:06:00 UTC, 6 replies.
- [jira] [Work logged] (GOBBLIN-1957) Add feature to improve ORCWriter buffer sizes with large record sizes - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/15 21:07:00 UTC, 6 replies.
- [PR] Temporal commit step integration [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/15 23:03:30 UTC, 16 replies.
- [jira] [Created] (GOBBLIN-1958) Fix /flowexecutions KILL action to return HTTP 409 when already a pending action, not 400 - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/16 00:49:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1958) Fix /flowexecutions KILL action to return HTTP 409 when already a pending action, not 400 - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/16 00:51:00 UTC, 0 replies.
- [PR] [GOBBLIN-1958] Consistently handle /flowexecutions KILL and RESUME action errors [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/16 00:57:04 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1958) Fix /flowexecutions KILL action to return HTTP 409 when already a pending action, not 400 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/16 00:58:00 UTC, 7 replies.
- [PR] Add semantics for failure on partial success [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/16 02:53:17 UTC, 1 replies.
- Re: [PR] [GOBBLIN-1958] Consistently handle /flowexecutions errors for KILL and RESUME actions [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/16 17:03:51 UTC, 6 replies.
- [jira] [Created] (GOBBLIN-1959) Introduce Gobblin partial success semantic which fails job on partial success - posted by "William Lo (Jira)" <ji...@apache.org> on 2023/11/16 17:19:00 UTC, 0 replies.
- [PR] [GOBBLIN-1947] Send workUnitChange event when helix task consistently fail [gobblin] - posted by "hanghangliu (via GitHub)" <gi...@apache.org> on 2023/11/16 19:44:45 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1947) Send WorkUnitChangeEvent when helix task consistently fail - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/16 19:45:00 UTC, 2 replies.
- Re: [PR] [GOBBLIN-1959] Add semantics for failure on partial success [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/17 00:06:27 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1959) Introduce Gobblin partial success semantic which fails job on partial success - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/17 00:07:00 UTC, 0 replies.
- [PR] Emit audit count after commit in IcebergMetadataWriter [gobblin] - posted by "homatthew (via GitHub)" <gi...@apache.org> on 2023/11/17 22:04:47 UTC, 0 replies.
- Re: [PR] DRAFT: Emit audit count after commit in IcebergMetadataWriter [gobblin] - posted by "homatthew (via GitHub)" <gi...@apache.org> on 2023/11/17 22:15:52 UTC, 1 replies.
- [jira] [Created] (GOBBLIN-1960) Emit audit count after commit in IcebergMetadataWriter - posted by "Matthew Ho (Jira)" <ji...@apache.org> on 2023/11/20 18:34:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1961) Qualify IcebergTable DatasetDescriptors (used by Iceberg-Distcp) - posted by "Kip Kohn (Jira)" <ji...@apache.org> on 2023/11/21 09:04:00 UTC, 0 replies.
- [PR] [GOBBLIN-1961] Use DB-qualified table ID as `IcebergTable` dataset descriptor [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/21 09:07:36 UTC, 2 replies.
- [jira] [Work logged] (GOBBLIN-1961) Qualify IcebergTable DatasetDescriptors (used by Iceberg-Distcp) - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/21 09:08:00 UTC, 11 replies.
- [PR] [GOBBLIN-1961] Allow `IcebergDatasetFinder` to use separate names for source vs. destination-side DB and table [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/21 23:28:24 UTC, 8 replies.
- Re: [PR] [GOBBLIN-1960] Emit audit count after commit in IcebergMetadataWriter [gobblin] - posted by "ZihanLi58 (via GitHub)" <gi...@apache.org> on 2023/11/22 00:49:08 UTC, 5 replies.
- [jira] [Work logged] (GOBBLIN-1960) Emit audit count after commit in IcebergMetadataWriter - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/22 00:50:00 UTC, 5 replies.
- [PR] Prevent NPE in `FlowCompilationValidationHelper.validateAndHandleConcurrentExecution` [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/22 21:11:38 UTC, 2 replies.
- [jira] [Created] (GOBBLIN-1962) Gobblin job creation encountered a failure due to a NullPointerException, inability to obtain a job lock for the "Data copy" job. - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 04:51:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1963) Following the restart, jobs that were previously in the "RUNNING," "LAUNCHED," or "SUBMITTED" state failed to resume. - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 08:06:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1963) Following the restart, jobs that were previously in the "RUNNING," "LAUNCHED," or "SUBMITTED" state failed to resume. - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 08:09:00 UTC, 5 replies.
- [jira] [Created] (GOBBLIN-1964) [Gobblin] Job lock acquisition should be made resilient - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 08:32:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1964) [Gobblin] Job lock acquisition should be made resilient - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 08:36:00 UTC, 0 replies.
- [jira] [Created] (GOBBLIN-1965) Extending Hive data movement CDC check to support table regex lookup - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 09:03:00 UTC, 0 replies.
- [jira] [Updated] (GOBBLIN-1965) Extending Hive data movement CDC check to support table regex lookup - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 09:04:00 UTC, 1 replies.
- [jira] [Updated] (GOBBLIN-1965) Need additional Hive data movement CDC check improvement to support table regex lookup - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 09:05:00 UTC, 3 replies.
- [jira] [Updated] (GOBBLIN-1965) Need additional Hive data movement CDC check improvment to support table regex lookup - posted by "Apekshit Kumar (Jira)" <ji...@apache.org> on 2023/11/27 09:05:00 UTC, 1 replies.
- [jira] [Created] (GOBBLIN-1966) Delete Launch Action Events After Processing - posted by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/11/28 18:02:00 UTC, 0 replies.
- [PR] Delete Launch Action Events After Processing [gobblin] - posted by "umustafi (via GitHub)" <gi...@apache.org> on 2023/11/28 18:16:25 UTC, 16 replies.
- [jira] [Created] (GOBBLIN-1967) Add data node for generic external ingress egress - posted by "William Lo (Jira)" <ji...@apache.org> on 2023/11/28 20:22:00 UTC, 0 replies.
- [PR] [GOBBLIN-1967] Add external data node for generic ingress/egress on GaaS [gobblin] - posted by "Will-Lo (via GitHub)" <gi...@apache.org> on 2023/11/28 20:22:22 UTC, 10 replies.
- [jira] [Work logged] (GOBBLIN-1967) Add data node for generic external ingress egress - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/28 20:23:00 UTC, 10 replies.
- [jira] [Created] (GOBBLIN-1968) Gobblin Commit Step Runs on Temporal - posted by "William Lo (Jira)" <ji...@apache.org> on 2023/11/28 20:36:00 UTC, 0 replies.
- [PR] [GOBBLIN-1962] Fix failed to acquire job lock [gobblin] - posted by "Apexhit (via GitHub)" <gi...@apache.org> on 2023/11/30 04:56:21 UTC, 0 replies.
- [jira] [Work logged] (GOBBLIN-1962) Gobblin job creation encountered a failure due to a NullPointerException, inability to obtain a job lock for the "Data copy" job. - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/30 04:57:00 UTC, 0 replies.
- Re: [PR] [GOBBLIN-1968] Temporal commit step integration [gobblin] - posted by "phet (via GitHub)" <gi...@apache.org> on 2023/11/30 08:21:20 UTC, 6 replies.
- [jira] [Work logged] (GOBBLIN-1968) Gobblin Commit Step Runs on Temporal - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/11/30 08:22:00 UTC, 6 replies.