issues@paimon.apache.org, 2024-10

You are viewing a plain text version of this content. The canonical link for it is here.

- [PR] Bump org.apache.avro:avro from 1.11.1 to 1.11.4 in /paimon-flink/paimon-flink-cdc [paimon] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2024/10/08 15:05:22 UTC, 1 replies.
- [I] [Feature] Avoid logging full rows with sensitive information on conversion failure in Flink CDC [paimon] - posted by "atallahade (via GitHub)" <gi...@apache.org> on 2024/10/08 15:25:08 UTC, 0 replies.
- [PR] Support scan tag [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/08 15:29:06 UTC, 0 replies.
- Re: [PR] [core] Manifest and Statistic support query by tag name [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/08 15:48:22 UTC, 14 replies.
- Re: [PR] [common][flink] Add support for complex types in kafka debezium avro cdc action [paimon] - posted by "AshishKhatkar (via GitHub)" <gi...@apache.org> on 2024/10/08 17:04:42 UTC, 2 replies.
- Re: [PR] [core] Filter data file while executing local orphan clean [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/09 01:33:17 UTC, 15 replies.
- Re: [PR] [spark] Support nested col pruning [paimon] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/10/09 01:51:24 UTC, 1 replies.
- Re: [PR] [core] Introduce expire_tags action and procedure with olderThan user custom time [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/09 01:59:55 UTC, 3 replies.
- Re: [PR] [core] Delete redundant if statement when produce changelog by lookup for first row. [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/09 02:22:19 UTC, 2 replies.
- Re: [PR] Refactoring module structure and building [paimon-python] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 02:45:56 UTC, 0 replies.
- Re: [PR] [core][spark]support format table create, and implement format table for SparkCatalog [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 02:54:50 UTC, 0 replies.
- Re: [PR] [feature][flink] introduce RecordAttributesProcessor for write operators [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 03:24:38 UTC, 0 replies.
- Re: [PR] [core] Optimize multiple commit to reduce conflicts [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/09 03:31:35 UTC, 2 replies.
- Re: [PR] Catalog supports to create table from pyarrow schema [paimon-python] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 03:35:08 UTC, 0 replies.
- Re: [PR] Remove flink-shaded-hadoop-2-uber in java-bridge [paimon-python] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 06:04:54 UTC, 1 replies.
- Re: [I] [Bug] A single bad message can cause Flink CDC writer to stuck in an infinite loop waiting for the schema change [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 07:05:10 UTC, 2 replies.
- Re: [PR] [Feature] Kafka debezium json supports automatic discovery of primary keys [paimon] - posted by "sunxiaojian (via GitHub)" <gi...@apache.org> on 2024/10/09 07:38:51 UTC, 0 replies.
- Re: [PR] [POC][Feature] Support common jdbc catalog lock for filesystem catalog [paimon] - posted by "sunxiaojian (via GitHub)" <gi...@apache.org> on 2024/10/09 07:39:53 UTC, 0 replies.
- Re: [PR] [fix][flink] Fix Iceberg compatible metadata cannot be read when data file format is parquet [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/09 08:03:38 UTC, 8 replies.
- [PR] [core] Delete tag not failed if tag not exists [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/09 08:32:52 UTC, 1 replies.
- [PR] [spark] Add test case for writing nested array [paimon] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/10/09 08:53:02 UTC, 2 replies.
- [PR] Refactor reader and writer [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/09 08:59:31 UTC, 1 replies.
- [PR] Add tests for new reader and writer api [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/09 09:58:31 UTC, 1 replies.
- [PR] Fix InsertOnly behavior for CDC and deduplication scenarios [paimon] - posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2024/10/09 09:59:24 UTC, 5 replies.
- Re: [I] Who is using Apache Paimon? [paimon] - posted by "tangjunfu (via GitHub)" <gi...@apache.org> on 2024/10/09 10:21:29 UTC, 2 replies.
- [PR] [flink][cdc] Add support for retry cnt instead of busy wait and additional support to skip corrupt records in cdc writer [paimon] - posted by "AshishKhatkar (via GitHub)" <gi...@apache.org> on 2024/10/09 10:27:07 UTC, 6 replies.
- [PR] [spark] Fix push down limit data correctness issue with deletion vector [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/09 10:51:02 UTC, 2 replies.
- [PR] Fix overwrite [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/09 11:14:22 UTC, 1 replies.
- [PR] [core] Support parallel close writers [paimon] - posted by "neuyilan (via GitHub)" <gi...@apache.org> on 2024/10/09 11:15:41 UTC, 10 replies.
- [PR] [doc] first-row merge engine adds changelog producer usage documentation. [paimon] - posted by "zhuangchong (via GitHub)" <gi...@apache.org> on 2024/10/09 11:21:00 UTC, 1 replies.
- Re: [I] [Feature] Upgrade Flink CDC to 3.1.X Version [paimon] - posted by "zhuangchong (via GitHub)" <gi...@apache.org> on 2024/10/09 11:34:32 UTC, 1 replies.
- Re: [PR] [common] [flink] Add support for complex types in kafka debezium avro cdc action. [paimon] - posted by "umeshdangat (via GitHub)" <gi...@apache.org> on 2024/10/09 15:55:37 UTC, 1 replies.
- [PR] [spark] Support push down limit for primary key table [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/10 01:34:04 UTC, 4 replies.
- [PR] [doc] update unaware-bucket-topo.png [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/10 01:56:02 UTC, 1 replies.
- Re: [PR] [Flink] Support statistics in flink [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/10 02:08:20 UTC, 0 replies.
- [PR] [flink] Add query service test with deletion vectors options [paimon] - posted by "Shadowell (via GitHub)" <gi...@apache.org> on 2024/10/10 02:14:03 UTC, 2 replies.
- [PR] Fix unstable overwrite test [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/10 03:40:19 UTC, 1 replies.
- Re: [PR] [core] Support push down limit for primary key table [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/10 05:30:15 UTC, 0 replies.
- [PR] [WIP][spark] Support scala 2.13 [paimon] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/10/10 06:02:59 UTC, 0 replies.
- Re: [PR] [core][spark] Support push down limit for primary key table [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/10 06:15:17 UTC, 4 replies.
- Re: [PR] [Flink] Support analysis statistics in flink [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/10 07:10:01 UTC, 0 replies.
- [PR] [doc] Add doc for creating table [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/10 07:14:01 UTC, 1 replies.
- [PR] [core] Manifest and Statistic support query by timestamp [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/10 08:27:44 UTC, 7 replies.
- [I] [Docs] [Good First Issue] Fix wrong explanation and demo in consumer. [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/10 08:48:12 UTC, 0 replies.
- [PR] [core] Sort some system table query result [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/10 09:36:23 UTC, 7 replies.
- [PR] [core] Support set snapshot-id when query by consumer-id [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/11 02:25:51 UTC, 2 replies.
- Re: [PR] [Hive] Add AWS Glue Catalog Support [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/11 03:24:59 UTC, 0 replies.
- Re: [I] [Feature] AWS Glue Metastore support [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/11 03:25:00 UTC, 0 replies.
- Re: [PR] [core] Support specify snapshot-id and timestamp when query by consumer-id [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/11 05:30:53 UTC, 1 replies.
- [PR] Fix symbol [paimon] - posted by "eric666666 (via GitHub)" <gi...@apache.org> on 2024/10/11 06:33:59 UTC, 2 replies.
- Re: [I] [Docs] Fix wrong explanation and demo in consumer. [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/11 07:11:52 UTC, 1 replies.
- [PR] [flink] fix compact unaware bucket table in combine mode the writer parallelism is always 1 [paimon] - posted by "Tan-JiaLiang (via GitHub)" <gi...@apache.org> on 2024/10/11 08:05:20 UTC, 3 replies.
- [PR] [core] Enable file index for DV table [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/11 08:12:04 UTC, 1 replies.
- [PR] Modify long_description [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/11 08:22:32 UTC, 1 replies.
- [PR] [spark] Improve write table plan explain string [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/11 09:36:27 UTC, 3 replies.
- Re: [PR] [core] Support TimeTravelUtils to resolve snapshot from scan params [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/11 12:05:13 UTC, 0 replies.
- Re: [PR] [core] Add TimeTravelUtils to resolve snapshot from scan params [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/11 12:19:48 UTC, 9 replies.
- [PR] Flink LookupTable support cache row filter [paimon] - posted by "Sxnan (via GitHub)" <gi...@apache.org> on 2024/10/12 01:59:22 UTC, 0 replies.
- [PR] Expose metrics for paimon presto reader [paimon-presto] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/12 02:09:58 UTC, 2 replies.
- Re: [PR] [format][orc] open orc switch useSelected,allowSARGToFilter to make sure pushdown works [paimon] - posted by "ranxianglei (via GitHub)" <gi...@apache.org> on 2024/10/12 02:15:15 UTC, 9 replies.
- Re: [PR] [spark] Support scala 2.13 [paimon] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2024/10/12 03:46:16 UTC, 1 replies.
- Re: [I] [Bug] when Dedicated Compaction use combined mode, restore from checkpoint ,then error：This exception is intentionally thrown after committing the restored checkpoints By restarting the job we hope that writers can start writing based on these new commits. [paimon] - posted by "Tan-JiaLiang (via GitHub)" <gi...@apache.org> on 2024/10/12 03:47:00 UTC, 1 replies.
- Re: [PR] [flink] Flink LookupTable support cache row filter [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/12 07:47:22 UTC, 5 replies.
- [I] [Feature] Extend merge_into procedure to support notMatchedBySourceUpsert/Delete. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/12 09:54:10 UTC, 1 replies.
- [PR] [flink] extend merge_into procedure to support notMatchedBySourceUpsert/Delete. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/12 09:57:22 UTC, 5 replies.
- [PR] [hotfix] Add `.java-version` to to `.gitignore` [paimon] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/10/12 14:24:00 UTC, 3 replies.
- [PR] [spark] Add show tags sql syntax [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/13 11:49:29 UTC, 8 replies.
- [I] [Feature] Introduce prefix scan. [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/14 01:41:14 UTC, 3 replies.
- [PR] [core] Support timestamp type in Iceberg compatibility [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/14 03:18:10 UTC, 2 replies.
- [I] [Bug] When I submit a task in the sql-client interface for flink to read up paimon to write to oss, there is a crash [paimon] - posted by "jinmu0410 (via GitHub)" <gi...@apache.org> on 2024/10/14 04:22:24 UTC, 1 replies.
- [PR] [core] Support parallel reading of local orphan clean [paimon] - posted by "bknbkn (via GitHub)" <gi...@apache.org> on 2024/10/14 05:37:52 UTC, 17 replies.
- [PR] [flink] Fix FlinkGenericCatalog can not get procedure [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/14 11:19:06 UTC, 2 replies.
- [PR] [core] Introduce metadata.stats-dense-store to reduce meta size for multiple columns table [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/14 12:30:57 UTC, 18 replies.
- Re: [PR] [trivial] code refactoring for paimon table action. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/14 12:51:37 UTC, 0 replies.
- Re: [PR] [core] Add benchmark for reader and writer with bloom filter in sort file store [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/14 12:52:04 UTC, 1 replies.
- Re: [I] [Feature] Add benchmark for reader and writer with bloom filter in sort file store [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/14 12:52:08 UTC, 0 replies.
- [PR] [flink] Support add partition for FlinkSQL [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/14 14:03:03 UTC, 2 replies.
- [I] [Bug] When using mysql-CDC Database synchronization Action On Combined Mode, mysql field changes cause tasks to wait indefinitely [paimon] - posted by "dsanww (via GitHub)" <gi...@apache.org> on 2024/10/15 02:20:04 UTC, 0 replies.
- [PR] [WIP][spark] Support spark 4.0 [paimon] - posted by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2024/10/15 02:41:56 UTC, 0 replies.
- [PR] [test] add random test case for manifest file full compaction [paimon] - posted by "LsomeYeah (via GitHub)" <gi...@apache.org> on 2024/10/15 04:16:30 UTC, 2 replies.
- Re: [I] [Feature] Branch allows for setting expiration times. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:20:16 UTC, 4 replies.
- Re: [I] [Feature] ConfigOption add sinceVersion [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:21:37 UTC, 0 replies.
- Re: [I] [Feature] Support nested col pruning push down [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:21:54 UTC, 0 replies.
- [PR] Add release tools [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/15 06:35:01 UTC, 2 replies.
- Re: [PR] [core] Use java11 as default [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:45:23 UTC, 6 replies.
- Re: [PR] [core]IcebergConversions addType for Timestamp and Time [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:51:01 UTC, 1 replies.
- Re: [PR] [hotfix] Remove useless #withPartitionKeys call [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 06:51:37 UTC, 0 replies.
- Re: [PR] [core] fix the collect of overlapped snapshots [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 07:02:03 UTC, 1 replies.
- [PR] [flink] Add ManifestCompactProcedure to enable compact manifest manually [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/15 07:07:08 UTC, 4 replies.
- Re: [PR] [core]Fix branchesTable created_from_snapshot field display result error. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 07:19:47 UTC, 1 replies.
- Re: [PR] Compatible with Spark4 （upgrade antlr4 to version 4.13.1 Compatible with jdk17 ） [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 07:22:37 UTC, 1 replies.
- Re: [PR] [WIP][core] Support add partition for paimon [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/15 09:24:51 UTC, 2 replies.
- Re: [PR] [core] Support add partition for paimon [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/15 10:07:31 UTC, 5 replies.
- [PR] [core] Fix the KvQueryTableTest may stuck in loop [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/15 11:10:42 UTC, 4 replies.
- [PR] [spark] Add tag ddl sytnax for create/delete/rename tag [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/15 11:30:46 UTC, 6 replies.
- Re: [I] [Feature] Support kafka connect paimon sink [paimon] - posted by "sunxiaojian (via GitHub)" <gi...@apache.org> on 2024/10/15 12:16:35 UTC, 1 replies.
- [PR] [flink] Support Column Statistics for Flink [paimon] - posted by "HuangXingBo (via GitHub)" <gi...@apache.org> on 2024/10/16 02:00:14 UTC, 3 replies.
- [PR] [core] Rollback action write hint first and use thread pool to delete manifests [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/16 02:30:00 UTC, 1 replies.
- [I] [Feature] enable self-define FieldAggregator [paimon] - posted by "Stephen0421 (via GitHub)" <gi...@apache.org> on 2024/10/16 02:40:23 UTC, 1 replies.
- [PR] [WIP][core] Support RollbackAction and Procedure with timestammp [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/16 02:51:08 UTC, 0 replies.
- [PR] [core] Adjust create partition interface [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/16 03:23:15 UTC, 2 replies.
- [PR] [core] enable self-define FieldAggregator. [paimon] - posted by "Stephen0421 (via GitHub)" <gi...@apache.org> on 2024/10/16 03:39:17 UTC, 1 replies.
- Re: [PR] [Hive] HiveCatalog: Table StorageDescriptor location and control HMS FileSystem scan. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/16 03:44:09 UTC, 1 replies.
- Re: [PR] [spark]Support change default database [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/16 03:51:01 UTC, 1 replies.
- [PR] [doc] Add read performance doc. [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/16 04:00:27 UTC, 4 replies.
- Re: [PR] [core]delete created_from_snapshot and created_from_snapshot from branchTable [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/16 06:24:59 UTC, 1 replies.
- [I] [Feature] Delete partition in the metastore when it expires. [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/16 07:14:22 UTC, 3 replies.
- Re: [PR] [flink] Add CompactManifestProcedure to enable compact manifest manually [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/16 08:34:23 UTC, 6 replies.
- [PR] [core] Improve TruncateSimpleColStatsCollector performance [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/16 08:39:40 UTC, 2 replies.
- [PR] [spark] Support spark DropPartition with sync metastore [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/16 10:11:36 UTC, 7 replies.
- [PR] [core] Introduce View Support to HiveCatalog [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/16 11:05:42 UTC, 7 replies.
- [PR] support async lookup [paimon] - posted by "neuyilan (via GitHub)" <gi...@apache.org> on 2024/10/16 12:47:13 UTC, 0 replies.
- Re: [I] [Bug] Branches Table created_from_snapshot field result error. [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/17 06:10:31 UTC, 0 replies.
- [I] [Feature] enable self-define MergeEngine [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/17 07:01:51 UTC, 3 replies.
- [PR] [hive] Support syncing Iceberg compatible metadata to Hive, so Paimon table can be accessed from Iceberg Hive catalog [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/17 08:55:33 UTC, 2 replies.
- [I] [Bug] [paimon] - posted by "zhuangchong (via GitHub)" <gi...@apache.org> on 2024/10/17 12:25:48 UTC, 1 replies.
- [PR] [flink] fix delete record exception after partial-update merge engine configuration to lookup changelog producer [paimon] - posted by "zhuangchong (via GitHub)" <gi...@apache.org> on 2024/10/17 12:34:57 UTC, 4 replies.
- [PR] [spark] Replace create existing tag semantic with replace_tag [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/18 01:58:13 UTC, 7 replies.
- Re: [I] [Feature] Introduce a bulk insert mode for dynamic bucket [paimon] - posted by "baimafeima-yf (via GitHub)" <gi...@apache.org> on 2024/10/18 06:28:39 UTC, 1 replies.
- Re: [PR] [WIP][core] Support RollbackAction and Procedure with timestamp [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/18 06:47:15 UTC, 4 replies.
- [PR] [arrow] Allocate buffer for MapVector in init [paimon] - posted by "leaves12138 (via GitHub)" <gi...@apache.org> on 2024/10/18 07:03:23 UTC, 2 replies.
- [PR] [flink] Make DPP distribute the splits fairly for flink [paimon] - posted by "HuangXingBo (via GitHub)" <gi...@apache.org> on 2024/10/18 08:11:22 UTC, 2 replies.
- [PR] [core] Fix partition column generate wrong partition spec [paimon] - posted by "ulysses-you (via GitHub)" <gi...@apache.org> on 2024/10/18 09:28:37 UTC, 3 replies.
- [PR] [core] Update writer/reader benchmark for bloom filter [paimon] - posted by "FangYongs (via GitHub)" <gi...@apache.org> on 2024/10/18 10:05:28 UTC, 3 replies.
- [I] [Bug] idea cannot find classes of other modules in the paimon-spark submodule. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/18 13:59:23 UTC, 1 replies.
- [PR] [spark] remove the dependency of paimon-bundle in all submodules of paimon-spark. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/18 14:00:08 UTC, 12 replies.
- Re: [PR] [spark] Support push down aggregate [paimon] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2024/10/19 13:26:19 UTC, 0 replies.
- Re: [PR] [spark] Support push down aggregate with group by partition column [paimon] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2024/10/19 13:26:25 UTC, 0 replies.
- Re: [PR] [spark] Support report partitioning to eliminate shuffle exchange [paimon] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2024/10/19 13:56:59 UTC, 0 replies.
- Re: [PR] [core] Rollback action write hint first [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/20 07:40:35 UTC, 1 replies.
- [PR] [core] Fix writer close avoid memory leak in Manifest [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/20 08:42:55 UTC, 1 replies.
- Re: [PR] [Core]Support async lookup [paimon] - posted by "neuyilan (via GitHub)" <gi...@apache.org> on 2024/10/21 01:28:27 UTC, 6 replies.
- [PR] [fix][test] fix unstable random test for manifest full compaction [paimon] - posted by "LsomeYeah (via GitHub)" <gi...@apache.org> on 2024/10/21 03:12:48 UTC, 2 replies.
- [I] [Bug] Spark Streaming support toTable method [paimon] - posted by "melin (via GitHub)" <gi...@apache.org> on 2024/10/21 05:57:31 UTC, 0 replies.
- [PR] [Bug] Fix NoSuchElementException when enable partition mark done [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/21 12:26:13 UTC, 1 replies.
- Re: [PR] [cdc] Update cdc module dependencies [paimon] - posted by "Chouving77 (via GitHub)" <gi...@apache.org> on 2024/10/21 12:32:50 UTC, 0 replies.
- [PR] [Bug] Close PartitionMarkDone to prevent potential resource leakage [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/22 07:03:25 UTC, 2 replies.
- [PR] [catalog] Support set HiveCatalog options in SparkGenericCatalog. [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/22 07:05:15 UTC, 1 replies.
- [PR] [test] Add test for hive-conf-dir in Spark catalog. [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/22 07:58:42 UTC, 5 replies.
- [PR] [hive] Support create formatTable set csv.field-delimiter [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/22 08:30:07 UTC, 3 replies.
- [I] [Feature] Decouple the PartitionMarkDone from Flink to enable marking as done for Spark batch processing. [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/22 08:33:37 UTC, 3 replies.
- [PR] [parquet] Add type id to parquet files [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/22 08:49:35 UTC, 3 replies.
- [PR] [spark] support to mark done for spark writer [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/22 10:15:36 UTC, 3 replies.
- [PR] Read interface support predicate [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/23 04:03:43 UTC, 0 replies.
- [I] [Bug] Failed to execute delete with an append table by a timestamp condition statement, error "failed to parse timestamp datatype value" [paimon] - posted by "hnynes (via GitHub)" <gi...@apache.org> on 2024/10/23 07:07:45 UTC, 1 replies.
- [PR] [format] Fix ParquetFilters cannot handle tinyint and smallint correctly [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/23 08:08:11 UTC, 1 replies.
- [I] [Bug] thread is blocked when executing `show tables from catalog.database` via DLF. [paimon] - posted by "songpcmusic (via GitHub)" <gi...@apache.org> on 2024/10/23 08:54:14 UTC, 0 replies.
- [PR] [hive]add retention seconds in hive catalog. [paimon] - posted by "YanZhangN (via GitHub)" <gi...@apache.org> on 2024/10/23 10:16:22 UTC, 7 replies.
- Re: [I] [Bug] java.lang.UnsatisfiedLinkError: com.github.luben.zstd.ZstdInputStreamNoFinalizer.recommendedDInSize()J [paimon] - posted by "Chouving77 (via GitHub)" <gi...@apache.org> on 2024/10/23 13:16:07 UTC, 2 replies.
- [PR] [docs] Add example on querying Paimon table with Trino Iceberg connector [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/24 03:08:08 UTC, 3 replies.
- [I] [Feature] Support nested col pruning push down for flink [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/24 03:42:38 UTC, 0 replies.
- [I] [Feature] Support table level options via sql conf for Spark Engine [paimon] - posted by "xiangyuf (via GitHub)" <gi...@apache.org> on 2024/10/24 07:56:53 UTC, 0 replies.
- [I] [Bug] Assumption on the Consistency of Flink CatalogTable is Vulnerable [paimon] - posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2024/10/24 11:03:15 UTC, 2 replies.
- Re: [PR] [core] Support RollbackAction and Procedure with timestamp [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/24 12:01:02 UTC, 3 replies.
- [PR] Consumer procedure fix [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/24 14:45:30 UTC, 0 replies.
- [PR] [doc] Add partitions doc added [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/24 14:47:22 UTC, 0 replies.
- [I] [Bug] The documentation describes an error about Asynchronous Compaction [paimon] - posted by "chenjiehao (via GitHub)" <gi...@apache.org> on 2024/10/24 15:45:34 UTC, 2 replies.
- Re: [PR] [core] Check snapshot when reset consumer [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/25 01:38:17 UTC, 5 replies.
- Re: [PR] [flink] Fix query service error while query table with deletion vectors option [paimon] - posted by "Shadowell (via GitHub)" <gi...@apache.org> on 2024/10/25 01:56:28 UTC, 1 replies.
- [PR] [core] Fix snapshot privilege check logic [paimon] - posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2024/10/25 02:20:46 UTC, 5 replies.
- [PR] [doc] fix doc describes an error about Asynchronous Compaction [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/25 02:32:40 UTC, 4 replies.
- [PR] feat: improve apache paimon website ui [paimon-website] - posted by "Laffery (via GitHub)" <gi...@apache.org> on 2024/10/25 03:36:26 UTC, 2 replies.
- [PR] [cdc] Add flink execution mode check for cdc table sync action. [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/25 03:44:14 UTC, 6 replies.
- [I] [Bug] Query service process record repeatedly [paimon] - posted by "Shadowell (via GitHub)" <gi...@apache.org> on 2024/10/25 06:10:30 UTC, 0 replies.
- [PR] [flink] add coordinate and worker operator for small changelog files compaction [paimon] - posted by "LsomeYeah (via GitHub)" <gi...@apache.org> on 2024/10/25 06:17:35 UTC, 5 replies.
- Re: [PR] [flink] Small changelog files can now be compacted into big files [paimon] - posted by "tsreaper (via GitHub)" <gi...@apache.org> on 2024/10/25 06:40:59 UTC, 1 replies.
- [PR] [flink] fix false assumption on catalog table passing logic [paimon] - posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2024/10/25 07:43:02 UTC, 6 replies.
- [I] [Bug] spark module MigrateTableProcedureTest#migrate partitioned table with null partition failed in idea. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/25 10:04:39 UTC, 0 replies.
- Re: [PR] [doc] Add doc for adding partitions [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/25 10:11:40 UTC, 3 replies.
- [PR] [flink] Lookup source should ignore scan options [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/25 11:02:41 UTC, 4 replies.
- [I] [Bug] fall-back branch does not work [paimon] - posted by "JackeyLee007 (via GitHub)" <gi...@apache.org> on 2024/10/25 11:30:47 UTC, 1 replies.
- [PR] [core] Support sequence.field sort order for pk table [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/26 13:50:28 UTC, 8 replies.
- Re: [PR] [spark] Support spark 4.0 [paimon] - posted by "YannByron (via GitHub)" <gi...@apache.org> on 2024/10/28 02:17:05 UTC, 11 replies.
- [PR] [flink] PartitionMarkDone enables the use of various partition trigge… [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/28 05:36:55 UTC, 6 replies.
- Re: [I] [Bug] https://paimon.apache.org/docs/0.7/* web url content not found [paimon] - posted by "herefree (via GitHub)" <gi...@apache.org> on 2024/10/28 06:03:24 UTC, 0 replies.
- [PR] [hive] Fix wrong construct for dlf metastore [paimon] - posted by "mxdzs0612 (via GitHub)" <gi...@apache.org> on 2024/10/28 06:43:10 UTC, 2 replies.
- [I] [Feature] Support guava cache in CacheManager [paimon] - posted by "FangYongs (via GitHub)" <gi...@apache.org> on 2024/10/28 06:43:18 UTC, 2 replies.
- [PR] [core] Support guava cache in CacheManager [paimon] - posted by "FangYongs (via GitHub)" <gi...@apache.org> on 2024/10/28 09:03:42 UTC, 9 replies.
- [PR] [spark]: clean up zstd-jni lib files [paimon] - posted by "zhongyujiang (via GitHub)" <gi...@apache.org> on 2024/10/28 09:38:18 UTC, 4 replies.
- [PR] [core] Introduce compactionsCompletedCount/compactionsFailedCount/compactionsQueuedCount metrics. [paimon] - posted by "zhuyaogai (via GitHub)" <gi...@apache.org> on 2024/10/28 10:29:00 UTC, 8 replies.
- [PR] [core] Add avg/max/total compaction io size metric [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/28 10:51:03 UTC, 4 replies.
- [PR] [spark] Support table options filter via SQL conf for Spark Engine [paimon] - posted by "xiangyuf (via GitHub)" <gi...@apache.org> on 2024/10/28 12:04:25 UTC, 5 replies.
- Re: [I] [Feature] Support Flink sourceIdleTime metric in Paimon Source [paimon] - posted by "qingfei1994 (via GitHub)" <gi...@apache.org> on 2024/10/28 12:27:56 UTC, 2 replies.
- [I] [Feature] support iceberg rest catalog for iceberg compatibility [paimon] - posted by "tonycox (via GitHub)" <gi...@apache.org> on 2024/10/28 18:06:52 UTC, 0 replies.
- [PR] [Flink] support speculative execution when batch read paimon table [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/29 02:20:57 UTC, 0 replies.
- Re: [PR] [Flink] Support speculative execution when batch read paimon table. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/29 02:25:18 UTC, 7 replies.
- [I] [Bug] the underlying local dir doesn't created but create schema return succ if using a wrong localfs path [paimon] - posted by "FANNG1 (via GitHub)" <gi...@apache.org> on 2024/10/29 02:50:27 UTC, 1 replies.
- Re: [I] [Bug] Requests to all /ui paths in Paimon WebUI return a 401 error [paimon-webui] - posted by "zhaofuw (via GitHub)" <gi...@apache.org> on 2024/10/29 03:13:42 UTC, 0 replies.
- Re: [I] [Bug] Delete record exception after partial-update merge engine configuration to lookup changelog producer [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/29 05:56:56 UTC, 0 replies.
- [PR] [flink] fix sink parallelism in case of AQE [paimon] - posted by "yunfengzhou-hub (via GitHub)" <gi...@apache.org> on 2024/10/29 05:58:09 UTC, 1 replies.
- [PR] [flink] Introduce PartitionListener to enable custom actions in the F… [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/29 07:27:35 UTC, 2 replies.
- [PR] [core] add check for make directory for db location when creating database [paimon] - posted by "FANNG1 (via GitHub)" <gi...@apache.org> on 2024/10/29 07:41:15 UTC, 1 replies.
- Re: [PR] [core] Introduce compactionCompletedCount/compactionQueuedCount metrics. [paimon] - posted by "zhuyaogai (via GitHub)" <gi...@apache.org> on 2024/10/29 08:44:53 UTC, 1 replies.
- Re: [PR] [lineage] Introduce jdbc lineage meta implementations [paimon] - posted by "gmdfalk (via GitHub)" <gi...@apache.org> on 2024/10/29 09:26:31 UTC, 0 replies.
- [I] [Bug] Fix the dead loop issue in CacheManager [paimon] - posted by "FangYongs (via GitHub)" <gi...@apache.org> on 2024/10/29 09:44:09 UTC, 1 replies.
- [PR] [core] Fix the dead loop issue in CacheManager [paimon] - posted by "FangYongs (via GitHub)" <gi...@apache.org> on 2024/10/29 09:49:44 UTC, 10 replies.
- [I] [Bug] The partition statistic is not correct in hms [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/29 11:11:03 UTC, 1 replies.
- Re: [PR] [core] FileBasedBloomFilter should not be pass private member to cache manager. [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/29 14:34:56 UTC, 0 replies.
- [PR] [core] Manage the bloomfilter buffer in cache manager [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/29 14:42:42 UTC, 1 replies.
- Re: [I] [Feature] Introduce New Metrics for Compaction [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/30 03:14:41 UTC, 0 replies.
- Re: [PR] [WIP][Flink] Support speculative execution when batch read paimon table. [paimon] - posted by "wwj6591812 (via GitHub)" <gi...@apache.org> on 2024/10/30 03:30:10 UTC, 1 replies.
- Re: [PR] [cdc] Convert timestamp_ltz field contents using local time zone [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/30 06:48:31 UTC, 1 replies.
- Re: [PR] [core] Introduce level0FileCount for partitions table [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/30 06:50:28 UTC, 1 replies.
- Re: [PR] [core]: support rename primary key columns and bucket key columns [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/30 06:53:42 UTC, 4 replies.
- [PR] [core] try to get table store for checking table options when creating table [paimon] - posted by "LsomeYeah (via GitHub)" <gi...@apache.org> on 2024/10/30 07:10:29 UTC, 2 replies.
- [PR] [flink] Procedure sorting compact a table without partitions filter. [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/30 08:30:09 UTC, 2 replies.
- [PR] [WIP][refactor] Expose FileStoreLookupFunction#checkRefresh to allow user-defined lookup function to override refresh strategy [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/30 09:14:46 UTC, 1 replies.
- [I] [Bug] Branch can only read data in latest schema [paimon] - posted by "gmdfalk (via GitHub)" <gi...@apache.org> on 2024/10/30 09:49:39 UTC, 0 replies.
- [PR] [cdc] Complementary flink exec mode check for mongodb and postgres cd… [paimon] - posted by "LinMingQiang (via GitHub)" <gi...@apache.org> on 2024/10/30 11:50:39 UTC, 1 replies.
- [PR] [hive] Refactor HiveCatalog to reduce io when getTable [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/30 12:11:07 UTC, 1 replies.
- [PR] [core] Introduce RollbackToTimestamp Procedure and Action [paimon] - posted by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2024/10/30 12:47:01 UTC, 10 replies.
- [PR] [core] Change variable name in RecordLevelExpire [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/30 14:47:32 UTC, 1 replies.
- [PR] [core] Space allowed between multiple deleted tags [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/30 15:08:00 UTC, 1 replies.
- Re: [I] [Feature] Paimon Spark Extensions conflict with Iceberg [paimon] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/10/31 01:59:15 UTC, 0 replies.
- [PR] [flink] Lookup join supports time periods black list [paimon] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/31 02:19:58 UTC, 1 replies.
- Re: [PR] [core] URISyntaxException when run test on windows [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/31 02:40:44 UTC, 1 replies.
- [PR] [hive]add dlf.lifecycle as a table param in hive catalog. [paimon] - posted by "YanZhangN (via GitHub)" <gi...@apache.org> on 2024/10/31 02:48:19 UTC, 1 replies.
- [PR] [fix] fix error in FlinkSink for changelog files merge [paimon] - posted by "LsomeYeah (via GitHub)" <gi...@apache.org> on 2024/10/31 05:15:03 UTC, 1 replies.
- [PR] [hive]pass 'partition.expiration-time' prop to hms. [paimon] - posted by "YanZhangN (via GitHub)" <gi...@apache.org> on 2024/10/31 05:51:52 UTC, 1 replies.
- [PR] [core] Support timestamp field type in record level expire [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/31 06:35:49 UTC, 5 replies.
- Re: [PR] [hive] Pass 'partition.expiration-time' prop to hms. [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/31 06:41:40 UTC, 0 replies.
- [PR] Supports insert and merge into operations [paimon-trino] - posted by "rfyu (via GitHub)" <gi...@apache.org> on 2024/10/31 08:20:22 UTC, 0 replies.
- [PR] [cdc] fixed unable to remove options [paimon] - posted by "MOBIN-F (via GitHub)" <gi...@apache.org> on 2024/10/31 08:57:12 UTC, 2 replies.
- [PR] [core] Introduce BlockCache for SortLookupStoreReader [paimon] - posted by "Aitozi (via GitHub)" <gi...@apache.org> on 2024/10/31 09:05:58 UTC, 2 replies.
- [PR] [core] Add file compression type in file names [paimon] - posted by "askwang (via GitHub)" <gi...@apache.org> on 2024/10/31 09:07:52 UTC, 6 replies.
- [PR] [core] Remove unused snapshot option for materialized table [paimon] - posted by "reswqa (via GitHub)" <gi...@apache.org> on 2024/10/31 09:13:36 UTC, 2 replies.
- [PR] [hotfix] Fix runtime exception on windows [paimon-python] - posted by "yuzelin (via GitHub)" <gi...@apache.org> on 2024/10/31 09:16:55 UTC, 2 replies.
- [I] [Feature] Add empty commit options to support some special situation [paimon] - posted by "zlzhang0122 (via GitHub)" <gi...@apache.org> on 2024/10/31 09:36:34 UTC, 0 replies.
- [PR] [Core]support async lookup in hash store [paimon] - posted by "neuyilan (via GitHub)" <gi...@apache.org> on 2024/10/31 12:41:53 UTC, 0 replies.
- Re: [I] [Feature] Add block cache for sorted lookup file store [paimon] - posted by "JingsongLi (via GitHub)" <gi...@apache.org> on 2024/10/31 12:52:46 UTC, 0 replies.
- [I] [Feature] support setting uid suffix for source/sink to improve state compatibility when jobGraph changes. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/31 13:50:51 UTC, 0 replies.
- [PR] [flink] support setting uid suffix for source/sink to improve state compatibility when jobGraph changes. [paimon] - posted by "liming30 (via GitHub)" <gi...@apache.org> on 2024/10/31 13:52:05 UTC, 0 replies.
- Re: [PR] [Core]Support async lookup in hash store [paimon] - posted by "neuyilan (via GitHub)" <gi...@apache.org> on 2024/10/31 16:17:04 UTC, 1 replies.