You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/05/13 04:24:00 UTC
[jira] [Closed] (FLINK-27558) Introduce a new optional option for TableStoreFactory to represent planned manifest entries
[ https://issues.apache.org/jira/browse/FLINK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jingsong Lee closed FLINK-27558.
--------------------------------
Resolution: Fixed
master: a3270a64b06606b6407866e88ae4ea5092cff7df
> Introduce a new optional option for TableStoreFactory to represent planned manifest entries
> -------------------------------------------------------------------------------------------
>
> Key: FLINK-27558
> URL: https://issues.apache.org/jira/browse/FLINK-27558
> Project: Flink
> Issue Type: Sub-task
> Components: Table Store
> Affects Versions: table-store-0.2.0
> Reporter: Jane Chan
> Assignee: Jane Chan
> Priority: Major
> Labels: pull-request-available
> Fix For: table-store-0.2.0
>
>
> WhenÂ
> {code:java}
> TableStoreFactory.onCompactTable
> {code}
> gets called, the planned manifest entries need to be injected back into the enriched options, and we need a new key to represent it.
> The explained plan should be like
> {code}
> == Abstract Syntax Tree ==
> LogicalSink(table=[default_catalog.default_database.T0], fields=[f0, f1, f2], hints=[[[OPTIONS options:{num-sorted-run.compaction-trigger=2, path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/, compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
> +- LogicalTableScan(table=[[default_catalog, default_database, T0]], hints=[[[OPTIONS inheritPath:[] options:{num-sorted-run.compaction-trigger=2, path=file:/var/folders/xd/9dp1y4vd3h56kjkvdk426l500000gn/T/junit6150615541165154705/junit667583448612916332/, compaction.scanned-manifest={"snapshotId":4,"manifestEntries":{"__DEFAULT__":{"bucket-0":[{"fileName":"data-05f48089-3b58-4a29-8274-9105bfdce224-0","minKey":["f0=6","f1=Jane Eyre","f2=9.9"],"maxKey":["f0=6","f1=Jane Eyre","f2=9.9"]},{"fileName":"data-980d06b9-50c6-4540-ae01-d5c1ff688c4d-0","minKey":["f0=5","f1=Northanger Abby","f2=8.6"],"maxKey":["f0=5","f1=Northanger Abby","f2=8.6"]},{"fileName":"data-beadf34e-9918-4abd-a271-1dcd9733dfb7-0","minKey":["f0=3","f1=The Mansfield Park","f2=7.0"],"maxKey":["f0=4","f1=Sense and Sensibility","f2=9.0"]},{"fileName":"data-5e772406-6b80-4b2f-b6cc-20bf79a11369-0","minKey":["f0=1","f1=Pride and Prejudice","f2=9.0"],"maxKey":["f0=2","f1=Emma","f2=8.5"]}]}}}}]]])
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)