[GitHub] [iceberg] JingsongLi opened a new issue #1275: Flink: Implement Flink InputFormat and integrate it to FlinkCatalog

[GitBox <gi...@apache.org>]

JingsongLi opened a new issue #1275:
URL: https://github.com/apache/iceberg/issues/1275


   The final user case can be:
   ```
   -- In Flink SQL client
   
   CREATE CATALOG iceberg WITH('type'='iceberg', 'catalog-type'='hadoop', 'warehouse'='file:/tmp/warehouse_path');
   USE CATALOG iceberg;
   
   -- Create a "default.my_table" Iceberg Hadoop table in "/tmp/warehouse_path".
   -- CREATE TABLE my_table (a INT, b STRING, c STRING) PARTITIONED BY(c) WITH('type'='iceberg'); -- Not supported now.
   -- INSERT INTO my_table VALUES (1, '1', '1'), (1, '2', '2'); -- Not supported now.
   
   -- Support:
   SELECT * FROM my_table; -- SELECT
   SELECT a, c FROM my_table; -- projection push down
   SELECT * FROM my_table WHERE c='2'; -- filter push down
   SELECT * FROM my_table LIMIT 1; -- limit push down
   ```
   
   The implementations can be:
   - Implement `FlinkInputFormat`: implement `SplitGenerator` and `RowDataReader`.
   - Integrate it to Catalog: Implement `FlinkTableFactory` and `FlinkTableSource`.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org