[jira] [Commented] (FLINK-30445) Add Flink Web3 Connector

["Junyao Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-30445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648853#comment-17648853 ] 

Junyao Huang commented on FLINK-30445:
--------------------------------------

Hi, [~martijnvisser] , would I have access to create new FLIP myself? https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals

> Add Flink Web3 Connector
> ------------------------
>
>                 Key: FLINK-30445
>                 URL: https://issues.apache.org/jira/browse/FLINK-30445
>             Project: Flink
>          Issue Type: New Feature
>            Reporter: Junyao Huang
>            Priority: Major
>
> Web3 is very hot. But you could search GitHub open source blockchain explorer, the most stars project is blockscout, [https://github.com/blockscout/blockscout|https://github.com/blockscout/blockscout,] which use Elixir as a parallel engine to sync block from blockchain node into a file(CSV format). I think Flink is the best solution of ingestion. Reason:
> (1)blockchain needs to match different chain, including Ethereum, Bitcoin, Solana, etc. through JSON RPC.
> (2)Like EtherScan, the blockchain needs to fetch the latest block into storage for the index to search.
> (3)Also as a supplement to (2), we need a connector to fully sync all block from Blockchain Node. I think Flink Stream/Batch alignment feature is suit for this scenarios.
> (4)According to FLIP-27, we could use block number as SourceSplit to read. It is very natural.
> (5)Flink Community could use web3 topic to get PR effects on web3 cycle.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)