You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "MonsterChenzhuo (via GitHub)" <gi...@apache.org> on 2023/04/04 11:58:01 UTC
[GitHub] [incubator-seatunnel] MonsterChenzhuo commented on pull request #4164: [Feature][ConnectorV2]add file excel sink and source
MonsterChenzhuo commented on PR #4164:
URL: https://github.com/apache/incubator-seatunnel/pull/4164#issuecomment-1495847548
ftp、Sftp test
<img width="1021" alt="图片" src="https://user-images.githubusercontent.com/60029759/229781929-0ba5818f-2349-4abe-b8be-692ccd06dcfa.png">
<img width="1154" alt="图片" src="https://user-images.githubusercontent.com/60029759/229784458-1dd1ab66-8a92-44c9-bd7c-78702d417095.png">
2023-04-04 19:56:34,442 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1) (8b5f4516a0f742f909722f9b2391f00a) switched from DEPLOYING to INITIALIZING.
2023-04-04 19:56:34,535 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - output rowType: c_map<Map<STRING, STRING>>, c_array<ARRAY<INT>>, c_string<STRING>, c_boolean<BOOLEAN>, c_tinyint<TINYINT>, c_smallint<SMALLINT>, c_int<INT>, c_bigint<BIGINT>, c_float<FLOAT>, c_double<DOUBLE>, c_bytes<BYTES>, c_date<DATE>, c_decimal<Decimal(38, 18)>, c_timestamp<TIMESTAMP>, c_row<ROW<c_map Map<STRING, STRING>,c_array ARRAY<INT>,c_string STRING,c_boolean BOOLEAN,c_tinyint TINYINT,c_smallint SMALLINT,c_int INT,c_bigint BIGINT,c_float FLOAT,c_double DOUBLE,c_bytes BYTES,c_date DATE,c_decimal Decimal(38, 18),c_timestamp TIMESTAMP>>
2023-04-04 19:56:34,548 INFO org.apache.seatunnel.translation.flink.source.BaseSeaTunnelSourceFunction - Consumer subtask 0 has no restore state.
2023-04-04 19:56:34,556 INFO org.apache.seatunnel.connectors.seatunnel.file.source.split.FileSourceSplitEnumerator - SubTask 0 is assigned to [file:/Users/zhuoyuchen/Desktop/e2e.xlsx]
2023-04-04 19:56:34,558 INFO org.apache.flink.runtime.taskmanager.Task - Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1)#0 (8b5f4516a0f742f909722f9b2391f00a) switched from INITIALIZING to RUNNING.
2023-04-04 19:56:34,559 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1) (8b5f4516a0f742f909722f9b2391f00a) switched from INITIALIZING to RUNNING.
2023-04-04 19:56:35,302 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=1: SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : {"OQBqH":"wTKAH","rkvlO":"KXStv","pCMEX":"CyJKx","DAgdj":"SMbQe","dsJag":"jyFsb"}, [2095115245, 220036717, 1427565674, 454707262, 1254213323], rDAya, true, 25, 22478, 1333226130, 2121369863495191552, 3.2607235E38, 9.981217840075622E307, [91, 55, 55, 44, 32, 49, 49, 54, 44, 32, 56, 57, 44, 32, 49, 49, 56, 44, 32, 49, 49, 57, 93], 2023-06-13, 6.174646127906821E+19, 2023-05-17T00:36:12, [{"gfBji":"emeXF","BCStD":"cUZwy","XyMkz":"CWBGW","nTHbQ":"Oaaos","IwjTs":"zyGjf"}, [1939637044, 1066960875, 2141621606, 1638720300, 1269572120], YjilG, false, 11, 26418, 1110174340, 4728476106429842432, 2.0147008E38, 8.338846635117556E307, [85, 120, 116, 114, 82], 2023-12-18, 7.627320560637959E+19, 2023-03-04T07:08:58]
2023-04-04 19:56:35,309 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=2: SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : {"CsNWf":"zPqJw","TpNjQ":"PRJVp","vrnjO":"DPLgU","CiqBl":"buNOk","zwxrj":"amWQB"}, [1907780289, 603006068, 1499103511, 1664361282, 1954659141], tlGZx, false, 57, 12377, 2018512972, 4289484500905522176, 1.6261603E37, 3.212515417004616E307, [91, 54, 57, 44, 32, 54, 56, 44, 32, 56, 52, 44, 32, 49, 49, 53, 44, 32, 56, 53, 93], 2023-04-09, 9.910022191838642E+19, 2023-04-26T13:34:37, [{"nQKso":"SieuO","EWTvX":"tiNDg","BNQQk":"gTHin","WJRGR":"aEvAo","UaBqo":"uYQKS"}, [1532331195, 1937694896, 1076700740, 1918982238, 1848188893], pMXdt, true, 29, 26801, 1176668170, 6979831097367872512, 3.1210152E38, 1.2397703959747439E308, [105, 71, 115, 110, 66], 2023-12-06, 9.145198807616533E+19, 2023-06-25T14:48:32]
2023-04-04 19:56:35,320 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=3: SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : {"BcQrZ":"NeqLL","UjbSy":"zOQTN","GXPZh":"fbhIe","weICe":"TgbNo","Ceexe":"SLocM"}, [568165232, 148140995, 1424723363, 143852139, 1739017648], OJAhJ, false, 49, 10355, 753397823, 8716948125956533248, 6.9086283E37, 1.4531838439908356E308, [91, 54, 54, 44, 32, 49, 49, 50, 44, 32, 49, 49, 51, 44, 32, 49, 48, 50, 44, 32, 56, 53, 93], 2023-04-23, 3.5313325785835196E+19, 2023-07-25T00:49:42, [{"NHAod":"bEHsL","kFhyq":"jGVeW","NNbGi":"fiaxs","lUXii":"wsAXk","vpZUY":"RwBrv"}, [1166108684, 33568523, 1631516316, 1056141081, 383999373], DKzXf, false, 55, 11647, 491155597, 4631245454348803072, 2.3000027E38, 4.994745800575068E307, [116, 79, 97, 122, 106], 2023-10-24, 1.33589056880950554E+18, 2023-04-13T12:07:20]
2023-04-04 19:56:35,330 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=4: SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : {"gQcKG":"wuZrm","XqhQR":"EUSBe","znPMm":"cBsFV","IFUis":"TqoeT","UNNUM":"QflNg"}, [884099422, 575096287, 1474286603, 460734375, 331544071], XbsPD, true, 83, 23047, 197040251, 1214385768298543104, 2.7490064E38, 4.85325598318931E307, [91, 55, 51, 44, 32, 49, 50, 48, 44, 32, 49, 49, 57, 44, 32, 56, 50, 44, 32, 55, 55, 93], 2023-10-18, 4.371249109784438E+19, 2023-08-20T20:30:20, [{"ZwGBS":"qFbmG","yLoFX":"yaFBz","adCij":"iqota","YhIKB":"nljjK","vFtfq":"sztOi"}, [1603101335, 306333008, 558717179, 1685313180, 1123190321], QTUED, false, 122, 28275, 784631344, 2666059071953321984, 2.1216978E38, 2.16231799113261E307, [118, 69, 71, 66, 73], 2023-08-14, 3.2126522713088406E+19, 2023-09-05T05:09:43]
2023-04-04 19:56:35,337 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=5: SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : {"GvYvC":"GwQeI","lcbKQ":"hxMBm","IAZcR":"oLGcX","nSKXZ":"mwReC","lhKXf":"fUSym"}, [1032612363, 853726186, 1552190828, 1279372680, 1338787938], LnIBa, true, 40, 20216, 169628980, 1300092495241966592, 1.5487907E38, 1.7080796439354392E306, [91, 57, 55, 44, 32, 49, 49, 57, 44, 32, 55, 51, 44, 32, 49, 49, 55, 44, 32, 56, 56, 93], 2023-01-02, 3.906035407715534E+19, 2023-11-23T12:40:16, [{"TAViV":"vgCTK","iZXas":"RtBlu","OLnHX":"BSGYj","srkpH":"pGNkJ","PIhFt":"OqSDa"}, [400240622, 159949170, 1012001551, 13013702, 1794182386], vzVkD, true, 70, 12001, 1664931122, 9193584532670996480, 1.5386908E38, 9.915098876262986E305, [77, 71, 66, 87, 102], 2023-03-01, 8.006372520258236E+19, 2023-11-15T12:17:11]
2023-04-04 19:56:35,342 INFO org.apache.seatunnel.connectors.seatunnel.file.source.BaseFileSourceReader - Closed the bounded File source
2023-04-04 19:56:35,360 INFO org.apache.flink.runtime.taskmanager.Task - Source: SeaTunnel LocalFileSource -> Sink Writer: Console (1/1)#0 (8b5f4516a0f742f909722f9b2391f00a) switched from RUNNING to FINISHED.
<img width="1268" alt="图片" src="https://user-images.githubusercontent.com/60029759/229781890-941afaf6-aca5-4b5c-b024-dc09c8021d6b.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org