You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "rangez (via GitHub)" <gi...@apache.org> on 2024/03/20 02:29:45 UTC
[I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
rangez opened a new issue, #32504:
URL: https://github.com/apache/doris/issues/32504
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
doriswriter-0.0.1-SNAPSHOT.jar
### What's Wrong?
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 2024-02-19 18:55:14.914 [job-0] INFO StandAloneJobContainerCommunicator - Total 8564079 records, 1256821128 bytes | Speed 11.33MB/s, 80572 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 1.280s | All Task WaitReaderTime 1,160.040s | Percentage 4.88%
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 2024-02-19 18:55:14.914 [job-0] ERROR JobContainer - 运行scheduler 模式[standalone]出错.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 2024-02-19 18:55:14.916 [job-0] ERROR JobContainer - Exception when job run
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:143) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_242]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 2 common frames omitted
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 common frames omitted
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) ~[na:na]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 common frames omitted
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 2024-02-19 18:55:14.916 [job-0] INFO StandAloneJobContainerCommunicator - Total 8853807 records, 1298751089 bytes | Speed 1.21GB/s, 8853807 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 1.300s | All Task WaitReaderTime 1,197.407s | Percentage 4.88%
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 2024-02-19 18:55:14.917 [job-0] ERROR Engine -
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] 经DataX智能分析,该任务最可能的错误原因是:
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:143)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 2 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:14 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Exception in thread "taskGroup-0" com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] - java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:143)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.lang.RuntimeException: Writing records to Doris failed.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.writeRecord(DorisWriterManager.java:71)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.startWrite(DorisWriter.java:140)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 2 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 1 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 3 more
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Exception in thread "taskGroup-1" com.alibaba.datax.common.exception.DataXException: Code:[Framework-02], Description:[DataX引擎运行过程出错，具体原因请参看DataX运行结束时的错误诊断信息 .]. - java.lang.InterruptedException: sleep interrupted
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.sleep(Native Method)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.TaskGroupContainer.start(TaskGroupContainer.java:268)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.TaskGroupContainerRunner.run(TaskGroupContainerRunner.java:24)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] - java.lang.InterruptedException: sleep interrupted
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.sleep(Native Method)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.TaskGroupContainer.start(TaskGroupContainer.java:268)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.TaskGroupContainerRunner.run(TaskGroupContainerRunner.java:24)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53]
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.TaskGroupContainer.start(TaskGroupContainer.java:284)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.runner.TaskGroupContainerRunner.run(TaskGroupContainerRunner.java:24)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.run(Thread.java:748)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] Caused by: java.lang.InterruptedException: sleep interrupted
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at java.lang.Thread.sleep(Native Method)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] at com.alibaba.datax.core.taskgroup.TaskGroupContainer.start(TaskGroupContainer.java:268)
2024-02-19 18:55:15 [AnalysisStatistics.analysisStatisticsLog-53] ... 4 more
2024-02-19 18:55:15 [JobThread.run-165] <br>----------- datax-web job execute end(finish) -----------<br>----------- ReturnT:ReturnT [code=500, msg=command exit value(1) is failed, content=null]
### What You Expected?
对于特殊字符提供处理方案
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "MaskedMenhxy (via GitHub)" <gi...@apache.org>.
MaskedMenhxy commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2502679737
@rangez 请问下你怎么解决的呢，目前我也有这个问题。暂时换成了mysqlwriter。目前看来，这个问题需要doris侧来解决才行。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "Belep (via GitHub)" <gi...@apache.org>.
Belep commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2058336066
apache doris 源码里面拓展写的 doriswrite看着已经改了
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "rangez (via GitHub)" <gi...@apache.org>.
rangez commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2017446077
@sirius19
- Doris版本：
`doris-2.1.0与doris-1.2.6都无法写入`
- doris的建表sql：
`
CREATE TABLE table_0 (
column_1 int(11) NULL,
column_2 varchar(32) NULL
) ENGINE=OLAP
DUPLICATE KEY(column_1)
COMMENT '表'
DISTRIBUTED BY HASH(column_1) BUCKETS 2
PROPERTIES (
"replication_allocation" = "tag.location.default: 3",
"in_memory" = "false",
"storage_format" = "V2",
"disable_auto_compaction" = "false"
);
`
- 直接在doris中执行insert语句不会报错，采用jdbc方式写入也不会报错。
- 原因已经找到了，doriswriter 使用的是http方式导入，而http方式导入过程中，%是一个特殊字符，doriswriter组件写数据时未进行过转义操作。
- 如：在浏览器搜索栏输入%，地址栏会将%转义成%25
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "sirius19 (via GitHub)" <gi...@apache.org>.
sirius19 commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2017093942
doris是什么版本的
doris的建表sql是什么
直接在doris中执行insert语句会报错吗
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "rangez (via GitHub)" <gi...@apache.org>.
rangez commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2008579049
尝试过了，一样的报错
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "rangez (via GitHub)" <gi...@apache.org>.
rangez commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2008602877
- 我的表以及数据：
`CREATE TABLE `table_0` (
`column_1` int NULL DEFAULT NULL,
`column_2` varchar(32) CHARACTER SET utf8mb4 COLLATE utf8mb4_0900_ai_ci NULL DEFAULT NULL
) ENGINE = InnoDB CHARACTER SET = utf8mb4 COLLATE = utf8mb4_0900_ai_ci ROW_FORMAT = Dynamic;
-- ----------------------------
-- Records of table_0
-- ----------------------------
INSERT INTO `table_0` VALUES (1, '刘禹福20%');
INSERT INTO `table_0` VALUES (2, '王许前80%');
`
- 我的mysql2doris.json文件：
`{
"core": {
"transport": {
"channel": {
"speed": {
"byte": 1048576
}
}
}
},
"job": {
"setting": {
"speed": {
"channel": 4,
"byte": 1048576
},
"errorLimit": {
"record": 0,
"percentage": 0.02
}
},
"content": [
{
"reader": {
"name": "mysqlreader",
"parameter": {
"username": "test",
"password": "**********",
"column": [
"column_1",
"column_2"
],
"where": "1=1",
"splitPk": "",
"connection": [
{
"table": [
"test.table_0"
],
"jdbcUrl": [
"jdbc:mysql://172.16.xx.xx:3306/test?useSSL=false"
]
}
]
}
},
"writer": {
"name": "doriswriter",
"parameter": {
"username": "test",
"password": "**********",
"column": [
"column_1",
"column_2"
],
"loadUrl": [
"172.16.xx.xx:8030"
],
"loadProps": {
"format": "json"
},
"connection": [
{
"jdbcUrl": "jdbc:mysql://172.16.xx.xx:9030/testx?useSSL=false",
"selectedDatabase": "testx",
"table": [
"table_0"
]
}
]
}
}
}
]
}
}`
- 运行之后报错的日志：
`
DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
2024-03-20 10:56:47.501 [main] INFO MessageSource - JVM TimeZone: GMT+08:00, Locale: zh_CN
2024-03-20 10:56:47.504 [main] INFO MessageSource - use Locale: zh_CN timeZone: sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]
2024-03-20 10:56:47.515 [main] INFO VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2024-03-20 10:56:47.520 [main] INFO Engine - the machine info =>
osInfo: Huawei Technologies Co., Ltd 1.8 25.242-b08
jvmInfo: Linux amd64 4.19.90-23.8.v2101.ky10.x86_64
cpu num: 32
totalPhysicalMemory: -0.00G
freePhysicalMemory: -0.00G
maxFileDescriptorCount: -1
currentOpenFileDescriptorCount: -1
GC Names [PS MarkSweep, PS Scavenge]
MEMORY_NAME | allocation_size | init_size
PS Eden Space | 256.00MB | 256.00MB
Code Cache | 240.00MB | 2.44MB
Compressed Class Space | 1,024.00MB | 0.00MB
PS Survivor Space | 42.50MB | 42.50MB
PS Old Gen | 683.00MB | 683.00MB
Metaspace | -0.00MB | 0.00MB
2024-03-20 10:56:47.537 [main] INFO Engine -
{
"content":[
{
"reader":{
"name":"mysqlreader",
"parameter":{
"column":[
"column_1",
"column_2"
],
"connection":[
{
"jdbcUrl":[
"jdbc:mysql://172.16.xx.xx:3306/test?useSSL=false"
],
"table":[
"test.table_0"
]
}
],
"password":"**********",
"splitPk":"",
"username":"test",
"where":"1=1"
}
},
"writer":{
"name":"doriswriter",
"parameter":{
"column":[
"column_1",
"column_2"
],
"connection":[
{
"jdbcUrl":"jdbc:mysql://172.16.xx.xx:9030/test?useSSL=false",
"selectedDatabase":"test",
"table":[
"table_0"
]
}
],
"loadProps":{
"format":"json"
},
"loadUrl":[
"172.16.xx.xx:8030"
],
"password":"****",
"username":"test"
}
}
}
],
"setting":{
"errorLimit":{
"percentage":0.02,
"record":0
},
"speed":{
"byte":33554432,
"channel":32
}
}
}
2024-03-20 10:56:47.551 [main] WARN Engine - prioriy set to 0, because NumberFormatException, the value is: null
2024-03-20 10:56:47.553 [main] INFO PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2024-03-20 10:56:47.553 [main] INFO JobContainer - DataX jobContainer starts job.
2024-03-20 10:56:47.554 [main] INFO JobContainer - Set jobId = 0
2024-03-20 10:56:47.844 [job-0] INFO OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://172.16.xx.xx:3306/test?useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2024-03-20 10:56:47.857 [job-0] INFO OriginalConfPretreatmentUtil - table:[test.table_0] has columns:[column_1,column_2].
2024-03-20 10:56:47.891 [job-0] INFO JobContainer - jobContainer starts to do prepare ...
2024-03-20 10:56:47.892 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
2024-03-20 10:56:47.892 [job-0] INFO JobContainer - DataX Writer.Job [doriswriter] do prepare work .
2024-03-20 10:56:47.893 [job-0] INFO JobContainer - jobContainer starts to do split ...
2024-03-20 10:56:47.894 [job-0] INFO JobContainer - Job set Max-Byte-Speed to 33554432 bytes.
2024-03-20 10:56:47.896 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] splits to [1] tasks.
2024-03-20 10:56:47.897 [job-0] INFO JobContainer - DataX Writer.Job [doriswriter] splits to [1] tasks.
2024-03-20 10:56:47.912 [job-0] INFO JobContainer - jobContainer starts to do schedule ...
2024-03-20 10:56:47.915 [job-0] INFO JobContainer - Scheduler starts [1] taskGroups.
2024-03-20 10:56:47.917 [job-0] INFO JobContainer - Running by standalone Mode.
2024-03-20 10:56:47.921 [taskGroup-0] INFO TaskGroupContainer - taskGroupId=[0] start [1] channels for [1] tasks.
2024-03-20 10:56:47.925 [taskGroup-0] INFO Channel - Channel set byte_speed_limit to 1048576.
2024-03-20 10:56:47.925 [taskGroup-0] INFO Channel - Channel set record_speed_limit to -1, No tps activated.
2024-03-20 10:56:47.939 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started
2024-03-20 10:56:47.943 [0-0-0-reader] INFO CommonRdbmsReader$Task - Begin to read record by Sql: [select column_1,column_2 from test.table_0 where (1=1)
] jdbcUrl:[jdbc:mysql://172.16.xx.xx:3306/test?useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2024-03-20 10:56:47.959 [0-0-0-reader] INFO CommonRdbmsReader$Task - Finished read record by Sql: [select column_1,column_2 from test.table_0 where (1=1)
] jdbcUrl:[jdbc:mysql://172.16.xx.xx:3306/test?useSSL=false&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2024-03-20 10:56:47.978 [Thread-1] INFO DorisStreamLoadObserver - Start to join batch data: rows[2] bytes[84] label[datax_doris_writer_0078661c-78d0-40e7-81ce-3f956580158f].
2024-03-20 10:56:47.978 [Thread-1] INFO DorisStreamLoadObserver - Executing stream load to: 'http://172.16.xx.xx:8030/api/test/table_0/_stream_load', size: '87'
2024-03-20 10:56:48.187 [Thread-1] WARN DorisStreamLoadObserver - Request failed with code:500
2024-03-20 10:56:48.188 [Thread-1] INFO DorisStreamLoadObserver - StreamLoad response :null
2024-03-20 10:56:48.191 [Thread-1] WARN DorisWriterManager - Failed to flush batch data to Doris, retry times = 0
java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
2024-03-20 10:56:49.194 [Thread-1] INFO DorisStreamLoadObserver - Start to join batch data: rows[2] bytes[84] label[datax_doris_writer_0078661c-78d0-40e7-81ce-3f956580158f].
2024-03-20 10:56:49.194 [Thread-1] INFO DorisStreamLoadObserver - Executing stream load to: 'http://172.16.xx.xx:8030/api/test/table_0/_stream_load', size: '87'
2024-03-20 10:56:49.204 [Thread-1] WARN DorisStreamLoadObserver - Request failed with code:500
2024-03-20 10:56:49.204 [Thread-1] INFO DorisStreamLoadObserver - StreamLoad response :null
2024-03-20 10:56:49.204 [Thread-1] WARN DorisWriterManager - Failed to flush batch data to Doris, retry times = 1
java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
2024-03-20 10:56:51.207 [Thread-1] INFO DorisStreamLoadObserver - Start to join batch data: rows[2] bytes[84] label[datax_doris_writer_0078661c-78d0-40e7-81ce-3f956580158f].
2024-03-20 10:56:51.207 [Thread-1] INFO DorisStreamLoadObserver - Executing stream load to: 'http://172.16.xx.xx:8030/api/test/table_0/_stream_load', size: '87'
2024-03-20 10:56:51.217 [Thread-1] WARN DorisStreamLoadObserver - Request failed with code:500
2024-03-20 10:56:51.218 [Thread-1] INFO DorisStreamLoadObserver - StreamLoad response :null
2024-03-20 10:56:51.218 [Thread-1] WARN DorisWriterManager - Failed to flush batch data to Doris, retry times = 2
java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
2024-03-20 10:56:54.221 [Thread-1] INFO DorisStreamLoadObserver - Start to join batch data: rows[2] bytes[84] label[datax_doris_writer_0078661c-78d0-40e7-81ce-3f956580158f].
2024-03-20 10:56:54.221 [Thread-1] INFO DorisStreamLoadObserver - Executing stream load to: 'http://172.16.xx.xx:8030/api/test/table_0/_stream_load', size: '87'
2024-03-20 10:56:54.232 [Thread-1] WARN DorisStreamLoadObserver - Request failed with code:500
2024-03-20 10:56:54.232 [Thread-1] INFO DorisStreamLoadObserver - StreamLoad response :null
2024-03-20 10:56:54.233 [Thread-1] WARN DorisWriterManager - Failed to flush batch data to Doris, retry times = 3
java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) [doriswriter-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
2024-03-20 10:56:54.234 [0-0-0-writer] ERROR WriterRunner - Writer Runner Received Exceptions:
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
- java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:152) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
... 2 common frames omitted
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
... 3 common frames omitted
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
... 1 common frames omitted
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) ~[doriswriter-0.0.1-SNAPSHOT.jar:na]
... 3 common frames omitted
Exception in thread "taskGroup-0" com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
- java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:152)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
... 2 more
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
2024-03-20 10:56:57.931 [job-0] INFO StandAloneJobContainerCommunicator - Total 2 records, 14 bytes | Speed 1B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00%
2024-03-20 10:56:57.932 [job-0] ERROR JobContainer - 运行scheduler 模式[standalone]出错.
2024-03-20 10:56:57.932 [job-0] ERROR JobContainer - Exception when job run
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
- java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:152) ~[na:na]
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_242]
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150) ~[na:na]
... 2 common frames omitted
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111) ~[na:na]
... 3 common frames omitted
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134) ~[na:na]
... 1 common frames omitted
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66) ~[na:na]
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163) ~[na:na]
... 3 common frames omitted
2024-03-20 10:56:57.933 [job-0] INFO StandAloneJobContainerCommunicator - Total 2 records, 14 bytes | Speed 14B/s, 2 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00%
2024-03-20 10:56:57.934 [job-0] ERROR Engine -
经DataX智能分析,该任务最可能的错误原因是:
com.alibaba.datax.common.exception.DataXException: Code:[DBUtilErrorCode-05], Description:[往您配置的写入表中写入数据时失败.]. - java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
- java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:152)
at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:65)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:113)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Task.post(DorisWriter.java:150)
... 2 more
Caused by: java.lang.RuntimeException: Writing records to Doris failed.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.checkFlushException(DorisWriterManager.java:189)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.waitAsyncFlushingDone(DorisWriterManager.java:150)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.flush(DorisWriterManager.java:98)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.close(DorisWriterManager.java:111)
... 3 more
Caused by: java.io.IOException: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:170)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.access$000(DorisWriterManager.java:19)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager$1.run(DorisWriterManager.java:134)
... 1 more
Caused by: java.io.IOException: Unable to flush data to Doris: unknown result status.
at com.alibaba.datax.plugin.writer.doriswriter.DorisStreamLoadObserver.streamLoad(DorisStreamLoadObserver.java:66)
at com.alibaba.datax.plugin.writer.doriswriter.DorisWriterManager.asyncFlush(DorisWriterManager.java:163)
... 3 more
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "Belep (via GitHub)" <gi...@apache.org>.
Belep commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2058289928
这样的数据后来怎么导入的呢？改doriswrite插件？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "zhbdesign (via GitHub)" <gi...@apache.org>.
zhbdesign commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-2008577769
"loadProps": {"format": "json"}试试呢
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #32504:
URL: https://github.com/apache/doris/issues/32504#issuecomment-3459143093
We're closing this issue because it hasn't been updated in a while.
If you'd like to revive this issue, please reopen it and feel free a maintainer to remove the Stale tag!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作 [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #32504: [Bug] 使用doriswriter插件时，当数据中含有%字符时，无法迁移，且无法进行http%25转义操作
URL: https://github.com/apache/doris/issues/32504
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org