You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "feng-kui (via GitHub)" <gi...@apache.org> on 2023/03/01 02:53:55 UTC

[GitHub] [incubator-seatunnel] feng-kui opened a new issue, #4242: [Bug] [connector-doris] 包含%的数据导入报错

feng-kui opened a new issue, #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   varchar类型字段的值中，包含%，stream load导入报错（但老版本2.1.3没有问题），如下：
   ```
   {"timestamp":"2023-03-01T02:44:08.106+00:00","status":500,"error":"Internal Server Error","path":"/api/example_db/table20/_stream_load"}
   ```
   
   ### SeaTunnel Version
   
   2.3.0
   
   ### SeaTunnel Config
   
   ```conf
   source {
     Hive {
       table_name = "dw.test"
       metastore_uri = "thrift://x.x.x.x:9083"
       result_table_name = "tmp_table"
     }
   
   }
   
   transform {
   
     sql {
       sql = "select '1' id,'a%' name from tmp_table"
     }
   }
   
   sink {
     Doris {
       nodeUrls=["header-01:8031"]
       database="test"
       table="test"
       username="root"
       password="123"
       batch_max_rows=1000
       max_retries=0
       labelPrefix="fix_test_"
       sink.properties.format="JSON"
       sink.properties.strip_outer_array = "true"
   }
   }
   ```
   ```
   
   
   ### Running Command
   
   ```shell
   start-seatunnel-spark-connector-v2.sh -m yarn -e client -c test.conf
   ```
   
   
   ### Error Exception
   
   ```log
   {"timestamp":"2023-03-01T02:44:08.106+00:00","status":500,"error":"Internal Server Error","path":"/api/example_db/test/_stream_load"}
   ```
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] feng-kui commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "feng-kui (via GitHub)" <gi...@apache.org>.
feng-kui commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1479200751

   > doris是哪个版本的？
   
   doris是1.2.1版本


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] kingbabingge commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "kingbabingge (via GitHub)" <gi...@apache.org>.
kingbabingge commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1453038399

   我也是遇到类似的报错
   {"timestamp":"2023-03-01T02:44:08.106+00:00","status":500,"error":"Internal Server Error","path":"/api/example_db/table20/_stream_load"}
   
   请问你是怎么定位出是里面含有%导致的？怎么看具体报错信息？


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] feng-kui commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "feng-kui (via GitHub)" <gi...@apache.org>.
feng-kui commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1457459531

   > 我也是遇到类似的报错 {"timestamp":"2023-03-01T02:44:08.106+00:00","status":500,"error":"Internal Server Error","path":"/api/example_db/table20/_stream_load"}
   > 
   > 请问你是怎么定位出是里面含有%导致的？怎么看具体报错信息？
   
   一批数据一批数据的试，最后定位到报错数据，对字段的值看着可疑的，同步试验出来的


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [seatunnel] kingbabingge commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "kingbabingge (via GitHub)" <gi...@apache.org>.
kingbabingge commented on issue #4242:
URL: https://github.com/apache/seatunnel/issues/4242#issuecomment-1573099136

   @CalvinKirs @zy-kkk @TyrantLucifer 这个问题我们发现是因为 spring mvc 对 application/x-www-form-urlencoded 类型解码造成的。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] 666fishsun commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "666fishsun (via GitHub)" <gi...@apache.org>.
666fishsun commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1536460192

   @feng-kui hi, is it still not solved? Is that still not work with the latest version of seatunnel?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [seatunnel] Hisoka-X closed issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "Hisoka-X (via GitHub)" <gi...@apache.org>.
Hisoka-X closed issue #4242: [Bug] [connector-doris] 包含%的数据导入报错
URL: https://github.com/apache/seatunnel/issues/4242


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "CalvinKirs (via GitHub)" <gi...@apache.org>.
CalvinKirs commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1471708788

   https://github.com/apache/doris/issues/17267


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1522577236

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "Hisoka-X (via GitHub)" <gi...@apache.org>.
Hisoka-X commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1454731734

   @CalvinKirs Hi, clavin. any help info for this? Is SeaTunnel problem or Doris problem?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [seatunnel] kingbabingge commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "kingbabingge (via GitHub)" <gi...@apache.org>.
kingbabingge commented on issue #4242:
URL: https://github.com/apache/seatunnel/issues/4242#issuecomment-1573187765

   ![image](https://github.com/apache/seatunnel/assets/25143332/2f5d707e-2c64-4289-845f-b1d4336842dc)
   @feng-kui seatunel 2.1.3版本没问题是因为，指定的content-type不是`application/x-www-form-urlencoded` 所以没问题。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] TyrantLucifer commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "TyrantLucifer (via GitHub)" <gi...@apache.org>.
TyrantLucifer commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1467673014

   @CalvinKirs @zy-kkk PTAL


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "CalvinKirs (via GitHub)" <gi...@apache.org>.
CalvinKirs commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1471708007

   Which version is doris?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] feng-kui commented on issue #4242: [Bug] [connector-doris] 包含%的数据导入报错

Posted by "feng-kui (via GitHub)" <gi...@apache.org>.
feng-kui commented on issue #4242:
URL: https://github.com/apache/incubator-seatunnel/issues/4242#issuecomment-1479202674

   > [阿帕奇/多丽丝#17267](https://github.com/apache/doris/issues/17267)
   
   这个也是我提的，seatunnel版本2.1.3没有这个问题（写入的doris集群为同一个）


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org