You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/08/31 16:36:48 UTC

[GitHub] [incubator-doris] xy720 opened a new issue #4490: [Spark load][Bug] Spark load's column terminator is not consistent with Broker load

xy720 opened a new issue #4490:
URL: https://github.com/apache/incubator-doris/issues/4490


   **Describe the bug**
   For Broker load:
   
   ```
   load label test_db.label13 
   ( 
       DATA INFILE("hdfs://my-hdfs-host:54310/user/doris/table4") 
       into table test_tbl
       COLUMNS TERMINATED BY "|" 
       (k1,k2,name,clicks)
    ) 
   WITH BROKER "doris" 
   (
       "username" = "test", 
       "password" = "test"
   );
   ```
   
   For spark load:
   
   ```
   load label test_db.label13 
   ( 
       DATA INFILE ("hdfs://my-hdfs-host:54310/user/doris/table4") 
       into table test 
       COLUMNS TERMINATED BY "|" 
       (k1,k2,name,clicks ) 
   ) 
   WITH RESOURCE "spark0";
   ```
   
   They have the same table schema态same upstream data source. The former(broker load) run successfully, but the latter(spark load) report an error "quality not good enough to cancel". And if you change the column terminator of spark load to "\\|", then it will run successfully.
   
   **Expected behavior**
   We should keep the column terminator's format of spark load consistent with that of broker load.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org

[GitHub] [incubator-doris] morningman closed issue #4490: [Spark load][Bug] Spark load's column terminator is not consistent with Broker load

Posted by GitBox <gi...@apache.org>.
morningman closed issue #4490:
URL: https://github.com/apache/incubator-doris/issues/4490


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org