[GitHub] [incubator-doris] francisoliverlee commented on issue #2440: FS Broker connect to HDFS is failure

[GitBox <gi...@apache.org>]

francisoliverlee commented on issue #2440:
URL: https://github.com/apache/incubator-doris/issues/2440#issuecomment-783816724


   me too. more detail here:
   ### des
   doris version: 0.12.21
   ```
   type:LOAD_RUN_FAIL; msg:errCode = 2, detailMessage = Open broker reader failed, broker:TNetworkAddress(hostname=x.x.xx.x, port=8000) failed:could not open file hdfs://x.x.xx.x:9000/bigdata_dw/vk_dw/vk_dw_evt_pack_order_detail_doris_da/pt=20210221/000034_0, cause by: Failed on local exception: java.io.IOException: Server asks us to fall back to SIMPLE auth, but this client is configured to only allow secure connections.; Host Details : local host is: "x.x.x.xx/x.x.x.x"; destination host is: "x.x.xx.x":8020;	
   ```
   
   ### Reproduce
   - 1. 使用kerberos模式访问hdfs(broker load, 或者select into outfile)
     ```sql
   	SELECT
       *
   FROM
       vk_dm.vk_dwd_9m_kpi_new_da INTO OUTFILE "hdfs://1.1.1.1:8020/user/xxx/" FORMAT AS CSV PROPERTIES (
           "broker.name" = "hdfs_broker",
           "broker.hadoop.security.authentication" = "kerberos",
           "broker.kerberos_principal" = "doris@YOUR.COM",
           "broker.kerberos_keytab" = "/home/doris/my.keytab",
           "column_separator" = ",",
           "line_delimiter" = "\n",
           "max_file_size" = "100MB"
    );
   	```
   - 2. 再使用simple访问hdfs
     ```
   LOAD LABEL vk_dm.vk_dwd_9m_kpi_new_da_load_02_22_13
   (
       DATA INFILE ("hdfs://xxxxxx:8020/tmp/liwei5/2021_02_22_01/*")
       INTO TABLE vk_dwd_9m_kpi_new_da
       COLUMNS TERMINATED BY ","
       (Col0,Col1)
       SET
       (
           target=Col0,
           kpi_date=Col1
       )
   )
   WITH BROKER "hdfs_broker"
   (
   	"username" = "xxx",
   	"password" = "xxx"
   )
   PROPERTIES
   (
       "timeout" = "3600"
   );
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org