You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/09/19 11:34:17 UTC

[GitHub] [doris] liujinhui1994 opened a new issue, #12745: [Bug] HDFS Broker NPT

liujinhui1994 opened a new issue, #12745:
URL: https://github.com/apache/doris/issues/12745

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   mastert
   
   ### What's Wrong?
   
   2022-09-19 19:30:40,230 WARN (mysql-nio-pool-0|208) [StmtExecutor.execute():528] execute Exception. stmt[7, bd4fd32877f14807-b5b31274476b499b], errCode = 2, detailMessage = Unknown table 'PROFILING'
   2022-09-19 19:30:48,223 WARN (pending-load-task-scheduler-pool-0|209) [LoadTask.exec():73] LOAD_JOB=17006, error_msg={Unexpected failed to execute load task}
   java.lang.NullPointerException: null
   	at org.apache.doris.load.Load.initColumns(Load.java:988) ~[classes/:?]
   	at org.apache.doris.load.Load.initColumns(Load.java:813) ~[classes/:?]
   	at org.apache.doris.planner.BrokerScanNode.initColumns(BrokerScanNode.java:286) ~[classes/:?]
   	at org.apache.doris.planner.BrokerScanNode.initParams(BrokerScanNode.java:248) ~[classes/:?]
   	at org.apache.doris.planner.BrokerScanNode.init(BrokerScanNode.java:189) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadingTaskPlanner.plan(LoadingTaskPlanner.java:158) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadLoadingTask.init(LoadLoadingTask.java:109) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.createLoadingTask(BrokerLoadJob.java:207) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.onPendingTaskFinished(BrokerLoadJob.java:164) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.onTaskFinished(BrokerLoadJob.java:123) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadTask.exec(LoadTask.java:65) ~[classes/:?]
   	at org.apache.doris.task.MasterTask.run(MasterTask.java:31) ~[classes/:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run(FutureTask.java) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_231]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_231]
   2022-09-19 19:30:48,278 WARN (pending-load-task-scheduler-pool-1|216) [LoadTask.exec():69] LOAD_JOB=17006, error_msg={Failed to execute load task}
   org.apache.doris.common.LabelAlreadyUsedException: errCode = 2, detailMessage = Label [test011101] has already been used, relate to txn [5006]
   	at org.apache.doris.transaction.DatabaseTransactionMgr.beginTransaction(DatabaseTransactionMgr.java:322) ~[classes/:?]
   	at org.apache.doris.transaction.GlobalTransactionMgr.beginTransaction(GlobalTransactionMgr.java:145) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.beginTxn(BrokerLoadJob.java:98) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadPendingTask.executeTask(BrokerLoadPendingTask.java:61) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadTask.exec(LoadTask.java:63) ~[classes/:?]
   	at org.apache.doris.task.MasterTask.run(MasterTask.java:31) ~[classes/:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run(FutureTask.java) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_231]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_231]
   2022-09-19 19:30:48,325 WARN (pending-load-task-scheduler-pool-2|218) [LoadTask.exec():69] LOAD_JOB=17006, error_msg={Failed to execute load task}
   org.apache.doris.common.LabelAlreadyUsedException: errCode = 2, detailMessage = Label [test011101] has already been used, relate to txn [5006]
   	at org.apache.doris.transaction.DatabaseTransactionMgr.beginTransaction(DatabaseTransactionMgr.java:322) ~[classes/:?]
   	at org.apache.doris.transaction.GlobalTransactionMgr.beginTransaction(GlobalTransactionMgr.java:145) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.beginTxn(BrokerLoadJob.java:98) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadPendingTask.executeTask(BrokerLoadPendingTask.java:61) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadTask.exec(LoadTask.java:63) ~[classes/:?]
   	at org.apache.doris.task.MasterTask.run(MasterTask.java:31) ~[classes/:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run(FutureTask.java) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_231]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_231]
   2022-09-19 19:30:48,372 WARN (pending-load-task-scheduler-pool-3|220) [LoadTask.exec():69] LOAD_JOB=17006, error_msg={Failed to execute load task}
   org.apache.doris.common.LabelAlreadyUsedException: errCode = 2, detailMessage = Label [test011101] has already been used, relate to txn [5006]
   	at org.apache.doris.transaction.DatabaseTransactionMgr.beginTransaction(DatabaseTransactionMgr.java:322) ~[classes/:?]
   	at org.apache.doris.transaction.GlobalTransactionMgr.beginTransaction(GlobalTransactionMgr.java:145) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadJob.beginTxn(BrokerLoadJob.java:98) ~[classes/:?]
   	at org.apache.doris.load.loadv2.BrokerLoadPendingTask.executeTask(BrokerLoadPendingTask.java:61) ~[classes/:?]
   	at org.apache.doris.load.loadv2.LoadTask.exec(LoadTask.java:63) ~[classes/:?]
   	at org.apache.doris.task.MasterTask.run(MasterTask.java:31) ~[classes/:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) ~[?:1.8.0_231]
   	at java.util.concurrent.FutureTask.run(FutureTask.java) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_231]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_231]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_231]
   
   ### What You Expected?
   
   LOAD LABEL test011101
   (
       DATA INFILE("hdfs://xxxxxx/doris_test/ds=20220829/*")
       INTO TABLE personas_topic_static_hive_bitmap
       FORMAT AS "parquet"
   	  (label_code, label_value, mobile)  
   	  COLUMNS FROM PATH AS (`ds`)
      SET 
      (label_code=label_code, label_value=label_value, ds = str_to_date(`ds`,'%Y%m%d'), mobile = to_bitmap(mobile) )
   )
   with HDFS (
   						
         "hadoop.username"="liujh",
   		
   			"fs.defaultFS"="hdfs://xxxx"
   			
           )
   PROPERTIES
   (
       "timeout"="14400",
       "max_filter_ratio"="0"
   );
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] liujinhui1994 commented on issue #12745: [Bug] HDFS Broker NPT

Posted by GitBox <gi...@apache.org>.
liujinhui1994 commented on issue #12745:
URL: https://github.com/apache/doris/issues/12745#issuecomment-1251939019

   The master branch has been fixed. close this issues


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] liujinhui1994 commented on issue #12745: [Bug] HDFS Broker NPT

Posted by GitBox <gi...@apache.org>.
liujinhui1994 commented on issue #12745:
URL: https://github.com/apache/doris/issues/12745#issuecomment-1251080457

   I have resolved this, and will submit an issue PR tomorrow.
   
   
   
   
   
   ------------------ Original ------------------
   From: dataalive ***@***.***&gt;
   Date: Mon,Sep 19,2022 10:10 PM
   To: apache/doris ***@***.***&gt;
   Cc: liujinhui ***@***.***&gt;, Author ***@***.***&gt;
   Subject: Re: [apache/doris] [Bug]  HDFS Broker NPT (Issue #12745)
   
   
   
   
   
     
   error_msg={Failed to execute load task} org.apache.doris.common.LabelAlreadyUsedException: errCode = 2, detailMessage = Label [test011101] has already been used
     
   the actual reason is label reused?
    
   —
   Reply to this email directly, view it on GitHub, or unsubscribe.
   You are receiving this because you authored the thread.Message ID: ***@***.***&gt;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] dataalive commented on issue #12745: [Bug] HDFS Broker NPT

Posted by GitBox <gi...@apache.org>.
dataalive commented on issue #12745:
URL: https://github.com/apache/doris/issues/12745#issuecomment-1251076531

   > error_msg={Failed to execute load task} org.apache.doris.common.LabelAlreadyUsedException: errCode = 2, detailMessage = Label [test011101] has already been used
   
   the actual reason is label reused?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [doris] liujinhui1994 closed issue #12745: [Bug] HDFS Broker NPT

Posted by GitBox <gi...@apache.org>.
liujinhui1994 closed issue #12745: [Bug]  HDFS Broker NPT
URL: https://github.com/apache/doris/issues/12745


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org