You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/03/04 10:19:45 UTC
[GitHub] [incubator-doris] zhangxinjian123 opened a new issue #5460: SPARK LOAD ERROR
zhangxinjian123 opened a new issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460
CREATE EXTERNAL RESOURCE "sparktest"
PROPERTIES
(
"type" = "spark",
"spark.master" = "yarn",
"spark.submit.deployMode" = "cluster",
"spark.executor.memory" = "1g",
"spark.yarn.queue" = "root.users.hdfs",
"spark.hadoop.yarn.resourcemanager.address" = "xxx.xx.xx.xx:8032",
"spark.hadoop.fs.defaultFS" = "hdfs://xxx.xx.xx.xx:8020",
"working_dir" = "hdfs://xxx.xx.xx.xx:8020/tmp",
"broker" = "broker_name",
"broker.username" = "user123",
"broker.password" = "pass123"
);
GRANT USAGE_PRIV ON RESOURCE "sparktest" TO "user123"@"%";
GRANT USAGE_PRIV ON RESOURCE "sparktest" TO ROLE "roletest";
GRANT USAGE_PRIV ON RESOURCE * TO "user123"@"%";
GRANT USAGE_PRIV ON RESOURCE * TO ROLE "roletest";
LOAD LABEL testhive.tablespark
(
DATA INFILE("hdfs://xxx.xx.xx.xx:8020/tmp/table2.txt")
INTO TABLE tablespark
COLUMNS TERMINATED BY ","
(tmp_c1,tmp_c2,tmp_c3)
SET
(
id=tmp_c2,
name=tmp_c1,
username=tmp_c3
)
)
WITH RESOURCE 'sparktest'
(
"spark.executor.memory" = "5g",
"spark.shuffle.compress" = "true"
)
PROPERTIES
(
"timeout" = "3600"
);
ERROR 1064 (HY000): Unexpected exception: null
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangboya1 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangboya1 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790512777
which version do you use
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] AndyChang521 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
AndyChang521 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-854518669
请问你的问题解决了吗？我也遇到类似问题了，方便加个QQ吗？咨询交流点spark load doris问题，thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangboya1 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangboya1 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790579558
It's fe null pointer exception, 0.14 has fixed it
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangboya1 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangboya1 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-791129843
https://github.com/apache/incubator-doris/tags
https://github.com/apache/incubator-doris/archive/0.14.0-rc01.tar.gz
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangxinjian123 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangxinjian123 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790561772
version : 0.13.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangxinjian123 removed a comment on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangxinjian123 removed a comment on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790599556
I am only find 0.13.Can you tell me where the 0.14 link is？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangxinjian123 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangxinjian123 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790601077
I am only find 0.13.Can you tell me where the 0.14 link is？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] zhangxinjian123 commented on issue #5460: SPARK LOAD ERROR
Posted by GitBox <gi...@apache.org>.
zhangxinjian123 commented on issue #5460:
URL: https://github.com/apache/incubator-doris/issues/5460#issuecomment-790599556
I am only find 0.13.Can you tell me where the 0.14 link is？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org